RMSNorm eps value is wrong

#19
by qnixsynapse - opened

The RMSNorm eps value in this model is wrong because of an error on the official HF repository which has been fixed. It's a request to please upload with the correct RMSNorm eps for better output quality.

For more information, please see here: https://github.com/facebookresearch/llama/issues/771

Sign up or log in to comment