Update README.md

README.md

@@ -29,6 +29,7 @@ SambaLingo-Slovenian-Base is a pretrained Bi-lingual Slovenian and English model
 - **Language(s):** Slovenian, English
 - **Finetuned from model:** [Llama 2](https://huggingface.co/meta-llama/Llama-2-7b-hf)
 - **Try the chat version of this model**: [SambaLingo-chat-space](https://huggingface.co/spaces/sambanovasystems/SambaLingo-chat-space).
+- **Paper:** [SambaLingo: Teaching Large Language Models New Languages](https://arxiv.org/abs/2404.05829)
 - **Blog Post**: [sambalingo-open-source-language-experts](https://sambanova.ai/blog/sambalingo-open-source-language-experts)
 
 ## Getting Started
@@ -54,16 +55,7 @@ All pre-training is done on the [Cultura-X](https://huggingface.co/datasets/uonl
 We extended the vocabulary of the base llama model from 32,000 tokens to 57,000 tokens by adding up to 25,000 non-overlapping tokens from the new language.
 
 ## Evaluation
-We measure the models’ capability on the new languages with a mix of canonical multilingual NLP benchmarks, including evaluation perplexity, translation, question answering, text classification, and natural language understanding.
-|        | SambaLingo-Slovenian-Base     | sl-gpt2 | bloom-7b1 | xglm-7.5B | mGPT-13B |
-|-------------------------------|---------|-----------|-----------|----------|--------|
-| Perplexity (Lower Is Better)  | **1.678**   | -         | 3.261     | 4.201    | 3.428  |
-| FLORES en->sl (8 shot, CHRF)  | **0.508**   | 0.072     | 0.143     | 0.068    | 0.062  |
-| FLORES sl->en (8 shot, CHRF)  | **0.565**   | 0.066     | 0.182     | 0.184    | 0.058  |
-| FLORES en->sl  (8 shot, BLEU) | **0.202**   | 0.000     | 0.004     | 0.152    | 0.000  |
-| FLORES sl->en  (8 shot, BLEU) | **0.273**   | 0.000     | 0.010     | 0.007    | 0.000  |
-| Belebele (3 shot)             | **42.78%**  | 26.11%    | 23.44%    | 23.33%   | 23.89% |
-| SIB-200 (3 shot)              | **56.37%**  | -         | 41.18%    | 50.00%   | 40.69% |
+For evaluation results see our paper: [SambaLingo: Teaching Large Language Models New Languages](https://arxiv.org/abs/2404.05829)
 
 ## Uses
 <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
@@ -105,12 +97,12 @@ We would like to give a special thanks to the following groups:
 
 ## Cite SambaLingo
 ```
-@software{sambalingo,
-  title = {{SambaLingo: Open Source Language Experts}},
-  author = {SambaNova Systems},
-  url = {https://huggingface.co/sambanovasystems/SambaLingo-Slovenian-Base}
-  month = {2},
-  year = {2024},
-  version = {1.0},
+@misc{csaki2024sambalingo,
+      title={SambaLingo: Teaching Large Language Models New Languages}, 
+      author={Zoltan Csaki and Bo Li and Jonathan Li and Qiantong Xu and Pian Pawakapan and Leon Zhang and Yun Du and Hengyu Zhao and Changran Hu and Urmish Thakker},
+      year={2024},
+      eprint={2404.05829},
+      archivePrefix={arXiv},
+      primaryClass={cs.CL}
 }
 ```