Commit
•
cc68dc2
1
Parent(s):
5e3fd48
Adding Evaluation Results (#12)
Browse files- Adding Evaluation Results (b5a12d928dbc7a9d92c086ab1e7aadfd53acbefb)
Co-authored-by: Open LLM Leaderboard PR Bot <leaderboard-pr-bot@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -229,4 +229,17 @@ GGUF Quants: https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B-GGUF
|
|
| 229 |
primaryClass={cs.CL},
|
| 230 |
url={https://arxiv.org/abs/2408.11857},
|
| 231 |
}
|
| 232 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 229 |
primaryClass={cs.CL},
|
| 230 |
url={https://arxiv.org/abs/2408.11857},
|
| 231 |
}
|
| 232 |
+
```
|
| 233 |
+
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
|
| 234 |
+
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_NousResearch__Hermes-3-Llama-3.1-8B)
|
| 235 |
+
|
| 236 |
+
| Metric |Value|
|
| 237 |
+
|-------------------|----:|
|
| 238 |
+
|Avg. |23.49|
|
| 239 |
+
|IFEval (0-Shot) |61.70|
|
| 240 |
+
|BBH (3-Shot) |30.72|
|
| 241 |
+
|MATH Lvl 5 (4-Shot)| 4.76|
|
| 242 |
+
|GPQA (0-shot) | 6.38|
|
| 243 |
+
|MuSR (0-shot) |13.62|
|
| 244 |
+
|MMLU-PRO (5-shot) |23.77|
|
| 245 |
+
|