File size: 1,699 Bytes
679ee06 a09da73 d24aefa a09da73 146727e 4666f59 146727e 4666f59 146727e 4666f59 d24aefa 71e7af3 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 |
---
license: apache-2.0
library_name: transformers
language:
- en
tags:
- mistral
- merge
- zephyr
- openchat
---
<div align="center">
<img src="https://huggingface.co/Fredithefish/OpenZephyrChat/resolve/main/logo.jpeg" alt="Alt Text" width="250"/>
<h1>🔥 OpenZephyrChat - Merging Zephyr-beta with OpenChat-3.5 🔥</h1>
This Model is a ties merge between Zephyr-beta and OpenChat-3.5, it was done by using the <a>https://github.com/cg123/mergekit</a> repository
</div>
# Model Information
- **License:** Apache-2 (commercially usable)
- **Parameter size:** 7B
- **Merge:**
- [OpenChat](https://huggingface.co/openchat/openchat_3.5) with ```--weight 0.6 --density 0.5```
- [Zephyr](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) with ```--weight 0.3 --density 0.5```
- [Mistral](https://huggingface.co/mistralai/Mistral-7B-v0.1) serving as the base model
## Evals
<table>
<tr>
<td>BENCHMARK</td>
<td>SCORE</td>
</tr>
<tr>
<td>ARC</td>
<td>64.85</td>
</tr>
<tr>
<td>HellaSwag</td>
<td>85.08</td>
</tr>
<tr>
<td>MMLU</td>
<td>64.92</td>
</tr>
<tr>
<td>TruthfulQA</td>
<td>48.24</td>
</tr>
<tr>
<td>Winogrande</td>
<td>81.06</td>
</tr>
<tr>
<td>GSM8K</td>
<td>64.59</td>
</tr>
</table>
<a href="https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard">Source</a>
<style>
table {
width: 50%;
border-collapse: collapse;
margin: 20px;
}
th, td {
border: 1px solid black;
padding: 10px;
text-align: left;
}
th {
background-color: #f2f2f2;
}
</style>
|