OpenZephyrChat / README.md
Fredithefish's picture
Update README.md
4666f59
metadata
license: apache-2.0
library_name: transformers
language:
  - en
tags:
  - mistral
  - merge
  - zephyr
  - openchat
Alt Text

🔥 OpenZephyrChat - Merging Zephyr-beta with OpenChat-3.5 🔥

This Model is a ties merge between Zephyr-beta and OpenChat-3.5, it was done by using the https://github.com/cg123/mergekit repository

Model Information

  • License: Apache-2 (commercially usable)
  • Parameter size: 7B
  • Merge:
    • OpenChat with --weight 0.6 --density 0.5
    • Zephyr with --weight 0.3 --density 0.5
    • Mistral serving as the base model

Evals

BENCHMARK SCORE
ARC 64.85
HellaSwag 85.08
MMLU 64.92
TruthfulQA 48.24
Winogrande 81.06
GSM8K 64.59

Source