chihoonlee10's picture
Update README.md
2bdf85b verified
---
library_name: transformers
license: apache-2.0
pipeline_tag: text-generation
---
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f22e4076fedc4fd11e978f/MoTedec_ZL8GM2MmGyAPs.png)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f22e4076fedc4fd11e978f/LJ6jXeMTrPobAzgpfklhI.png)
# T3Q-ko-solar-dpo-v6.0
## This model is a version of T3Q-ko-solar-dpo-v5.0 that has been fine-tuned with DPO.
## Model Developers Chihoon Lee(chihoonlee10), T3Q
hf (pretrained=chihoonlee10/T3Q-ko-solar-dpo-v6.0), limit: None, provide_description: False, num_fewshot: 0, batch_size: None
| Task |Version| Metric |Value | |Stderr|
|----------------|------:|--------|-----:|---|-----:|
|kobest_boolq | 0|acc |0.5028|± |0.0133|
| | |macro_f1|0.3396|± |0.0067|
|kobest_copa | 0|acc |0.8020|± |0.0126|
| | |macro_f1|0.8018|± |0.0126|
|kobest_hellaswag| 0|acc |0.5340|± |0.0223|
| | |acc_norm|0.5720|± |0.0221|
| | |macro_f1|0.5322|± |0.0224|
|kobest_sentineg | 0|acc |0.7985|± |0.0202|
| | |macro_f1|0.7956|± |0.0205|