metadata
library_name: transformers
license: apache-2.0
pipeline_tag: text-generation
T3Q-ko-solar-dpo-v6.0
This model is a version of T3Q-ko-solar-dpo-v5.0 that has been fine-tuned with DPO.
Model Developers Chihoon Lee(chihoonlee10), T3Q
hf (pretrained=chihoonlee10/T3Q-ko-solar-dpo-v6.0), limit: None, provide_description: False, num_fewshot: 0, batch_size: None
| Task | Version | Metric | Value | Stderr | |
|---|---|---|---|---|---|
| kobest_boolq | 0 | acc | 0.5028 | ± | 0.0133 |
| macro_f1 | 0.3396 | ± | 0.0067 | ||
| kobest_copa | 0 | acc | 0.8020 | ± | 0.0126 |
| macro_f1 | 0.8018 | ± | 0.0126 | ||
| kobest_hellaswag | 0 | acc | 0.5340 | ± | 0.0223 |
| acc_norm | 0.5720 | ± | 0.0221 | ||
| macro_f1 | 0.5322 | ± | 0.0224 | ||
| kobest_sentineg | 0 | acc | 0.7985 | ± | 0.0202 |
| macro_f1 | 0.7956 | ± | 0.0205 |