Commit
•
4da1dd4
1
Parent(s):
fa3b339
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,10 +1,13 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
|
|
|
|
|
|
| 4 |
wandb: https://wandb.ai/open-assistant/supervised-finetuning/runs/770a0t41 (exported at 4000 steps)
|
| 5 |
|
| 6 |
-
data
|
| 7 |
|
|
|
|
| 8 |
```
|
| 9 |
reference-data:
|
| 10 |
datasets:
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
+
fine-tuned with OA data on top of `andreaskoepf/pythia-12b-pre-2000`
|
| 5 |
+
|
| 6 |
wandb: https://wandb.ai/open-assistant/supervised-finetuning/runs/770a0t41 (exported at 4000 steps)
|
| 7 |
|
| 8 |
+
command: `/home/ubuntu/Open-Assistant/model/model_training/trainer_sft.py --local_rank=0 --configs defaults reference-data reference-pythia-12b --cache_dir /home/ubuntu/data_cache --output_dir .saved/oasst-sft-3-pythia-12b-reference_2kpre --num_train_epochs 8 --residual_dropout 0.2 --deepspeed --use_flash_attention true --model_name andreaskoepf/pythia-12b-pre-2000`
|
| 9 |
|
| 10 |
+
data:
|
| 11 |
```
|
| 12 |
reference-data:
|
| 13 |
datasets:
|