File size: 205 Bytes
0c6f928
3961902
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
# Pythia 12B

- Single-GPU A100 only (?)

```shell
python scripts/finetune.py examples/pythia-12b/config.yml
```

⚠️ Multiple-GPU A100 - Doesn't seem to work with multi-gpu without causing OOM! ⚠️