Commit History
set zero3 optimizer betas to auto so they inherit from HF trainer config (#507)
1e07c16
unverified
add eval benchmark callback (#441)
7657632
unverified
customizable ascii art (#506)
548787d
unverified
support for datasets with multiple names (#480)
5ac3392
unverified
remove --force-reinstall from Dockerfile to ensure correct pytorch version (#492)
e356b29
unverified
Fix(doc): Clarify no amp to full yaml docs (#496)
48c5647
unverified
tweak: use default config file when only one file is present (#501)
36b2e1c
unverified
Maxime
commited on
Refactor train cfg cli (#499)
125cccb
unverified
use math.ceil instead of round /cc #498
fd55bc8
pad_to_worst_case_seq_len boolean, for testing memory limits (#498)
8e197f6
unverified
simplify linear layer locator
267b7b2
fsdp requires params be the same type too (#493)
98bf76e
unverified
Fix(tokenizer): Make sure to add pad for CodeLlamaTokenizer (#489)
4c37bd0
unverified
Merge pull request #485 from maximegmd/patch-4
f144e98
unverified
fix condition and add logging
3a011ea
Merge branch 'main' into patch-4
1f613e5
rename var and reformat
f319b0b
Update src/axolotl/utils/models.py
7fd662d
unverified
Update src/axolotl/utils/models.py
9e69968
unverified
Feat(cfg): Add code-llama configs for all sizes (#479)
3513071
unverified
Feat(deepspeed): Add zero2 config (#476)
3fc9006
unverified
Feat(doc): Update eval_steps doc (#487)
ad8be43
unverified
Add example Llama 2 ReLoRA config (#471)
fe4d6ba
unverified
Merge pull request #486 from OpenAccess-AI-Collective/adam-bnb-simpler
f313010
unverified
let transformers handle adamw_bnb_8bit
868530c
ignore: address pr review
d03887f
unverified
Maxime
commited on
fix: inference did not move the model to the correct device (#483)
17605b8
unverified
Maxime
commited on
ignore: linter
a184549
unverified
Maxime
commited on
fix: finetune model inference needs the dtype fix to work with flash-attn
f311df9
unverified
Maxime
commited on
Fix missing 'packaging' wheel (#482)
c500d02
unverified
Maxime
commited on