qwerrwe / src /axolotl /utils /distributed.py

Commit History

fix distributed devices (#612)
2fe95cd
unverified

Maxime commited on

gather/broadcast the max value of the packing efficiency automatically (#463)
b15b19e
unverified

winglian commited on

Early stopping metric (#537)
e30f1e3
unverified

winglian commited on

No gather single gpu (#523)
09f1543
unverified

winglian commited on

add eval benchmark callback (#441)
7657632
unverified

winglian commited on

use context manager to run things on rank0 before others (#397)
fc2d6be
unverified

winglian commited on

Attention mask and position id fixes for packing (#285)
2bb0b78
unverified

winglian commited on