qwerrwe / tests /test_packed_dataset.py

Commit History

Attention mask and position id fixes for packing (#285)
2bb0b78
unverified

winglian commited on

don't worry about duplicate code here
0136f51

winglian commited on

fix packing so that concatenated sequences reset the attention
9b8585d

winglian commited on