Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Spaces:
Dovakiins
/
qwerrwe
like
0
Build error
App
Files
Files
Community
2284209
qwerrwe
/
tests
100 contributors
History:
49 commits
Jan Philipp Harries
Fix pretraining with iterable/streaming Dataset (#556)
2f586d1
unverified
about 1 year ago
fixtures
fix test fixture b/c hf trainer tokenization changed (#464)
about 1 year ago
monkeypatch
Attention mask and position id fixes for packing (#285)
about 1 year ago
test_data.py
2.23 kB
Fix pretraining with iterable/streaming Dataset (#556)
about 1 year ago
test_dict.py
3.17 kB
fix DefaultDict.__or__
about 1 year ago
test_expand_mask.py
1.43 kB
Attention mask and position id fixes for packing (#285)
about 1 year ago
test_packed_dataset.py
2.28 kB
Attention mask and position id fixes for packing (#285)
about 1 year ago
test_prompt_tokenizers.py
8.19 kB
Attention mask and position id fixes for packing (#285)
about 1 year ago
test_prompters.py
4.39 kB
Attention mask and position id fixes for packing (#285)
about 1 year ago
test_tokenizers.py
860 Bytes
simplify `load_tokenizer`
about 1 year ago
test_validation.py
9.23 kB
recommend padding when using sample packing (#531)
about 1 year ago