Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

qwerrwe / tests

100 contributors

History: 107 commits

winglian's picture

Pretrain transforms (#1261)

c7cf381 unverified 8 months ago

core
add gptneox embeddings, fix phi2 inputs, also fix the casting (#1083) 8 months ago
e2e
relora: magnitude pruning of the optimizer (#1245) 8 months ago
fixtures
Respect sequence_len in config for `type: llama2_chat` (#926) 9 months ago
monkeypatch
support for true batches with multipack (#1230) 8 months ago
prompt_strategies
Feat/chatml add system message (#1117) 8 months ago
utils
Add shifted sparse attention (#973) [skip-ci] 8 months ago
test_data.py

2.23 kB

Fix pretraining with iterable/streaming Dataset (#556) about 1 year ago
test_dict.py

3.17 kB

fix DefaultDict.__or__ about 1 year ago
test_expand_mask.py

1.43 kB

Attention mask and position id fixes for packing (#285) about 1 year ago
test_normalize_config.py

3 kB

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci] 8 months ago
test_packed_batch_sampler.py

3.32 kB

support for true batches with multipack (#1230) 8 months ago
test_packed_dataset.py

2.28 kB

Attention mask and position id fixes for packing (#285) about 1 year ago
test_packed_pretraining.py

2.7 kB

Pretrain transforms (#1261) 8 months ago
test_prompt_tokenizers.py

16.3 kB

fix mistral prompt assembly (#982) 9 months ago
test_prompters.py

4.39 kB

Attention mask and position id fixes for packing (#285) about 1 year ago
test_tokenizers.py

2.51 kB

Support for additional_special_tokens (#1221) [skip ci] 8 months ago
test_validation.py

22.8 kB

Peft lotfq (#1222) 8 months ago