Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

qwerrwe / tests

100 contributors

History: 98 commits

JohanWork

Feat(test): Add tests for alpaca chatml prompt tokenizer (#1088)

5439707 unverified 8 months ago

core
add gptneox embeddings, fix phi2 inputs, also fix the casting (#1083) 9 months ago
e2e
Falcon embeddings (#1149) [skip docker] 8 months ago
fixtures
Respect sequence_len in config for `type: llama2_chat` (#926) 9 months ago
monkeypatch
Multipack simplify for Mixtral (#1142) 8 months ago
prompt_strategies
Feat(test): Add tests for alpaca chatml prompt tokenizer (#1088) 8 months ago
utils
Add shifted sparse attention (#973) [skip-ci] 8 months ago
test_data.py

2.23 kB

Fix pretraining with iterable/streaming Dataset (#556) about 1 year ago
test_dict.py

3.17 kB

fix DefaultDict.__or__ about 1 year ago
test_expand_mask.py

1.43 kB

Attention mask and position id fixes for packing (#285) about 1 year ago
test_normalize_config.py

3 kB

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci] 8 months ago
test_packed_dataset.py

2.28 kB

Attention mask and position id fixes for packing (#285) about 1 year ago
test_packed_pretraining.py

2.4 kB

streaming multipack for pretraining dataset (#959) 9 months ago
test_prompt_tokenizers.py

16.3 kB

fix mistral prompt assembly (#982) 9 months ago
test_prompters.py

4.39 kB

Attention mask and position id fixes for packing (#285) about 1 year ago
test_tokenizers.py

1.91 kB

Feat: Warns to add to modules_to_save when adding tokens or switching special_tokens (#787) 9 months ago
test_validation.py

22.4 kB

Deprecate max packed sequence len (#1141) 8 months ago