Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

qwerrwe / tests

100 contributors

History: 94 commits

winglian's picture

Multipack simplify for Mixtral (#1142)

6910e6a unverified 8 months ago

core
add gptneox embeddings, fix phi2 inputs, also fix the casting (#1083) 9 months ago
e2e
Multipack simplify for Mixtral (#1142) 8 months ago
fixtures
Respect sequence_len in config for `type: llama2_chat` (#926) 9 months ago
monkeypatch
Multipack simplify for Mixtral (#1142) 8 months ago
prompt_strategies
fix: `train_on_inputs: true` ignored for sharegpt (#1045) [skip ci] 9 months ago
utils
Add shifted sparse attention (#973) [skip-ci] 8 months ago
test_data.py

2.23 kB

Fix pretraining with iterable/streaming Dataset (#556) about 1 year ago
test_dict.py

3.17 kB

fix DefaultDict.__or__ about 1 year ago
test_expand_mask.py

1.43 kB

Attention mask and position id fixes for packing (#285) about 1 year ago
test_normalize_config.py

2.56 kB

Enable or disable bf16 support based on availability (#1116) 8 months ago
test_packed_dataset.py

2.28 kB

Attention mask and position id fixes for packing (#285) about 1 year ago
test_packed_pretraining.py

2.4 kB

streaming multipack for pretraining dataset (#959) 9 months ago
test_prompt_tokenizers.py

16.3 kB

fix mistral prompt assembly (#982) 9 months ago
test_prompters.py

4.39 kB

Attention mask and position id fixes for packing (#285) about 1 year ago
test_tokenizers.py

1.91 kB

Feat: Warns to add to modules_to_save when adding tokens or switching special_tokens (#787) 9 months ago
test_validation.py
22.9 kB

Add `layers_to_transform` for `lora_config` (#1118) 8 months ago