qwerrwe / tests /test_validation.py

Commit History

recommend padding when using sample packing (#531)
3437149
unverified

winglian commited on

extract module for working with cfg
8cec513

tmm1 commited on

Attention mask and position id fixes for packing (#285)
2bb0b78
unverified

winglian commited on

params are adam_*, not adamw_*
19cf0bd

winglian commited on

Additional test case per pr
ad5ca4f

winglian commited on

add validation and tests for adamw hyperparam
cb9d3af

winglian commited on

Merge branch 'main' into flash-optimum
fd2c981
unverified

winglian commited on

new validation for mpt w grad checkpoints
14668fa

winglian commited on

add streaming dataset support for pretraining datasets
eea2731

winglian commited on

Validate falcon with fsdp
babf0fd

Nanobit commited on

Update doc for grad_accu and add validation tests for batch size
3c71c8d

Nanobit commited on

black formatting
6fa40bf

winglian commited on

add support for gradient accumulation steps
3aad5f3

winglian commited on

Apply isort then black
37293dc

Nanobit commited on

Ignore unsupported-binary-operation
0dd35c7

Nanobit commited on

Black formatting
b832a0a

Nanobit commited on

Lint validation
1f3c3f5

Nanobit commited on

update for pr feedback
fd5f965

winglian commited on

new hf_use_auth_token setting so login to hf isn't required
1c33eb8

winglian commited on

Feat: Update validate_config and add tests
52dd92a

Nanobit commited on