Kevin Sydney commited on
Commit
384b817
1 Parent(s): db9094d

Set eval_sample_packing to false in mistral config.yaml (#1003)

Browse files

Without eval_sampling_packing set to false, ValueError occurs with eval dataset split is too small for sample_packing.

Files changed (1) hide show
  1. examples/mistral/config.yml +1 -0
examples/mistral/config.yml CHANGED
@@ -17,6 +17,7 @@ output_dir: ./out
17
  sequence_len: 8192
18
  sample_packing: true
19
  pad_to_sequence_len: true
 
20
 
21
  wandb_project:
22
  wandb_entity:
 
17
  sequence_len: 8192
18
  sample_packing: true
19
  pad_to_sequence_len: true
20
+ eval_sample_packing: false
21
 
22
  wandb_project:
23
  wandb_entity: