update datasets version to cut down the warnings due to pyarrow arg change (#897)
Browse files* update datasets to cut down the warnings
* set versions for tokenizers and gradio
* upgrade transformers to latest version
- requirements.txt +4 -3
requirements.txt
CHANGED
|
@@ -2,14 +2,15 @@
|
|
| 2 |
auto-gptq==0.5.1
|
| 3 |
packaging
|
| 4 |
peft==0.6.0
|
| 5 |
-
transformers==4.35.
|
|
|
|
| 6 |
bitsandbytes>=0.41.1
|
| 7 |
accelerate==0.24.1
|
| 8 |
deepspeed
|
| 9 |
addict
|
| 10 |
fire
|
| 11 |
PyYAML>=6.0
|
| 12 |
-
datasets>=2.
|
| 13 |
flash-attn==2.3.3
|
| 14 |
sentencepiece
|
| 15 |
wandb
|
|
@@ -29,7 +30,7 @@ scikit-learn==1.2.2
|
|
| 29 |
pynvml
|
| 30 |
art
|
| 31 |
fschat==0.2.29
|
| 32 |
-
gradio
|
| 33 |
tensorboard
|
| 34 |
|
| 35 |
# remote filesystems
|
|
|
|
| 2 |
auto-gptq==0.5.1
|
| 3 |
packaging
|
| 4 |
peft==0.6.0
|
| 5 |
+
transformers==4.35.2
|
| 6 |
+
tokenizers==0.15.0
|
| 7 |
bitsandbytes>=0.41.1
|
| 8 |
accelerate==0.24.1
|
| 9 |
deepspeed
|
| 10 |
addict
|
| 11 |
fire
|
| 12 |
PyYAML>=6.0
|
| 13 |
+
datasets>=2.15.0
|
| 14 |
flash-attn==2.3.3
|
| 15 |
sentencepiece
|
| 16 |
wandb
|
|
|
|
| 30 |
pynvml
|
| 31 |
art
|
| 32 |
fschat==0.2.29
|
| 33 |
+
gradio==3.50.2
|
| 34 |
tensorboard
|
| 35 |
|
| 36 |
# remote filesystems
|