Hugging Face's logo

dadashzadeh
/
tiny-bert-Sentiment-persian

Text Classification
Transformers
TensorBoard
Safetensors
Persian
bert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
dadashzadeh commited on
Commit
c945286
•
1 Parent(s): ad88e2e

End of training

Browse files
Files changed (5) hide show
  1. README.md +19 -13
  2. model.safetensors +1 -1
  3. runs/Jul11_01-09-50_0acce8ee3931/events.out.tfevents.1720660192.0acce8ee3931.378.12 +3 -0
  4. runs/Jul11_01-09-50_0acce8ee3931/events.out.tfevents.1720661043.0acce8ee3931.378.13 +3 -0
  5. training_args.bin +1 -1
README.md CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [dadashzadeh/tiny-bert-Sentiment-persian](https://huggingface.co/dadashzadeh/tiny-bert-Sentiment-persian) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.6672
21
- - Accuracy: 0.7279
22
 
23
  ## Model description
24
 
@@ -38,23 +38,29 @@ More information needed
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 2e-05
41
- - train_batch_size: 20
42
- - eval_batch_size: 20
43
  - seed: 10
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
- - num_epochs: 6
47
 
48
  ### Training results
49
 
50
- | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
- |:-------------:|:-----:|:----:|:---------------:|:--------:|
52
- | 0.696 | 1.0 | 1431 | 0.6928 | 0.7136 |
53
- | 0.6826 | 2.0 | 2862 | 0.6893 | 0.7153 |
54
- | 0.6737 | 3.0 | 4293 | 0.6620 | 0.7257 |
55
- | 0.6801 | 4.0 | 5724 | 0.6579 | 0.7317 |
56
- | 0.6682 | 5.0 | 7155 | 0.6662 | 0.7270 |
57
- | 0.6756 | 6.0 | 8586 | 0.6672 | 0.7279 |
 
 
 
 
 
 
58
 
59
 
60
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [dadashzadeh/tiny-bert-Sentiment-persian](https://huggingface.co/dadashzadeh/tiny-bert-Sentiment-persian) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.6615
21
+ - Accuracy: 0.7421
22
 
23
  ## Model description
24
 
 
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 2e-05
41
+ - train_batch_size: 10
42
+ - eval_batch_size: 25
43
  - seed: 10
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
+ - num_epochs: 12
47
 
48
  ### Training results
49
 
50
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
+ |:-------------:|:-----:|:-----:|:---------------:|:--------:|
52
+ | 0.6731 | 1.0 | 2861 | 0.6896 | 0.7119 |
53
+ | 0.6829 | 2.0 | 5722 | 0.7134 | 0.7002 |
54
+ | 0.6748 | 3.0 | 8583 | 0.6781 | 0.7287 |
55
+ | 0.6585 | 4.0 | 11444 | 0.6637 | 0.7343 |
56
+ | 0.6477 | 5.0 | 14305 | 0.6524 | 0.7317 |
57
+ | 0.6697 | 6.0 | 17166 | 0.6429 | 0.7421 |
58
+ | 0.6504 | 7.0 | 20027 | 0.6455 | 0.7417 |
59
+ | 0.6296 | 8.0 | 22888 | 0.6559 | 0.7369 |
60
+ | 0.647 | 9.0 | 25749 | 0.6528 | 0.7430 |
61
+ | 0.6453 | 10.0 | 28610 | 0.6600 | 0.7421 |
62
+ | 0.6523 | 11.0 | 31471 | 0.6489 | 0.7490 |
63
+ | 0.6281 | 12.0 | 34332 | 0.6615 | 0.7421 |
64
 
65
 
66
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6b719c5f5b86ed89c4905a111b9a94acde408ac626af3879f1429404cf74c54f
3
  size 17549828
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0eaa94ba97e936aa5541f9ba4e7b7d2dc3a0f2d94f01600b94708280ad77006
3
  size 17549828
runs/Jul11_01-09-50_0acce8ee3931/events.out.tfevents.1720660192.0acce8ee3931.378.12 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c33039970a911b7e94171612c0295f3acae7b29183e5732faf1b8525880376a
3
+ size 23839
runs/Jul11_01-09-50_0acce8ee3931/events.out.tfevents.1720661043.0acce8ee3931.378.13 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ecd1f75077c5702b9de12f693a962b3e7d9236bb0b84efe8eff01e569b15a0da
3
+ size 417
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a90c212a44e2ab507b605b3ed5d0c455488aaf0d884d66018be144eeabc926c8
3
  size 5112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73522c3ba692449eb0e3394c99bed5696e96c2bf414f315a2010123a7a98ab35
3
  size 5112