Hugging Face's logo

dtorber
/
bertweet-base

Text Classification
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
dtorber commited on
Commit
a35762f
•
1 Parent(s): 9963789

Model save

Browse files
Files changed (2) hide show
  1. README.md +14 -12
  2. runs/Apr05_16-59-56_tardis/events.out.tfevents.1712329489.tardis.3497868.1 +3 -0
README.md CHANGED
@@ -17,14 +17,14 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [vinai/bertweet-base](https://huggingface.co/vinai/bertweet-base) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.4366
21
- - F1 Macro: 0.8302
22
- - F1: 0.8917
23
- - F1 Neg: 0.7686
24
- - Acc: 0.8525
25
- - Prec: 0.8804
26
- - Recall: 0.9033
27
- - Mcc: 0.6610
28
 
29
  ## Model description
30
 
@@ -50,16 +50,18 @@ The following hyperparameters were used during training:
50
  - distributed_type: multi-GPU
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
- - num_epochs: 3
54
  - mixed_precision_training: Native AMP
55
 
56
  ### Training results
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | F1 Macro | F1 | F1 Neg | Acc | Prec | Recall | Mcc |
59
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:------:|:------:|:------:|:------:|:------:|
60
- | 0.6636 | 1.0 | 614 | 0.5643 | 0.6935 | 0.8191 | 0.5678 | 0.745 | 0.75 | 0.9023 | 0.4193 |
61
- | 0.5206 | 2.0 | 1228 | 0.6205 | 0.7341 | 0.7640 | 0.7042 | 0.7375 | 0.8995 | 0.6641 | 0.5116 |
62
- | 0.4363 | 3.0 | 1842 | 0.5409 | 0.7997 | 0.8673 | 0.7321 | 0.8225 | 0.8315 | 0.9062 | 0.6059 |
 
 
63
 
64
 
65
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [vinai/bertweet-base](https://huggingface.co/vinai/bertweet-base) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.5645
21
+ - F1 Macro: 0.8513
22
+ - F1: 0.9041
23
+ - F1 Neg: 0.7984
24
+ - Acc: 0.87
25
+ - Prec: 0.8974
26
+ - Recall: 0.9108
27
+ - Mcc: 0.7027
28
 
29
  ## Model description
30
 
 
50
  - distributed_type: multi-GPU
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
+ - num_epochs: 5
54
  - mixed_precision_training: Native AMP
55
 
56
  ### Training results
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | F1 Macro | F1 | F1 Neg | Acc | Prec | Recall | Mcc |
59
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:------:|:------:|:------:|:------:|:------:|
60
+ | 0.6718 | 1.0 | 614 | 0.6382 | 0.6919 | 0.8136 | 0.5702 | 0.74 | 0.7517 | 0.8867 | 0.4083 |
61
+ | 0.5134 | 2.0 | 1228 | 0.5523 | 0.7460 | 0.7657 | 0.7263 | 0.7475 | 0.9429 | 0.6445 | 0.5564 |
62
+ | 0.4637 | 3.0 | 1842 | 0.5460 | 0.8362 | 0.8837 | 0.7887 | 0.85 | 0.8769 | 0.8906 | 0.6726 |
63
+ | 0.4004 | 4.0 | 2456 | 0.6145 | 0.8160 | 0.8505 | 0.7815 | 0.8225 | 0.9224 | 0.7891 | 0.6471 |
64
+ | 0.3192 | 5.0 | 3070 | 0.5929 | 0.8476 | 0.8911 | 0.8042 | 0.86 | 0.8876 | 0.8945 | 0.6953 |
65
 
66
 
67
  ### Framework versions
runs/Apr05_16-59-56_tardis/events.out.tfevents.1712329489.tardis.3497868.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c167e11175b17e98166bb7c984c6b1fe8034096368c9ec04f06222a0a8b25c7
3
+ size 699