pabRomero commited on
Commit
ed40d19
1 Parent(s): e992cf4

Training complete

Browse files
Files changed (1) hide show
  1. README.md +11 -9
README.md CHANGED
@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
21
 
22
  This model is a fine-tuned version of [microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext](https://huggingface.co/microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext) on the None dataset.
23
  It achieves the following results on the evaluation set:
24
- - Loss: 0.0780
25
- - Precision: 0.8002
26
- - Recall: 0.7735
27
- - F1: 0.7866
28
- - Accuracy: 0.9772
29
 
30
  ## Model description
31
 
@@ -51,20 +51,22 @@ The following hyperparameters were used during training:
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
  - lr_scheduler_warmup_ratio: 0.1
54
- - num_epochs: 2
55
  - mixed_precision_training: Native AMP
56
 
57
  ### Training results
58
 
59
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
60
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
61
- | No log | 1.0 | 231 | 0.0932 | 0.7529 | 0.7616 | 0.7572 | 0.9734 |
62
- | No log | 2.0 | 462 | 0.0780 | 0.8002 | 0.7735 | 0.7866 | 0.9772 |
 
 
63
 
64
 
65
  ### Framework versions
66
 
67
  - Transformers 4.44.2
68
- - Pytorch 2.4.0+cu121
69
  - Datasets 2.21.0
70
  - Tokenizers 0.19.1
 
21
 
22
  This model is a fine-tuned version of [microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext](https://huggingface.co/microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext) on the None dataset.
23
  It achieves the following results on the evaluation set:
24
+ - Loss: 0.0712
25
+ - Precision: 0.8087
26
+ - Recall: 0.7954
27
+ - F1: 0.8020
28
+ - Accuracy: 0.9781
29
 
30
  ## Model description
31
 
 
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
  - lr_scheduler_warmup_ratio: 0.1
54
+ - num_epochs: 4
55
  - mixed_precision_training: Native AMP
56
 
57
  ### Training results
58
 
59
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
60
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
61
+ | No log | 1.0 | 231 | 0.0934 | 0.7464 | 0.7652 | 0.7557 | 0.9730 |
62
+ | No log | 2.0 | 462 | 0.0730 | 0.7975 | 0.7915 | 0.7945 | 0.9774 |
63
+ | 0.2789 | 3.0 | 693 | 0.0713 | 0.8075 | 0.7924 | 0.7999 | 0.9777 |
64
+ | 0.2789 | 4.0 | 924 | 0.0712 | 0.8087 | 0.7954 | 0.8020 | 0.9781 |
65
 
66
 
67
  ### Framework versions
68
 
69
  - Transformers 4.44.2
70
+ - Pytorch 2.4.1+cu121
71
  - Datasets 2.21.0
72
  - Tokenizers 0.19.1