End of training

README.md

@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [kxx-kkk/FYP_sq2_mrqa_adqa](https://huggingface.co/kxx-kkk/FYP_sq2_mrqa_adqa) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 2.9214
+- Loss: 3.2206
 
 ## Model description
 
@@ -34,25 +34,23 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 2e-05
+- learning_rate: 1e-05
 - train_batch_size: 16
 - eval_batch_size: 16
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 3
+- num_epochs: 2
 - mixed_precision_training: Native AMP
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 2.6837        | 0.48  | 500  | 2.9669          |
-| 2.3939        | 0.95  | 1000 | 2.7932          |
-| 2.3193        | 1.43  | 1500 | 3.0776          |
-| 2.2214        | 1.91  | 2000 | 2.7540          |
-| 2.1982        | 2.39  | 2500 | 3.0105          |
-| 2.1551        | 2.86  | 3000 | 2.9214          |
+| 2.8023        | 0.48  | 500  | 3.4618          |
+| 2.4772        | 0.95  | 1000 | 3.3024          |
+| 2.4056        | 1.43  | 1500 | 3.2717          |
+| 2.3162        | 1.91  | 2000 | 3.2206          |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3f9215d4711eb9002a01d0deac135049228bbde7f5de13e4d1ec9847f123d047
+oid sha256:8025ea5db6278eec9f46707062ef829bc7ef0feaca4bb62ef53cfd2d448a8b76
 size 735356752

runs/Apr05_07-12-38_a3c94d63b396/events.out.tfevents.1712301160.a3c94d63b396.501.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ac47aed8420bf93b9c3c057495d55b97a2d4876b7489da06dc1e107a54db6c3f
-size 6959
+oid sha256:2c9730ea973c6684ade4339b13b88ae6bcd93e4d76c33f53653875a144f77d6d
+size 7313