Hugging Face's logo

thrunlab
/
llama_7b_hf_relu_refined_web_relu_2024-03-27

Text Generation
Transformers
Safetensors
sparse_llama
Generated from Trainer
custom_code
Model card Files Community
lukeleeai commited on
Commit
638e165
•
1 Parent(s): 8736831

End of training

Browse files
Files changed (4) hide show
  1. README.md +10 -2
  2. model-00001-of-00003.safetensors +1 -1
  3. model-00002-of-00003.safetensors +1 -1
  4. model-00003-of-00003.safetensors +1 -1
README.md CHANGED
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 2.6123
18
 
19
  ## Model description
20
 
@@ -44,7 +44,7 @@ The following hyperparameters were used during training:
44
  - total_eval_batch_size: 4
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
  - lr_scheduler_type: linear
47
- - training_steps: 800
48
 
49
  ### Training results
50
 
@@ -82,6 +82,14 @@ The following hyperparameters were used during training:
82
  | 2.6303 | 0.24 | 750 | 2.8400 |
83
  | 2.6914 | 0.25 | 775 | 2.8327 |
84
  | 2.7409 | 0.26 | 800 | 2.8241 |
 
 
 
 
 
 
 
 
85
 
86
 
87
  ### Framework versions
 
14
 
15
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 2.5560
18
 
19
  ## Model description
20
 
 
44
  - total_eval_batch_size: 4
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
  - lr_scheduler_type: linear
47
+ - training_steps: 1000
48
 
49
  ### Training results
50
 
 
82
  | 2.6303 | 0.24 | 750 | 2.8400 |
83
  | 2.6914 | 0.25 | 775 | 2.8327 |
84
  | 2.7409 | 0.26 | 800 | 2.8241 |
85
+ | 2.7072 | 0.26 | 825 | 2.8182 |
86
+ | 2.6851 | 0.27 | 850 | 2.8120 |
87
+ | 2.6687 | 0.28 | 875 | 2.8054 |
88
+ | 2.6158 | 0.29 | 900 | 2.7999 |
89
+ | 2.8079 | 0.3 | 925 | 2.7939 |
90
+ | 2.7443 | 0.3 | 950 | 2.7891 |
91
+ | 2.6934 | 0.31 | 975 | 2.7850 |
92
+ | 2.5733 | 0.32 | 1000 | 2.7790 |
93
 
94
 
95
  ### Framework versions
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:58b5baa4765feb709a9291e9210e9d244d63b1c7e237936c962aa8a94d189197
3
  size 4938985352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e89d68b22f1e4f7998701efccd7e8273ca587a184b4065627aaa1ef15806768e
3
  size 4938985352
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1e0a51fc28afb6576c4342fd64ab30d7e4c19512af3369c0df16a1c59848bc8a
3
  size 4947390880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b580b5bc10e9cf1b42bf171ac77c45741ec31d7b722b6e54b2dab1784574a5c0
3
  size 4947390880
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f3075e0e151d85110f52fd3809a39af8cd831634fdb660b4578a54f569131037
3
  size 3590488816
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3374baeb295913671fb7bc888e45e6244dc83559091c2c017907b55141d9c50
3
  size 3590488816