|
--- |
|
license: apache-2.0 |
|
language: |
|
- en |
|
- zh |
|
base_model: |
|
- meta-llama/Meta-Llama-3.1-8B-Instruct |
|
datasets: |
|
- BAAI/IndustryInstruction_Finance-Economics |
|
- BAAI/IndustryInstruction |
|
--- |
|
|
|
This model is finetuned on the model llama3.1-8b-instruct using the dataset [BAAI/IndustryInstruction_Finance-Economics](https://huggingface.co/datasets/BAAI/IndustryInstruction_Finance-Economics) dataset, the dataset details can jump to the repo: [BAAI/IndustryInstruction](https://huggingface.co/datasets/BAAI/IndustryInstruction) |
|
|
|
## training params |
|
``` |
|
learning_rate=1e-5 |
|
lr_scheduler_type=cosine |
|
max_length=2048 |
|
warmup_ratio=0.05 |
|
batch_size=64 |
|
epoch=10 |
|
``` |
|
|
|
select best ckpt by the evaluation loss |
|
## evaluation |
|
|
|
The following is an evaluation on the FinerBen dataset metrci. Since there are too many samples in the dataset, I randomly selected 500 samples from each dataset for evaluation. |
|
|
|
 |
