README.md

metadata

license: cc-by-nc-4.0
datasets:
  - nayohan/math-gpt-4o-200k-ko
language:
  - ko
  - en
base_model: meta-llama/Meta-Llama-3.1-8B-Instruct

A Creative Commons NonCommercial license (CC NC, CC BY-NC or NC license) is a Creative Commons license which a copyright holder can apply to their media to give public permission for anyone to reuse that media only for noncommercial activities. Creative Commons is an organization which develops a variety of public copyright licenses, and the "noncommercial" licenses are a subset of these. Unlike the CC0, CC BY, and CC BY-SA licenses, the CC BY-NC license is considered non-free.

unsloth를 사용하여 meta-llama/Meta-Llama-3.1-8B-Instruct 모델에 LORA 파인튜닝을 완료했습니다.

v01과의 차이점은 per_device_train_batch_size, gradient_accumulation_steps 파라미터의 값을 변경해 학습했습니다.

Contact : cgh@tnap.co.kr