Hugging Face's logo

csujeong
/
Gemma-7B-Finetuning-JCS-Ko-Ins

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
1
csujeong commited on
Commit
b1615e2
•
1 Parent(s): 65323d7

Training in progress, step 60

Browse files
Files changed (5) hide show
  1. adapter_model.safetensors +1 -1
  2. runs/Feb26_14-06-57_e7cca09e096a/events.out.tfevents.1708956653.e7cca09e096a.365.0 +2 -2
  3. wandb/debug-internal.log +58 -0
  4. wandb/run-20240226_141107-8c2rkhry/files/wandb-summary.json +1 -1
  5. wandb/run-20240226_141107-8c2rkhry/logs/debug-internal.log +58 -0
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b202e861e68e437ed2a26ae859e3f6ebb2af0445e2c574b55f0d1451de488647
3
  size 201888736
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e13a9ed83d36a01f3cfe6fd70c627b68b4b689361a03dc3a6a0ddc42427b0f60
3
  size 201888736
runs/Feb26_14-06-57_e7cca09e096a/events.out.tfevents.1708956653.e7cca09e096a.365.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d6a246bfdb2275e5b09d4600bde20b6c5f3e6822cc9d2138c23125020911336a
3
- size 6201
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74d5fb88924f74089b37f734f116365d42661628a148852bc5a9e087c5e4d8e4
3
+ size 6756
wandb/debug-internal.log CHANGED
@@ -307,3 +307,61 @@
307
  2024-02-26 14:20:11,130 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
308
  2024-02-26 14:20:12,207 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
309
  2024-02-26 14:20:17,209 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
307
  2024-02-26 14:20:11,130 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
308
  2024-02-26 14:20:12,207 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
309
  2024-02-26 14:20:17,209 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
310
+ 2024-02-26 14:20:22,212 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
311
+ 2024-02-26 14:20:26,112 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: keepalive
312
+ 2024-02-26 14:20:26,152 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
313
+ 2024-02-26 14:20:26,152 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
314
+ 2024-02-26 14:20:26,153 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
315
+ 2024-02-26 14:20:27,219 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
316
+ 2024-02-26 14:20:32,219 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
317
+ 2024-02-26 14:20:37,220 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
318
+ 2024-02-26 14:20:40,868 DEBUG SenderThread:3960 [sender.py:send():382] send: stats
319
+ 2024-02-26 14:20:41,112 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: keepalive
320
+ 2024-02-26 14:20:41,152 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
321
+ 2024-02-26 14:20:41,152 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
322
+ 2024-02-26 14:20:41,153 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
323
+ 2024-02-26 14:20:42,299 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
324
+ 2024-02-26 14:20:47,299 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
325
+ 2024-02-26 14:20:52,300 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
326
+ 2024-02-26 14:20:56,112 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: keepalive
327
+ 2024-02-26 14:20:56,153 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
328
+ 2024-02-26 14:20:56,153 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
329
+ 2024-02-26 14:20:56,154 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
330
+ 2024-02-26 14:20:58,277 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
331
+ 2024-02-26 14:21:03,278 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
332
+ 2024-02-26 14:21:08,279 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
333
+ 2024-02-26 14:21:10,869 DEBUG SenderThread:3960 [sender.py:send():382] send: stats
334
+ 2024-02-26 14:21:11,112 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: keepalive
335
+ 2024-02-26 14:21:11,153 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
336
+ 2024-02-26 14:21:11,153 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
337
+ 2024-02-26 14:21:11,154 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
338
+ 2024-02-26 14:21:14,269 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
339
+ 2024-02-26 14:21:19,269 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
340
+ 2024-02-26 14:21:24,270 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
341
+ 2024-02-26 14:21:26,112 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: keepalive
342
+ 2024-02-26 14:21:26,153 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
343
+ 2024-02-26 14:21:26,153 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
344
+ 2024-02-26 14:21:26,154 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
345
+ 2024-02-26 14:21:28,588 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: partial_history
346
+ 2024-02-26 14:21:28,591 DEBUG SenderThread:3960 [sender.py:send():382] send: history
347
+ 2024-02-26 14:21:28,592 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: summary_record
348
+ 2024-02-26 14:21:28,598 INFO SenderThread:3960 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
349
+ 2024-02-26 14:21:29,292 INFO Thread-12 :3960 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Gemma-7B-Finetuning-JCS-Ko-Ins/wandb/run-20240226_141107-8c2rkhry/files/wandb-summary.json
350
+ 2024-02-26 14:21:29,599 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
351
+ 2024-02-26 14:21:34,600 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
352
+ 2024-02-26 14:21:34,743 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: partial_history
353
+ 2024-02-26 14:21:34,745 DEBUG SenderThread:3960 [sender.py:send():382] send: metric
354
+ 2024-02-26 14:21:34,746 DEBUG SenderThread:3960 [sender.py:send():382] send: metric
355
+ 2024-02-26 14:21:34,747 DEBUG SenderThread:3960 [sender.py:send():382] send: metric
356
+ 2024-02-26 14:21:34,747 DEBUG SenderThread:3960 [sender.py:send():382] send: metric
357
+ 2024-02-26 14:21:34,748 DEBUG SenderThread:3960 [sender.py:send():382] send: metric
358
+ 2024-02-26 14:21:34,748 DEBUG SenderThread:3960 [sender.py:send():382] send: history
359
+ 2024-02-26 14:21:34,755 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: summary_record
360
+ 2024-02-26 14:21:34,762 INFO SenderThread:3960 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
361
+ 2024-02-26 14:21:35,308 INFO Thread-12 :3960 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Gemma-7B-Finetuning-JCS-Ko-Ins/wandb/run-20240226_141107-8c2rkhry/files/wandb-summary.json
362
+ 2024-02-26 14:21:39,765 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
363
+ 2024-02-26 14:21:40,870 DEBUG SenderThread:3960 [sender.py:send():382] send: stats
364
+ 2024-02-26 14:21:41,112 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: keepalive
365
+ 2024-02-26 14:21:41,113 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
366
+ 2024-02-26 14:21:41,121 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
367
+ 2024-02-26 14:21:41,122 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
wandb/run-20240226_141107-8c2rkhry/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 2.1754, "train/grad_norm": 2.8607287406921387, "train/learning_rate": 1.4314282383241096e-05, "train/epoch": 0.37, "train/global_step": 50, "_timestamp": 1708957205.8741422, "_runtime": 538.3027002811432, "_step": 4}
 
1
+ {"train/loss": 1.9458, "train/grad_norm": 2.4569854736328125, "train/learning_rate": 0.0, "train/epoch": 0.44, "train/global_step": 60, "_timestamp": 1708957294.7426143, "_runtime": 627.1711723804474, "_step": 6, "train/train_runtime": 640.7805, "train/train_samples_per_second": 0.375, "train/train_steps_per_second": 0.094, "train/total_flos": 1159490380369920.0, "train/train_loss": 2.218592135111491}
wandb/run-20240226_141107-8c2rkhry/logs/debug-internal.log CHANGED
@@ -307,3 +307,61 @@
307
  2024-02-26 14:20:11,130 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
308
  2024-02-26 14:20:12,207 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
309
  2024-02-26 14:20:17,209 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
307
  2024-02-26 14:20:11,130 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
308
  2024-02-26 14:20:12,207 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
309
  2024-02-26 14:20:17,209 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
310
+ 2024-02-26 14:20:22,212 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
311
+ 2024-02-26 14:20:26,112 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: keepalive
312
+ 2024-02-26 14:20:26,152 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
313
+ 2024-02-26 14:20:26,152 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
314
+ 2024-02-26 14:20:26,153 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
315
+ 2024-02-26 14:20:27,219 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
316
+ 2024-02-26 14:20:32,219 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
317
+ 2024-02-26 14:20:37,220 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
318
+ 2024-02-26 14:20:40,868 DEBUG SenderThread:3960 [sender.py:send():382] send: stats
319
+ 2024-02-26 14:20:41,112 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: keepalive
320
+ 2024-02-26 14:20:41,152 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
321
+ 2024-02-26 14:20:41,152 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
322
+ 2024-02-26 14:20:41,153 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
323
+ 2024-02-26 14:20:42,299 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
324
+ 2024-02-26 14:20:47,299 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
325
+ 2024-02-26 14:20:52,300 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
326
+ 2024-02-26 14:20:56,112 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: keepalive
327
+ 2024-02-26 14:20:56,153 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
328
+ 2024-02-26 14:20:56,153 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
329
+ 2024-02-26 14:20:56,154 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
330
+ 2024-02-26 14:20:58,277 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
331
+ 2024-02-26 14:21:03,278 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
332
+ 2024-02-26 14:21:08,279 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
333
+ 2024-02-26 14:21:10,869 DEBUG SenderThread:3960 [sender.py:send():382] send: stats
334
+ 2024-02-26 14:21:11,112 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: keepalive
335
+ 2024-02-26 14:21:11,153 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
336
+ 2024-02-26 14:21:11,153 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
337
+ 2024-02-26 14:21:11,154 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
338
+ 2024-02-26 14:21:14,269 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
339
+ 2024-02-26 14:21:19,269 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
340
+ 2024-02-26 14:21:24,270 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
341
+ 2024-02-26 14:21:26,112 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: keepalive
342
+ 2024-02-26 14:21:26,153 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
343
+ 2024-02-26 14:21:26,153 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
344
+ 2024-02-26 14:21:26,154 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
345
+ 2024-02-26 14:21:28,588 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: partial_history
346
+ 2024-02-26 14:21:28,591 DEBUG SenderThread:3960 [sender.py:send():382] send: history
347
+ 2024-02-26 14:21:28,592 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: summary_record
348
+ 2024-02-26 14:21:28,598 INFO SenderThread:3960 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
349
+ 2024-02-26 14:21:29,292 INFO Thread-12 :3960 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Gemma-7B-Finetuning-JCS-Ko-Ins/wandb/run-20240226_141107-8c2rkhry/files/wandb-summary.json
350
+ 2024-02-26 14:21:29,599 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
351
+ 2024-02-26 14:21:34,600 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
352
+ 2024-02-26 14:21:34,743 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: partial_history
353
+ 2024-02-26 14:21:34,745 DEBUG SenderThread:3960 [sender.py:send():382] send: metric
354
+ 2024-02-26 14:21:34,746 DEBUG SenderThread:3960 [sender.py:send():382] send: metric
355
+ 2024-02-26 14:21:34,747 DEBUG SenderThread:3960 [sender.py:send():382] send: metric
356
+ 2024-02-26 14:21:34,747 DEBUG SenderThread:3960 [sender.py:send():382] send: metric
357
+ 2024-02-26 14:21:34,748 DEBUG SenderThread:3960 [sender.py:send():382] send: metric
358
+ 2024-02-26 14:21:34,748 DEBUG SenderThread:3960 [sender.py:send():382] send: history
359
+ 2024-02-26 14:21:34,755 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: summary_record
360
+ 2024-02-26 14:21:34,762 INFO SenderThread:3960 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
361
+ 2024-02-26 14:21:35,308 INFO Thread-12 :3960 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Gemma-7B-Finetuning-JCS-Ko-Ins/wandb/run-20240226_141107-8c2rkhry/files/wandb-summary.json
362
+ 2024-02-26 14:21:39,765 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
363
+ 2024-02-26 14:21:40,870 DEBUG SenderThread:3960 [sender.py:send():382] send: stats
364
+ 2024-02-26 14:21:41,112 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: keepalive
365
+ 2024-02-26 14:21:41,113 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
366
+ 2024-02-26 14:21:41,121 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
367
+ 2024-02-26 14:21:41,122 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status