Hugging Face's logo

csujeong
/
Mistral-7B-Finetuning-Insurance

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
csujeong commited on
Commit
1f30149
•
1 Parent(s): 9342b05

Training in progress, step 60

Browse files
Files changed (5) hide show
  1. adapter_model.safetensors +1 -1
  2. runs/Mar22_04-33-33_6b98cdd15d10/events.out.tfevents.1711082034.6b98cdd15d10.209.0 +2 -2
  3. wandb/debug-internal.log +58 -0
  4. wandb/run-20240322_043407-hize5f4p/files/wandb-summary.json +1 -1
  5. wandb/run-20240322_043407-hize5f4p/logs/debug-internal.log +58 -0
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5f47674183b3a4716e1aaff94498aecd975cda1b6f4da9cb134fd13e5489e859
3
  size 184592616
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:889a0152cde2535403e07ca247ccc426478ffd6df68b30975538d9ed0612995a
3
  size 184592616
runs/Mar22_04-33-33_6b98cdd15d10/events.out.tfevents.1711082034.6b98cdd15d10.209.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a40080baacd4ebc36d11dfd225b95b3a4298aedf4584c4adb81b53d8aa954270
3
- size 6266
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36d0cefd0116efa1b31164fbfb5458e53acce83365bd88905a99eb655797ce2d
3
+ size 6821
wandb/debug-internal.log CHANGED
@@ -341,3 +341,61 @@
341
  2024-03-22 04:46:36,978 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
342
  2024-03-22 04:46:41,979 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
343
  2024-03-22 04:46:43,219 DEBUG SenderThread:4275 [sender.py:send():378] send: stats
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
341
  2024-03-22 04:46:36,978 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
342
  2024-03-22 04:46:41,979 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
343
  2024-03-22 04:46:43,219 DEBUG SenderThread:4275 [sender.py:send():378] send: stats
344
+ 2024-03-22 04:46:45,817 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: stop_status
345
+ 2024-03-22 04:46:45,818 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: stop_status
346
+ 2024-03-22 04:46:47,978 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
347
+ 2024-03-22 04:46:52,979 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
348
+ 2024-03-22 04:46:57,980 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
349
+ 2024-03-22 04:47:00,817 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: stop_status
350
+ 2024-03-22 04:47:00,818 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: stop_status
351
+ 2024-03-22 04:47:03,064 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
352
+ 2024-03-22 04:47:08,064 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
353
+ 2024-03-22 04:47:13,065 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
354
+ 2024-03-22 04:47:13,220 DEBUG SenderThread:4275 [sender.py:send():378] send: stats
355
+ 2024-03-22 04:47:15,817 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: stop_status
356
+ 2024-03-22 04:47:15,818 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: stop_status
357
+ 2024-03-22 04:47:19,024 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
358
+ 2024-03-22 04:47:24,025 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
359
+ 2024-03-22 04:47:29,029 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
360
+ 2024-03-22 04:47:30,817 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: stop_status
361
+ 2024-03-22 04:47:30,818 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: stop_status
362
+ 2024-03-22 04:47:34,998 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
363
+ 2024-03-22 04:47:39,998 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
364
+ 2024-03-22 04:47:43,220 DEBUG SenderThread:4275 [sender.py:send():378] send: stats
365
+ 2024-03-22 04:47:45,222 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
366
+ 2024-03-22 04:47:45,817 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: stop_status
367
+ 2024-03-22 04:47:45,818 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: stop_status
368
+ 2024-03-22 04:47:50,999 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
369
+ 2024-03-22 04:47:54,054 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: partial_history
370
+ 2024-03-22 04:47:54,057 DEBUG SenderThread:4275 [sender.py:send():378] send: history
371
+ 2024-03-22 04:47:54,058 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: summary_record
372
+ 2024-03-22 04:47:54,064 INFO SenderThread:4275 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
373
+ 2024-03-22 04:47:54,251 INFO Thread-12 :4275 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Mistral-7B-Finetuning-Insurance/wandb/run-20240322_043407-hize5f4p/files/wandb-summary.json
374
+ 2024-03-22 04:47:56,066 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
375
+ 2024-03-22 04:48:04,801 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
376
+ 2024-03-22 04:48:05,680 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: stop_status
377
+ 2024-03-22 04:48:05,681 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: stop_status
378
+ 2024-03-22 04:48:06,885 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
379
+ 2024-03-22 04:48:11,889 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
380
+ 2024-03-22 04:48:16,895 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
381
+ 2024-03-22 04:48:16,896 DEBUG SenderThread:4275 [sender.py:send():378] send: stats
382
+ 2024-03-22 04:48:20,681 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: stop_status
383
+ 2024-03-22 04:48:20,683 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: stop_status
384
+ 2024-03-22 04:48:20,840 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: partial_history
385
+ 2024-03-22 04:48:20,928 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: summary_record
386
+ 2024-03-22 04:48:20,934 INFO SenderThread:4275 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
387
+ 2024-03-22 04:48:20,935 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: summary_record
388
+ 2024-03-22 04:48:20,941 INFO SenderThread:4275 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
389
+ 2024-03-22 04:48:20,942 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: summary_record
390
+ 2024-03-22 04:48:20,951 INFO SenderThread:4275 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
391
+ 2024-03-22 04:48:20,952 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: summary_record
392
+ 2024-03-22 04:48:20,960 INFO SenderThread:4275 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
393
+ 2024-03-22 04:48:20,962 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: summary_record
394
+ 2024-03-22 04:48:20,969 INFO SenderThread:4275 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
395
+ 2024-03-22 04:48:20,971 DEBUG SenderThread:4275 [sender.py:send():378] send: history
396
+ 2024-03-22 04:48:20,971 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: summary_record
397
+ 2024-03-22 04:48:21,160 INFO SenderThread:4275 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
398
+ 2024-03-22 04:48:21,480 INFO Thread-12 :4275 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Mistral-7B-Finetuning-Insurance/wandb/run-20240322_043407-hize5f4p/files/wandb-summary.json
399
+ 2024-03-22 04:48:22,163 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
400
+ 2024-03-22 04:48:27,164 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
401
+ 2024-03-22 04:48:32,165 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240322_043407-hize5f4p/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 1.5516, "train/grad_norm": 1.9267557859420776, "train/learning_rate": 1.4314282383241096e-05, "train/epoch": 0.37, "train/global_step": 50, "_timestamp": 1711082759.2536302, "_runtime": 711.6881680488586, "_step": 4}
 
1
+ {"train/loss": 1.4437, "train/grad_norm": 1.8876476287841797, "train/learning_rate": 0.0, "train/epoch": 0.44, "train/global_step": 60, "_timestamp": 1711082900.8391073, "_runtime": 853.2736451625824, "_step": 6, "train_runtime": 866.0323, "train_samples_per_second": 0.277, "train_steps_per_second": 0.069, "total_flos": 1585974939893760.0, "train_loss": 1.606863021850586}
wandb/run-20240322_043407-hize5f4p/logs/debug-internal.log CHANGED
@@ -341,3 +341,61 @@
341
  2024-03-22 04:46:36,978 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
342
  2024-03-22 04:46:41,979 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
343
  2024-03-22 04:46:43,219 DEBUG SenderThread:4275 [sender.py:send():378] send: stats
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
341
  2024-03-22 04:46:36,978 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
342
  2024-03-22 04:46:41,979 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
343
  2024-03-22 04:46:43,219 DEBUG SenderThread:4275 [sender.py:send():378] send: stats
344
+ 2024-03-22 04:46:45,817 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: stop_status
345
+ 2024-03-22 04:46:45,818 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: stop_status
346
+ 2024-03-22 04:46:47,978 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
347
+ 2024-03-22 04:46:52,979 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
348
+ 2024-03-22 04:46:57,980 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
349
+ 2024-03-22 04:47:00,817 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: stop_status
350
+ 2024-03-22 04:47:00,818 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: stop_status
351
+ 2024-03-22 04:47:03,064 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
352
+ 2024-03-22 04:47:08,064 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
353
+ 2024-03-22 04:47:13,065 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
354
+ 2024-03-22 04:47:13,220 DEBUG SenderThread:4275 [sender.py:send():378] send: stats
355
+ 2024-03-22 04:47:15,817 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: stop_status
356
+ 2024-03-22 04:47:15,818 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: stop_status
357
+ 2024-03-22 04:47:19,024 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
358
+ 2024-03-22 04:47:24,025 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
359
+ 2024-03-22 04:47:29,029 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
360
+ 2024-03-22 04:47:30,817 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: stop_status
361
+ 2024-03-22 04:47:30,818 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: stop_status
362
+ 2024-03-22 04:47:34,998 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
363
+ 2024-03-22 04:47:39,998 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
364
+ 2024-03-22 04:47:43,220 DEBUG SenderThread:4275 [sender.py:send():378] send: stats
365
+ 2024-03-22 04:47:45,222 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
366
+ 2024-03-22 04:47:45,817 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: stop_status
367
+ 2024-03-22 04:47:45,818 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: stop_status
368
+ 2024-03-22 04:47:50,999 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
369
+ 2024-03-22 04:47:54,054 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: partial_history
370
+ 2024-03-22 04:47:54,057 DEBUG SenderThread:4275 [sender.py:send():378] send: history
371
+ 2024-03-22 04:47:54,058 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: summary_record
372
+ 2024-03-22 04:47:54,064 INFO SenderThread:4275 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
373
+ 2024-03-22 04:47:54,251 INFO Thread-12 :4275 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Mistral-7B-Finetuning-Insurance/wandb/run-20240322_043407-hize5f4p/files/wandb-summary.json
374
+ 2024-03-22 04:47:56,066 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
375
+ 2024-03-22 04:48:04,801 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
376
+ 2024-03-22 04:48:05,680 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: stop_status
377
+ 2024-03-22 04:48:05,681 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: stop_status
378
+ 2024-03-22 04:48:06,885 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
379
+ 2024-03-22 04:48:11,889 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
380
+ 2024-03-22 04:48:16,895 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
381
+ 2024-03-22 04:48:16,896 DEBUG SenderThread:4275 [sender.py:send():378] send: stats
382
+ 2024-03-22 04:48:20,681 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: stop_status
383
+ 2024-03-22 04:48:20,683 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: stop_status
384
+ 2024-03-22 04:48:20,840 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: partial_history
385
+ 2024-03-22 04:48:20,928 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: summary_record
386
+ 2024-03-22 04:48:20,934 INFO SenderThread:4275 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
387
+ 2024-03-22 04:48:20,935 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: summary_record
388
+ 2024-03-22 04:48:20,941 INFO SenderThread:4275 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
389
+ 2024-03-22 04:48:20,942 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: summary_record
390
+ 2024-03-22 04:48:20,951 INFO SenderThread:4275 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
391
+ 2024-03-22 04:48:20,952 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: summary_record
392
+ 2024-03-22 04:48:20,960 INFO SenderThread:4275 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
393
+ 2024-03-22 04:48:20,962 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: summary_record
394
+ 2024-03-22 04:48:20,969 INFO SenderThread:4275 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
395
+ 2024-03-22 04:48:20,971 DEBUG SenderThread:4275 [sender.py:send():378] send: history
396
+ 2024-03-22 04:48:20,971 DEBUG SenderThread:4275 [sender.py:send_request():405] send_request: summary_record
397
+ 2024-03-22 04:48:21,160 INFO SenderThread:4275 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
398
+ 2024-03-22 04:48:21,480 INFO Thread-12 :4275 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Mistral-7B-Finetuning-Insurance/wandb/run-20240322_043407-hize5f4p/files/wandb-summary.json
399
+ 2024-03-22 04:48:22,163 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
400
+ 2024-03-22 04:48:27,164 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report
401
+ 2024-03-22 04:48:32,165 DEBUG HandlerThread:4275 [handler.py:handle_request():146] handle_request: status_report