Hugging Face's logo

csujeong
/
Mistral-7B-Finetuning-Insurance-16R

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
csujeong commited on
Commit
a8c2cd6
•
1 Parent(s): dfddded

Training in progress, step 60

Browse files
Files changed (6) hide show
  1. adapter_model.safetensors +1 -1
  2. runs/Jan07_11-26-45_371ca9b7a7c7/events.out.tfevents.1704627272.371ca9b7a7c7.476.1 +2 -2
  3. wandb/debug-internal.log +58 -0
  4. wandb/run-20240107_113444-ebd79hle/files/config.yaml +20 -0
  5. wandb/run-20240107_113444-ebd79hle/files/wandb-summary.json +1 -1
  6. wandb/run-20240107_113444-ebd79hle/logs/debug-internal.log +58 -0
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:868082268644df07c501a0abede3aa8c2cf02f870eca255e85165e2661161172
3
  size 184592616
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:46aca25a1dfb6403d7a66dade2ce50e6a82d44a8ecd9492eba92fa9f5dfa541c
3
  size 184592616
runs/Jan07_11-26-45_371ca9b7a7c7/events.out.tfevents.1704627272.371ca9b7a7c7.476.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d39b19274ed4be6c7cbb002af596d6cfd9be2a0aba0bf38b8543ffc8a2c1fe14
3
- size 5653
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32e57050c8b28a73b5395196f5673bc9704ee12a3316a62ed275e6373d809272
3
+ size 6155
wandb/debug-internal.log CHANGED
@@ -351,3 +351,61 @@
351
  2024-01-07 11:45:32,990 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
352
  2024-01-07 11:45:37,990 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
353
  2024-01-07 11:45:42,991 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
351
  2024-01-07 11:45:32,990 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
352
  2024-01-07 11:45:37,990 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
353
  2024-01-07 11:45:42,991 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
354
+ 2024-01-07 11:45:47,802 DEBUG SenderThread:4664 [sender.py:send():382] send: stats
355
+ 2024-01-07 11:45:47,849 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: stop_status
356
+ 2024-01-07 11:45:47,850 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: stop_status
357
+ 2024-01-07 11:45:47,890 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: internal_messages
358
+ 2024-01-07 11:45:48,977 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
359
+ 2024-01-07 11:45:53,978 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
360
+ 2024-01-07 11:45:58,979 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
361
+ 2024-01-07 11:46:02,849 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: stop_status
362
+ 2024-01-07 11:46:02,850 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: stop_status
363
+ 2024-01-07 11:46:02,890 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: internal_messages
364
+ 2024-01-07 11:46:04,952 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
365
+ 2024-01-07 11:46:09,953 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
366
+ 2024-01-07 11:46:14,954 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
367
+ 2024-01-07 11:46:17,803 DEBUG SenderThread:4664 [sender.py:send():382] send: stats
368
+ 2024-01-07 11:46:17,849 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: stop_status
369
+ 2024-01-07 11:46:17,850 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: stop_status
370
+ 2024-01-07 11:46:17,890 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: internal_messages
371
+ 2024-01-07 11:46:20,926 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
372
+ 2024-01-07 11:46:25,927 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
373
+ 2024-01-07 11:46:30,927 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
374
+ 2024-01-07 11:46:32,850 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: stop_status
375
+ 2024-01-07 11:46:32,850 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: stop_status
376
+ 2024-01-07 11:46:32,890 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: internal_messages
377
+ 2024-01-07 11:46:35,982 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
378
+ 2024-01-07 11:46:40,983 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
379
+ 2024-01-07 11:46:45,984 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
380
+ 2024-01-07 11:46:47,804 DEBUG SenderThread:4664 [sender.py:send():382] send: stats
381
+ 2024-01-07 11:46:47,850 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: stop_status
382
+ 2024-01-07 11:46:47,850 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: stop_status
383
+ 2024-01-07 11:46:47,890 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: internal_messages
384
+ 2024-01-07 11:46:51,935 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
385
+ 2024-01-07 11:46:56,935 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
386
+ 2024-01-07 11:47:01,246 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: partial_history
387
+ 2024-01-07 11:47:01,251 DEBUG SenderThread:4664 [sender.py:send():382] send: history
388
+ 2024-01-07 11:47:01,251 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: summary_record
389
+ 2024-01-07 11:47:01,255 INFO SenderThread:4664 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
390
+ 2024-01-07 11:47:01,485 INFO Thread-12 :4664 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Mistral-7B-Finetuning-Insurance/wandb/run-20240107_113444-ebd79hle/files/wandb-summary.json
391
+ 2024-01-07 11:47:02,257 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
392
+ 2024-01-07 11:47:02,850 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: stop_status
393
+ 2024-01-07 11:47:02,850 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: stop_status
394
+ 2024-01-07 11:47:02,864 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: internal_messages
395
+ 2024-01-07 11:47:06,910 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: partial_history
396
+ 2024-01-07 11:47:06,914 DEBUG SenderThread:4664 [sender.py:send():382] send: metric
397
+ 2024-01-07 11:47:06,914 DEBUG SenderThread:4664 [sender.py:send():382] send: metric
398
+ 2024-01-07 11:47:06,915 DEBUG SenderThread:4664 [sender.py:send():382] send: metric
399
+ 2024-01-07 11:47:06,915 DEBUG SenderThread:4664 [sender.py:send():382] send: metric
400
+ 2024-01-07 11:47:06,915 DEBUG SenderThread:4664 [sender.py:send():382] send: metric
401
+ 2024-01-07 11:47:06,916 DEBUG SenderThread:4664 [sender.py:send():382] send: history
402
+ 2024-01-07 11:47:06,916 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: summary_record
403
+ 2024-01-07 11:47:06,933 INFO SenderThread:4664 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
404
+ 2024-01-07 11:47:07,509 INFO Thread-12 :4664 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Mistral-7B-Finetuning-Insurance/wandb/run-20240107_113444-ebd79hle/files/wandb-summary.json
405
+ 2024-01-07 11:47:07,935 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
406
+ 2024-01-07 11:47:12,941 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
407
+ 2024-01-07 11:47:13,526 INFO Thread-12 :4664 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Mistral-7B-Finetuning-Insurance/wandb/run-20240107_113444-ebd79hle/files/config.yaml
408
+ 2024-01-07 11:47:17,804 DEBUG SenderThread:4664 [sender.py:send():382] send: stats
409
+ 2024-01-07 11:47:17,850 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: stop_status
410
+ 2024-01-07 11:47:17,850 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: stop_status
411
+ 2024-01-07 11:47:17,864 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: internal_messages
wandb/run-20240107_113444-ebd79hle/files/config.yaml CHANGED
@@ -68,6 +68,26 @@ _wandb:
68
  5: 1
69
  6:
70
  - 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
71
  vocab_size:
72
  desc: null
73
  value: 32000
 
68
  5: 1
69
  6:
70
  - 1
71
+ - 1: train/train_runtime
72
+ 5: 1
73
+ 6:
74
+ - 1
75
+ - 1: train/train_samples_per_second
76
+ 5: 1
77
+ 6:
78
+ - 1
79
+ - 1: train/train_steps_per_second
80
+ 5: 1
81
+ 6:
82
+ - 1
83
+ - 1: train/total_flos
84
+ 5: 1
85
+ 6:
86
+ - 1
87
+ - 1: train/train_loss
88
+ 5: 1
89
+ 6:
90
+ - 1
91
  vocab_size:
92
  desc: null
93
  value: 32000
wandb/run-20240107_113444-ebd79hle/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 1.3936, "train/learning_rate": 1.4314282383241096e-05, "train/epoch": 0.37, "train/global_step": 50, "_timestamp": 1704627930.7727094, "_runtime": 645.9548902511597, "_step": 4}
 
1
+ {"train/loss": 1.3246, "train/learning_rate": 0.0, "train/epoch": 0.44, "train/global_step": 60, "_timestamp": 1704628026.9098504, "_runtime": 742.0920312404633, "_step": 6, "train/train_runtime": 754.4162, "train/train_samples_per_second": 0.318, "train/train_steps_per_second": 0.08, "train/total_flos": 1590097255219200.0, "train/train_loss": 1.4476683457692465}
wandb/run-20240107_113444-ebd79hle/logs/debug-internal.log CHANGED
@@ -351,3 +351,61 @@
351
  2024-01-07 11:45:32,990 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
352
  2024-01-07 11:45:37,990 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
353
  2024-01-07 11:45:42,991 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
351
  2024-01-07 11:45:32,990 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
352
  2024-01-07 11:45:37,990 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
353
  2024-01-07 11:45:42,991 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
354
+ 2024-01-07 11:45:47,802 DEBUG SenderThread:4664 [sender.py:send():382] send: stats
355
+ 2024-01-07 11:45:47,849 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: stop_status
356
+ 2024-01-07 11:45:47,850 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: stop_status
357
+ 2024-01-07 11:45:47,890 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: internal_messages
358
+ 2024-01-07 11:45:48,977 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
359
+ 2024-01-07 11:45:53,978 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
360
+ 2024-01-07 11:45:58,979 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
361
+ 2024-01-07 11:46:02,849 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: stop_status
362
+ 2024-01-07 11:46:02,850 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: stop_status
363
+ 2024-01-07 11:46:02,890 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: internal_messages
364
+ 2024-01-07 11:46:04,952 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
365
+ 2024-01-07 11:46:09,953 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
366
+ 2024-01-07 11:46:14,954 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
367
+ 2024-01-07 11:46:17,803 DEBUG SenderThread:4664 [sender.py:send():382] send: stats
368
+ 2024-01-07 11:46:17,849 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: stop_status
369
+ 2024-01-07 11:46:17,850 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: stop_status
370
+ 2024-01-07 11:46:17,890 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: internal_messages
371
+ 2024-01-07 11:46:20,926 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
372
+ 2024-01-07 11:46:25,927 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
373
+ 2024-01-07 11:46:30,927 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
374
+ 2024-01-07 11:46:32,850 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: stop_status
375
+ 2024-01-07 11:46:32,850 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: stop_status
376
+ 2024-01-07 11:46:32,890 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: internal_messages
377
+ 2024-01-07 11:46:35,982 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
378
+ 2024-01-07 11:46:40,983 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
379
+ 2024-01-07 11:46:45,984 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
380
+ 2024-01-07 11:46:47,804 DEBUG SenderThread:4664 [sender.py:send():382] send: stats
381
+ 2024-01-07 11:46:47,850 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: stop_status
382
+ 2024-01-07 11:46:47,850 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: stop_status
383
+ 2024-01-07 11:46:47,890 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: internal_messages
384
+ 2024-01-07 11:46:51,935 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
385
+ 2024-01-07 11:46:56,935 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
386
+ 2024-01-07 11:47:01,246 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: partial_history
387
+ 2024-01-07 11:47:01,251 DEBUG SenderThread:4664 [sender.py:send():382] send: history
388
+ 2024-01-07 11:47:01,251 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: summary_record
389
+ 2024-01-07 11:47:01,255 INFO SenderThread:4664 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
390
+ 2024-01-07 11:47:01,485 INFO Thread-12 :4664 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Mistral-7B-Finetuning-Insurance/wandb/run-20240107_113444-ebd79hle/files/wandb-summary.json
391
+ 2024-01-07 11:47:02,257 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
392
+ 2024-01-07 11:47:02,850 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: stop_status
393
+ 2024-01-07 11:47:02,850 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: stop_status
394
+ 2024-01-07 11:47:02,864 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: internal_messages
395
+ 2024-01-07 11:47:06,910 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: partial_history
396
+ 2024-01-07 11:47:06,914 DEBUG SenderThread:4664 [sender.py:send():382] send: metric
397
+ 2024-01-07 11:47:06,914 DEBUG SenderThread:4664 [sender.py:send():382] send: metric
398
+ 2024-01-07 11:47:06,915 DEBUG SenderThread:4664 [sender.py:send():382] send: metric
399
+ 2024-01-07 11:47:06,915 DEBUG SenderThread:4664 [sender.py:send():382] send: metric
400
+ 2024-01-07 11:47:06,915 DEBUG SenderThread:4664 [sender.py:send():382] send: metric
401
+ 2024-01-07 11:47:06,916 DEBUG SenderThread:4664 [sender.py:send():382] send: history
402
+ 2024-01-07 11:47:06,916 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: summary_record
403
+ 2024-01-07 11:47:06,933 INFO SenderThread:4664 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
404
+ 2024-01-07 11:47:07,509 INFO Thread-12 :4664 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Mistral-7B-Finetuning-Insurance/wandb/run-20240107_113444-ebd79hle/files/wandb-summary.json
405
+ 2024-01-07 11:47:07,935 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
406
+ 2024-01-07 11:47:12,941 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: status_report
407
+ 2024-01-07 11:47:13,526 INFO Thread-12 :4664 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Mistral-7B-Finetuning-Insurance/wandb/run-20240107_113444-ebd79hle/files/config.yaml
408
+ 2024-01-07 11:47:17,804 DEBUG SenderThread:4664 [sender.py:send():382] send: stats
409
+ 2024-01-07 11:47:17,850 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: stop_status
410
+ 2024-01-07 11:47:17,850 DEBUG SenderThread:4664 [sender.py:send_request():409] send_request: stop_status
411
+ 2024-01-07 11:47:17,864 DEBUG HandlerThread:4664 [handler.py:handle_request():146] handle_request: internal_messages