Femboyuwu2000 commited on
Commit
803a7c8
1 Parent(s): 2998a55

Training in progress, step 7080

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ce253f116aab223a935d9ef740c7edf5afd3e4c9177c968cdc244a12015a1042
3
  size 13982248
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba68833e7854c46295405364ce4a0bdab48fb64ab5fcd771555f060646b84e4b
3
  size 13982248
runs/Apr12_07-40-41_e5a48bec8248/events.out.tfevents.1712907642.e5a48bec8248.443.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:487ce2a85f07693d3fc0098598d61b7df20d8f8eede0dd6a8fefdbf87681d561
3
- size 79319
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51f04d8bbf9e234dad7417448f5a2f5e7f687c600e2db743ce015e3a4ec55b1d
3
+ size 79952
wandb/debug-internal.log CHANGED
@@ -5804,3 +5804,53 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
5804
  2024-04-12 10:03:49,307 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5805
  2024-04-12 10:03:49,498 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
5806
  2024-04-12 10:03:51,499 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5804
  2024-04-12 10:03:49,307 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5805
  2024-04-12 10:03:49,498 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
5806
  2024-04-12 10:03:51,499 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
5807
+ 2024-04-12 10:03:54,308 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5808
+ 2024-04-12 10:03:59,309 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5809
+ 2024-04-12 10:04:02,143 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
5810
+ 2024-04-12 10:04:02,719 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
5811
+ 2024-04-12 10:04:02,720 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
5812
+ 2024-04-12 10:04:04,785 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5813
+ 2024-04-12 10:04:09,786 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5814
+ 2024-04-12 10:04:11,624 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
5815
+ 2024-04-12 10:04:11,626 DEBUG SenderThread:485 [sender.py:send():379] send: history
5816
+ 2024-04-12 10:04:11,626 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
5817
+ 2024-04-12 10:04:11,626 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
5818
+ 2024-04-12 10:04:12,512 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
5819
+ 2024-04-12 10:04:13,513 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
5820
+ 2024-04-12 10:04:15,325 DEBUG SenderThread:485 [sender.py:send():379] send: stats
5821
+ 2024-04-12 10:04:15,325 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5822
+ 2024-04-12 10:04:17,143 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
5823
+ 2024-04-12 10:04:17,719 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
5824
+ 2024-04-12 10:04:17,720 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
5825
+ 2024-04-12 10:04:20,784 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5826
+ 2024-04-12 10:04:25,785 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5827
+ 2024-04-12 10:04:30,786 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5828
+ 2024-04-12 10:04:32,144 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
5829
+ 2024-04-12 10:04:32,719 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
5830
+ 2024-04-12 10:04:32,720 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
5831
+ 2024-04-12 10:04:35,824 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5832
+ 2024-04-12 10:04:38,307 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
5833
+ 2024-04-12 10:04:38,308 DEBUG SenderThread:485 [sender.py:send():379] send: history
5834
+ 2024-04-12 10:04:38,308 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
5835
+ 2024-04-12 10:04:38,309 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
5836
+ 2024-04-12 10:04:38,529 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
5837
+ 2024-04-12 10:04:39,529 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
5838
+ 2024-04-12 10:04:40,907 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5839
+ 2024-04-12 10:04:45,326 DEBUG SenderThread:485 [sender.py:send():379] send: stats
5840
+ 2024-04-12 10:04:46,326 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5841
+ 2024-04-12 10:04:47,144 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
5842
+ 2024-04-12 10:04:47,719 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
5843
+ 2024-04-12 10:04:47,720 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
5844
+ 2024-04-12 10:04:51,877 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5845
+ 2024-04-12 10:04:56,878 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5846
+ 2024-04-12 10:05:01,879 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5847
+ 2024-04-12 10:05:02,144 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
5848
+ 2024-04-12 10:05:02,444 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
5849
+ 2024-04-12 10:05:02,446 DEBUG SenderThread:485 [sender.py:send():379] send: history
5850
+ 2024-04-12 10:05:02,446 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
5851
+ 2024-04-12 10:05:02,446 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
5852
+ 2024-04-12 10:05:02,543 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
5853
+ 2024-04-12 10:05:02,722 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
5854
+ 2024-04-12 10:05:02,722 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
5855
+ 2024-04-12 10:05:05,545 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
5856
+ 2024-04-12 10:05:07,309 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240412_074044-widovcn3/files/output.log CHANGED
@@ -700,4 +700,10 @@
700
  warnings.warn(
701
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
702
  warnings.warn(
 
 
 
 
 
 
703
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
 
700
  warnings.warn(
701
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
702
  warnings.warn(
703
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
704
+ warnings.warn(
705
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
706
+ warnings.warn(
707
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
708
+ warnings.warn(
709
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
wandb/run-20240412_074044-widovcn3/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 3.5194, "train/grad_norm": 42.29374313354492, "train/learning_rate": 2.259795445847566e-05, "train/epoch": 0.56, "train/global_step": 7020, "_timestamp": 1712916228.5003977, "_runtime": 8583.992679595947, "_step": 350}
 
1
+ {"train/loss": 3.5607, "train/grad_norm": 26.298309326171875, "train/learning_rate": 2.2471934095463724e-05, "train/epoch": 0.57, "train/global_step": 7080, "_timestamp": 1712916302.4443035, "_runtime": 8657.93658542633, "_step": 353}
wandb/run-20240412_074044-widovcn3/logs/debug-internal.log CHANGED
@@ -5804,3 +5804,53 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
5804
  2024-04-12 10:03:49,307 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5805
  2024-04-12 10:03:49,498 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
5806
  2024-04-12 10:03:51,499 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5804
  2024-04-12 10:03:49,307 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5805
  2024-04-12 10:03:49,498 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
5806
  2024-04-12 10:03:51,499 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
5807
+ 2024-04-12 10:03:54,308 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5808
+ 2024-04-12 10:03:59,309 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5809
+ 2024-04-12 10:04:02,143 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
5810
+ 2024-04-12 10:04:02,719 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
5811
+ 2024-04-12 10:04:02,720 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
5812
+ 2024-04-12 10:04:04,785 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5813
+ 2024-04-12 10:04:09,786 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5814
+ 2024-04-12 10:04:11,624 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
5815
+ 2024-04-12 10:04:11,626 DEBUG SenderThread:485 [sender.py:send():379] send: history
5816
+ 2024-04-12 10:04:11,626 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
5817
+ 2024-04-12 10:04:11,626 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
5818
+ 2024-04-12 10:04:12,512 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
5819
+ 2024-04-12 10:04:13,513 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
5820
+ 2024-04-12 10:04:15,325 DEBUG SenderThread:485 [sender.py:send():379] send: stats
5821
+ 2024-04-12 10:04:15,325 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5822
+ 2024-04-12 10:04:17,143 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
5823
+ 2024-04-12 10:04:17,719 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
5824
+ 2024-04-12 10:04:17,720 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
5825
+ 2024-04-12 10:04:20,784 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5826
+ 2024-04-12 10:04:25,785 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5827
+ 2024-04-12 10:04:30,786 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5828
+ 2024-04-12 10:04:32,144 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
5829
+ 2024-04-12 10:04:32,719 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
5830
+ 2024-04-12 10:04:32,720 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
5831
+ 2024-04-12 10:04:35,824 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5832
+ 2024-04-12 10:04:38,307 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
5833
+ 2024-04-12 10:04:38,308 DEBUG SenderThread:485 [sender.py:send():379] send: history
5834
+ 2024-04-12 10:04:38,308 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
5835
+ 2024-04-12 10:04:38,309 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
5836
+ 2024-04-12 10:04:38,529 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
5837
+ 2024-04-12 10:04:39,529 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
5838
+ 2024-04-12 10:04:40,907 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5839
+ 2024-04-12 10:04:45,326 DEBUG SenderThread:485 [sender.py:send():379] send: stats
5840
+ 2024-04-12 10:04:46,326 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5841
+ 2024-04-12 10:04:47,144 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
5842
+ 2024-04-12 10:04:47,719 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
5843
+ 2024-04-12 10:04:47,720 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
5844
+ 2024-04-12 10:04:51,877 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5845
+ 2024-04-12 10:04:56,878 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5846
+ 2024-04-12 10:05:01,879 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
5847
+ 2024-04-12 10:05:02,144 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
5848
+ 2024-04-12 10:05:02,444 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
5849
+ 2024-04-12 10:05:02,446 DEBUG SenderThread:485 [sender.py:send():379] send: history
5850
+ 2024-04-12 10:05:02,446 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
5851
+ 2024-04-12 10:05:02,446 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
5852
+ 2024-04-12 10:05:02,543 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
5853
+ 2024-04-12 10:05:02,722 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
5854
+ 2024-04-12 10:05:02,722 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
5855
+ 2024-04-12 10:05:05,545 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
5856
+ 2024-04-12 10:05:07,309 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb CHANGED
Binary files a/wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb and b/wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb differ