Hugging Face's logo

Femboyuwu2000
/
bloomz-1b1-vn-chat

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
Femboyuwu2000 commited on
Commit
2921d30
•
1 Parent(s): ede9f92

Training in progress, step 8520

Browse files
Files changed (7) hide show
  1. adapter_model.safetensors +1 -1
  2. runs/Apr12_07-40-41_e5a48bec8248/events.out.tfevents.1712907642.e5a48bec8248.443.0 +2 -2
  3. wandb/debug-internal.log +133 -0
  4. wandb/run-20240412_074044-widovcn3/files/output.log +16 -0
  5. wandb/run-20240412_074044-widovcn3/files/wandb-summary.json +1 -1
  6. wandb/run-20240412_074044-widovcn3/logs/debug-internal.log +133 -0
  7. wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb +0 -0
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3f684eb4c69a77fe91d3a34e9a84125b29ddef7258b75b25c8cfc8c0ba8687b7
3
  size 13982248
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6c80e46eda7401c9947fcc4db6cf030f4833f5cdd67c6bc2b42598b787e30647
3
  size 13982248
runs/Apr12_07-40-41_e5a48bec8248/events.out.tfevents.1712907642.e5a48bec8248.443.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6b41ff1333502937a93fa189515f8349ec318cb6d1382bf306f1eb5bb402a581
3
- size 93456
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1c3b46af1aeab44d67af88f92e72f5bbfaff805158112608937ce5044624f18
3
+ size 95144
wandb/debug-internal.log CHANGED
@@ -6905,3 +6905,136 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
6905
  2024-04-12 10:31:22,502 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
6906
  2024-04-12 10:31:22,503 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
6907
  2024-04-12 10:31:23,197 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6905
  2024-04-12 10:31:22,502 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
6906
  2024-04-12 10:31:22,503 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
6907
  2024-04-12 10:31:23,197 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
6908
+ 2024-04-12 10:31:25,198 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
6909
+ 2024-04-12 10:31:25,300 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6910
+ 2024-04-12 10:31:30,301 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6911
+ 2024-04-12 10:31:32,402 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6912
+ 2024-04-12 10:31:32,752 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6913
+ 2024-04-12 10:31:32,752 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6914
+ 2024-04-12 10:31:35,792 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6915
+ 2024-04-12 10:31:40,793 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6916
+ 2024-04-12 10:31:45,376 DEBUG SenderThread:485 [sender.py:send():379] send: stats
6917
+ 2024-04-12 10:31:46,378 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6918
+ 2024-04-12 10:31:46,464 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
6919
+ 2024-04-12 10:31:46,465 DEBUG SenderThread:485 [sender.py:send():379] send: history
6920
+ 2024-04-12 10:31:46,465 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
6921
+ 2024-04-12 10:31:46,466 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
6922
+ 2024-04-12 10:31:47,207 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
6923
+ 2024-04-12 10:31:47,402 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6924
+ 2024-04-12 10:31:47,752 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6925
+ 2024-04-12 10:31:47,752 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6926
+ 2024-04-12 10:31:49,208 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
6927
+ 2024-04-12 10:31:51,850 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6928
+ 2024-04-12 10:31:56,851 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6929
+ 2024-04-12 10:32:01,852 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6930
+ 2024-04-12 10:32:02,402 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6931
+ 2024-04-12 10:32:02,752 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6932
+ 2024-04-12 10:32:02,753 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6933
+ 2024-04-12 10:32:06,889 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6934
+ 2024-04-12 10:32:10,294 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
6935
+ 2024-04-12 10:32:10,295 DEBUG SenderThread:485 [sender.py:send():379] send: history
6936
+ 2024-04-12 10:32:10,295 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
6937
+ 2024-04-12 10:32:10,296 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
6938
+ 2024-04-12 10:32:11,217 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
6939
+ 2024-04-12 10:32:12,264 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6940
+ 2024-04-12 10:32:13,218 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
6941
+ 2024-04-12 10:32:15,378 DEBUG SenderThread:485 [sender.py:send():379] send: stats
6942
+ 2024-04-12 10:32:17,379 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6943
+ 2024-04-12 10:32:17,402 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6944
+ 2024-04-12 10:32:17,752 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6945
+ 2024-04-12 10:32:17,753 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6946
+ 2024-04-12 10:32:22,803 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6947
+ 2024-04-12 10:32:27,804 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6948
+ 2024-04-12 10:32:32,402 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6949
+ 2024-04-12 10:32:32,753 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6950
+ 2024-04-12 10:32:32,754 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6951
+ 2024-04-12 10:32:32,827 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6952
+ 2024-04-12 10:32:37,828 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6953
+ 2024-04-12 10:32:40,251 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
6954
+ 2024-04-12 10:32:40,252 DEBUG SenderThread:485 [sender.py:send():379] send: history
6955
+ 2024-04-12 10:32:40,253 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
6956
+ 2024-04-12 10:32:40,253 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
6957
+ 2024-04-12 10:32:41,228 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
6958
+ 2024-04-12 10:32:41,228 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
6959
+ 2024-04-12 10:32:43,019 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6960
+ 2024-04-12 10:32:45,379 DEBUG SenderThread:485 [sender.py:send():379] send: stats
6961
+ 2024-04-12 10:32:47,402 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6962
+ 2024-04-12 10:32:47,753 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6963
+ 2024-04-12 10:32:47,753 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6964
+ 2024-04-12 10:32:48,787 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6965
+ 2024-04-12 10:32:53,788 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6966
+ 2024-04-12 10:32:58,789 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6967
+ 2024-04-12 10:33:02,402 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6968
+ 2024-04-12 10:33:02,753 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6969
+ 2024-04-12 10:33:02,753 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6970
+ 2024-04-12 10:33:03,833 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6971
+ 2024-04-12 10:33:08,834 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6972
+ 2024-04-12 10:33:10,092 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
6973
+ 2024-04-12 10:33:10,093 DEBUG SenderThread:485 [sender.py:send():379] send: history
6974
+ 2024-04-12 10:33:10,094 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
6975
+ 2024-04-12 10:33:10,094 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
6976
+ 2024-04-12 10:33:10,240 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
6977
+ 2024-04-12 10:33:11,240 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
6978
+ 2024-04-12 10:33:13,987 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6979
+ 2024-04-12 10:33:15,380 DEBUG SenderThread:485 [sender.py:send():379] send: stats
6980
+ 2024-04-12 10:33:17,403 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6981
+ 2024-04-12 10:33:17,753 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6982
+ 2024-04-12 10:33:17,753 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6983
+ 2024-04-12 10:33:19,887 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6984
+ 2024-04-12 10:33:24,888 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6985
+ 2024-04-12 10:33:29,889 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6986
+ 2024-04-12 10:33:32,403 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6987
+ 2024-04-12 10:33:32,753 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6988
+ 2024-04-12 10:33:32,754 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6989
+ 2024-04-12 10:33:32,797 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
6990
+ 2024-04-12 10:33:32,839 DEBUG SenderThread:485 [sender.py:send():379] send: history
6991
+ 2024-04-12 10:33:32,839 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
6992
+ 2024-04-12 10:33:32,840 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
6993
+ 2024-04-12 10:33:33,248 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
6994
+ 2024-04-12 10:33:35,249 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
6995
+ 2024-04-12 10:33:35,572 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6996
+ 2024-04-12 10:33:40,573 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6997
+ 2024-04-12 10:33:45,381 DEBUG SenderThread:485 [sender.py:send():379] send: stats
6998
+ 2024-04-12 10:33:46,382 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6999
+ 2024-04-12 10:33:47,403 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
7000
+ 2024-04-12 10:33:47,753 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
7001
+ 2024-04-12 10:33:47,754 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
7002
+ 2024-04-12 10:33:51,809 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7003
+ 2024-04-12 10:33:56,810 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7004
+ 2024-04-12 10:33:57,860 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
7005
+ 2024-04-12 10:33:57,861 DEBUG SenderThread:485 [sender.py:send():379] send: history
7006
+ 2024-04-12 10:33:57,862 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
7007
+ 2024-04-12 10:33:57,862 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
7008
+ 2024-04-12 10:33:58,258 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
7009
+ 2024-04-12 10:33:59,258 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
7010
+ 2024-04-12 10:34:02,403 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
7011
+ 2024-04-12 10:34:02,639 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7012
+ 2024-04-12 10:34:02,753 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
7013
+ 2024-04-12 10:34:02,754 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
7014
+ 2024-04-12 10:34:07,862 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7015
+ 2024-04-12 10:34:12,863 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7016
+ 2024-04-12 10:34:15,382 DEBUG SenderThread:485 [sender.py:send():379] send: stats
7017
+ 2024-04-12 10:34:17,403 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
7018
+ 2024-04-12 10:34:17,754 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
7019
+ 2024-04-12 10:34:17,754 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
7020
+ 2024-04-12 10:34:17,881 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7021
+ 2024-04-12 10:34:20,663 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
7022
+ 2024-04-12 10:34:20,665 DEBUG SenderThread:485 [sender.py:send():379] send: history
7023
+ 2024-04-12 10:34:20,665 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
7024
+ 2024-04-12 10:34:20,665 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
7025
+ 2024-04-12 10:34:21,268 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
7026
+ 2024-04-12 10:34:23,269 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
7027
+ 2024-04-12 10:34:23,458 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7028
+ 2024-04-12 10:34:28,459 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7029
+ 2024-04-12 10:34:32,403 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
7030
+ 2024-04-12 10:34:32,754 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
7031
+ 2024-04-12 10:34:32,754 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
7032
+ 2024-04-12 10:34:33,873 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7033
+ 2024-04-12 10:34:38,874 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7034
+ 2024-04-12 10:34:43,874 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7035
+ 2024-04-12 10:34:44,575 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
7036
+ 2024-04-12 10:34:44,576 DEBUG SenderThread:485 [sender.py:send():379] send: history
7037
+ 2024-04-12 10:34:44,577 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
7038
+ 2024-04-12 10:34:44,577 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
7039
+ 2024-04-12 10:34:45,279 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
7040
+ 2024-04-12 10:34:45,382 DEBUG SenderThread:485 [sender.py:send():379] send: stats
wandb/run-20240412_074044-widovcn3/files/output.log CHANGED
@@ -832,4 +832,20 @@
832
  warnings.warn(
833
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
834
  warnings.warn(
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
835
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
 
832
  warnings.warn(
833
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
834
  warnings.warn(
835
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
836
+ warnings.warn(
837
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
838
+ warnings.warn(
839
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
840
+ warnings.warn(
841
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
842
+ warnings.warn(
843
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
844
+ warnings.warn(
845
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
846
+ warnings.warn(
847
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
848
+ warnings.warn(
849
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
850
+ warnings.warn(
851
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
wandb/run-20240412_074044-widovcn3/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 3.4806, "train/grad_norm": 30.5143985748291, "train/learning_rate": 1.963525491562421e-05, "train/epoch": 0.67, "train/global_step": 8360, "_timestamp": 1712917882.5004034, "_runtime": 10237.992685317993, "_step": 417}
 
1
+ {"train/loss": 3.4568, "train/grad_norm": 33.18935775756836, "train/learning_rate": 1.926411174348373e-05, "train/epoch": 0.68, "train/global_step": 8520, "_timestamp": 1712918084.5750935, "_runtime": 10440.067375421524, "_step": 425}
wandb/run-20240412_074044-widovcn3/logs/debug-internal.log CHANGED
@@ -6905,3 +6905,136 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
6905
  2024-04-12 10:31:22,502 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
6906
  2024-04-12 10:31:22,503 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
6907
  2024-04-12 10:31:23,197 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6905
  2024-04-12 10:31:22,502 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
6906
  2024-04-12 10:31:22,503 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
6907
  2024-04-12 10:31:23,197 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
6908
+ 2024-04-12 10:31:25,198 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
6909
+ 2024-04-12 10:31:25,300 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6910
+ 2024-04-12 10:31:30,301 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6911
+ 2024-04-12 10:31:32,402 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6912
+ 2024-04-12 10:31:32,752 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6913
+ 2024-04-12 10:31:32,752 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6914
+ 2024-04-12 10:31:35,792 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6915
+ 2024-04-12 10:31:40,793 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6916
+ 2024-04-12 10:31:45,376 DEBUG SenderThread:485 [sender.py:send():379] send: stats
6917
+ 2024-04-12 10:31:46,378 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6918
+ 2024-04-12 10:31:46,464 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
6919
+ 2024-04-12 10:31:46,465 DEBUG SenderThread:485 [sender.py:send():379] send: history
6920
+ 2024-04-12 10:31:46,465 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
6921
+ 2024-04-12 10:31:46,466 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
6922
+ 2024-04-12 10:31:47,207 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
6923
+ 2024-04-12 10:31:47,402 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6924
+ 2024-04-12 10:31:47,752 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6925
+ 2024-04-12 10:31:47,752 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6926
+ 2024-04-12 10:31:49,208 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
6927
+ 2024-04-12 10:31:51,850 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6928
+ 2024-04-12 10:31:56,851 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6929
+ 2024-04-12 10:32:01,852 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6930
+ 2024-04-12 10:32:02,402 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6931
+ 2024-04-12 10:32:02,752 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6932
+ 2024-04-12 10:32:02,753 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6933
+ 2024-04-12 10:32:06,889 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6934
+ 2024-04-12 10:32:10,294 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
6935
+ 2024-04-12 10:32:10,295 DEBUG SenderThread:485 [sender.py:send():379] send: history
6936
+ 2024-04-12 10:32:10,295 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
6937
+ 2024-04-12 10:32:10,296 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
6938
+ 2024-04-12 10:32:11,217 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
6939
+ 2024-04-12 10:32:12,264 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6940
+ 2024-04-12 10:32:13,218 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
6941
+ 2024-04-12 10:32:15,378 DEBUG SenderThread:485 [sender.py:send():379] send: stats
6942
+ 2024-04-12 10:32:17,379 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6943
+ 2024-04-12 10:32:17,402 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6944
+ 2024-04-12 10:32:17,752 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6945
+ 2024-04-12 10:32:17,753 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6946
+ 2024-04-12 10:32:22,803 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6947
+ 2024-04-12 10:32:27,804 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6948
+ 2024-04-12 10:32:32,402 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6949
+ 2024-04-12 10:32:32,753 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6950
+ 2024-04-12 10:32:32,754 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6951
+ 2024-04-12 10:32:32,827 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6952
+ 2024-04-12 10:32:37,828 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6953
+ 2024-04-12 10:32:40,251 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
6954
+ 2024-04-12 10:32:40,252 DEBUG SenderThread:485 [sender.py:send():379] send: history
6955
+ 2024-04-12 10:32:40,253 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
6956
+ 2024-04-12 10:32:40,253 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
6957
+ 2024-04-12 10:32:41,228 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
6958
+ 2024-04-12 10:32:41,228 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
6959
+ 2024-04-12 10:32:43,019 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6960
+ 2024-04-12 10:32:45,379 DEBUG SenderThread:485 [sender.py:send():379] send: stats
6961
+ 2024-04-12 10:32:47,402 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6962
+ 2024-04-12 10:32:47,753 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6963
+ 2024-04-12 10:32:47,753 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6964
+ 2024-04-12 10:32:48,787 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6965
+ 2024-04-12 10:32:53,788 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6966
+ 2024-04-12 10:32:58,789 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6967
+ 2024-04-12 10:33:02,402 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6968
+ 2024-04-12 10:33:02,753 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6969
+ 2024-04-12 10:33:02,753 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6970
+ 2024-04-12 10:33:03,833 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6971
+ 2024-04-12 10:33:08,834 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6972
+ 2024-04-12 10:33:10,092 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
6973
+ 2024-04-12 10:33:10,093 DEBUG SenderThread:485 [sender.py:send():379] send: history
6974
+ 2024-04-12 10:33:10,094 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
6975
+ 2024-04-12 10:33:10,094 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
6976
+ 2024-04-12 10:33:10,240 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
6977
+ 2024-04-12 10:33:11,240 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
6978
+ 2024-04-12 10:33:13,987 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6979
+ 2024-04-12 10:33:15,380 DEBUG SenderThread:485 [sender.py:send():379] send: stats
6980
+ 2024-04-12 10:33:17,403 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6981
+ 2024-04-12 10:33:17,753 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6982
+ 2024-04-12 10:33:17,753 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6983
+ 2024-04-12 10:33:19,887 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6984
+ 2024-04-12 10:33:24,888 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6985
+ 2024-04-12 10:33:29,889 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6986
+ 2024-04-12 10:33:32,403 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
6987
+ 2024-04-12 10:33:32,753 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
6988
+ 2024-04-12 10:33:32,754 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
6989
+ 2024-04-12 10:33:32,797 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
6990
+ 2024-04-12 10:33:32,839 DEBUG SenderThread:485 [sender.py:send():379] send: history
6991
+ 2024-04-12 10:33:32,839 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
6992
+ 2024-04-12 10:33:32,840 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
6993
+ 2024-04-12 10:33:33,248 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
6994
+ 2024-04-12 10:33:35,249 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
6995
+ 2024-04-12 10:33:35,572 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6996
+ 2024-04-12 10:33:40,573 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6997
+ 2024-04-12 10:33:45,381 DEBUG SenderThread:485 [sender.py:send():379] send: stats
6998
+ 2024-04-12 10:33:46,382 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
6999
+ 2024-04-12 10:33:47,403 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
7000
+ 2024-04-12 10:33:47,753 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
7001
+ 2024-04-12 10:33:47,754 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
7002
+ 2024-04-12 10:33:51,809 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7003
+ 2024-04-12 10:33:56,810 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7004
+ 2024-04-12 10:33:57,860 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
7005
+ 2024-04-12 10:33:57,861 DEBUG SenderThread:485 [sender.py:send():379] send: history
7006
+ 2024-04-12 10:33:57,862 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
7007
+ 2024-04-12 10:33:57,862 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
7008
+ 2024-04-12 10:33:58,258 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
7009
+ 2024-04-12 10:33:59,258 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
7010
+ 2024-04-12 10:34:02,403 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
7011
+ 2024-04-12 10:34:02,639 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7012
+ 2024-04-12 10:34:02,753 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
7013
+ 2024-04-12 10:34:02,754 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
7014
+ 2024-04-12 10:34:07,862 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7015
+ 2024-04-12 10:34:12,863 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7016
+ 2024-04-12 10:34:15,382 DEBUG SenderThread:485 [sender.py:send():379] send: stats
7017
+ 2024-04-12 10:34:17,403 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
7018
+ 2024-04-12 10:34:17,754 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
7019
+ 2024-04-12 10:34:17,754 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
7020
+ 2024-04-12 10:34:17,881 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7021
+ 2024-04-12 10:34:20,663 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
7022
+ 2024-04-12 10:34:20,665 DEBUG SenderThread:485 [sender.py:send():379] send: history
7023
+ 2024-04-12 10:34:20,665 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
7024
+ 2024-04-12 10:34:20,665 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
7025
+ 2024-04-12 10:34:21,268 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
7026
+ 2024-04-12 10:34:23,269 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
7027
+ 2024-04-12 10:34:23,458 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7028
+ 2024-04-12 10:34:28,459 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7029
+ 2024-04-12 10:34:32,403 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
7030
+ 2024-04-12 10:34:32,754 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
7031
+ 2024-04-12 10:34:32,754 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
7032
+ 2024-04-12 10:34:33,873 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7033
+ 2024-04-12 10:34:38,874 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7034
+ 2024-04-12 10:34:43,874 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
7035
+ 2024-04-12 10:34:44,575 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
7036
+ 2024-04-12 10:34:44,576 DEBUG SenderThread:485 [sender.py:send():379] send: history
7037
+ 2024-04-12 10:34:44,577 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
7038
+ 2024-04-12 10:34:44,577 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
7039
+ 2024-04-12 10:34:45,279 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
7040
+ 2024-04-12 10:34:45,382 DEBUG SenderThread:485 [sender.py:send():379] send: stats
wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb CHANGED
Binary files a/wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb and b/wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb differ