Femboyuwu2000 commited on
Commit
96038a6
1 Parent(s): db8453b

Training in progress, step 2620

Browse files
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b209e171b2bafde533025af3ea490078abf0bfdeb25b88b922c9d4d854d7b585
3
  size 13982248
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:102a934b9c2b16bd152b8fb45fb756ed8a39ee8f7db8b00ff347bd79c86fbef6
3
  size 13982248
runs/Apr12_07-40-41_e5a48bec8248/events.out.tfevents.1712907642.e5a48bec8248.443.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d2d59b1509a86bec9150afca9f1a392df75b95d5d8b786d5de53696b7773352a
3
- size 30156
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3aa0007a3970a6a3d78e5d544ffcacd675c46c52125276c776752ee3c5281ec8
3
+ size 32899
wandb/debug-internal.log CHANGED
@@ -1997,3 +1997,216 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
1997
  2024-04-12 08:29:05,161 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
1998
  2024-04-12 08:29:05,161 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
1999
  2024-04-12 08:29:06,134 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1997
  2024-04-12 08:29:05,161 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
1998
  2024-04-12 08:29:05,161 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
1999
  2024-04-12 08:29:06,134 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2000
+ 2024-04-12 08:29:07,135 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2001
+ 2024-04-12 08:29:08,989 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2002
+ 2024-04-12 08:29:13,991 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2003
+ 2024-04-12 08:29:15,124 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2004
+ 2024-04-12 08:29:16,521 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2005
+ 2024-04-12 08:29:16,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2006
+ 2024-04-12 08:29:16,522 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2007
+ 2024-04-12 08:29:19,600 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2008
+ 2024-04-12 08:29:24,601 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2009
+ 2024-04-12 08:29:29,602 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2010
+ 2024-04-12 08:29:31,520 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2011
+ 2024-04-12 08:29:31,521 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2012
+ 2024-04-12 08:29:31,521 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2013
+ 2024-04-12 08:29:32,263 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2014
+ 2024-04-12 08:29:32,264 DEBUG SenderThread:485 [sender.py:send():379] send: history
2015
+ 2024-04-12 08:29:32,264 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2016
+ 2024-04-12 08:29:32,265 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2017
+ 2024-04-12 08:29:33,145 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2018
+ 2024-04-12 08:29:35,049 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2019
+ 2024-04-12 08:29:35,145 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2020
+ 2024-04-12 08:29:40,050 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2021
+ 2024-04-12 08:29:45,051 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2022
+ 2024-04-12 08:29:45,125 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2023
+ 2024-04-12 08:29:46,520 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2024
+ 2024-04-12 08:29:46,521 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2025
+ 2024-04-12 08:29:46,521 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2026
+ 2024-04-12 08:29:50,564 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2027
+ 2024-04-12 08:29:55,565 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2028
+ 2024-04-12 08:29:55,761 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2029
+ 2024-04-12 08:29:55,762 DEBUG SenderThread:485 [sender.py:send():379] send: history
2030
+ 2024-04-12 08:29:55,762 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2031
+ 2024-04-12 08:29:55,763 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2032
+ 2024-04-12 08:29:56,154 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2033
+ 2024-04-12 08:29:57,154 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2034
+ 2024-04-12 08:30:01,520 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2035
+ 2024-04-12 08:30:01,521 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2036
+ 2024-04-12 08:30:01,521 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2037
+ 2024-04-12 08:30:01,522 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2038
+ 2024-04-12 08:30:06,578 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2039
+ 2024-04-12 08:30:11,579 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2040
+ 2024-04-12 08:30:15,127 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2041
+ 2024-04-12 08:30:16,521 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2042
+ 2024-04-12 08:30:16,521 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2043
+ 2024-04-12 08:30:16,521 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2044
+ 2024-04-12 08:30:16,640 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2045
+ 2024-04-12 08:30:21,641 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2046
+ 2024-04-12 08:30:25,139 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2047
+ 2024-04-12 08:30:25,140 DEBUG SenderThread:485 [sender.py:send():379] send: history
2048
+ 2024-04-12 08:30:25,140 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2049
+ 2024-04-12 08:30:25,141 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2050
+ 2024-04-12 08:30:25,166 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2051
+ 2024-04-12 08:30:26,878 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2052
+ 2024-04-12 08:30:27,167 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2053
+ 2024-04-12 08:30:31,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2054
+ 2024-04-12 08:30:31,523 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2055
+ 2024-04-12 08:30:31,525 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2056
+ 2024-04-12 08:30:32,557 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2057
+ 2024-04-12 08:30:37,559 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2058
+ 2024-04-12 08:30:42,560 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2059
+ 2024-04-12 08:30:45,128 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2060
+ 2024-04-12 08:30:46,521 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2061
+ 2024-04-12 08:30:46,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2062
+ 2024-04-12 08:30:46,522 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2063
+ 2024-04-12 08:30:47,628 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2064
+ 2024-04-12 08:30:48,429 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2065
+ 2024-04-12 08:30:48,430 DEBUG SenderThread:485 [sender.py:send():379] send: history
2066
+ 2024-04-12 08:30:48,430 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2067
+ 2024-04-12 08:30:48,431 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2068
+ 2024-04-12 08:30:49,176 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2069
+ 2024-04-12 08:30:51,177 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2070
+ 2024-04-12 08:30:53,277 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2071
+ 2024-04-12 08:30:58,278 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2072
+ 2024-04-12 08:31:01,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2073
+ 2024-04-12 08:31:01,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2074
+ 2024-04-12 08:31:01,524 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2075
+ 2024-04-12 08:31:03,571 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2076
+ 2024-04-12 08:31:08,572 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2077
+ 2024-04-12 08:31:11,181 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2078
+ 2024-04-12 08:31:11,183 DEBUG SenderThread:485 [sender.py:send():379] send: history
2079
+ 2024-04-12 08:31:11,183 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2080
+ 2024-04-12 08:31:11,183 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2081
+ 2024-04-12 08:31:11,185 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2082
+ 2024-04-12 08:31:13,185 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2083
+ 2024-04-12 08:31:13,902 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2084
+ 2024-04-12 08:31:15,129 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2085
+ 2024-04-12 08:31:16,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2086
+ 2024-04-12 08:31:16,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2087
+ 2024-04-12 08:31:16,523 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2088
+ 2024-04-12 08:31:19,605 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2089
+ 2024-04-12 08:31:24,606 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2090
+ 2024-04-12 08:31:29,607 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2091
+ 2024-04-12 08:31:31,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2092
+ 2024-04-12 08:31:31,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2093
+ 2024-04-12 08:31:31,524 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2094
+ 2024-04-12 08:31:34,407 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2095
+ 2024-04-12 08:31:34,408 DEBUG SenderThread:485 [sender.py:send():379] send: history
2096
+ 2024-04-12 08:31:34,408 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2097
+ 2024-04-12 08:31:34,409 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2098
+ 2024-04-12 08:31:35,121 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2099
+ 2024-04-12 08:31:35,194 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2100
+ 2024-04-12 08:31:37,195 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2101
+ 2024-04-12 08:31:40,122 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2102
+ 2024-04-12 08:31:45,123 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2103
+ 2024-04-12 08:31:45,130 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2104
+ 2024-04-12 08:31:46,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2105
+ 2024-04-12 08:31:46,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2106
+ 2024-04-12 08:31:46,523 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2107
+ 2024-04-12 08:31:50,653 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2108
+ 2024-04-12 08:31:55,653 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2109
+ 2024-04-12 08:31:58,282 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2110
+ 2024-04-12 08:31:58,284 DEBUG SenderThread:485 [sender.py:send():379] send: history
2111
+ 2024-04-12 08:31:58,284 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2112
+ 2024-04-12 08:31:58,285 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2113
+ 2024-04-12 08:31:59,203 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2114
+ 2024-04-12 08:32:01,003 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2115
+ 2024-04-12 08:32:01,204 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2116
+ 2024-04-12 08:32:01,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2117
+ 2024-04-12 08:32:01,523 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2118
+ 2024-04-12 08:32:01,564 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2119
+ 2024-04-12 08:32:06,646 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2120
+ 2024-04-12 08:32:11,647 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2121
+ 2024-04-12 08:32:15,132 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2122
+ 2024-04-12 08:32:16,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2123
+ 2024-04-12 08:32:16,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2124
+ 2024-04-12 08:32:16,523 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2125
+ 2024-04-12 08:32:17,614 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2126
+ 2024-04-12 08:32:22,615 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2127
+ 2024-04-12 08:32:22,957 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2128
+ 2024-04-12 08:32:22,959 DEBUG SenderThread:485 [sender.py:send():379] send: history
2129
+ 2024-04-12 08:32:22,959 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2130
+ 2024-04-12 08:32:22,960 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2131
+ 2024-04-12 08:32:23,213 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2132
+ 2024-04-12 08:32:25,214 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2133
+ 2024-04-12 08:32:27,687 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2134
+ 2024-04-12 08:32:31,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2135
+ 2024-04-12 08:32:31,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2136
+ 2024-04-12 08:32:31,523 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2137
+ 2024-04-12 08:32:33,614 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2138
+ 2024-04-12 08:32:38,615 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2139
+ 2024-04-12 08:32:43,616 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2140
+ 2024-04-12 08:32:45,133 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2141
+ 2024-04-12 08:32:46,435 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2142
+ 2024-04-12 08:32:46,437 DEBUG SenderThread:485 [sender.py:send():379] send: history
2143
+ 2024-04-12 08:32:46,437 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2144
+ 2024-04-12 08:32:46,437 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2145
+ 2024-04-12 08:32:46,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2146
+ 2024-04-12 08:32:46,523 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2147
+ 2024-04-12 08:32:46,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2148
+ 2024-04-12 08:32:47,224 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2149
+ 2024-04-12 08:32:49,158 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2150
+ 2024-04-12 08:32:49,225 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2151
+ 2024-04-12 08:32:54,159 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2152
+ 2024-04-12 08:32:59,160 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2153
+ 2024-04-12 08:33:01,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2154
+ 2024-04-12 08:33:01,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2155
+ 2024-04-12 08:33:01,524 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2156
+ 2024-04-12 08:33:04,594 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2157
+ 2024-04-12 08:33:09,595 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2158
+ 2024-04-12 08:33:09,888 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2159
+ 2024-04-12 08:33:09,894 DEBUG SenderThread:485 [sender.py:send():379] send: history
2160
+ 2024-04-12 08:33:09,894 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2161
+ 2024-04-12 08:33:09,894 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2162
+ 2024-04-12 08:33:10,234 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2163
+ 2024-04-12 08:33:11,234 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2164
+ 2024-04-12 08:33:14,744 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2165
+ 2024-04-12 08:33:15,134 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2166
+ 2024-04-12 08:33:16,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2167
+ 2024-04-12 08:33:16,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2168
+ 2024-04-12 08:33:16,524 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2169
+ 2024-04-12 08:33:20,569 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2170
+ 2024-04-12 08:33:25,570 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2171
+ 2024-04-12 08:33:30,571 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2172
+ 2024-04-12 08:33:31,336 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2173
+ 2024-04-12 08:33:31,338 DEBUG SenderThread:485 [sender.py:send():379] send: history
2174
+ 2024-04-12 08:33:31,338 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2175
+ 2024-04-12 08:33:31,338 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2176
+ 2024-04-12 08:33:31,797 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2177
+ 2024-04-12 08:33:31,797 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2178
+ 2024-04-12 08:33:31,798 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2179
+ 2024-04-12 08:33:32,242 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2180
+ 2024-04-12 08:33:33,243 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2181
+ 2024-04-12 08:33:36,079 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2182
+ 2024-04-12 08:33:41,080 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2183
+ 2024-04-12 08:33:45,135 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2184
+ 2024-04-12 08:33:46,136 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2185
+ 2024-04-12 08:33:46,761 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2186
+ 2024-04-12 08:33:46,761 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2187
+ 2024-04-12 08:33:46,802 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2188
+ 2024-04-12 08:33:51,831 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2189
+ 2024-04-12 08:33:56,832 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2190
+ 2024-04-12 08:33:58,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2191
+ 2024-04-12 08:33:58,389 DEBUG SenderThread:485 [sender.py:send():379] send: history
2192
+ 2024-04-12 08:33:58,389 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2193
+ 2024-04-12 08:33:58,390 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2194
+ 2024-04-12 08:33:59,253 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2195
+ 2024-04-12 08:34:01,254 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2196
+ 2024-04-12 08:34:01,761 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2197
+ 2024-04-12 08:34:01,761 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2198
+ 2024-04-12 08:34:01,802 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2199
+ 2024-04-12 08:34:02,806 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2200
+ 2024-04-12 08:34:07,807 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2201
+ 2024-04-12 08:34:12,808 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2202
+ 2024-04-12 08:34:15,136 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2203
+ 2024-04-12 08:34:16,761 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2204
+ 2024-04-12 08:34:16,761 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2205
+ 2024-04-12 08:34:16,802 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2206
+ 2024-04-12 08:34:17,897 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2207
+ 2024-04-12 08:34:22,665 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2208
+ 2024-04-12 08:34:22,666 DEBUG SenderThread:485 [sender.py:send():379] send: history
2209
+ 2024-04-12 08:34:22,666 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2210
+ 2024-04-12 08:34:22,666 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2211
+ 2024-04-12 08:34:23,263 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2212
+ 2024-04-12 08:34:23,439 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240412_074044-widovcn3/files/output.log CHANGED
@@ -234,4 +234,28 @@
234
  warnings.warn(
235
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
236
  warnings.warn(
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
237
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
 
234
  warnings.warn(
235
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
236
  warnings.warn(
237
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
238
+ warnings.warn(
239
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
240
+ warnings.warn(
241
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
242
+ warnings.warn(
243
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
244
+ warnings.warn(
245
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
246
+ warnings.warn(
247
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
248
+ warnings.warn(
249
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
250
+ warnings.warn(
251
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
252
+ warnings.warn(
253
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
254
+ warnings.warn(
255
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
256
+ warnings.warn(
257
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
258
+ warnings.warn(
259
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
260
+ warnings.warn(
261
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
wandb/run-20240412_074044-widovcn3/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 3.5974, "train/grad_norm": 31.878395080566406, "train/learning_rate": 2.9394880643660242e-05, "train/epoch": 0.19, "train/global_step": 2360, "_timestamp": 1712910545.158962, "_runtime": 2900.6512439250946, "_step": 117}
 
1
+ {"train/loss": 3.621, "train/grad_norm": 25.755775451660156, "train/learning_rate": 2.920460247795056e-05, "train/epoch": 0.21, "train/global_step": 2620, "_timestamp": 1712910862.664395, "_runtime": 3218.156677007675, "_step": 130}
wandb/run-20240412_074044-widovcn3/logs/debug-internal.log CHANGED
@@ -1997,3 +1997,216 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
1997
  2024-04-12 08:29:05,161 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
1998
  2024-04-12 08:29:05,161 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
1999
  2024-04-12 08:29:06,134 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1997
  2024-04-12 08:29:05,161 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
1998
  2024-04-12 08:29:05,161 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
1999
  2024-04-12 08:29:06,134 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2000
+ 2024-04-12 08:29:07,135 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2001
+ 2024-04-12 08:29:08,989 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2002
+ 2024-04-12 08:29:13,991 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2003
+ 2024-04-12 08:29:15,124 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2004
+ 2024-04-12 08:29:16,521 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2005
+ 2024-04-12 08:29:16,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2006
+ 2024-04-12 08:29:16,522 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2007
+ 2024-04-12 08:29:19,600 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2008
+ 2024-04-12 08:29:24,601 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2009
+ 2024-04-12 08:29:29,602 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2010
+ 2024-04-12 08:29:31,520 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2011
+ 2024-04-12 08:29:31,521 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2012
+ 2024-04-12 08:29:31,521 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2013
+ 2024-04-12 08:29:32,263 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2014
+ 2024-04-12 08:29:32,264 DEBUG SenderThread:485 [sender.py:send():379] send: history
2015
+ 2024-04-12 08:29:32,264 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2016
+ 2024-04-12 08:29:32,265 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2017
+ 2024-04-12 08:29:33,145 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2018
+ 2024-04-12 08:29:35,049 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2019
+ 2024-04-12 08:29:35,145 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2020
+ 2024-04-12 08:29:40,050 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2021
+ 2024-04-12 08:29:45,051 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2022
+ 2024-04-12 08:29:45,125 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2023
+ 2024-04-12 08:29:46,520 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2024
+ 2024-04-12 08:29:46,521 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2025
+ 2024-04-12 08:29:46,521 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2026
+ 2024-04-12 08:29:50,564 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2027
+ 2024-04-12 08:29:55,565 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2028
+ 2024-04-12 08:29:55,761 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2029
+ 2024-04-12 08:29:55,762 DEBUG SenderThread:485 [sender.py:send():379] send: history
2030
+ 2024-04-12 08:29:55,762 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2031
+ 2024-04-12 08:29:55,763 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2032
+ 2024-04-12 08:29:56,154 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2033
+ 2024-04-12 08:29:57,154 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2034
+ 2024-04-12 08:30:01,520 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2035
+ 2024-04-12 08:30:01,521 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2036
+ 2024-04-12 08:30:01,521 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2037
+ 2024-04-12 08:30:01,522 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2038
+ 2024-04-12 08:30:06,578 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2039
+ 2024-04-12 08:30:11,579 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2040
+ 2024-04-12 08:30:15,127 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2041
+ 2024-04-12 08:30:16,521 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2042
+ 2024-04-12 08:30:16,521 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2043
+ 2024-04-12 08:30:16,521 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2044
+ 2024-04-12 08:30:16,640 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2045
+ 2024-04-12 08:30:21,641 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2046
+ 2024-04-12 08:30:25,139 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2047
+ 2024-04-12 08:30:25,140 DEBUG SenderThread:485 [sender.py:send():379] send: history
2048
+ 2024-04-12 08:30:25,140 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2049
+ 2024-04-12 08:30:25,141 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2050
+ 2024-04-12 08:30:25,166 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2051
+ 2024-04-12 08:30:26,878 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2052
+ 2024-04-12 08:30:27,167 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2053
+ 2024-04-12 08:30:31,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2054
+ 2024-04-12 08:30:31,523 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2055
+ 2024-04-12 08:30:31,525 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2056
+ 2024-04-12 08:30:32,557 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2057
+ 2024-04-12 08:30:37,559 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2058
+ 2024-04-12 08:30:42,560 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2059
+ 2024-04-12 08:30:45,128 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2060
+ 2024-04-12 08:30:46,521 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2061
+ 2024-04-12 08:30:46,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2062
+ 2024-04-12 08:30:46,522 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2063
+ 2024-04-12 08:30:47,628 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2064
+ 2024-04-12 08:30:48,429 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2065
+ 2024-04-12 08:30:48,430 DEBUG SenderThread:485 [sender.py:send():379] send: history
2066
+ 2024-04-12 08:30:48,430 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2067
+ 2024-04-12 08:30:48,431 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2068
+ 2024-04-12 08:30:49,176 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2069
+ 2024-04-12 08:30:51,177 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2070
+ 2024-04-12 08:30:53,277 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2071
+ 2024-04-12 08:30:58,278 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2072
+ 2024-04-12 08:31:01,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2073
+ 2024-04-12 08:31:01,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2074
+ 2024-04-12 08:31:01,524 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2075
+ 2024-04-12 08:31:03,571 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2076
+ 2024-04-12 08:31:08,572 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2077
+ 2024-04-12 08:31:11,181 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2078
+ 2024-04-12 08:31:11,183 DEBUG SenderThread:485 [sender.py:send():379] send: history
2079
+ 2024-04-12 08:31:11,183 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2080
+ 2024-04-12 08:31:11,183 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2081
+ 2024-04-12 08:31:11,185 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2082
+ 2024-04-12 08:31:13,185 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2083
+ 2024-04-12 08:31:13,902 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2084
+ 2024-04-12 08:31:15,129 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2085
+ 2024-04-12 08:31:16,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2086
+ 2024-04-12 08:31:16,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2087
+ 2024-04-12 08:31:16,523 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2088
+ 2024-04-12 08:31:19,605 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2089
+ 2024-04-12 08:31:24,606 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2090
+ 2024-04-12 08:31:29,607 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2091
+ 2024-04-12 08:31:31,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2092
+ 2024-04-12 08:31:31,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2093
+ 2024-04-12 08:31:31,524 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2094
+ 2024-04-12 08:31:34,407 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2095
+ 2024-04-12 08:31:34,408 DEBUG SenderThread:485 [sender.py:send():379] send: history
2096
+ 2024-04-12 08:31:34,408 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2097
+ 2024-04-12 08:31:34,409 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2098
+ 2024-04-12 08:31:35,121 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2099
+ 2024-04-12 08:31:35,194 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2100
+ 2024-04-12 08:31:37,195 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2101
+ 2024-04-12 08:31:40,122 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2102
+ 2024-04-12 08:31:45,123 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2103
+ 2024-04-12 08:31:45,130 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2104
+ 2024-04-12 08:31:46,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2105
+ 2024-04-12 08:31:46,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2106
+ 2024-04-12 08:31:46,523 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2107
+ 2024-04-12 08:31:50,653 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2108
+ 2024-04-12 08:31:55,653 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2109
+ 2024-04-12 08:31:58,282 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2110
+ 2024-04-12 08:31:58,284 DEBUG SenderThread:485 [sender.py:send():379] send: history
2111
+ 2024-04-12 08:31:58,284 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2112
+ 2024-04-12 08:31:58,285 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2113
+ 2024-04-12 08:31:59,203 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2114
+ 2024-04-12 08:32:01,003 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2115
+ 2024-04-12 08:32:01,204 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2116
+ 2024-04-12 08:32:01,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2117
+ 2024-04-12 08:32:01,523 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2118
+ 2024-04-12 08:32:01,564 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2119
+ 2024-04-12 08:32:06,646 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2120
+ 2024-04-12 08:32:11,647 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2121
+ 2024-04-12 08:32:15,132 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2122
+ 2024-04-12 08:32:16,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2123
+ 2024-04-12 08:32:16,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2124
+ 2024-04-12 08:32:16,523 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2125
+ 2024-04-12 08:32:17,614 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2126
+ 2024-04-12 08:32:22,615 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2127
+ 2024-04-12 08:32:22,957 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2128
+ 2024-04-12 08:32:22,959 DEBUG SenderThread:485 [sender.py:send():379] send: history
2129
+ 2024-04-12 08:32:22,959 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2130
+ 2024-04-12 08:32:22,960 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2131
+ 2024-04-12 08:32:23,213 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2132
+ 2024-04-12 08:32:25,214 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2133
+ 2024-04-12 08:32:27,687 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2134
+ 2024-04-12 08:32:31,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2135
+ 2024-04-12 08:32:31,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2136
+ 2024-04-12 08:32:31,523 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2137
+ 2024-04-12 08:32:33,614 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2138
+ 2024-04-12 08:32:38,615 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2139
+ 2024-04-12 08:32:43,616 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2140
+ 2024-04-12 08:32:45,133 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2141
+ 2024-04-12 08:32:46,435 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2142
+ 2024-04-12 08:32:46,437 DEBUG SenderThread:485 [sender.py:send():379] send: history
2143
+ 2024-04-12 08:32:46,437 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2144
+ 2024-04-12 08:32:46,437 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2145
+ 2024-04-12 08:32:46,522 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2146
+ 2024-04-12 08:32:46,523 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2147
+ 2024-04-12 08:32:46,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2148
+ 2024-04-12 08:32:47,224 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2149
+ 2024-04-12 08:32:49,158 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2150
+ 2024-04-12 08:32:49,225 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2151
+ 2024-04-12 08:32:54,159 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2152
+ 2024-04-12 08:32:59,160 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2153
+ 2024-04-12 08:33:01,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2154
+ 2024-04-12 08:33:01,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2155
+ 2024-04-12 08:33:01,524 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2156
+ 2024-04-12 08:33:04,594 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2157
+ 2024-04-12 08:33:09,595 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2158
+ 2024-04-12 08:33:09,888 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2159
+ 2024-04-12 08:33:09,894 DEBUG SenderThread:485 [sender.py:send():379] send: history
2160
+ 2024-04-12 08:33:09,894 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2161
+ 2024-04-12 08:33:09,894 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2162
+ 2024-04-12 08:33:10,234 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2163
+ 2024-04-12 08:33:11,234 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2164
+ 2024-04-12 08:33:14,744 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2165
+ 2024-04-12 08:33:15,134 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2166
+ 2024-04-12 08:33:16,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2167
+ 2024-04-12 08:33:16,523 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2168
+ 2024-04-12 08:33:16,524 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2169
+ 2024-04-12 08:33:20,569 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2170
+ 2024-04-12 08:33:25,570 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2171
+ 2024-04-12 08:33:30,571 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2172
+ 2024-04-12 08:33:31,336 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2173
+ 2024-04-12 08:33:31,338 DEBUG SenderThread:485 [sender.py:send():379] send: history
2174
+ 2024-04-12 08:33:31,338 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2175
+ 2024-04-12 08:33:31,338 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2176
+ 2024-04-12 08:33:31,797 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2177
+ 2024-04-12 08:33:31,797 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2178
+ 2024-04-12 08:33:31,798 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2179
+ 2024-04-12 08:33:32,242 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2180
+ 2024-04-12 08:33:33,243 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2181
+ 2024-04-12 08:33:36,079 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2182
+ 2024-04-12 08:33:41,080 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2183
+ 2024-04-12 08:33:45,135 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2184
+ 2024-04-12 08:33:46,136 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2185
+ 2024-04-12 08:33:46,761 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2186
+ 2024-04-12 08:33:46,761 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2187
+ 2024-04-12 08:33:46,802 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2188
+ 2024-04-12 08:33:51,831 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2189
+ 2024-04-12 08:33:56,832 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2190
+ 2024-04-12 08:33:58,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2191
+ 2024-04-12 08:33:58,389 DEBUG SenderThread:485 [sender.py:send():379] send: history
2192
+ 2024-04-12 08:33:58,389 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2193
+ 2024-04-12 08:33:58,390 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2194
+ 2024-04-12 08:33:59,253 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2195
+ 2024-04-12 08:34:01,254 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
2196
+ 2024-04-12 08:34:01,761 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2197
+ 2024-04-12 08:34:01,761 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2198
+ 2024-04-12 08:34:01,802 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2199
+ 2024-04-12 08:34:02,806 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2200
+ 2024-04-12 08:34:07,807 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2201
+ 2024-04-12 08:34:12,808 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2202
+ 2024-04-12 08:34:15,136 DEBUG SenderThread:485 [sender.py:send():379] send: stats
2203
+ 2024-04-12 08:34:16,761 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
2204
+ 2024-04-12 08:34:16,761 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
2205
+ 2024-04-12 08:34:16,802 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
2206
+ 2024-04-12 08:34:17,897 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
2207
+ 2024-04-12 08:34:22,665 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
2208
+ 2024-04-12 08:34:22,666 DEBUG SenderThread:485 [sender.py:send():379] send: history
2209
+ 2024-04-12 08:34:22,666 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
2210
+ 2024-04-12 08:34:22,666 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2211
+ 2024-04-12 08:34:23,263 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
2212
+ 2024-04-12 08:34:23,439 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb CHANGED
Binary files a/wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb and b/wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb differ