2024-04-08 18:22:43,862 INFO StreamThr :158 [internal.py:wandb_internal():86] W&B internal server running at pid: 158, started at: 2024-04-08 18:22:43.861842 2024-04-08 18:22:43,864 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status 2024-04-08 18:22:44,398 INFO WriterThread:158 [datastore.py:open_for_write():87] open: /kaggle/working/wandb/run-20240408_182243-93ndfgce/run-93ndfgce.wandb 2024-04-08 18:22:44,398 DEBUG SenderThread:158 [sender.py:send():378] send: header 2024-04-08 18:22:44,401 DEBUG SenderThread:158 [sender.py:send():378] send: run 2024-04-08 18:22:44,626 INFO SenderThread:158 [dir_watcher.py:__init__():211] watching files in: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files 2024-04-08 18:22:44,626 INFO SenderThread:158 [sender.py:_start_run_threads():1099] run started: 93ndfgce with start time 1712600563.863812 2024-04-08 18:22:44,634 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: check_version 2024-04-08 18:22:44,634 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: check_version 2024-04-08 18:22:44,702 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: run_start 2024-04-08 18:22:44,713 DEBUG HandlerThread:158 [system_info.py:__init__():26] System info init 2024-04-08 18:22:44,713 DEBUG HandlerThread:158 [system_info.py:__init__():41] System info init done 2024-04-08 18:22:44,713 INFO HandlerThread:158 [system_monitor.py:start():194] Starting system monitor 2024-04-08 18:22:44,713 INFO SystemMonitor:158 [system_monitor.py:_start():158] Starting system asset monitoring threads 2024-04-08 18:22:44,714 INFO HandlerThread:158 [system_monitor.py:probe():214] Collecting system info 2024-04-08 18:22:44,714 INFO SystemMonitor:158 [interfaces.py:start():190] Started cpu monitoring 2024-04-08 18:22:44,715 INFO SystemMonitor:158 [interfaces.py:start():190] Started disk monitoring 2024-04-08 18:22:44,715 INFO SystemMonitor:158 [interfaces.py:start():190] Started gpu monitoring 2024-04-08 18:22:44,716 INFO SystemMonitor:158 [interfaces.py:start():190] Started memory monitoring 2024-04-08 18:22:44,717 INFO SystemMonitor:158 [interfaces.py:start():190] Started network monitoring 2024-04-08 18:22:44,727 DEBUG HandlerThread:158 [system_info.py:probe():150] Probing system 2024-04-08 18:22:44,729 DEBUG HandlerThread:158 [gitlib.py:_init_repo():56] git repository is invalid 2024-04-08 18:22:44,729 DEBUG HandlerThread:158 [system_info.py:probe():198] Probing system done 2024-04-08 18:22:44,729 DEBUG HandlerThread:158 [system_monitor.py:probe():223] {'os': 'Linux-5.15.133+-x86_64-with-glibc2.31', 'python': '3.10.13', 'heartbeatAt': '2024-04-08T18:22:44.727527', 'startedAt': '2024-04-08T18:22:43.855755', 'docker': None, 'cuda': None, 'args': (), 'state': 'running', 'program': 'kaggle.ipynb', 'codePathLocal': None, 'root': '/kaggle/working', 'host': '9d8ae58bd3dc', 'username': 'root', 'executable': '/opt/conda/bin/python3.10', 'cpu_count': 2, 'cpu_count_logical': 4, 'cpu_freq': {'current': 2000.122, 'min': 0.0, 'max': 0.0}, 'cpu_freq_per_core': [{'current': 2000.122, 'min': 0.0, 'max': 0.0}, {'current': 2000.122, 'min': 0.0, 'max': 0.0}, {'current': 2000.122, 'min': 0.0, 'max': 0.0}, {'current': 2000.122, 'min': 0.0, 'max': 0.0}], 'disk': {'/': {'total': 8062.387607574463, 'used': 5568.723934173584}}, 'gpu': 'Tesla T4', 'gpu_count': 2, 'gpu_devices': [{'name': 'Tesla T4', 'memory_total': 16106127360}, {'name': 'Tesla T4', 'memory_total': 16106127360}], 'memory': {'total': 31.357559204101562}} 2024-04-08 18:22:44,729 INFO HandlerThread:158 [system_monitor.py:probe():224] Finished collecting system info 2024-04-08 18:22:44,729 INFO HandlerThread:158 [system_monitor.py:probe():227] Publishing system info 2024-04-08 18:22:44,729 DEBUG HandlerThread:158 [system_info.py:_save_conda():207] Saving list of conda packages installed into the current environment 2024-04-08 18:22:45,628 INFO Thread-12 :158 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/conda-environment.yaml 2024-04-08 18:23:40,634 DEBUG HandlerThread:158 [system_info.py:_save_conda():219] Saving conda packages done 2024-04-08 18:23:40,635 INFO HandlerThread:158 [system_monitor.py:probe():229] Finished publishing system info 2024-04-08 18:23:40,644 INFO Thread-12 :158 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/conda-environment.yaml 2024-04-08 18:23:40,644 INFO Thread-12 :158 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/wandb-metadata.json 2024-04-08 18:23:40,649 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:23:40,650 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:23:40,650 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:23:40,650 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:23:40,650 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:23:40,651 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:23:40,651 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:23:40,651 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:23:40,651 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:23:40,651 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:23:40,651 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:23:40,652 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: python_packages 2024-04-08 18:23:40,652 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: stop_status 2024-04-08 18:23:40,652 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: python_packages 2024-04-08 18:23:40,653 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: internal_messages 2024-04-08 18:23:40,657 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: stop_status 2024-04-08 18:23:40,657 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:23:40,661 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:23:40,661 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:23:40,661 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:23:40,661 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:23:40,661 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:23:40,662 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:23:40,662 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:23:40,662 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:23:40,662 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:23:40,757 DEBUG SenderThread:158 [sender.py:send():378] send: telemetry 2024-04-08 18:23:40,757 DEBUG SenderThread:158 [sender.py:send():378] send: config 2024-04-08 18:23:40,759 DEBUG SenderThread:158 [sender.py:send():378] send: metric 2024-04-08 18:23:40,759 DEBUG SenderThread:158 [sender.py:send():378] send: telemetry 2024-04-08 18:23:40,759 DEBUG SenderThread:158 [sender.py:send():378] send: metric 2024-04-08 18:23:40,759 WARNING SenderThread:158 [sender.py:send_metric():1316] Seen metric with glob (shouldn't happen) 2024-04-08 18:23:40,759 DEBUG SenderThread:158 [sender.py:send():378] send: telemetry 2024-04-08 18:23:40,760 DEBUG SenderThread:158 [sender.py:send():378] send: files 2024-04-08 18:23:40,760 INFO SenderThread:158 [sender.py:_save_file():1365] saving file wandb-metadata.json with policy now 2024-04-08 18:23:41,047 INFO wandb-upload_0:158 [upload_job.py:push():131] Uploaded file /tmp/tmpubn4nx1dwandb/8h65w2bf-wandb-metadata.json 2024-04-08 18:23:41,645 INFO Thread-12 :158 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/output.log 2024-04-08 18:23:41,645 INFO Thread-12 :158 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/requirements.txt 2024-04-08 18:23:41,766 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:23:43,645 INFO Thread-12 :158 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/output.log 2024-04-08 18:23:44,717 DEBUG SystemMonitor:158 [system_monitor.py:_start():172] Starting system metrics aggregation loop 2024-04-08 18:23:44,719 DEBUG SenderThread:158 [sender.py:send():378] send: stats 2024-04-08 18:23:44,725 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:23:45,646 INFO Thread-12 :158 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/config.yaml 2024-04-08 18:23:46,767 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:23:49,873 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:23:51,499 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: partial_history 2024-04-08 18:23:51,501 DEBUG SenderThread:158 [sender.py:send():378] send: metric 2024-04-08 18:23:51,501 DEBUG SenderThread:158 [sender.py:send():378] send: metric 2024-04-08 18:23:51,501 DEBUG SenderThread:158 [sender.py:send():378] send: metric 2024-04-08 18:23:51,502 DEBUG SenderThread:158 [sender.py:send():378] send: metric 2024-04-08 18:23:51,502 DEBUG SenderThread:158 [sender.py:send():378] send: history 2024-04-08 18:23:51,502 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: summary_record 2024-04-08 18:23:51,502 INFO SenderThread:158 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end 2024-04-08 18:23:51,649 INFO Thread-12 :158 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/wandb-summary.json 2024-04-08 18:23:51,768 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:23:53,650 INFO Thread-12 :158 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/output.log 2024-04-08 18:23:55,429 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:23:55,651 INFO Thread-12 :158 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/output.log 2024-04-08 18:23:56,784 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:24:00,430 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:24:01,795 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:24:05,431 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:24:06,796 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:24:10,432 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:24:11,803 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:24:14,720 DEBUG SenderThread:158 [sender.py:send():378] send: stats 2024-04-08 18:24:15,726 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:24:16,662 INFO Thread-12 :158 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/config.yaml 2024-04-08 18:24:16,804 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:24:20,853 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:24:21,467 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: partial_history 2024-04-08 18:24:21,469 DEBUG SenderThread:158 [sender.py:send():378] send: history 2024-04-08 18:24:21,469 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: summary_record 2024-04-08 18:24:21,471 INFO SenderThread:158 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end 2024-04-08 18:24:21,664 INFO Thread-12 :158 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/wandb-summary.json 2024-04-08 18:24:21,812 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:24:23,665 INFO Thread-12 :158 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/output.log 2024-04-08 18:24:25,665 INFO Thread-12 :158 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/output.log 2024-04-08 18:24:26,376 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:24:26,819 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:24:31,377 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:24:31,825 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:24:36,378 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:24:36,831 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:24:41,379 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:24:41,832 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:24:44,721 DEBUG SenderThread:158 [sender.py:send():378] send: stats 2024-04-08 18:24:46,721 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:24:46,840 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:24:47,715 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: pause 2024-04-08 18:24:47,715 INFO HandlerThread:158 [handler.py:handle_request_pause():708] stopping system metrics thread 2024-04-08 18:24:47,716 INFO HandlerThread:158 [system_monitor.py:finish():203] Stopping system monitor 2024-04-08 18:24:47,716 DEBUG SystemMonitor:158 [system_monitor.py:_start():179] Finished system metrics aggregation loop 2024-04-08 18:24:47,716 DEBUG SystemMonitor:158 [system_monitor.py:_start():183] Publishing last batch of metrics 2024-04-08 18:24:47,716 INFO HandlerThread:158 [interfaces.py:finish():202] Joined cpu monitor 2024-04-08 18:24:47,718 INFO HandlerThread:158 [interfaces.py:finish():202] Joined disk monitor 2024-04-08 18:24:47,728 INFO HandlerThread:158 [interfaces.py:finish():202] Joined gpu monitor 2024-04-08 18:24:47,728 INFO HandlerThread:158 [interfaces.py:finish():202] Joined memory monitor 2024-04-08 18:24:47,729 INFO HandlerThread:158 [interfaces.py:finish():202] Joined network monitor 2024-04-08 18:24:47,729 DEBUG SenderThread:158 [sender.py:send():378] send: stats 2024-04-08 18:24:51,730 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:24:51,862 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:24:56,731 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:24:56,863 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:25:01,732 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:25:01,865 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:25:06,733 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:25:06,866 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:25:11,734 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:25:11,867 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:25:16,735 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:25:16,868 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:25:21,736 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:25:21,869 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:25:26,737 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:25:26,870 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:25:31,738 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:25:31,871 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:25:36,738 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:25:36,872 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:25:41,739 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:25:41,873 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:25:46,740 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:25:46,874 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:25:51,741 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:25:51,875 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:25:56,742 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:25:56,877 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:26:01,743 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:26:01,878 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:26:06,744 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:26:06,879 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:26:11,745 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:26:11,880 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:26:16,746 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:26:16,881 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:26:21,747 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:26:21,882 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:26:24,085 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: resume 2024-04-08 18:26:24,085 INFO HandlerThread:158 [handler.py:handle_request_resume():699] starting system metrics thread 2024-04-08 18:26:24,085 INFO HandlerThread:158 [system_monitor.py:start():194] Starting system monitor 2024-04-08 18:26:24,085 INFO SystemMonitor:158 [system_monitor.py:_start():158] Starting system asset monitoring threads 2024-04-08 18:26:24,086 INFO SystemMonitor:158 [interfaces.py:start():190] Started cpu monitoring 2024-04-08 18:26:24,087 INFO SystemMonitor:158 [interfaces.py:start():190] Started disk monitoring 2024-04-08 18:26:24,088 INFO SystemMonitor:158 [interfaces.py:start():190] Started gpu monitoring 2024-04-08 18:26:24,089 INFO SystemMonitor:158 [interfaces.py:start():190] Started memory monitoring 2024-04-08 18:26:24,090 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: pause 2024-04-08 18:26:24,090 INFO HandlerThread:158 [handler.py:handle_request_pause():708] stopping system metrics thread 2024-04-08 18:26:24,090 INFO SystemMonitor:158 [interfaces.py:start():190] Started network monitoring 2024-04-08 18:26:24,091 INFO HandlerThread:158 [system_monitor.py:finish():203] Stopping system monitor 2024-04-08 18:26:24,091 DEBUG SystemMonitor:158 [system_monitor.py:_start():172] Starting system metrics aggregation loop 2024-04-08 18:26:24,091 DEBUG SystemMonitor:158 [system_monitor.py:_start():179] Finished system metrics aggregation loop 2024-04-08 18:26:24,091 DEBUG SystemMonitor:158 [system_monitor.py:_start():183] Publishing last batch of metrics 2024-04-08 18:26:24,093 INFO HandlerThread:158 [interfaces.py:finish():202] Joined cpu monitor 2024-04-08 18:26:24,094 INFO HandlerThread:158 [interfaces.py:finish():202] Joined disk monitor 2024-04-08 18:26:24,113 INFO HandlerThread:158 [interfaces.py:finish():202] Joined gpu monitor 2024-04-08 18:26:24,113 INFO HandlerThread:158 [interfaces.py:finish():202] Joined memory monitor 2024-04-08 18:26:24,113 INFO HandlerThread:158 [interfaces.py:finish():202] Joined network monitor 2024-04-08 18:26:24,114 DEBUG SenderThread:158 [sender.py:send():378] send: stats 2024-04-08 18:26:26,884 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:26:27,114 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:26:31,885 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:26:32,116 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:26:36,886 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:26:37,117 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:26:41,887 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:26:42,118 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:26:46,888 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:26:47,119 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:26:51,889 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:26:52,120 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:26:56,890 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:26:57,121 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:27:01,892 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:27:02,122 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:27:06,892 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:27:07,123 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:27:11,894 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:27:12,124 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:27:16,895 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:27:17,125 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:27:21,895 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:27:22,126 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:27:26,897 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:27:27,127 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:27:31,898 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:27:32,128 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:27:36,899 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:27:37,129 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:27:41,900 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:27:42,130 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:27:46,901 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:27:47,131 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:27:51,903 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:27:52,132 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:27:56,904 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:27:57,133 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:28:01,905 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:28:02,134 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:28:06,906 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:28:07,135 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:28:11,907 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:28:12,136 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:28:16,908 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:28:17,136 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:28:21,909 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:28:22,137 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:28:26,910 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:28:27,138 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:28:31,911 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:28:32,139 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:28:36,912 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:28:37,140 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:28:41,914 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:28:42,141 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:28:46,915 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:28:47,142 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:28:51,916 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:28:52,143 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:28:56,917 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:28:57,144 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:29:01,919 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:29:02,145 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:29:06,920 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:29:07,146 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:29:11,921 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:29:12,147 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:29:16,922 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:29:17,148 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:29:21,923 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:29:22,149 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:29:26,924 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:29:27,150 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:29:31,925 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:29:32,151 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:29:36,927 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:29:37,152 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:29:41,927 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:29:42,153 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:29:46,929 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:29:47,154 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:29:51,930 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:29:52,155 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:29:56,931 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:29:57,156 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:30:01,932 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:30:02,157 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:30:06,933 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:30:07,159 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:30:11,934 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:30:12,160 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:30:16,935 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:30:17,161 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:30:21,936 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:30:22,162 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:30:26,937 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:30:27,164 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:30:31,938 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:30:32,165 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:30:36,940 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:30:37,166 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:30:41,941 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:30:42,167 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:30:46,942 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:30:47,167 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:30:51,943 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:30:52,169 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:30:56,944 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:30:57,170 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:31:01,945 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:31:02,171 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:31:06,947 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:31:07,172 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:31:11,948 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:31:12,174 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:31:16,949 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:31:17,175 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:31:18,809 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: resume 2024-04-08 18:31:18,809 INFO HandlerThread:158 [handler.py:handle_request_resume():699] starting system metrics thread 2024-04-08 18:31:18,809 INFO HandlerThread:158 [system_monitor.py:start():194] Starting system monitor 2024-04-08 18:31:18,810 INFO SystemMonitor:158 [system_monitor.py:_start():158] Starting system asset monitoring threads 2024-04-08 18:31:18,810 INFO SystemMonitor:158 [interfaces.py:start():190] Started cpu monitoring 2024-04-08 18:31:18,811 INFO SystemMonitor:158 [interfaces.py:start():190] Started disk monitoring 2024-04-08 18:31:18,813 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: pause 2024-04-08 18:31:18,813 INFO SystemMonitor:158 [interfaces.py:start():190] Started gpu monitoring 2024-04-08 18:31:18,813 INFO HandlerThread:158 [handler.py:handle_request_pause():708] stopping system metrics thread 2024-04-08 18:31:18,814 INFO HandlerThread:158 [system_monitor.py:finish():203] Stopping system monitor 2024-04-08 18:31:18,814 INFO HandlerThread:158 [interfaces.py:finish():202] Joined cpu monitor 2024-04-08 18:31:18,815 INFO HandlerThread:158 [interfaces.py:finish():202] Joined disk monitor 2024-04-08 18:31:18,815 INFO SystemMonitor:158 [interfaces.py:start():190] Started memory monitoring 2024-04-08 18:31:18,815 DEBUG SystemMonitor:158 [system_monitor.py:_start():172] Starting system metrics aggregation loop 2024-04-08 18:31:18,815 DEBUG SystemMonitor:158 [system_monitor.py:_start():179] Finished system metrics aggregation loop 2024-04-08 18:31:18,815 DEBUG SystemMonitor:158 [system_monitor.py:_start():183] Publishing last batch of metrics 2024-04-08 18:31:18,835 INFO HandlerThread:158 [interfaces.py:finish():202] Joined gpu monitor 2024-04-08 18:31:18,835 INFO HandlerThread:158 [interfaces.py:finish():202] Joined memory monitor 2024-04-08 18:31:18,836 DEBUG SenderThread:158 [sender.py:send():378] send: stats 2024-04-08 18:31:21,950 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:31:22,837 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:31:26,951 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:31:27,838 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:31:31,952 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:31:32,839 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:31:36,953 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:31:37,840 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:31:41,954 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:31:42,840 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:31:46,955 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:31:47,841 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:31:51,957 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:31:52,842 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:31:56,958 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:31:57,843 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:32:01,959 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:32:02,844 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:32:06,960 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:32:07,844 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:32:11,961 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:32:12,845 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:32:16,962 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:32:17,846 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:32:21,963 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:32:22,846 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:32:26,964 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:32:27,847 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:32:31,965 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:32:32,847 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:32:36,967 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:32:37,848 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:32:41,968 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:32:42,849 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:32:46,969 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:32:47,849 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:32:51,970 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:32:52,850 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:32:56,971 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:32:57,851 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:33:01,973 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:33:02,852 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:33:06,974 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:33:07,853 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:33:11,975 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:33:12,854 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:33:16,976 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:33:17,855 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:33:21,977 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:33:22,856 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:33:26,978 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:33:27,857 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:33:31,979 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:33:32,857 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:33:36,981 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:33:37,858 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:33:41,982 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:33:42,859 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:33:46,983 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:33:47,859 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:33:51,984 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:33:52,860 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:33:56,985 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:33:57,861 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:34:01,987 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:34:02,862 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:34:06,988 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:34:07,863 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:34:11,989 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:34:12,863 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:34:16,990 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:34:17,864 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:34:21,991 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:34:22,865 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:34:26,992 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:34:27,866 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:34:31,993 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:34:32,866 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:34:36,994 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:34:37,867 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:34:41,995 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:34:42,868 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:34:46,997 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:34:47,868 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:34:51,998 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:34:52,869 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:34:56,999 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:34:57,870 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:35:02,000 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:35:02,871 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:35:07,002 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:35:07,873 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:35:12,003 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:35:12,873 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:35:17,004 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:35:17,874 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:35:22,005 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:35:22,875 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:35:27,006 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:35:27,876 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:35:32,007 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:35:32,877 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:35:37,008 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:35:37,878 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:35:42,009 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:35:42,879 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:35:47,010 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:35:47,880 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:35:52,011 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:35:52,881 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:35:57,013 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:35:57,881 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:36:02,014 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:36:02,882 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:36:07,015 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:36:07,884 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:36:12,016 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:36:12,884 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:36:17,017 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:36:17,885 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:36:22,018 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:36:22,886 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:36:27,019 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:36:27,887 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:36:32,021 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:36:32,888 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:36:37,022 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:36:37,889 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:36:42,023 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:36:42,889 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:36:47,024 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:36:47,890 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:36:52,025 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:36:52,891 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:36:57,026 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:36:57,892 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:37:02,027 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:37:02,893 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:37:07,029 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:37:07,894 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:37:12,030 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:37:12,895 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:37:17,031 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:37:17,895 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:37:22,032 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:37:22,897 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:37:27,033 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:37:27,898 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:37:32,034 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:37:32,898 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:37:37,035 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:37:37,900 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:37:42,036 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:37:42,900 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:37:47,037 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:37:47,901 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:37:52,038 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:37:52,902 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:37:57,040 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:37:57,903 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:38:02,041 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:38:02,904 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:38:07,042 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:38:07,904 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:38:12,043 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:38:12,905 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:38:17,044 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:38:17,905 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:38:22,045 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:38:22,906 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:38:27,046 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:38:27,907 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:38:32,047 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:38:32,907 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:38:37,048 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:38:37,908 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:38:42,049 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:38:42,909 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:38:47,051 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:38:47,909 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:38:52,052 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:38:52,910 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:38:57,053 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:38:57,911 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:39:02,054 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:39:02,912 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:39:07,055 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:39:07,913 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:39:12,057 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:39:12,913 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:39:17,058 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:39:17,914 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:39:22,059 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:39:22,915 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:39:27,060 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:39:27,916 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:39:32,061 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:39:32,917 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:39:37,062 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:39:37,918 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:39:42,063 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:39:42,918 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:39:47,064 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:39:47,919 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:39:52,065 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:39:52,920 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:39:57,067 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:39:57,921 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:40:02,068 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:40:02,921 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:40:07,069 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:40:07,922 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:40:12,070 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:40:12,923 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:40:17,071 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:40:17,923 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:40:22,072 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:40:22,924 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:40:27,073 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:40:27,925 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:40:32,074 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:40:32,925 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:40:37,075 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:40:37,926 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:40:42,076 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:40:42,926 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:40:47,078 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:40:47,927 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:40:52,079 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:40:52,928 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:40:57,080 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:40:57,929 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:41:02,081 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:41:02,929 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:41:07,082 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:41:07,931 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:41:12,084 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:41:12,932 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:41:17,085 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:41:17,933 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:41:22,086 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:41:22,934 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:41:27,087 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:41:27,935 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:41:32,088 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:41:32,935 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:41:37,089 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:41:37,936 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:41:42,090 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:41:42,937 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:41:47,091 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:41:47,938 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:41:52,092 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:41:52,939 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:41:57,093 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:41:57,940 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:42:02,094 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:42:02,941 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:42:07,096 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:42:07,943 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:42:12,097 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:42:12,944 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:42:17,098 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:42:17,945 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:42:22,099 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:42:22,946 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:42:27,100 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:42:27,947 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:42:31,825 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: resume 2024-04-08 18:42:31,825 INFO HandlerThread:158 [handler.py:handle_request_resume():699] starting system metrics thread 2024-04-08 18:42:31,825 INFO HandlerThread:158 [system_monitor.py:start():194] Starting system monitor 2024-04-08 18:42:31,825 INFO SystemMonitor:158 [system_monitor.py:_start():158] Starting system asset monitoring threads 2024-04-08 18:42:31,826 INFO SystemMonitor:158 [interfaces.py:start():190] Started cpu monitoring 2024-04-08 18:42:31,826 INFO SystemMonitor:158 [interfaces.py:start():190] Started disk monitoring 2024-04-08 18:42:31,829 INFO SystemMonitor:158 [interfaces.py:start():190] Started gpu monitoring 2024-04-08 18:42:31,829 INFO SystemMonitor:158 [interfaces.py:start():190] Started memory monitoring 2024-04-08 18:42:31,830 INFO SystemMonitor:158 [interfaces.py:start():190] Started network monitoring 2024-04-08 18:42:32,101 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:42:32,956 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:42:34,071 INFO Thread-12 :158 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/output.log 2024-04-08 18:42:35,072 INFO Thread-12 :158 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/output.log 2024-04-08 18:42:37,102 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:42:37,975 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:42:42,103 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:42:42,991 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:42:44,191 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: pause 2024-04-08 18:42:44,191 INFO HandlerThread:158 [handler.py:handle_request_pause():708] stopping system metrics thread 2024-04-08 18:42:44,191 INFO HandlerThread:158 [system_monitor.py:finish():203] Stopping system monitor 2024-04-08 18:42:44,191 INFO HandlerThread:158 [interfaces.py:finish():202] Joined cpu monitor 2024-04-08 18:42:44,192 INFO HandlerThread:158 [interfaces.py:finish():202] Joined disk monitor 2024-04-08 18:42:44,193 DEBUG SystemMonitor:158 [system_monitor.py:_start():172] Starting system metrics aggregation loop 2024-04-08 18:42:44,193 DEBUG SystemMonitor:158 [system_monitor.py:_start():179] Finished system metrics aggregation loop 2024-04-08 18:42:44,193 DEBUG SystemMonitor:158 [system_monitor.py:_start():183] Publishing last batch of metrics 2024-04-08 18:42:44,204 INFO HandlerThread:158 [interfaces.py:finish():202] Joined gpu monitor 2024-04-08 18:42:44,205 INFO HandlerThread:158 [interfaces.py:finish():202] Joined memory monitor 2024-04-08 18:42:44,205 INFO HandlerThread:158 [interfaces.py:finish():202] Joined network monitor 2024-04-08 18:42:44,205 DEBUG SenderThread:158 [sender.py:send():378] send: stats 2024-04-08 18:42:45,075 INFO Thread-12 :158 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/output.log 2024-04-08 18:42:47,104 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:42:48,206 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:42:52,105 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: keepalive 2024-04-08 18:42:52,632 DEBUG SenderThread:158 [sender.py:send():378] send: exit 2024-04-08 18:42:52,632 INFO SenderThread:158 [sender.py:send_exit():585] handling exit code: 0 2024-04-08 18:42:52,632 INFO SenderThread:158 [sender.py:send_exit():587] handling runtime: 135 2024-04-08 18:42:52,633 INFO SenderThread:158 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end 2024-04-08 18:42:52,633 INFO SenderThread:158 [sender.py:send_exit():593] send defer 2024-04-08 18:42:52,633 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: defer 2024-04-08 18:42:52,633 INFO HandlerThread:158 [handler.py:handle_request_defer():172] handle defer: 0 2024-04-08 18:42:52,633 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: defer 2024-04-08 18:42:52,633 INFO SenderThread:158 [sender.py:send_request_defer():609] handle sender defer: 0 2024-04-08 18:42:52,633 INFO SenderThread:158 [sender.py:transition_state():613] send defer: 1 2024-04-08 18:42:52,634 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: defer 2024-04-08 18:42:52,634 INFO HandlerThread:158 [handler.py:handle_request_defer():172] handle defer: 1 2024-04-08 18:42:52,634 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: defer 2024-04-08 18:42:52,634 INFO SenderThread:158 [sender.py:send_request_defer():609] handle sender defer: 1 2024-04-08 18:42:52,634 INFO SenderThread:158 [sender.py:transition_state():613] send defer: 2 2024-04-08 18:42:52,634 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: defer 2024-04-08 18:42:52,634 INFO HandlerThread:158 [handler.py:handle_request_defer():172] handle defer: 2 2024-04-08 18:42:52,634 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: defer 2024-04-08 18:42:52,634 INFO SenderThread:158 [sender.py:send_request_defer():609] handle sender defer: 2 2024-04-08 18:42:52,635 INFO SenderThread:158 [sender.py:transition_state():613] send defer: 3 2024-04-08 18:42:52,635 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: defer 2024-04-08 18:42:52,635 INFO HandlerThread:158 [handler.py:handle_request_defer():172] handle defer: 3 2024-04-08 18:42:52,635 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: defer 2024-04-08 18:42:52,635 INFO SenderThread:158 [sender.py:send_request_defer():609] handle sender defer: 3 2024-04-08 18:42:52,635 INFO SenderThread:158 [sender.py:transition_state():613] send defer: 4 2024-04-08 18:42:52,635 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: defer 2024-04-08 18:42:52,635 INFO HandlerThread:158 [handler.py:handle_request_defer():172] handle defer: 4 2024-04-08 18:42:52,635 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: defer 2024-04-08 18:42:52,636 INFO SenderThread:158 [sender.py:send_request_defer():609] handle sender defer: 4 2024-04-08 18:42:52,636 INFO SenderThread:158 [sender.py:transition_state():613] send defer: 5 2024-04-08 18:42:52,636 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: defer 2024-04-08 18:42:52,636 INFO HandlerThread:158 [handler.py:handle_request_defer():172] handle defer: 5 2024-04-08 18:42:52,636 DEBUG SenderThread:158 [sender.py:send():378] send: summary 2024-04-08 18:42:52,637 INFO SenderThread:158 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end 2024-04-08 18:42:52,637 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: defer 2024-04-08 18:42:52,637 INFO SenderThread:158 [sender.py:send_request_defer():609] handle sender defer: 5 2024-04-08 18:42:52,637 INFO SenderThread:158 [sender.py:transition_state():613] send defer: 6 2024-04-08 18:42:52,637 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: defer 2024-04-08 18:42:52,637 INFO HandlerThread:158 [handler.py:handle_request_defer():172] handle defer: 6 2024-04-08 18:42:52,637 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: defer 2024-04-08 18:42:52,637 INFO SenderThread:158 [sender.py:send_request_defer():609] handle sender defer: 6 2024-04-08 18:42:52,637 INFO SenderThread:158 [sender.py:transition_state():613] send defer: 7 2024-04-08 18:42:52,638 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: status_report 2024-04-08 18:42:52,638 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: defer 2024-04-08 18:42:52,638 INFO HandlerThread:158 [handler.py:handle_request_defer():172] handle defer: 7 2024-04-08 18:42:52,638 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: defer 2024-04-08 18:42:52,638 INFO SenderThread:158 [sender.py:send_request_defer():609] handle sender defer: 7 2024-04-08 18:42:53,078 INFO Thread-12 :158 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/wandb-summary.json 2024-04-08 18:42:53,632 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: poll_exit 2024-04-08 18:42:54,833 INFO SenderThread:158 [sender.py:transition_state():613] send defer: 8 2024-04-08 18:42:54,833 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: poll_exit 2024-04-08 18:42:54,834 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: defer 2024-04-08 18:42:54,834 INFO HandlerThread:158 [handler.py:handle_request_defer():172] handle defer: 8 2024-04-08 18:42:54,834 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: defer 2024-04-08 18:42:54,834 INFO SenderThread:158 [sender.py:send_request_defer():609] handle sender defer: 8 2024-04-08 18:42:54,834 INFO SenderThread:158 [job_builder.py:build():298] Attempting to build job artifact 2024-04-08 18:42:54,838 INFO SenderThread:158 [job_builder.py:_get_source_type():439] no source found 2024-04-08 18:42:54,838 INFO SenderThread:158 [sender.py:transition_state():613] send defer: 9 2024-04-08 18:42:54,838 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: defer 2024-04-08 18:42:54,838 INFO HandlerThread:158 [handler.py:handle_request_defer():172] handle defer: 9 2024-04-08 18:42:54,838 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: defer 2024-04-08 18:42:54,838 INFO SenderThread:158 [sender.py:send_request_defer():609] handle sender defer: 9 2024-04-08 18:42:54,838 INFO SenderThread:158 [dir_watcher.py:finish():358] shutting down directory watcher 2024-04-08 18:42:55,079 INFO Thread-12 :158 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/output.log 2024-04-08 18:42:55,080 INFO SenderThread:158 [dir_watcher.py:finish():388] scan: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files 2024-04-08 18:42:55,080 INFO SenderThread:158 [dir_watcher.py:finish():402] scan save: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/wandb-summary.json wandb-summary.json 2024-04-08 18:42:55,080 INFO SenderThread:158 [dir_watcher.py:finish():402] scan save: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/wandb-metadata.json wandb-metadata.json 2024-04-08 18:42:55,081 INFO SenderThread:158 [dir_watcher.py:finish():402] scan save: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/requirements.txt requirements.txt 2024-04-08 18:42:55,084 INFO SenderThread:158 [dir_watcher.py:finish():402] scan save: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/config.yaml config.yaml 2024-04-08 18:42:55,087 INFO SenderThread:158 [dir_watcher.py:finish():402] scan save: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/output.log output.log 2024-04-08 18:42:55,088 INFO SenderThread:158 [dir_watcher.py:finish():402] scan save: /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/conda-environment.yaml conda-environment.yaml 2024-04-08 18:42:55,088 INFO SenderThread:158 [sender.py:transition_state():613] send defer: 10 2024-04-08 18:42:55,089 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: defer 2024-04-08 18:42:55,089 INFO HandlerThread:158 [handler.py:handle_request_defer():172] handle defer: 10 2024-04-08 18:42:55,089 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: defer 2024-04-08 18:42:55,089 INFO SenderThread:158 [sender.py:send_request_defer():609] handle sender defer: 10 2024-04-08 18:42:55,090 INFO SenderThread:158 [file_pusher.py:finish():172] shutting down file pusher 2024-04-08 18:42:55,413 INFO wandb-upload_4:158 [upload_job.py:push():131] Uploaded file /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/conda-environment.yaml 2024-04-08 18:42:55,424 INFO wandb-upload_1:158 [upload_job.py:push():131] Uploaded file /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/requirements.txt 2024-04-08 18:42:55,430 INFO wandb-upload_2:158 [upload_job.py:push():131] Uploaded file /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/config.yaml 2024-04-08 18:42:55,454 INFO wandb-upload_0:158 [upload_job.py:push():131] Uploaded file /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/wandb-summary.json 2024-04-08 18:42:55,478 INFO wandb-upload_3:158 [upload_job.py:push():131] Uploaded file /kaggle/working/wandb/run-20240408_182243-93ndfgce/files/output.log 2024-04-08 18:42:55,634 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: poll_exit 2024-04-08 18:42:55,634 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: poll_exit 2024-04-08 18:42:55,679 INFO Thread-11 (_thread_body):158 [sender.py:transition_state():613] send defer: 11 2024-04-08 18:42:55,679 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: defer 2024-04-08 18:42:55,679 INFO HandlerThread:158 [handler.py:handle_request_defer():172] handle defer: 11 2024-04-08 18:42:55,680 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: defer 2024-04-08 18:42:55,680 INFO SenderThread:158 [sender.py:send_request_defer():609] handle sender defer: 11 2024-04-08 18:42:55,680 INFO SenderThread:158 [file_pusher.py:join():178] waiting for file pusher 2024-04-08 18:42:55,680 INFO SenderThread:158 [sender.py:transition_state():613] send defer: 12 2024-04-08 18:42:55,681 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: defer 2024-04-08 18:42:55,681 INFO HandlerThread:158 [handler.py:handle_request_defer():172] handle defer: 12 2024-04-08 18:42:55,681 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: defer 2024-04-08 18:42:55,681 INFO SenderThread:158 [sender.py:send_request_defer():609] handle sender defer: 12 2024-04-08 18:42:55,681 INFO SenderThread:158 [file_stream.py:finish():595] file stream finish called 2024-04-08 18:42:55,883 INFO SenderThread:158 [file_stream.py:finish():599] file stream finish is done 2024-04-08 18:42:55,883 INFO SenderThread:158 [sender.py:transition_state():613] send defer: 13 2024-04-08 18:42:55,883 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: defer 2024-04-08 18:42:55,883 INFO HandlerThread:158 [handler.py:handle_request_defer():172] handle defer: 13 2024-04-08 18:42:55,884 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: defer 2024-04-08 18:42:55,884 INFO SenderThread:158 [sender.py:send_request_defer():609] handle sender defer: 13 2024-04-08 18:42:55,884 INFO SenderThread:158 [sender.py:transition_state():613] send defer: 14 2024-04-08 18:42:55,885 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: defer 2024-04-08 18:42:55,885 DEBUG SenderThread:158 [sender.py:send():378] send: final 2024-04-08 18:42:55,885 INFO HandlerThread:158 [handler.py:handle_request_defer():172] handle defer: 14 2024-04-08 18:42:55,885 DEBUG SenderThread:158 [sender.py:send():378] send: footer 2024-04-08 18:42:55,885 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: defer 2024-04-08 18:42:55,886 INFO SenderThread:158 [sender.py:send_request_defer():609] handle sender defer: 14 2024-04-08 18:42:55,887 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: poll_exit 2024-04-08 18:42:55,887 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: poll_exit 2024-04-08 18:42:55,888 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: poll_exit 2024-04-08 18:42:55,888 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: poll_exit 2024-04-08 18:42:55,889 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: server_info 2024-04-08 18:42:55,890 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: server_info 2024-04-08 18:42:55,894 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: get_summary 2024-04-08 18:42:55,895 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: sampled_history 2024-04-08 18:42:55,896 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: internal_messages 2024-04-08 18:42:55,896 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: job_info 2024-04-08 18:42:55,941 DEBUG SenderThread:158 [sender.py:send_request():405] send_request: job_info 2024-04-08 18:42:55,942 INFO MainThread:158 [wandb_run.py:_footer_history_summary_info():3851] rendering history 2024-04-08 18:42:55,942 INFO MainThread:158 [wandb_run.py:_footer_history_summary_info():3883] rendering summary 2024-04-08 18:42:55,942 INFO MainThread:158 [wandb_run.py:_footer_sync_info():3810] logging synced files 2024-04-08 18:42:55,942 DEBUG HandlerThread:158 [handler.py:handle_request():146] handle_request: shutdown 2024-04-08 18:42:55,943 INFO HandlerThread:158 [handler.py:finish():869] shutting down handler 2024-04-08 18:42:56,897 INFO WriterThread:158 [datastore.py:close():296] close: /kaggle/working/wandb/run-20240408_182243-93ndfgce/run-93ndfgce.wandb 2024-04-08 18:42:56,942 INFO SenderThread:158 [sender.py:finish():1521] shutting down sender 2024-04-08 18:42:56,942 INFO SenderThread:158 [file_pusher.py:finish():172] shutting down file pusher 2024-04-08 18:42:56,942 INFO SenderThread:158 [file_pusher.py:join():178] waiting for file pusher