Hugging Face's logo

Femboyuwu2000
/
bloomz-1b1-vn-chat

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
Femboyuwu2000 commited on
Commit
011216a
•
1 Parent(s): df4652c

Training in progress, step 5580

Browse files
Files changed (7) hide show
  1. adapter_model.safetensors +1 -1
  2. runs/Apr12_07-40-41_e5a48bec8248/events.out.tfevents.1712907642.e5a48bec8248.443.0 +2 -2
  3. wandb/debug-internal.log +213 -0
  4. wandb/run-20240412_074044-widovcn3/files/output.log +28 -0
  5. wandb/run-20240412_074044-widovcn3/files/wandb-summary.json +1 -1
  6. wandb/run-20240412_074044-widovcn3/logs/debug-internal.log +213 -0
  7. wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb +0 -0
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b3a737d68a4827402068459de6efdbc7478a5a7fd2fe7bd0de466d15928fc4c2
3
  size 13982248
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e51450f5e4b92cb6050a5a712137dfb440701725d7829a72cff434a6a6aaa41
3
  size 13982248
runs/Apr12_07-40-41_e5a48bec8248/events.out.tfevents.1712907642.e5a48bec8248.443.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3fdf21f7eb28af11b7f9f8952e5a23789a575baab7e449eb9c9e81285f034973
3
- size 61384
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eef85c95fbde3570115b4926112e5e23cb740522c25499dfd2acedeb6ba5d608
3
+ size 64127
wandb/debug-internal.log CHANGED
@@ -4418,3 +4418,216 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
4418
  2024-04-12 09:29:22,336 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4419
  2024-04-12 09:29:22,336 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4420
  2024-04-12 09:29:22,631 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4418
  2024-04-12 09:29:22,336 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4419
  2024-04-12 09:29:22,336 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4420
  2024-04-12 09:29:22,631 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4421
+ 2024-04-12 09:29:25,052 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4422
+ 2024-04-12 09:29:25,632 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4423
+ 2024-04-12 09:29:30,052 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4424
+ 2024-04-12 09:29:31,964 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4425
+ 2024-04-12 09:29:32,387 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4426
+ 2024-04-12 09:29:32,388 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4427
+ 2024-04-12 09:29:35,431 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4428
+ 2024-04-12 09:29:40,432 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4429
+ 2024-04-12 09:29:45,253 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4430
+ 2024-04-12 09:29:46,254 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4431
+ 2024-04-12 09:29:46,964 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4432
+ 2024-04-12 09:29:47,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4433
+ 2024-04-12 09:29:47,388 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4434
+ 2024-04-12 09:29:49,853 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4435
+ 2024-04-12 09:29:49,854 DEBUG SenderThread:485 [sender.py:send():379] send: history
4436
+ 2024-04-12 09:29:49,855 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4437
+ 2024-04-12 09:29:49,855 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4438
+ 2024-04-12 09:29:50,642 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4439
+ 2024-04-12 09:29:51,577 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4440
+ 2024-04-12 09:29:51,643 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4441
+ 2024-04-12 09:29:56,578 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4442
+ 2024-04-12 09:30:01,578 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4443
+ 2024-04-12 09:30:01,964 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4444
+ 2024-04-12 09:30:02,387 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4445
+ 2024-04-12 09:30:02,388 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4446
+ 2024-04-12 09:30:07,450 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4447
+ 2024-04-12 09:30:12,450 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4448
+ 2024-04-12 09:30:13,571 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4449
+ 2024-04-12 09:30:13,572 DEBUG SenderThread:485 [sender.py:send():379] send: history
4450
+ 2024-04-12 09:30:13,572 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4451
+ 2024-04-12 09:30:13,573 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4452
+ 2024-04-12 09:30:13,651 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4453
+ 2024-04-12 09:30:15,254 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4454
+ 2024-04-12 09:30:15,652 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4455
+ 2024-04-12 09:30:16,964 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4456
+ 2024-04-12 09:30:17,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4457
+ 2024-04-12 09:30:17,388 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4458
+ 2024-04-12 09:30:17,456 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4459
+ 2024-04-12 09:30:22,456 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4460
+ 2024-04-12 09:30:27,457 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4461
+ 2024-04-12 09:30:31,964 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4462
+ 2024-04-12 09:30:32,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4463
+ 2024-04-12 09:30:32,388 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4464
+ 2024-04-12 09:30:33,411 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4465
+ 2024-04-12 09:30:37,941 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4466
+ 2024-04-12 09:30:37,942 DEBUG SenderThread:485 [sender.py:send():379] send: history
4467
+ 2024-04-12 09:30:37,942 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4468
+ 2024-04-12 09:30:37,943 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4469
+ 2024-04-12 09:30:38,662 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4470
+ 2024-04-12 09:30:38,684 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4471
+ 2024-04-12 09:30:39,663 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4472
+ 2024-04-12 09:30:43,685 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4473
+ 2024-04-12 09:30:45,255 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4474
+ 2024-04-12 09:30:46,964 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4475
+ 2024-04-12 09:30:47,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4476
+ 2024-04-12 09:30:47,389 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4477
+ 2024-04-12 09:30:49,525 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4478
+ 2024-04-12 09:30:54,526 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4479
+ 2024-04-12 09:30:59,527 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4480
+ 2024-04-12 09:31:01,234 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4481
+ 2024-04-12 09:31:01,235 DEBUG SenderThread:485 [sender.py:send():379] send: history
4482
+ 2024-04-12 09:31:01,235 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4483
+ 2024-04-12 09:31:01,236 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4484
+ 2024-04-12 09:31:01,672 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4485
+ 2024-04-12 09:31:02,022 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4486
+ 2024-04-12 09:31:02,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4487
+ 2024-04-12 09:31:02,389 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4488
+ 2024-04-12 09:31:03,673 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4489
+ 2024-04-12 09:31:05,425 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4490
+ 2024-04-12 09:31:10,426 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4491
+ 2024-04-12 09:31:15,256 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4492
+ 2024-04-12 09:31:16,257 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4493
+ 2024-04-12 09:31:17,019 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4494
+ 2024-04-12 09:31:17,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4495
+ 2024-04-12 09:31:17,389 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4496
+ 2024-04-12 09:31:21,507 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4497
+ 2024-04-12 09:31:26,508 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4498
+ 2024-04-12 09:31:30,248 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4499
+ 2024-04-12 09:31:30,249 DEBUG SenderThread:485 [sender.py:send():379] send: history
4500
+ 2024-04-12 09:31:30,249 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4501
+ 2024-04-12 09:31:30,250 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4502
+ 2024-04-12 09:31:30,683 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4503
+ 2024-04-12 09:31:31,683 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4504
+ 2024-04-12 09:31:31,994 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4505
+ 2024-04-12 09:31:32,020 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4506
+ 2024-04-12 09:31:32,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4507
+ 2024-04-12 09:31:32,389 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4508
+ 2024-04-12 09:31:37,442 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4509
+ 2024-04-12 09:31:42,443 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4510
+ 2024-04-12 09:31:45,257 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4511
+ 2024-04-12 09:31:47,019 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4512
+ 2024-04-12 09:31:47,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4513
+ 2024-04-12 09:31:47,389 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4514
+ 2024-04-12 09:31:47,485 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4515
+ 2024-04-12 09:31:52,486 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4516
+ 2024-04-12 09:31:56,722 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4517
+ 2024-04-12 09:31:56,723 DEBUG SenderThread:485 [sender.py:send():379] send: history
4518
+ 2024-04-12 09:31:56,724 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4519
+ 2024-04-12 09:31:56,724 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4520
+ 2024-04-12 09:31:57,520 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4521
+ 2024-04-12 09:31:57,693 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4522
+ 2024-04-12 09:31:59,694 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4523
+ 2024-04-12 09:32:02,020 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4524
+ 2024-04-12 09:32:02,389 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4525
+ 2024-04-12 09:32:02,389 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4526
+ 2024-04-12 09:32:03,507 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4527
+ 2024-04-12 09:32:08,507 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4528
+ 2024-04-12 09:32:13,509 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4529
+ 2024-04-12 09:32:15,258 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4530
+ 2024-04-12 09:32:17,020 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4531
+ 2024-04-12 09:32:17,389 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4532
+ 2024-04-12 09:32:17,390 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4533
+ 2024-04-12 09:32:18,509 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4534
+ 2024-04-12 09:32:23,275 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4535
+ 2024-04-12 09:32:23,277 DEBUG SenderThread:485 [sender.py:send():379] send: history
4536
+ 2024-04-12 09:32:23,277 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4537
+ 2024-04-12 09:32:23,277 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4538
+ 2024-04-12 09:32:23,703 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4539
+ 2024-04-12 09:32:24,043 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4540
+ 2024-04-12 09:32:25,704 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4541
+ 2024-04-12 09:32:29,044 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4542
+ 2024-04-12 09:32:32,020 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4543
+ 2024-04-12 09:32:32,389 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4544
+ 2024-04-12 09:32:32,390 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4545
+ 2024-04-12 09:32:34,453 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4546
+ 2024-04-12 09:32:39,454 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4547
+ 2024-04-12 09:32:44,455 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4548
+ 2024-04-12 09:32:44,660 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4549
+ 2024-04-12 09:32:44,661 DEBUG SenderThread:485 [sender.py:send():379] send: history
4550
+ 2024-04-12 09:32:44,662 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4551
+ 2024-04-12 09:32:44,662 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4552
+ 2024-04-12 09:32:44,711 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4553
+ 2024-04-12 09:32:45,260 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4554
+ 2024-04-12 09:32:47,020 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4555
+ 2024-04-12 09:32:47,389 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4556
+ 2024-04-12 09:32:47,390 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4557
+ 2024-04-12 09:32:47,712 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4558
+ 2024-04-12 09:32:49,468 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4559
+ 2024-04-12 09:32:54,469 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4560
+ 2024-04-12 09:32:59,470 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4561
+ 2024-04-12 09:33:02,020 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4562
+ 2024-04-12 09:33:02,389 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4563
+ 2024-04-12 09:33:02,390 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4564
+ 2024-04-12 09:33:05,426 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4565
+ 2024-04-12 09:33:07,176 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4566
+ 2024-04-12 09:33:07,177 DEBUG SenderThread:485 [sender.py:send():379] send: history
4567
+ 2024-04-12 09:33:07,177 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4568
+ 2024-04-12 09:33:07,178 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4569
+ 2024-04-12 09:33:07,720 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4570
+ 2024-04-12 09:33:09,721 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4571
+ 2024-04-12 09:33:11,191 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4572
+ 2024-04-12 09:33:15,260 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4573
+ 2024-04-12 09:33:16,261 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4574
+ 2024-04-12 09:33:17,020 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4575
+ 2024-04-12 09:33:17,389 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4576
+ 2024-04-12 09:33:17,390 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4577
+ 2024-04-12 09:33:21,526 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4578
+ 2024-04-12 09:33:26,527 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4579
+ 2024-04-12 09:33:30,615 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4580
+ 2024-04-12 09:33:30,616 DEBUG SenderThread:485 [sender.py:send():379] send: history
4581
+ 2024-04-12 09:33:30,617 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4582
+ 2024-04-12 09:33:30,617 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4583
+ 2024-04-12 09:33:30,729 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4584
+ 2024-04-12 09:33:32,020 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4585
+ 2024-04-12 09:33:32,390 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4586
+ 2024-04-12 09:33:32,391 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4587
+ 2024-04-12 09:33:32,423 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4588
+ 2024-04-12 09:33:33,730 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4589
+ 2024-04-12 09:33:37,425 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4590
+ 2024-04-12 09:33:42,426 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4591
+ 2024-04-12 09:33:45,262 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4592
+ 2024-04-12 09:33:47,021 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4593
+ 2024-04-12 09:33:47,390 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4594
+ 2024-04-12 09:33:47,390 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4595
+ 2024-04-12 09:33:47,509 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4596
+ 2024-04-12 09:33:52,511 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4597
+ 2024-04-12 09:33:56,795 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4598
+ 2024-04-12 09:33:56,796 DEBUG SenderThread:485 [sender.py:send():379] send: history
4599
+ 2024-04-12 09:33:56,797 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4600
+ 2024-04-12 09:33:56,797 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4601
+ 2024-04-12 09:33:57,657 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4602
+ 2024-04-12 09:33:57,741 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4603
+ 2024-04-12 09:33:59,742 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4604
+ 2024-04-12 09:34:02,021 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4605
+ 2024-04-12 09:34:02,390 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4606
+ 2024-04-12 09:34:02,390 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4607
+ 2024-04-12 09:34:03,489 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4608
+ 2024-04-12 09:34:08,490 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4609
+ 2024-04-12 09:34:13,491 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4610
+ 2024-04-12 09:34:15,263 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4611
+ 2024-04-12 09:34:17,021 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4612
+ 2024-04-12 09:34:17,390 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4613
+ 2024-04-12 09:34:17,391 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4614
+ 2024-04-12 09:34:18,515 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4615
+ 2024-04-12 09:34:19,658 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4616
+ 2024-04-12 09:34:19,659 DEBUG SenderThread:485 [sender.py:send():379] send: history
4617
+ 2024-04-12 09:34:19,659 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4618
+ 2024-04-12 09:34:19,660 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4619
+ 2024-04-12 09:34:19,751 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4620
+ 2024-04-12 09:34:21,752 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4621
+ 2024-04-12 09:34:24,416 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4622
+ 2024-04-12 09:34:29,417 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4623
+ 2024-04-12 09:34:32,021 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4624
+ 2024-04-12 09:34:32,390 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4625
+ 2024-04-12 09:34:32,391 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4626
+ 2024-04-12 09:34:34,470 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4627
+ 2024-04-12 09:34:39,471 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4628
+ 2024-04-12 09:34:42,155 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4629
+ 2024-04-12 09:34:42,157 DEBUG SenderThread:485 [sender.py:send():379] send: history
4630
+ 2024-04-12 09:34:42,157 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4631
+ 2024-04-12 09:34:42,158 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4632
+ 2024-04-12 09:34:42,760 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4633
+ 2024-04-12 09:34:43,760 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
wandb/run-20240412_074044-widovcn3/files/output.log CHANGED
@@ -528,4 +528,32 @@
528
  warnings.warn(
529
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
530
  warnings.warn(
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
531
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
 
528
  warnings.warn(
529
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
530
  warnings.warn(
531
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
532
+ warnings.warn(
533
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
534
+ warnings.warn(
535
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
536
+ warnings.warn(
537
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
538
+ warnings.warn(
539
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
540
+ warnings.warn(
541
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
542
+ warnings.warn(
543
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
544
+ warnings.warn(
545
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
546
+ warnings.warn(
547
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
548
+ warnings.warn(
549
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
550
+ warnings.warn(
551
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
552
+ warnings.warn(
553
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
554
+ warnings.warn(
555
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
556
+ warnings.warn(
557
+ /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
558
+ warnings.warn(
559
  /opt/conda/lib/python3.10/site-packages/torch/utils/checkpoint.py:429: UserWarning: torch.utils.checkpoint: please pass in use_reentrant=True or use_reentrant=False explicitly. The default value of use_reentrant will be updated to be False in the future. To maintain current behavior, pass use_reentrant=True. It is recommended that you use use_reentrant=False. Refer to docs for more details on the differences between the two variants.
wandb/run-20240412_074044-widovcn3/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 3.475, "train/grad_norm": 29.175064086914062, "train/learning_rate": 2.5827524199573033e-05, "train/epoch": 0.43, "train/global_step": 5320, "_timestamp": 1712914162.3341954, "_runtime": 6517.8264772892, "_step": 265}
 
1
+ {"train/loss": 3.4894, "train/grad_norm": 35.5067138671875, "train/learning_rate": 2.5380978745169473e-05, "train/epoch": 0.45, "train/global_step": 5580, "_timestamp": 1712914482.1552558, "_runtime": 6837.6475377082825, "_step": 278}
wandb/run-20240412_074044-widovcn3/logs/debug-internal.log CHANGED
@@ -4418,3 +4418,216 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
4418
  2024-04-12 09:29:22,336 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4419
  2024-04-12 09:29:22,336 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4420
  2024-04-12 09:29:22,631 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4418
  2024-04-12 09:29:22,336 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4419
  2024-04-12 09:29:22,336 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4420
  2024-04-12 09:29:22,631 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4421
+ 2024-04-12 09:29:25,052 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4422
+ 2024-04-12 09:29:25,632 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4423
+ 2024-04-12 09:29:30,052 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4424
+ 2024-04-12 09:29:31,964 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4425
+ 2024-04-12 09:29:32,387 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4426
+ 2024-04-12 09:29:32,388 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4427
+ 2024-04-12 09:29:35,431 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4428
+ 2024-04-12 09:29:40,432 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4429
+ 2024-04-12 09:29:45,253 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4430
+ 2024-04-12 09:29:46,254 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4431
+ 2024-04-12 09:29:46,964 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4432
+ 2024-04-12 09:29:47,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4433
+ 2024-04-12 09:29:47,388 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4434
+ 2024-04-12 09:29:49,853 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4435
+ 2024-04-12 09:29:49,854 DEBUG SenderThread:485 [sender.py:send():379] send: history
4436
+ 2024-04-12 09:29:49,855 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4437
+ 2024-04-12 09:29:49,855 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4438
+ 2024-04-12 09:29:50,642 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4439
+ 2024-04-12 09:29:51,577 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4440
+ 2024-04-12 09:29:51,643 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4441
+ 2024-04-12 09:29:56,578 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4442
+ 2024-04-12 09:30:01,578 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4443
+ 2024-04-12 09:30:01,964 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4444
+ 2024-04-12 09:30:02,387 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4445
+ 2024-04-12 09:30:02,388 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4446
+ 2024-04-12 09:30:07,450 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4447
+ 2024-04-12 09:30:12,450 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4448
+ 2024-04-12 09:30:13,571 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4449
+ 2024-04-12 09:30:13,572 DEBUG SenderThread:485 [sender.py:send():379] send: history
4450
+ 2024-04-12 09:30:13,572 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4451
+ 2024-04-12 09:30:13,573 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4452
+ 2024-04-12 09:30:13,651 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4453
+ 2024-04-12 09:30:15,254 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4454
+ 2024-04-12 09:30:15,652 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4455
+ 2024-04-12 09:30:16,964 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4456
+ 2024-04-12 09:30:17,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4457
+ 2024-04-12 09:30:17,388 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4458
+ 2024-04-12 09:30:17,456 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4459
+ 2024-04-12 09:30:22,456 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4460
+ 2024-04-12 09:30:27,457 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4461
+ 2024-04-12 09:30:31,964 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4462
+ 2024-04-12 09:30:32,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4463
+ 2024-04-12 09:30:32,388 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4464
+ 2024-04-12 09:30:33,411 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4465
+ 2024-04-12 09:30:37,941 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4466
+ 2024-04-12 09:30:37,942 DEBUG SenderThread:485 [sender.py:send():379] send: history
4467
+ 2024-04-12 09:30:37,942 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4468
+ 2024-04-12 09:30:37,943 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4469
+ 2024-04-12 09:30:38,662 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4470
+ 2024-04-12 09:30:38,684 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4471
+ 2024-04-12 09:30:39,663 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4472
+ 2024-04-12 09:30:43,685 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4473
+ 2024-04-12 09:30:45,255 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4474
+ 2024-04-12 09:30:46,964 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4475
+ 2024-04-12 09:30:47,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4476
+ 2024-04-12 09:30:47,389 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4477
+ 2024-04-12 09:30:49,525 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4478
+ 2024-04-12 09:30:54,526 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4479
+ 2024-04-12 09:30:59,527 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4480
+ 2024-04-12 09:31:01,234 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4481
+ 2024-04-12 09:31:01,235 DEBUG SenderThread:485 [sender.py:send():379] send: history
4482
+ 2024-04-12 09:31:01,235 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4483
+ 2024-04-12 09:31:01,236 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4484
+ 2024-04-12 09:31:01,672 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4485
+ 2024-04-12 09:31:02,022 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4486
+ 2024-04-12 09:31:02,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4487
+ 2024-04-12 09:31:02,389 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4488
+ 2024-04-12 09:31:03,673 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4489
+ 2024-04-12 09:31:05,425 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4490
+ 2024-04-12 09:31:10,426 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4491
+ 2024-04-12 09:31:15,256 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4492
+ 2024-04-12 09:31:16,257 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4493
+ 2024-04-12 09:31:17,019 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4494
+ 2024-04-12 09:31:17,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4495
+ 2024-04-12 09:31:17,389 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4496
+ 2024-04-12 09:31:21,507 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4497
+ 2024-04-12 09:31:26,508 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4498
+ 2024-04-12 09:31:30,248 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4499
+ 2024-04-12 09:31:30,249 DEBUG SenderThread:485 [sender.py:send():379] send: history
4500
+ 2024-04-12 09:31:30,249 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4501
+ 2024-04-12 09:31:30,250 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4502
+ 2024-04-12 09:31:30,683 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4503
+ 2024-04-12 09:31:31,683 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4504
+ 2024-04-12 09:31:31,994 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4505
+ 2024-04-12 09:31:32,020 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4506
+ 2024-04-12 09:31:32,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4507
+ 2024-04-12 09:31:32,389 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4508
+ 2024-04-12 09:31:37,442 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4509
+ 2024-04-12 09:31:42,443 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4510
+ 2024-04-12 09:31:45,257 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4511
+ 2024-04-12 09:31:47,019 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4512
+ 2024-04-12 09:31:47,388 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4513
+ 2024-04-12 09:31:47,389 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4514
+ 2024-04-12 09:31:47,485 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4515
+ 2024-04-12 09:31:52,486 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4516
+ 2024-04-12 09:31:56,722 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4517
+ 2024-04-12 09:31:56,723 DEBUG SenderThread:485 [sender.py:send():379] send: history
4518
+ 2024-04-12 09:31:56,724 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4519
+ 2024-04-12 09:31:56,724 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4520
+ 2024-04-12 09:31:57,520 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4521
+ 2024-04-12 09:31:57,693 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4522
+ 2024-04-12 09:31:59,694 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4523
+ 2024-04-12 09:32:02,020 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4524
+ 2024-04-12 09:32:02,389 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4525
+ 2024-04-12 09:32:02,389 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4526
+ 2024-04-12 09:32:03,507 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4527
+ 2024-04-12 09:32:08,507 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4528
+ 2024-04-12 09:32:13,509 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4529
+ 2024-04-12 09:32:15,258 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4530
+ 2024-04-12 09:32:17,020 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4531
+ 2024-04-12 09:32:17,389 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4532
+ 2024-04-12 09:32:17,390 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4533
+ 2024-04-12 09:32:18,509 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4534
+ 2024-04-12 09:32:23,275 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4535
+ 2024-04-12 09:32:23,277 DEBUG SenderThread:485 [sender.py:send():379] send: history
4536
+ 2024-04-12 09:32:23,277 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4537
+ 2024-04-12 09:32:23,277 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4538
+ 2024-04-12 09:32:23,703 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4539
+ 2024-04-12 09:32:24,043 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4540
+ 2024-04-12 09:32:25,704 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4541
+ 2024-04-12 09:32:29,044 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4542
+ 2024-04-12 09:32:32,020 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4543
+ 2024-04-12 09:32:32,389 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4544
+ 2024-04-12 09:32:32,390 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4545
+ 2024-04-12 09:32:34,453 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4546
+ 2024-04-12 09:32:39,454 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4547
+ 2024-04-12 09:32:44,455 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4548
+ 2024-04-12 09:32:44,660 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4549
+ 2024-04-12 09:32:44,661 DEBUG SenderThread:485 [sender.py:send():379] send: history
4550
+ 2024-04-12 09:32:44,662 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4551
+ 2024-04-12 09:32:44,662 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4552
+ 2024-04-12 09:32:44,711 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4553
+ 2024-04-12 09:32:45,260 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4554
+ 2024-04-12 09:32:47,020 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4555
+ 2024-04-12 09:32:47,389 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4556
+ 2024-04-12 09:32:47,390 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4557
+ 2024-04-12 09:32:47,712 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4558
+ 2024-04-12 09:32:49,468 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4559
+ 2024-04-12 09:32:54,469 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4560
+ 2024-04-12 09:32:59,470 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4561
+ 2024-04-12 09:33:02,020 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4562
+ 2024-04-12 09:33:02,389 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4563
+ 2024-04-12 09:33:02,390 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4564
+ 2024-04-12 09:33:05,426 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4565
+ 2024-04-12 09:33:07,176 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4566
+ 2024-04-12 09:33:07,177 DEBUG SenderThread:485 [sender.py:send():379] send: history
4567
+ 2024-04-12 09:33:07,177 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4568
+ 2024-04-12 09:33:07,178 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4569
+ 2024-04-12 09:33:07,720 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4570
+ 2024-04-12 09:33:09,721 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4571
+ 2024-04-12 09:33:11,191 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4572
+ 2024-04-12 09:33:15,260 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4573
+ 2024-04-12 09:33:16,261 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4574
+ 2024-04-12 09:33:17,020 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4575
+ 2024-04-12 09:33:17,389 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4576
+ 2024-04-12 09:33:17,390 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4577
+ 2024-04-12 09:33:21,526 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4578
+ 2024-04-12 09:33:26,527 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4579
+ 2024-04-12 09:33:30,615 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4580
+ 2024-04-12 09:33:30,616 DEBUG SenderThread:485 [sender.py:send():379] send: history
4581
+ 2024-04-12 09:33:30,617 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4582
+ 2024-04-12 09:33:30,617 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4583
+ 2024-04-12 09:33:30,729 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4584
+ 2024-04-12 09:33:32,020 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4585
+ 2024-04-12 09:33:32,390 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4586
+ 2024-04-12 09:33:32,391 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4587
+ 2024-04-12 09:33:32,423 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4588
+ 2024-04-12 09:33:33,730 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4589
+ 2024-04-12 09:33:37,425 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4590
+ 2024-04-12 09:33:42,426 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4591
+ 2024-04-12 09:33:45,262 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4592
+ 2024-04-12 09:33:47,021 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4593
+ 2024-04-12 09:33:47,390 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4594
+ 2024-04-12 09:33:47,390 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4595
+ 2024-04-12 09:33:47,509 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4596
+ 2024-04-12 09:33:52,511 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4597
+ 2024-04-12 09:33:56,795 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4598
+ 2024-04-12 09:33:56,796 DEBUG SenderThread:485 [sender.py:send():379] send: history
4599
+ 2024-04-12 09:33:56,797 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4600
+ 2024-04-12 09:33:56,797 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4601
+ 2024-04-12 09:33:57,657 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4602
+ 2024-04-12 09:33:57,741 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4603
+ 2024-04-12 09:33:59,742 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4604
+ 2024-04-12 09:34:02,021 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4605
+ 2024-04-12 09:34:02,390 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4606
+ 2024-04-12 09:34:02,390 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4607
+ 2024-04-12 09:34:03,489 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4608
+ 2024-04-12 09:34:08,490 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4609
+ 2024-04-12 09:34:13,491 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4610
+ 2024-04-12 09:34:15,263 DEBUG SenderThread:485 [sender.py:send():379] send: stats
4611
+ 2024-04-12 09:34:17,021 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4612
+ 2024-04-12 09:34:17,390 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4613
+ 2024-04-12 09:34:17,391 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4614
+ 2024-04-12 09:34:18,515 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4615
+ 2024-04-12 09:34:19,658 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4616
+ 2024-04-12 09:34:19,659 DEBUG SenderThread:485 [sender.py:send():379] send: history
4617
+ 2024-04-12 09:34:19,659 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4618
+ 2024-04-12 09:34:19,660 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4619
+ 2024-04-12 09:34:19,751 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4620
+ 2024-04-12 09:34:21,752 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
4621
+ 2024-04-12 09:34:24,416 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4622
+ 2024-04-12 09:34:29,417 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4623
+ 2024-04-12 09:34:32,021 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: internal_messages
4624
+ 2024-04-12 09:34:32,390 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: stop_status
4625
+ 2024-04-12 09:34:32,391 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: stop_status
4626
+ 2024-04-12 09:34:34,470 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4627
+ 2024-04-12 09:34:39,471 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: status_report
4628
+ 2024-04-12 09:34:42,155 DEBUG HandlerThread:485 [handler.py:handle_request():146] handle_request: partial_history
4629
+ 2024-04-12 09:34:42,157 DEBUG SenderThread:485 [sender.py:send():379] send: history
4630
+ 2024-04-12 09:34:42,157 DEBUG SenderThread:485 [sender.py:send_request():406] send_request: summary_record
4631
+ 2024-04-12 09:34:42,158 INFO SenderThread:485 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
4632
+ 2024-04-12 09:34:42,760 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/wandb-summary.json
4633
+ 2024-04-12 09:34:43,760 INFO Thread-12 :485 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240412_074044-widovcn3/files/output.log
wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb CHANGED
Binary files a/wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb and b/wandb/run-20240412_074044-widovcn3/run-widovcn3.wandb differ