The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling `transformers.utils.move_cache()`.

0it [00:00, ?it/s]
0it [00:00, ?it/s]
/opt/conda/lib/python3.10/site-packages/transformers/deepspeed.py:24: FutureWarning: transformers.deepspeed module is deprecated and will be removed in a future version. Please import deepspeed modules directly from transformers.integrations
  warnings.warn(
/opt/conda/lib/python3.10/site-packages/transformers/training_args.py:1525: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead
  warnings.warn(

Generating train split: 0 examples [00:00, ? examples/s]
Generating train split: 1237 examples [00:00, 12341.15 examples/s]
Generating train split: 2264 examples [00:00, 14207.36 examples/s]

Generating validation split: 0 examples [00:00, ? examples/s]
Generating validation split: 30 examples [00:00, 8467.64 examples/s]

Running tokenizer on train dataset:   0%|          | 0/2264 [00:00<?, ? examples/s]/opt/conda/lib/python3.10/site-packages/transformers/tokenization_utils_base.py:4126: UserWarning: `as_target_tokenizer` is deprecated and will be removed in v5 of Transformers. You can tokenize your labels by using the argument `text_target` of the regular `__call__` method (either in the same call as your input texts if you use the same keyword arguments, or in a separate call.
  warnings.warn(

Running tokenizer on train dataset:  44%|████▍     | 1000/2264 [00:00<00:00, 2109.03 examples/s]
Running tokenizer on train dataset:  88%|████████▊ | 2000/2264 [00:01<00:00, 1672.35 examples/s]
Running tokenizer on train dataset: 100%|██████████| 2264/2264 [00:01<00:00, 1618.69 examples/s]
Running tokenizer on train dataset: 100%|██████████| 2264/2264 [00:01<00:00, 1679.44 examples/s]
Saving cached train data ...

Saving the dataset (0/1 shards):   0%|          | 0/2264 [00:00<?, ? examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 2264/2264 [00:00<00:00, 369160.06 examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 2264/2264 [00:00<00:00, 359693.34 examples/s]

Running tokenizer on validation dataset:   0%|          | 0/30 [00:00<?, ? examples/s]
Running tokenizer on validation dataset: 100%|██████████| 30/30 [00:00<00:00, 1337.80 examples/s]
Saving cached validation data ...

Saving the dataset (0/1 shards):   0%|          | 0/30 [00:00<?, ? examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 30/30 [00:00<00:00, 7717.21 examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 30/30 [00:00<00:00, 7422.67 examples/s]

Downloading builder script:   0%|          | 0.00/8.15k [00:00<?, ?B/s]
Downloading builder script: 100%|██████████| 8.15k/8.15k [00:00<00:00, 17.6MB/s]
/opt/conda/lib/python3.10/site-packages/transformers/optimization.py:591: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning
  warnings.warn(
All 57600 steps, warm_up steps: 200
wandb: WARNING The `run_name` is currently set to the same value as `TrainingArguments.output_dir`. If this was not intended, please specify a different run name by setting the `TrainingArguments.run_name` parameter.
wandb: Currently logged in as: abdiharyadi. Use `wandb login --relogin` to force relogin
wandb: wandb version 0.18.3 is available!  To upgrade, please run:
wandb:  $ pip install wandb --upgrade
wandb: Tracking run with wandb version 0.17.5
wandb: Run data is saved locally in /kaggle/working/amr-tst-indo/AMRBART-id/fine-tune/wandb/run-20241002_065356-1wo93oi5
wandb: Run `wandb offline` to turn off syncing.
wandb: Syncing run /kaggle/working/amr-tst-indo/AMRBART-id/fine-tune/../outputs/mbart-en-id-smaller-fted-amr-generation-v2-fted
wandb: ⭐️ View project at https://wandb.ai/abdiharyadi/amr-tst
wandb: 🚀 View run at https://wandb.ai/abdiharyadi/amr-tst/runs/1wo93oi5

  0%|          | 0/57600 [00:00<?, ?it/s]/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

  0%|          | 1/57600 [00:01<22:53:19,  1.43s/it]
                                                    
{'loss': 2.1638, 'learning_rate': 5e-09, 'epoch': 0.01}

  0%|          | 1/57600 [00:01<22:53:19,  1.43s/it]
  0%|          | 2/57600 [00:02<14:49:26,  1.08it/s]
  0%|          | 3/57600 [00:02<12:24:25,  1.29it/s]
  0%|          | 4/57600 [00:03<11:36:40,  1.38it/s]
  0%|          | 5/57600 [00:03<11:33:14,  1.38it/s]
  0%|          | 6/57600 [00:04<11:15:21,  1.42it/s]
  0%|          | 7/57600 [00:05<11:02:08,  1.45it/s]
  0%|          | 8/57600 [00:05<10:31:48,  1.52it/s]
  0%|          | 9/57600 [00:06<10:42:17,  1.49it/s]
  0%|          | 10/57600 [00:07<10:22:35,  1.54it/s]
  0%|          | 11/57600 [00:07<10:05:39,  1.58it/s]
  0%|          | 12/57600 [00:08<10:07:27,  1.58it/s]
  0%|          | 13/57600 [00:09<10:15:30,  1.56it/s]
  0%|          | 14/57600 [00:09<10:47:56,  1.48it/s]
  0%|          | 15/57600 [00:10<10:45:47,  1.49it/s]
  0%|          | 16/57600 [00:11<10:58:59,  1.46it/s]
  0%|          | 17/57600 [00:11<10:42:39,  1.49it/s]
  0%|          | 18/57600 [00:12<10:23:51,  1.54it/s]
  0%|          | 19/57600 [00:13<10:27:55,  1.53it/s]
  0%|          | 20/57600 [00:13<10:15:56,  1.56it/s]
                                                     
{'loss': 1.9727, 'learning_rate': 1e-07, 'epoch': 0.22}

  0%|          | 20/57600 [00:13<10:15:56,  1.56it/s]
  0%|          | 21/57600 [00:14<10:20:16,  1.55it/s]
  0%|          | 22/57600 [00:14<10:01:48,  1.59it/s]
  0%|          | 23/57600 [00:15<9:49:05,  1.63it/s] 
  0%|          | 24/57600 [00:16<9:50:40,  1.62it/s]
  0%|          | 25/57600 [00:16<10:09:17,  1.57it/s]
  0%|          | 26/57600 [00:17<10:05:22,  1.59it/s]
  0%|          | 27/57600 [00:18<9:57:37,  1.61it/s] 
  0%|          | 28/57600 [00:18<9:52:31,  1.62it/s]
  0%|          | 29/57600 [00:19<10:10:27,  1.57it/s]
  0%|          | 30/57600 [00:19<9:53:34,  1.62it/s] 
  0%|          | 31/57600 [00:20<10:05:38,  1.58it/s]
  0%|          | 32/57600 [00:21<10:07:26,  1.58it/s]
  0%|          | 33/57600 [00:21<10:02:11,  1.59it/s]
  0%|          | 34/57600 [00:22<10:03:43,  1.59it/s]
  0%|          | 35/57600 [00:23<9:55:40,  1.61it/s] 
  0%|          | 36/57600 [00:23<9:48:05,  1.63it/s]
  0%|          | 37/57600 [00:24<10:04:09,  1.59it/s]
  0%|          | 38/57600 [00:24<9:52:57,  1.62it/s] 
  0%|          | 39/57600 [00:25<9:36:38,  1.66it/s]
  0%|          | 40/57600 [00:26<9:43:41,  1.64it/s]
                                                    
{'loss': 2.0028, 'learning_rate': 2e-07, 'epoch': 0.44}

  0%|          | 40/57600 [00:26<9:43:41,  1.64it/s]
  0%|          | 41/57600 [00:26<9:50:19,  1.63it/s]
  0%|          | 42/57600 [00:27<10:07:03,  1.58it/s]
  0%|          | 43/57600 [00:28<10:16:06,  1.56it/s]
  0%|          | 44/57600 [00:28<9:59:11,  1.60it/s] 
  0%|          | 45/57600 [00:29<10:00:40,  1.60it/s]
  0%|          | 46/57600 [00:29<9:43:02,  1.65it/s] 
  0%|          | 47/57600 [00:30<9:42:39,  1.65it/s]
  0%|          | 48/57600 [00:31<9:42:59,  1.65it/s]
  0%|          | 49/57600 [00:31<9:28:02,  1.69it/s]
  0%|          | 50/57600 [00:32<9:41:40,  1.65it/s]
  0%|          | 51/57600 [00:32<10:04:08,  1.59it/s]
  0%|          | 52/57600 [00:33<9:53:06,  1.62it/s] 
  0%|          | 53/57600 [00:34<9:44:33,  1.64it/s]
  0%|          | 54/57600 [00:34<9:56:32,  1.61it/s]
  0%|          | 55/57600 [00:35<9:45:13,  1.64it/s]
  0%|          | 56/57600 [00:35<9:48:08,  1.63it/s]
  0%|          | 57/57600 [00:36<9:57:28,  1.61it/s]
  0%|          | 58/57600 [00:37<10:01:37,  1.59it/s]
  0%|          | 59/57600 [00:37<10:02:49,  1.59it/s]
  0%|          | 60/57600 [00:38<9:48:06,  1.63it/s] 
                                                    
{'loss': 2.0448, 'learning_rate': 3e-07, 'epoch': 0.66}

  0%|          | 60/57600 [00:38<9:48:06,  1.63it/s]
  0%|          | 61/57600 [00:39<9:52:42,  1.62it/s]
  0%|          | 62/57600 [00:39<10:03:46,  1.59it/s]
  0%|          | 63/57600 [00:40<10:07:58,  1.58it/s]
  0%|          | 64/57600 [00:40<9:50:03,  1.63it/s] 
  0%|          | 65/57600 [00:41<9:41:24,  1.65it/s]
  0%|          | 66/57600 [00:42<9:52:39,  1.62it/s]
  0%|          | 67/57600 [00:42<10:01:19,  1.59it/s]
  0%|          | 68/57600 [00:43<9:46:14,  1.64it/s] 
  0%|          | 69/57600 [00:44<9:57:47,  1.60it/s]
  0%|          | 70/57600 [00:44<10:00:24,  1.60it/s]
  0%|          | 71/57600 [00:45<10:21:04,  1.54it/s]
  0%|          | 72/57600 [00:46<10:38:04,  1.50it/s]
  0%|          | 73/57600 [00:46<10:21:44,  1.54it/s]
  0%|          | 74/57600 [00:47<10:01:08,  1.59it/s]
  0%|          | 75/57600 [00:47<9:47:13,  1.63it/s] 
  0%|          | 76/57600 [00:48<9:46:40,  1.63it/s]
  0%|          | 77/57600 [00:49<10:08:43,  1.57it/s]
  0%|          | 78/57600 [00:49<10:09:48,  1.57it/s]
  0%|          | 79/57600 [00:50<9:55:05,  1.61it/s] 
  0%|          | 80/57600 [00:51<9:56:56,  1.61it/s]
                                                    
{'loss': 1.9696, 'learning_rate': 4e-07, 'epoch': 0.88}

  0%|          | 80/57600 [00:51<9:56:56,  1.61it/s]
  0%|          | 81/57600 [00:51<9:50:10,  1.62it/s]
  0%|          | 82/57600 [00:52<9:55:52,  1.61it/s]
  0%|          | 83/57600 [00:52<9:58:37,  1.60it/s]
  0%|          | 84/57600 [00:53<9:51:15,  1.62it/s]
  0%|          | 85/57600 [00:54<9:53:59,  1.61it/s]
  0%|          | 86/57600 [00:54<9:47:24,  1.63it/s]
  0%|          | 87/57600 [00:55<10:00:03,  1.60it/s]
  0%|          | 88/57600 [00:56<10:19:27,  1.55it/s]
  0%|          | 89/57600 [00:56<10:04:33,  1.59it/s]
  0%|          | 90/57600 [00:57<9:43:04,  1.64it/s] 
  0%|          | 91/57600 [00:58<10:28:24,  1.53it/s]
  0%|          | 92/57600 [00:58<10:22:47,  1.54it/s]
  0%|          | 93/57600 [00:59<10:27:13,  1.53it/s]
  0%|          | 94/57600 [00:59<10:13:40,  1.56it/s]
  0%|          | 95/57600 [01:00<9:59:58,  1.60it/s] 
  0%|          | 96/57600 [01:01<9:41:58,  1.65it/s]
  0%|          | 97/57600 [01:01<9:52:29,  1.62it/s]
  0%|          | 98/57600 [01:02<9:55:22,  1.61it/s]
  0%|          | 99/57600 [01:02<9:59:29,  1.60it/s]
  0%|          | 100/57600 [01:03<10:09:49,  1.57it/s]
                                                      
{'loss': 1.9375, 'learning_rate': 5e-07, 'epoch': 1.1}

  0%|          | 100/57600 [01:03<10:09:49,  1.57it/s]
  0%|          | 101/57600 [01:04<9:49:24,  1.63it/s] 
  0%|          | 102/57600 [01:04<10:00:45,  1.60it/s]
  0%|          | 103/57600 [01:05<10:04:47,  1.58it/s]
  0%|          | 104/57600 [01:06<10:23:08,  1.54it/s]
  0%|          | 105/57600 [01:06<10:18:39,  1.55it/s]
  0%|          | 106/57600 [01:07<10:07:23,  1.58it/s]
  0%|          | 107/57600 [01:08<10:36:06,  1.51it/s]
  0%|          | 108/57600 [01:08<10:38:56,  1.50it/s]
  0%|          | 109/57600 [01:09<10:28:53,  1.52it/s]
  0%|          | 110/57600 [01:10<10:20:51,  1.54it/s]
  0%|          | 111/57600 [01:10<10:03:35,  1.59it/s]
  0%|          | 112/57600 [01:11<9:56:21,  1.61it/s] 
  0%|          | 113/57600 [01:11<9:58:27,  1.60it/s]
  0%|          | 114/57600 [01:12<9:52:16,  1.62it/s]
  0%|          | 115/57600 [01:13<10:02:58,  1.59it/s]
  0%|          | 116/57600 [01:13<10:12:20,  1.56it/s]
  0%|          | 117/57600 [01:14<10:04:37,  1.58it/s]
  0%|          | 118/57600 [01:15<10:24:37,  1.53it/s]
  0%|          | 119/57600 [01:15<10:29:47,  1.52it/s]
  0%|          | 120/57600 [01:16<10:18:04,  1.55it/s]
                                                      
{'loss': 1.9075, 'learning_rate': 6e-07, 'epoch': 1.32}

  0%|          | 120/57600 [01:16<10:18:04,  1.55it/s]
  0%|          | 121/57600 [01:17<10:17:45,  1.55it/s]
  0%|          | 122/57600 [01:17<10:15:36,  1.56it/s]
  0%|          | 123/57600 [01:18<10:30:40,  1.52it/s]
  0%|          | 124/57600 [01:18<10:05:45,  1.58it/s]
  0%|          | 125/57600 [01:19<10:00:32,  1.60it/s]
  0%|          | 126/57600 [01:20<9:52:50,  1.62it/s] 
  0%|          | 127/57600 [01:20<9:50:21,  1.62it/s]
  0%|          | 128/57600 [01:21<9:51:52,  1.62it/s]
  0%|          | 129/57600 [01:22<9:46:15,  1.63it/s]
  0%|          | 130/57600 [01:22<10:05:11,  1.58it/s]
  0%|          | 131/57600 [01:23<9:46:43,  1.63it/s] 
  0%|          | 132/57600 [01:23<9:39:13,  1.65it/s]
  0%|          | 133/57600 [01:24<9:55:48,  1.61it/s]
  0%|          | 134/57600 [01:25<9:53:25,  1.61it/s]
  0%|          | 135/57600 [01:25<10:07:24,  1.58it/s]
  0%|          | 136/57600 [01:26<10:15:23,  1.56it/s]
  0%|          | 137/57600 [01:27<10:00:25,  1.60it/s]
  0%|          | 138/57600 [01:27<9:53:23,  1.61it/s] 
  0%|          | 139/57600 [01:28<9:48:10,  1.63it/s]
  0%|          | 140/57600 [01:28<10:06:43,  1.58it/s]
                                                      
{'loss': 1.9866, 'learning_rate': 7e-07, 'epoch': 1.55}

  0%|          | 140/57600 [01:28<10:06:43,  1.58it/s]
  0%|          | 141/57600 [01:29<10:38:40,  1.50it/s]
  0%|          | 142/57600 [01:30<10:25:16,  1.53it/s]
  0%|          | 143/57600 [01:30<10:25:53,  1.53it/s]
  0%|          | 144/57600 [01:31<10:26:00,  1.53it/s]
  0%|          | 145/57600 [01:32<10:28:33,  1.52it/s]
  0%|          | 146/57600 [01:32<10:16:00,  1.55it/s]
  0%|          | 147/57600 [01:33<10:01:30,  1.59it/s]
  0%|          | 148/57600 [01:34<10:22:07,  1.54it/s]
  0%|          | 149/57600 [01:34<10:09:38,  1.57it/s]
  0%|          | 150/57600 [01:35<10:06:17,  1.58it/s]
  0%|          | 151/57600 [01:36<10:25:19,  1.53it/s]
  0%|          | 152/57600 [01:36<10:24:27,  1.53it/s]
  0%|          | 153/57600 [01:37<10:04:11,  1.58it/s]
  0%|          | 154/57600 [01:37<10:04:57,  1.58it/s]
  0%|          | 155/57600 [01:38<9:54:03,  1.61it/s] 
  0%|          | 156/57600 [01:39<10:14:40,  1.56it/s]
  0%|          | 157/57600 [01:39<10:02:39,  1.59it/s]
  0%|          | 158/57600 [01:40<10:12:43,  1.56it/s]
  0%|          | 159/57600 [01:41<9:49:05,  1.63it/s] 
  0%|          | 160/57600 [01:41<9:58:32,  1.60it/s]
                                                     
{'loss': 1.882, 'learning_rate': 8e-07, 'epoch': 1.77}

  0%|          | 160/57600 [01:41<9:58:32,  1.60it/s]
  0%|          | 161/57600 [01:42<9:50:03,  1.62it/s]
  0%|          | 162/57600 [01:42<9:59:06,  1.60it/s]
  0%|          | 163/57600 [01:43<9:47:42,  1.63it/s]
  0%|          | 164/57600 [01:44<9:56:57,  1.60it/s]
  0%|          | 165/57600 [01:44<9:49:04,  1.63it/s]
  0%|          | 166/57600 [01:45<9:48:55,  1.63it/s]
  0%|          | 167/57600 [01:46<9:36:43,  1.66it/s]
  0%|          | 168/57600 [01:46<10:07:31,  1.58it/s]
  0%|          | 169/57600 [01:47<10:10:58,  1.57it/s]
  0%|          | 170/57600 [01:47<10:06:24,  1.58it/s]
  0%|          | 171/57600 [01:48<9:48:26,  1.63it/s] 
  0%|          | 172/57600 [01:49<9:45:39,  1.63it/s]
  0%|          | 173/57600 [01:49<9:28:28,  1.68it/s]
  0%|          | 174/57600 [01:50<9:34:34,  1.67it/s]
  0%|          | 175/57600 [01:50<9:35:35,  1.66it/s]
  0%|          | 176/57600 [01:51<9:45:28,  1.63it/s]
  0%|          | 177/57600 [01:52<9:44:08,  1.64it/s]
  0%|          | 178/57600 [01:52<9:33:17,  1.67it/s]
  0%|          | 179/57600 [01:53<9:31:29,  1.67it/s]
  0%|          | 180/57600 [01:53<9:33:31,  1.67it/s]
                                                     
{'loss': 1.9916, 'learning_rate': 9e-07, 'epoch': 1.99}

  0%|          | 180/57600 [01:53<9:33:31,  1.67it/s]
  0%|          | 181/57600 [01:54<9:38:02,  1.66it/s]
  0%|          | 182/57600 [01:55<10:19:27,  1.54it/s]
  0%|          | 183/57600 [01:55<10:07:04,  1.58it/s]
  0%|          | 184/57600 [01:56<10:11:37,  1.56it/s]
  0%|          | 185/57600 [01:57<10:18:20,  1.55it/s]
  0%|          | 186/57600 [01:57<10:01:07,  1.59it/s]
  0%|          | 187/57600 [01:58<9:59:35,  1.60it/s] 
  0%|          | 188/57600 [01:59<10:01:04,  1.59it/s]
  0%|          | 189/57600 [01:59<10:06:48,  1.58it/s]
  0%|          | 190/57600 [02:00<10:11:28,  1.56it/s]
  0%|          | 191/57600 [02:01<10:10:43,  1.57it/s]
  0%|          | 192/57600 [02:01<9:53:42,  1.61it/s] 
  0%|          | 193/57600 [02:02<10:08:52,  1.57it/s]
  0%|          | 194/57600 [02:02<10:17:54,  1.55it/s]
  0%|          | 195/57600 [02:03<10:24:18,  1.53it/s]
  0%|          | 196/57600 [02:04<10:14:59,  1.56it/s]
  0%|          | 197/57600 [02:04<10:24:16,  1.53it/s]
  0%|          | 198/57600 [02:05<10:05:08,  1.58it/s]
  0%|          | 199/57600 [02:06<9:53:57,  1.61it/s] 
  0%|          | 200/57600 [02:06<10:22:39,  1.54it/s]
                                                      
{'loss': 1.9132, 'learning_rate': 1e-06, 'epoch': 2.21}

  0%|          | 200/57600 [02:06<10:22:39,  1.54it/s]
  0%|          | 201/57600 [02:07<10:03:36,  1.58it/s]
  0%|          | 202/57600 [02:07<9:52:46,  1.61it/s] 
  0%|          | 203/57600 [02:08<9:51:11,  1.62it/s]
  0%|          | 204/57600 [02:09<9:47:35,  1.63it/s]
  0%|          | 205/57600 [02:09<9:40:58,  1.65it/s]
  0%|          | 206/57600 [02:10<9:59:02,  1.60it/s]
  0%|          | 207/57600 [02:11<9:45:23,  1.63it/s]
  0%|          | 208/57600 [02:11<10:09:04,  1.57it/s]
  0%|          | 209/57600 [02:12<10:05:38,  1.58it/s]
  0%|          | 210/57600 [02:12<9:50:19,  1.62it/s] 
  0%|          | 211/57600 [02:13<9:51:37,  1.62it/s]
  0%|          | 212/57600 [02:14<9:42:21,  1.64it/s]
  0%|          | 213/57600 [02:14<9:51:41,  1.62it/s]
  0%|          | 214/57600 [02:15<9:59:24,  1.60it/s]
  0%|          | 215/57600 [02:15<9:41:42,  1.64it/s]
  0%|          | 216/57600 [02:16<9:56:54,  1.60it/s]
  0%|          | 217/57600 [02:17<9:41:26,  1.64it/s]
  0%|          | 218/57600 [02:17<9:42:02,  1.64it/s]
  0%|          | 219/57600 [02:18<9:45:12,  1.63it/s]
  0%|          | 220/57600 [02:19<9:38:38,  1.65it/s]
                                                     
{'loss': 1.9858, 'learning_rate': 9.996864111498258e-07, 'epoch': 2.43}

  0%|          | 220/57600 [02:19<9:38:38,  1.65it/s]
  0%|          | 221/57600 [02:19<9:36:56,  1.66it/s]
  0%|          | 222/57600 [02:20<9:30:32,  1.68it/s]
  0%|          | 223/57600 [02:20<9:36:27,  1.66it/s]
  0%|          | 224/57600 [02:21<10:08:45,  1.57it/s]
  0%|          | 225/57600 [02:22<9:56:34,  1.60it/s] 
  0%|          | 226/57600 [02:22<9:43:16,  1.64it/s]
  0%|          | 227/57600 [02:23<9:46:49,  1.63it/s]
  0%|          | 228/57600 [02:23<9:42:54,  1.64it/s]
  0%|          | 229/57600 [02:24<9:31:02,  1.67it/s]
  0%|          | 230/57600 [02:25<9:21:39,  1.70it/s]
  0%|          | 231/57600 [02:25<9:34:18,  1.66it/s]
  0%|          | 232/57600 [02:26<9:48:36,  1.62it/s]
  0%|          | 233/57600 [02:26<9:46:53,  1.63it/s]
  0%|          | 234/57600 [02:27<9:56:34,  1.60it/s]
  0%|          | 235/57600 [02:28<9:32:56,  1.67it/s]
  0%|          | 236/57600 [02:28<9:56:33,  1.60it/s]
  0%|          | 237/57600 [02:29<9:55:15,  1.61it/s]
  0%|          | 238/57600 [02:30<9:51:58,  1.61it/s]
  0%|          | 239/57600 [02:30<9:49:33,  1.62it/s]
  0%|          | 240/57600 [02:31<10:05:24,  1.58it/s]
                                                      
{'loss': 1.9373, 'learning_rate': 9.993728222996515e-07, 'epoch': 2.65}

  0%|          | 240/57600 [02:31<10:05:24,  1.58it/s]
  0%|          | 241/57600 [02:31<10:09:45,  1.57it/s]
  0%|          | 242/57600 [02:32<9:48:23,  1.62it/s] 
  0%|          | 243/57600 [02:33<10:26:05,  1.53it/s]
  0%|          | 244/57600 [02:33<10:17:45,  1.55it/s]
  0%|          | 245/57600 [02:34<10:24:33,  1.53it/s]
  0%|          | 246/57600 [02:35<10:10:46,  1.57it/s]
  0%|          | 247/57600 [02:35<10:04:40,  1.58it/s]
  0%|          | 248/57600 [02:36<10:10:09,  1.57it/s]
  0%|          | 249/57600 [02:37<10:07:29,  1.57it/s]
  0%|          | 250/57600 [02:37<10:02:17,  1.59it/s]
  0%|          | 251/57600 [02:38<10:29:58,  1.52it/s]
  0%|          | 252/57600 [02:39<10:01:42,  1.59it/s]
  0%|          | 253/57600 [02:39<10:32:16,  1.51it/s]
  0%|          | 254/57600 [02:40<10:17:51,  1.55it/s]
  0%|          | 255/57600 [02:40<9:54:38,  1.61it/s] 
  0%|          | 256/57600 [02:41<9:45:56,  1.63it/s]
  0%|          | 257/57600 [02:42<9:53:32,  1.61it/s]
  0%|          | 258/57600 [02:42<9:48:26,  1.62it/s]
  0%|          | 259/57600 [02:43<9:53:07,  1.61it/s]
  0%|          | 260/57600 [02:44<9:52:48,  1.61it/s]
                                                     
{'loss': 1.9146, 'learning_rate': 9.990592334494773e-07, 'epoch': 2.87}

  0%|          | 260/57600 [02:44<9:52:48,  1.61it/s]
  0%|          | 261/57600 [02:44<9:58:43,  1.60it/s]
  0%|          | 262/57600 [02:45<10:07:11,  1.57it/s]
  0%|          | 263/57600 [02:45<10:22:58,  1.53it/s]
  0%|          | 264/57600 [02:46<10:15:12,  1.55it/s]
  0%|          | 265/57600 [02:47<10:12:31,  1.56it/s]
  0%|          | 266/57600 [02:47<10:18:45,  1.54it/s]
  0%|          | 267/57600 [02:48<10:20:17,  1.54it/s]
  0%|          | 268/57600 [02:49<10:16:57,  1.55it/s]
  0%|          | 269/57600 [02:49<9:50:41,  1.62it/s] 
  0%|          | 270/57600 [02:50<9:45:05,  1.63it/s]
  0%|          | 271/57600 [02:50<9:48:32,  1.62it/s]
  0%|          | 272/57600 [02:51<9:54:23,  1.61it/s]
  0%|          | 273/57600 [02:52<9:57:59,  1.60it/s]
  0%|          | 274/57600 [02:52<10:10:07,  1.57it/s]
  0%|          | 275/57600 [02:53<10:01:26,  1.59it/s]
  0%|          | 276/57600 [02:54<9:59:15,  1.59it/s] 
  0%|          | 277/57600 [02:54<9:44:20,  1.63it/s]
  0%|          | 278/57600 [02:55<9:41:39,  1.64it/s]
  0%|          | 279/57600 [02:55<9:29:44,  1.68it/s]
  0%|          | 280/57600 [02:56<9:59:29,  1.59it/s]
                                                     
{'loss': 1.8665, 'learning_rate': 9.987456445993032e-07, 'epoch': 3.09}

  0%|          | 280/57600 [02:56<9:59:29,  1.59it/s]
  0%|          | 281/57600 [02:57<9:54:05,  1.61it/s]
  0%|          | 282/57600 [02:57<9:58:41,  1.60it/s]
  0%|          | 283/57600 [02:58<10:04:24,  1.58it/s]
  0%|          | 284/57600 [02:59<10:01:39,  1.59it/s]
  0%|          | 285/57600 [02:59<10:20:33,  1.54it/s]
  0%|          | 286/57600 [03:00<10:09:09,  1.57it/s]
  0%|          | 287/57600 [03:01<9:52:07,  1.61it/s] 
  0%|          | 288/57600 [03:01<10:20:27,  1.54it/s]
  1%|          | 289/57600 [03:02<9:59:23,  1.59it/s] 
  1%|          | 290/57600 [03:02<10:03:13,  1.58it/s]
  1%|          | 291/57600 [03:03<9:57:36,  1.60it/s] 
  1%|          | 292/57600 [03:04<9:52:29,  1.61it/s]
  1%|          | 293/57600 [03:04<9:55:12,  1.60it/s]
  1%|          | 294/57600 [03:05<10:09:58,  1.57it/s]
  1%|          | 295/57600 [03:06<10:05:10,  1.58it/s]
  1%|          | 296/57600 [03:06<9:56:20,  1.60it/s] 
  1%|          | 297/57600 [03:07<9:50:59,  1.62it/s]
  1%|          | 298/57600 [03:07<9:48:46,  1.62it/s]
  1%|          | 299/57600 [03:08<9:49:36,  1.62it/s]
  1%|          | 300/57600 [03:09<9:58:25,  1.60it/s]
                                                     
{'loss': 1.9419, 'learning_rate': 9.98432055749129e-07, 'epoch': 3.31}

  1%|          | 300/57600 [03:09<9:58:25,  1.60it/s]
  1%|          | 301/57600 [03:09<9:52:13,  1.61it/s]
  1%|          | 302/57600 [03:10<10:03:12,  1.58it/s]
  1%|          | 303/57600 [03:11<10:05:07,  1.58it/s]
  1%|          | 304/57600 [03:11<10:19:34,  1.54it/s]
  1%|          | 305/57600 [03:12<10:08:26,  1.57it/s]
  1%|          | 306/57600 [03:13<10:11:44,  1.56it/s]
  1%|          | 307/57600 [03:13<10:24:48,  1.53it/s]
  1%|          | 308/57600 [03:14<10:18:02,  1.55it/s]
  1%|          | 309/57600 [03:15<10:24:42,  1.53it/s]
  1%|          | 310/57600 [03:15<10:23:42,  1.53it/s]
  1%|          | 311/57600 [03:16<10:20:23,  1.54it/s]
  1%|          | 312/57600 [03:16<10:14:58,  1.55it/s]
  1%|          | 313/57600 [03:17<9:52:59,  1.61it/s] 
  1%|          | 314/57600 [03:18<10:07:25,  1.57it/s]
  1%|          | 315/57600 [03:18<10:07:17,  1.57it/s]
  1%|          | 316/57600 [03:19<10:10:11,  1.56it/s]
  1%|          | 317/57600 [03:20<10:00:26,  1.59it/s]
  1%|          | 318/57600 [03:20<9:49:23,  1.62it/s] 
  1%|          | 319/57600 [03:21<9:54:30,  1.61it/s]
  1%|          | 320/57600 [03:21<9:43:43,  1.64it/s]
                                                     
{'loss': 1.8332, 'learning_rate': 9.981184668989545e-07, 'epoch': 3.53}

  1%|          | 320/57600 [03:21<9:43:43,  1.64it/s]
  1%|          | 321/57600 [03:22<9:39:22,  1.65it/s]
  1%|          | 322/57600 [03:23<9:35:57,  1.66it/s]
  1%|          | 323/57600 [03:23<9:38:16,  1.65it/s]
  1%|          | 324/57600 [03:24<9:29:21,  1.68it/s]
  1%|          | 325/57600 [03:25<10:17:13,  1.55it/s]
  1%|          | 326/57600 [03:25<10:21:17,  1.54it/s]
  1%|          | 327/57600 [03:26<10:05:01,  1.58it/s]
  1%|          | 328/57600 [03:26<10:16:35,  1.55it/s]
  1%|          | 329/57600 [03:27<10:00:25,  1.59it/s]
  1%|          | 330/57600 [03:28<10:03:38,  1.58it/s]
  1%|          | 331/57600 [03:28<10:26:10,  1.52it/s]
  1%|          | 332/57600 [03:29<10:16:20,  1.55it/s]
  1%|          | 333/57600 [03:30<10:03:48,  1.58it/s]
  1%|          | 334/57600 [03:30<9:47:56,  1.62it/s] 
  1%|          | 335/57600 [03:31<9:42:24,  1.64it/s]
  1%|          | 336/57600 [03:31<9:47:27,  1.62it/s]
  1%|          | 337/57600 [03:32<9:51:13,  1.61it/s]
  1%|          | 338/57600 [03:33<9:53:47,  1.61it/s]
  1%|          | 339/57600 [03:33<10:06:48,  1.57it/s]
  1%|          | 340/57600 [03:34<10:18:56,  1.54it/s]
                                                      
{'loss': 1.8534, 'learning_rate': 9.978048780487803e-07, 'epoch': 3.75}

  1%|          | 340/57600 [03:34<10:18:56,  1.54it/s]
  1%|          | 341/57600 [03:35<10:14:37,  1.55it/s]
  1%|          | 342/57600 [03:35<10:52:46,  1.46it/s]
  1%|          | 343/57600 [03:36<10:39:13,  1.49it/s]
  1%|          | 344/57600 [03:37<10:05:34,  1.58it/s]
  1%|          | 345/57600 [03:37<10:10:54,  1.56it/s]
  1%|          | 346/57600 [03:38<9:52:21,  1.61it/s] 
  1%|          | 347/57600 [03:38<9:34:05,  1.66it/s]
  1%|          | 348/57600 [03:39<9:25:03,  1.69it/s]
  1%|          | 349/57600 [03:40<9:24:32,  1.69it/s]
  1%|          | 350/57600 [03:40<9:24:33,  1.69it/s]
  1%|          | 351/57600 [03:41<9:32:59,  1.67it/s]
  1%|          | 352/57600 [03:41<9:39:29,  1.65it/s]
  1%|          | 353/57600 [03:42<9:42:51,  1.64it/s]
  1%|          | 354/57600 [03:43<9:39:03,  1.65it/s]
  1%|          | 355/57600 [03:43<9:37:32,  1.65it/s]
  1%|          | 356/57600 [03:44<9:31:27,  1.67it/s]
  1%|          | 357/57600 [03:44<9:40:57,  1.64it/s]
  1%|          | 358/57600 [03:45<9:42:15,  1.64it/s]
  1%|          | 359/57600 [03:46<10:11:15,  1.56it/s]
  1%|          | 360/57600 [03:46<9:59:13,  1.59it/s] 
                                                     
{'loss': 1.9421, 'learning_rate': 9.974912891986062e-07, 'epoch': 3.97}

  1%|          | 360/57600 [03:46<9:59:13,  1.59it/s]
  1%|          | 361/57600 [03:47<10:07:45,  1.57it/s]
  1%|          | 362/57600 [03:48<9:57:42,  1.60it/s] 
  1%|          | 363/57600 [03:48<10:03:49,  1.58it/s]
  1%|          | 364/57600 [03:49<10:02:29,  1.58it/s]
  1%|          | 365/57600 [03:50<10:05:17,  1.58it/s]
  1%|          | 366/57600 [03:50<10:02:33,  1.58it/s]
  1%|          | 367/57600 [03:51<10:01:17,  1.59it/s]
  1%|          | 368/57600 [03:51<10:01:21,  1.59it/s]
  1%|          | 369/57600 [03:52<9:49:13,  1.62it/s] 
  1%|          | 370/57600 [03:53<9:49:24,  1.62it/s]
  1%|          | 371/57600 [03:53<9:53:49,  1.61it/s]
  1%|          | 372/57600 [03:54<9:52:56,  1.61it/s]
  1%|          | 373/57600 [03:54<9:52:34,  1.61it/s]
  1%|          | 374/57600 [03:55<10:16:58,  1.55it/s]
  1%|          | 375/57600 [03:56<10:14:16,  1.55it/s]
  1%|          | 376/57600 [03:56<9:56:17,  1.60it/s] 
  1%|          | 377/57600 [03:57<9:46:20,  1.63it/s]
  1%|          | 378/57600 [03:58<9:48:42,  1.62it/s]
  1%|          | 379/57600 [03:58<9:51:46,  1.61it/s]
  1%|          | 380/57600 [03:59<10:10:09,  1.56it/s]
                                                      
{'loss': 1.9374, 'learning_rate': 9.97177700348432e-07, 'epoch': 4.19}

  1%|          | 380/57600 [03:59<10:10:09,  1.56it/s]
  1%|          | 381/57600 [04:00<9:54:39,  1.60it/s] 
  1%|          | 382/57600 [04:00<9:59:01,  1.59it/s]
  1%|          | 383/57600 [04:01<10:02:48,  1.58it/s]
  1%|          | 384/57600 [04:01<9:58:56,  1.59it/s] 
  1%|          | 385/57600 [04:02<9:54:11,  1.60it/s]
  1%|          | 386/57600 [04:03<10:05:47,  1.57it/s]
  1%|          | 387/57600 [04:03<10:04:29,  1.58it/s]
  1%|          | 388/57600 [04:04<9:43:12,  1.63it/s] 
  1%|          | 389/57600 [04:04<9:38:57,  1.65it/s]
  1%|          | 390/57600 [04:05<9:40:30,  1.64it/s]
  1%|          | 391/57600 [04:06<9:43:43,  1.63it/s]
  1%|          | 392/57600 [04:06<10:08:58,  1.57it/s]
  1%|          | 393/57600 [04:07<10:22:22,  1.53it/s]
  1%|          | 394/57600 [04:08<10:47:40,  1.47it/s]
  1%|          | 395/57600 [04:09<10:59:28,  1.45it/s]
  1%|          | 396/57600 [04:09<10:32:36,  1.51it/s]
  1%|          | 397/57600 [04:10<10:25:46,  1.52it/s]
  1%|          | 398/57600 [04:10<10:10:36,  1.56it/s]
  1%|          | 399/57600 [04:11<10:21:18,  1.53it/s]
  1%|          | 400/57600 [04:12<10:13:11,  1.55it/s]
                                                      
{'loss': 1.8876, 'learning_rate': 9.96864111498258e-07, 'epoch': 4.42}

  1%|          | 400/57600 [04:12<10:13:11,  1.55it/s]
  1%|          | 401/57600 [04:12<10:00:26,  1.59it/s]
  1%|          | 402/57600 [04:13<9:56:21,  1.60it/s] 
  1%|          | 403/57600 [04:14<9:56:01,  1.60it/s]
  1%|          | 404/57600 [04:14<10:07:36,  1.57it/s]
  1%|          | 405/57600 [04:15<10:09:54,  1.56it/s]
  1%|          | 406/57600 [04:16<10:38:28,  1.49it/s]
  1%|          | 407/57600 [04:16<10:36:15,  1.50it/s]
  1%|          | 408/57600 [04:17<10:31:45,  1.51it/s]
  1%|          | 409/57600 [04:18<10:28:38,  1.52it/s]
  1%|          | 410/57600 [04:18<10:13:18,  1.55it/s]
  1%|          | 411/57600 [04:19<10:13:23,  1.55it/s]
  1%|          | 412/57600 [04:19<10:22:57,  1.53it/s]
  1%|          | 413/57600 [04:20<10:09:04,  1.56it/s]
  1%|          | 414/57600 [04:21<10:03:06,  1.58it/s]
  1%|          | 415/57600 [04:21<10:01:48,  1.58it/s]
  1%|          | 416/57600 [04:22<10:06:34,  1.57it/s]
  1%|          | 417/57600 [04:23<9:55:44,  1.60it/s] 
  1%|          | 418/57600 [04:23<9:45:24,  1.63it/s]
  1%|          | 419/57600 [04:24<9:43:34,  1.63it/s]
  1%|          | 420/57600 [04:24<9:41:55,  1.64it/s]
                                                     
{'loss': 1.8593, 'learning_rate': 9.965505226480835e-07, 'epoch': 4.64}

  1%|          | 420/57600 [04:24<9:41:55,  1.64it/s]
  1%|          | 421/57600 [04:25<9:48:57,  1.62it/s]
  1%|          | 422/57600 [04:26<9:54:16,  1.60it/s]
  1%|          | 423/57600 [04:26<9:59:48,  1.59it/s]
  1%|          | 424/57600 [04:27<9:45:13,  1.63it/s]
  1%|          | 425/57600 [04:28<9:55:35,  1.60it/s]
  1%|          | 426/57600 [04:28<9:56:12,  1.60it/s]
  1%|          | 427/57600 [04:29<9:50:17,  1.61it/s]
  1%|          | 428/57600 [04:29<9:48:31,  1.62it/s]
  1%|          | 429/57600 [04:30<10:02:28,  1.58it/s]
  1%|          | 430/57600 [04:31<10:22:56,  1.53it/s]
  1%|          | 431/57600 [04:31<10:17:42,  1.54it/s]
  1%|          | 432/57600 [04:32<10:11:14,  1.56it/s]
  1%|          | 433/57600 [04:33<10:18:13,  1.54it/s]
  1%|          | 434/57600 [04:33<10:21:55,  1.53it/s]
  1%|          | 435/57600 [04:34<10:23:26,  1.53it/s]
  1%|          | 436/57600 [04:35<10:10:50,  1.56it/s]
  1%|          | 437/57600 [04:35<9:56:16,  1.60it/s] 
  1%|          | 438/57600 [04:36<10:05:02,  1.57it/s]
  1%|          | 439/57600 [04:36<9:45:33,  1.63it/s] 
  1%|          | 440/57600 [04:37<9:55:38,  1.60it/s]
                                                     
{'loss': 1.8243, 'learning_rate': 9.962369337979094e-07, 'epoch': 4.86}

  1%|          | 440/57600 [04:37<9:55:38,  1.60it/s]
  1%|          | 441/57600 [04:38<9:55:32,  1.60it/s]
  1%|          | 442/57600 [04:38<9:38:02,  1.65it/s]
  1%|          | 443/57600 [04:39<9:38:58,  1.65it/s]
  1%|          | 444/57600 [04:39<9:32:47,  1.66it/s]
  1%|          | 445/57600 [04:40<9:41:35,  1.64it/s]
  1%|          | 446/57600 [04:41<9:33:02,  1.66it/s]
  1%|          | 447/57600 [04:41<9:57:51,  1.59it/s]
  1%|          | 448/57600 [04:42<9:52:56,  1.61it/s]
  1%|          | 449/57600 [04:43<9:44:22,  1.63it/s]
  1%|          | 450/57600 [04:43<9:52:43,  1.61it/s]
  1%|          | 451/57600 [04:44<9:36:05,  1.65it/s]
  1%|          | 452/57600 [04:44<9:36:48,  1.65it/s]
  1%|          | 453/57600 [04:45<9:38:45,  1.65it/s]
  1%|          | 454/57600 [04:46<10:26:22,  1.52it/s]
  1%|          | 455/57600 [04:46<10:19:30,  1.54it/s]
  1%|          | 456/57600 [04:47<10:05:25,  1.57it/s]
  1%|          | 457/57600 [04:48<10:02:03,  1.58it/s]
  1%|          | 458/57600 [04:48<10:18:55,  1.54it/s]
  1%|          | 459/57600 [04:49<10:37:13,  1.49it/s]
  1%|          | 460/57600 [04:50<10:22:23,  1.53it/s]
                                                      
{'loss': 1.8791, 'learning_rate': 9.95923344947735e-07, 'epoch': 5.08}

  1%|          | 460/57600 [04:50<10:22:23,  1.53it/s]
  1%|          | 461/57600 [04:50<10:05:40,  1.57it/s]
  1%|          | 462/57600 [04:51<9:47:24,  1.62it/s] 
  1%|          | 463/57600 [04:51<10:03:42,  1.58it/s]
  1%|          | 464/57600 [04:52<10:21:11,  1.53it/s]
  1%|          | 465/57600 [04:53<10:16:45,  1.54it/s]
  1%|          | 466/57600 [04:53<10:09:59,  1.56it/s]
  1%|          | 467/57600 [04:54<10:12:55,  1.55it/s]
  1%|          | 468/57600 [04:55<10:10:34,  1.56it/s]
  1%|          | 469/57600 [04:55<10:11:03,  1.56it/s]
  1%|          | 470/57600 [04:56<10:07:17,  1.57it/s]
  1%|          | 471/57600 [04:57<10:08:58,  1.56it/s]
  1%|          | 472/57600 [04:57<9:58:15,  1.59it/s] 
  1%|          | 473/57600 [04:58<9:56:09,  1.60it/s]
  1%|          | 474/57600 [04:59<10:04:05,  1.58it/s]
  1%|          | 475/57600 [04:59<10:00:00,  1.59it/s]
  1%|          | 476/57600 [05:00<9:58:21,  1.59it/s] 
  1%|          | 477/57600 [05:00<10:14:23,  1.55it/s]
  1%|          | 478/57600 [05:01<10:08:47,  1.56it/s]
  1%|          | 479/57600 [05:02<10:11:03,  1.56it/s]
  1%|          | 480/57600 [05:02<9:55:04,  1.60it/s] 
                                                     
{'loss': 1.8878, 'learning_rate': 9.95609756097561e-07, 'epoch': 5.3}

  1%|          | 480/57600 [05:02<9:55:04,  1.60it/s]
  1%|          | 481/57600 [05:03<9:54:05,  1.60it/s]
  1%|          | 482/57600 [05:04<9:48:45,  1.62it/s]
  1%|          | 483/57600 [05:04<10:10:25,  1.56it/s]
  1%|          | 484/57600 [05:05<10:03:51,  1.58it/s]
  1%|          | 485/57600 [05:05<9:50:34,  1.61it/s] 
  1%|          | 486/57600 [05:06<9:53:15,  1.60it/s]
  1%|          | 487/57600 [05:07<10:05:27,  1.57it/s]
  1%|          | 488/57600 [05:07<9:55:04,  1.60it/s] 
  1%|          | 489/57600 [05:08<9:55:16,  1.60it/s]
  1%|          | 490/57600 [05:09<9:39:46,  1.64it/s]
  1%|          | 491/57600 [05:09<9:31:51,  1.66it/s]
  1%|          | 492/57600 [05:10<9:39:29,  1.64it/s]
  1%|          | 493/57600 [05:10<9:42:52,  1.63it/s]
  1%|          | 494/57600 [05:11<9:27:58,  1.68it/s]
  1%|          | 495/57600 [05:12<9:44:57,  1.63it/s]
  1%|          | 496/57600 [05:12<9:52:28,  1.61it/s]
  1%|          | 497/57600 [05:13<9:51:25,  1.61it/s]
  1%|          | 498/57600 [05:13<10:01:12,  1.58it/s]
  1%|          | 499/57600 [05:14<10:03:37,  1.58it/s]
  1%|          | 500/57600 [05:15<10:02:36,  1.58it/s]
                                                      
{'loss': 1.8985, 'learning_rate': 9.952961672473868e-07, 'epoch': 5.52}

  1%|          | 500/57600 [05:15<10:02:36,  1.58it/s]
  1%|          | 501/57600 [05:15<9:55:23,  1.60it/s] 
  1%|          | 502/57600 [05:16<10:06:03,  1.57it/s]
  1%|          | 503/57600 [05:17<10:08:55,  1.56it/s]
  1%|          | 504/57600 [05:17<9:57:07,  1.59it/s] 
  1%|          | 505/57600 [05:18<9:47:34,  1.62it/s]
  1%|          | 506/57600 [05:19<10:07:07,  1.57it/s]
  1%|          | 507/57600 [05:19<10:12:13,  1.55it/s]
  1%|          | 508/57600 [05:20<10:00:28,  1.58it/s]
  1%|          | 509/57600 [05:20<9:46:08,  1.62it/s] 
  1%|          | 510/57600 [05:21<9:43:15,  1.63it/s]
  1%|          | 511/57600 [05:22<9:34:18,  1.66it/s]
  1%|          | 512/57600 [05:22<10:10:05,  1.56it/s]
  1%|          | 513/57600 [05:23<10:26:43,  1.52it/s]
  1%|          | 514/57600 [05:24<10:16:41,  1.54it/s]
  1%|          | 515/57600 [05:24<10:04:48,  1.57it/s]
  1%|          | 516/57600 [05:25<10:12:08,  1.55it/s]
  1%|          | 517/57600 [05:26<10:09:19,  1.56it/s]
  1%|          | 518/57600 [05:26<10:11:28,  1.56it/s]
  1%|          | 519/57600 [05:27<10:10:55,  1.56it/s]
  1%|          | 520/57600 [05:27<9:52:32,  1.61it/s] 
                                                     
{'loss': 1.84, 'learning_rate': 9.949825783972126e-07, 'epoch': 5.74}

  1%|          | 520/57600 [05:27<9:52:32,  1.61it/s]
  1%|          | 521/57600 [05:28<10:10:02,  1.56it/s]
  1%|          | 522/57600 [05:29<10:20:23,  1.53it/s]
  1%|          | 523/57600 [05:29<10:26:24,  1.52it/s]
  1%|          | 524/57600 [05:30<10:02:55,  1.58it/s]
  1%|          | 525/57600 [05:31<10:17:53,  1.54it/s]
  1%|          | 526/57600 [05:31<10:16:26,  1.54it/s]
  1%|          | 527/57600 [05:32<10:17:11,  1.54it/s]
  1%|          | 528/57600 [05:33<10:04:34,  1.57it/s]
  1%|          | 529/57600 [05:33<10:09:08,  1.56it/s]
  1%|          | 530/57600 [05:34<10:05:42,  1.57it/s]
  1%|          | 531/57600 [05:35<10:01:47,  1.58it/s]
  1%|          | 532/57600 [05:35<10:07:44,  1.57it/s]
  1%|          | 533/57600 [05:36<10:00:23,  1.58it/s]
  1%|          | 534/57600 [05:36<10:01:48,  1.58it/s]
  1%|          | 535/57600 [05:37<9:59:37,  1.59it/s] 
  1%|          | 536/57600 [05:38<9:59:45,  1.59it/s]
  1%|          | 537/57600 [05:38<9:51:52,  1.61it/s]
  1%|          | 538/57600 [05:39<10:09:20,  1.56it/s]
  1%|          | 539/57600 [05:40<10:02:46,  1.58it/s]
  1%|          | 540/57600 [05:40<10:02:01,  1.58it/s]
                                                      
{'loss': 1.8468, 'learning_rate': 9.946689895470383e-07, 'epoch': 5.96}

  1%|          | 540/57600 [05:40<10:02:01,  1.58it/s]
  1%|          | 541/57600 [05:41<10:18:25,  1.54it/s]
  1%|          | 542/57600 [05:41<9:59:57,  1.59it/s] 
  1%|          | 543/57600 [05:42<9:43:01,  1.63it/s]
  1%|          | 544/57600 [05:43<10:12:05,  1.55it/s]
  1%|          | 545/57600 [05:43<10:11:36,  1.55it/s]
  1%|          | 546/57600 [05:44<10:09:49,  1.56it/s]
  1%|          | 547/57600 [05:45<10:10:28,  1.56it/s]
  1%|          | 548/57600 [05:45<10:12:20,  1.55it/s]
  1%|          | 549/57600 [05:46<10:32:17,  1.50it/s]
  1%|          | 550/57600 [05:47<10:07:36,  1.56it/s]
  1%|          | 551/57600 [05:47<10:16:06,  1.54it/s]
  1%|          | 552/57600 [05:48<10:08:13,  1.56it/s]
  1%|          | 553/57600 [05:49<10:12:17,  1.55it/s]
  1%|          | 554/57600 [05:49<10:04:07,  1.57it/s]
  1%|          | 555/57600 [05:50<10:18:41,  1.54it/s]
  1%|          | 556/57600 [05:51<10:13:13,  1.55it/s]
  1%|          | 557/57600 [05:51<9:54:50,  1.60it/s] 
  1%|          | 558/57600 [05:52<10:20:35,  1.53it/s]
  1%|          | 559/57600 [05:52<10:27:10,  1.52it/s]
  1%|          | 560/57600 [05:53<10:21:52,  1.53it/s]
                                                      
{'loss': 1.8469, 'learning_rate': 9.94355400696864e-07, 'epoch': 6.18}

  1%|          | 560/57600 [05:53<10:21:52,  1.53it/s]
  1%|          | 561/57600 [05:54<10:20:28,  1.53it/s]
  1%|          | 562/57600 [05:54<10:18:19,  1.54it/s]
  1%|          | 563/57600 [05:55<9:57:51,  1.59it/s] 
  1%|          | 564/57600 [05:56<9:59:39,  1.59it/s]
  1%|          | 565/57600 [05:56<10:35:38,  1.50it/s]
  1%|          | 566/57600 [05:57<10:18:30,  1.54it/s]
  1%|          | 567/57600 [05:58<10:33:18,  1.50it/s]
  1%|          | 568/57600 [05:58<10:14:56,  1.55it/s]
  1%|          | 569/57600 [05:59<9:54:14,  1.60it/s] 
  1%|          | 570/57600 [05:59<9:46:36,  1.62it/s]
  1%|          | 571/57600 [06:00<9:44:32,  1.63it/s]
  1%|          | 572/57600 [06:01<9:38:49,  1.64it/s]
  1%|          | 573/57600 [06:01<9:32:32,  1.66it/s]
  1%|          | 574/57600 [06:02<9:27:05,  1.68it/s]
  1%|          | 575/57600 [06:02<9:40:21,  1.64it/s]
  1%|          | 576/57600 [06:03<9:33:32,  1.66it/s]
  1%|          | 577/57600 [06:04<9:33:52,  1.66it/s]
  1%|          | 578/57600 [06:04<9:47:58,  1.62it/s]
  1%|          | 579/57600 [06:05<9:49:53,  1.61it/s]
  1%|          | 580/57600 [06:06<9:55:13,  1.60it/s]
                                                     
{'loss': 1.8528, 'learning_rate': 9.940418118466898e-07, 'epoch': 6.4}

  1%|          | 580/57600 [06:06<9:55:13,  1.60it/s]
  1%|          | 581/57600 [06:06<10:01:03,  1.58it/s]
  1%|          | 582/57600 [06:07<10:23:03,  1.53it/s]
  1%|          | 583/57600 [06:08<10:22:45,  1.53it/s]
  1%|          | 584/57600 [06:08<10:20:24,  1.53it/s]
  1%|          | 585/57600 [06:09<9:58:31,  1.59it/s] 
  1%|          | 586/57600 [06:09<9:43:04,  1.63it/s]
  1%|          | 587/57600 [06:10<10:03:31,  1.57it/s]
  1%|          | 588/57600 [06:11<10:06:52,  1.57it/s]
  1%|          | 589/57600 [06:11<9:49:29,  1.61it/s] 
  1%|          | 590/57600 [06:12<9:36:04,  1.65it/s]
  1%|          | 591/57600 [06:13<9:50:38,  1.61it/s]
  1%|          | 592/57600 [06:13<9:43:06,  1.63it/s]
  1%|          | 593/57600 [06:14<9:56:19,  1.59it/s]
  1%|          | 594/57600 [06:14<9:43:51,  1.63it/s]
  1%|          | 595/57600 [06:15<9:53:05,  1.60it/s]
  1%|          | 596/57600 [06:16<10:06:11,  1.57it/s]
  1%|          | 597/57600 [06:16<10:13:47,  1.55it/s]
  1%|          | 598/57600 [06:17<10:47:58,  1.47it/s]
  1%|          | 599/57600 [06:18<10:34:51,  1.50it/s]
  1%|          | 600/57600 [06:18<10:23:09,  1.52it/s]
                                                      
{'loss': 1.8269, 'learning_rate': 9.937282229965156e-07, 'epoch': 6.62}

  1%|          | 600/57600 [06:18<10:23:09,  1.52it/s]
  1%|          | 601/57600 [06:19<10:13:05,  1.55it/s]
  1%|          | 602/57600 [06:20<9:56:06,  1.59it/s] 
  1%|          | 603/57600 [06:20<10:06:36,  1.57it/s]
  1%|          | 604/57600 [06:21<9:55:24,  1.60it/s] 
  1%|          | 605/57600 [06:22<10:08:38,  1.56it/s]
  1%|          | 606/57600 [06:22<10:05:35,  1.57it/s]
  1%|          | 607/57600 [06:23<9:49:53,  1.61it/s] 
  1%|          | 608/57600 [06:23<9:46:40,  1.62it/s]
  1%|          | 609/57600 [06:24<9:40:41,  1.64it/s]
  1%|          | 610/57600 [06:25<9:36:23,  1.65it/s]
  1%|          | 611/57600 [06:25<9:59:05,  1.59it/s]
  1%|          | 612/57600 [06:26<9:48:01,  1.62it/s]
  1%|          | 613/57600 [06:26<9:45:12,  1.62it/s]
  1%|          | 614/57600 [06:27<9:54:39,  1.60it/s]
  1%|          | 615/57600 [06:28<10:13:53,  1.55it/s]
  1%|          | 616/57600 [06:28<10:00:54,  1.58it/s]
  1%|          | 617/57600 [06:29<10:06:43,  1.57it/s]
  1%|          | 618/57600 [06:30<10:22:31,  1.53it/s]
  1%|          | 619/57600 [06:30<10:13:03,  1.55it/s]
  1%|          | 620/57600 [06:31<10:16:48,  1.54it/s]
                                                      
{'loss': 1.8324, 'learning_rate': 9.934146341463415e-07, 'epoch': 6.84}

  1%|          | 620/57600 [06:31<10:16:48,  1.54it/s]
  1%|          | 621/57600 [06:32<10:23:20,  1.52it/s]
  1%|          | 622/57600 [06:32<10:43:12,  1.48it/s]
  1%|          | 623/57600 [06:33<10:19:06,  1.53it/s]
  1%|          | 624/57600 [06:34<10:02:43,  1.58it/s]
  1%|          | 625/57600 [06:34<9:55:43,  1.59it/s] 
  1%|          | 626/57600 [06:35<10:12:30,  1.55it/s]
  1%|          | 627/57600 [06:36<10:11:25,  1.55it/s]
  1%|          | 628/57600 [06:36<10:29:53,  1.51it/s]
  1%|          | 629/57600 [06:37<10:17:14,  1.54it/s]
  1%|          | 630/57600 [06:37<10:08:42,  1.56it/s]
  1%|          | 631/57600 [06:38<10:03:10,  1.57it/s]
  1%|          | 632/57600 [06:39<9:54:32,  1.60it/s] 
  1%|          | 633/57600 [06:39<9:38:11,  1.64it/s]
  1%|          | 634/57600 [06:40<9:48:33,  1.61it/s]
  1%|          | 635/57600 [06:41<9:59:13,  1.58it/s]
  1%|          | 636/57600 [06:41<9:45:44,  1.62it/s]
  1%|          | 637/57600 [06:42<9:54:02,  1.60it/s]
  1%|          | 638/57600 [06:42<9:59:12,  1.58it/s]
  1%|          | 639/57600 [06:43<10:10:00,  1.56it/s]
  1%|          | 640/57600 [06:44<10:31:59,  1.50it/s]
                                                      
{'loss': 1.808, 'learning_rate': 9.931010452961673e-07, 'epoch': 7.06}

  1%|          | 640/57600 [06:44<10:31:59,  1.50it/s]
  1%|          | 641/57600 [06:44<10:10:58,  1.55it/s]
  1%|          | 642/57600 [06:45<9:58:29,  1.59it/s] 
  1%|          | 643/57600 [06:46<9:52:25,  1.60it/s]
  1%|          | 644/57600 [06:46<10:03:23,  1.57it/s]
  1%|          | 645/57600 [06:47<10:00:35,  1.58it/s]
  1%|          | 646/57600 [06:48<10:03:12,  1.57it/s]
  1%|          | 647/57600 [06:48<9:52:39,  1.60it/s] 
  1%|          | 648/57600 [06:49<9:55:13,  1.59it/s]
  1%|          | 649/57600 [06:49<10:06:47,  1.56it/s]
  1%|          | 650/57600 [06:50<10:15:12,  1.54it/s]
  1%|          | 651/57600 [06:51<10:17:17,  1.54it/s]
  1%|          | 652/57600 [06:51<10:16:53,  1.54it/s]
  1%|          | 653/57600 [06:52<10:22:29,  1.52it/s]
  1%|          | 654/57600 [06:53<10:19:10,  1.53it/s]
  1%|          | 655/57600 [06:53<10:14:55,  1.54it/s]
  1%|          | 656/57600 [06:54<10:09:22,  1.56it/s]
  1%|          | 657/57600 [06:55<9:59:34,  1.58it/s] 
  1%|          | 658/57600 [06:55<9:58:57,  1.58it/s]
  1%|          | 659/57600 [06:56<10:08:28,  1.56it/s]
  1%|          | 660/57600 [06:57<10:02:34,  1.57it/s]
                                                      
{'loss': 1.9003, 'learning_rate': 9.92787456445993e-07, 'epoch': 7.28}

  1%|          | 660/57600 [06:57<10:02:34,  1.57it/s]
  1%|          | 661/57600 [06:57<10:02:55,  1.57it/s]
  1%|          | 662/57600 [06:58<10:04:02,  1.57it/s]
  1%|          | 663/57600 [06:58<10:05:27,  1.57it/s]
  1%|          | 664/57600 [06:59<10:07:43,  1.56it/s]
  1%|          | 665/57600 [07:00<9:54:28,  1.60it/s] 
  1%|          | 666/57600 [07:00<9:43:00,  1.63it/s]
  1%|          | 667/57600 [07:01<9:36:52,  1.64it/s]
  1%|          | 668/57600 [07:02<10:07:12,  1.56it/s]
  1%|          | 669/57600 [07:02<10:01:33,  1.58it/s]
  1%|          | 670/57600 [07:03<10:09:30,  1.56it/s]
  1%|          | 671/57600 [07:04<10:08:52,  1.56it/s]
  1%|          | 672/57600 [07:04<10:06:51,  1.56it/s]
  1%|          | 673/57600 [07:05<10:12:45,  1.55it/s]
  1%|          | 674/57600 [07:05<9:55:54,  1.59it/s] 
  1%|          | 675/57600 [07:06<9:59:42,  1.58it/s]
  1%|          | 676/57600 [07:07<9:58:34,  1.58it/s]
  1%|          | 677/57600 [07:07<10:10:01,  1.56it/s]
  1%|          | 678/57600 [07:08<10:00:00,  1.58it/s]
  1%|          | 679/57600 [07:09<9:47:42,  1.61it/s] 
  1%|          | 680/57600 [07:09<9:59:14,  1.58it/s]
                                                     
{'loss': 1.908, 'learning_rate': 9.924738675958186e-07, 'epoch': 7.51}

  1%|          | 680/57600 [07:09<9:59:14,  1.58it/s]
  1%|          | 681/57600 [07:10<9:54:34,  1.60it/s]
  1%|          | 682/57600 [07:10<9:47:49,  1.61it/s]
  1%|          | 683/57600 [07:11<9:46:48,  1.62it/s]
  1%|          | 684/57600 [07:12<9:36:41,  1.64it/s]
  1%|          | 685/57600 [07:12<9:47:21,  1.61it/s]
  1%|          | 686/57600 [07:13<9:46:30,  1.62it/s]
  1%|          | 687/57600 [07:14<9:57:37,  1.59it/s]
  1%|          | 688/57600 [07:14<9:47:39,  1.61it/s]
  1%|          | 689/57600 [07:15<9:57:05,  1.59it/s]
  1%|          | 690/57600 [07:15<9:48:41,  1.61it/s]
  1%|          | 691/57600 [07:16<9:42:35,  1.63it/s]
  1%|          | 692/57600 [07:17<9:51:40,  1.60it/s]
  1%|          | 693/57600 [07:17<10:08:50,  1.56it/s]
  1%|          | 694/57600 [07:18<10:00:15,  1.58it/s]
  1%|          | 695/57600 [07:19<10:06:26,  1.56it/s]
  1%|          | 696/57600 [07:19<10:22:48,  1.52it/s]
  1%|          | 697/57600 [07:20<10:09:33,  1.56it/s]
  1%|          | 698/57600 [07:21<10:16:43,  1.54it/s]
  1%|          | 699/57600 [07:21<10:28:12,  1.51it/s]
  1%|          | 700/57600 [07:22<10:38:29,  1.49it/s]
                                                      
{'loss': 1.8165, 'learning_rate': 9.921602787456445e-07, 'epoch': 7.73}

  1%|          | 700/57600 [07:22<10:38:29,  1.49it/s]
  1%|          | 701/57600 [07:23<10:29:03,  1.51it/s]
  1%|          | 702/57600 [07:23<10:22:34,  1.52it/s]
  1%|          | 703/57600 [07:24<10:14:57,  1.54it/s]
  1%|          | 704/57600 [07:24<10:04:41,  1.57it/s]
  1%|          | 705/57600 [07:25<9:50:29,  1.61it/s] 
  1%|          | 706/57600 [07:26<9:43:26,  1.63it/s]
  1%|          | 707/57600 [07:26<9:51:40,  1.60it/s]
  1%|          | 708/57600 [07:27<9:39:45,  1.64it/s]
  1%|          | 709/57600 [07:28<9:57:00,  1.59it/s]
  1%|          | 710/57600 [07:28<9:46:55,  1.62it/s]
  1%|          | 711/57600 [07:29<9:41:45,  1.63it/s]
  1%|          | 712/57600 [07:29<9:51:48,  1.60it/s]
  1%|          | 713/57600 [07:30<10:04:22,  1.57it/s]
  1%|          | 714/57600 [07:31<10:02:21,  1.57it/s]
  1%|          | 715/57600 [07:31<10:12:26,  1.55it/s]
  1%|          | 716/57600 [07:32<10:18:51,  1.53it/s]
  1%|          | 717/57600 [07:33<9:54:37,  1.59it/s] 
  1%|          | 718/57600 [07:33<10:07:30,  1.56it/s]
  1%|          | 719/57600 [07:34<10:24:40,  1.52it/s]
  1%|▏         | 720/57600 [07:35<10:23:31,  1.52it/s]
                                                      
{'loss': 1.7924, 'learning_rate': 9.918466898954704e-07, 'epoch': 7.95}

  1%|▏         | 720/57600 [07:35<10:23:31,  1.52it/s]
  1%|▏         | 721/57600 [07:35<10:13:18,  1.55it/s]
  1%|▏         | 722/57600 [07:36<10:17:07,  1.54it/s]
  1%|▏         | 723/57600 [07:37<10:00:07,  1.58it/s]
  1%|▏         | 724/57600 [07:37<9:58:17,  1.58it/s] 
  1%|▏         | 725/57600 [07:38<10:32:28,  1.50it/s]
  1%|▏         | 726/57600 [07:38<10:13:09,  1.55it/s]
  1%|▏         | 727/57600 [07:39<10:20:27,  1.53it/s]
  1%|▏         | 728/57600 [07:40<10:15:59,  1.54it/s]
  1%|▏         | 729/57600 [07:40<10:16:35,  1.54it/s]
  1%|▏         | 730/57600 [07:41<10:00:10,  1.58it/s]
  1%|▏         | 731/57600 [07:42<10:00:40,  1.58it/s]
  1%|▏         | 732/57600 [07:42<10:10:58,  1.55it/s]
  1%|▏         | 733/57600 [07:43<10:13:24,  1.55it/s]
  1%|▏         | 734/57600 [07:44<9:51:37,  1.60it/s] 
  1%|▏         | 735/57600 [07:44<9:55:08,  1.59it/s]
  1%|▏         | 736/57600 [07:45<9:51:03,  1.60it/s]
  1%|▏         | 737/57600 [07:45<9:41:37,  1.63it/s]
  1%|▏         | 738/57600 [07:46<10:04:02,  1.57it/s]
  1%|▏         | 739/57600 [07:47<10:24:55,  1.52it/s]
  1%|▏         | 740/57600 [07:47<9:56:30,  1.59it/s] 
                                                     
{'loss': 1.8275, 'learning_rate': 9.915331010452962e-07, 'epoch': 8.17}

  1%|▏         | 740/57600 [07:47<9:56:30,  1.59it/s]
  1%|▏         | 741/57600 [07:48<9:56:32,  1.59it/s]
  1%|▏         | 742/57600 [07:49<9:41:29,  1.63it/s]
  1%|▏         | 743/57600 [07:49<9:48:20,  1.61it/s]
  1%|▏         | 744/57600 [07:50<9:34:46,  1.65it/s]
  1%|▏         | 745/57600 [07:50<9:52:51,  1.60it/s]
  1%|▏         | 746/57600 [07:51<10:06:35,  1.56it/s]
  1%|▏         | 747/57600 [07:52<9:39:18,  1.64it/s] 
  1%|▏         | 748/57600 [07:52<9:43:34,  1.62it/s]
  1%|▏         | 749/57600 [07:53<9:32:15,  1.66it/s]
  1%|▏         | 750/57600 [07:53<9:31:26,  1.66it/s]
  1%|▏         | 751/57600 [07:54<9:35:59,  1.64it/s]
  1%|▏         | 752/57600 [07:55<10:07:19,  1.56it/s]
  1%|▏         | 753/57600 [07:55<10:05:30,  1.56it/s]
  1%|▏         | 754/57600 [07:56<9:51:48,  1.60it/s] 
  1%|▏         | 755/57600 [07:57<9:48:29,  1.61it/s]
  1%|▏         | 756/57600 [07:57<10:09:23,  1.55it/s]
  1%|▏         | 757/57600 [07:58<10:00:58,  1.58it/s]
  1%|▏         | 758/57600 [07:59<10:06:40,  1.56it/s]
  1%|▏         | 759/57600 [07:59<10:21:17,  1.52it/s]
  1%|▏         | 760/57600 [08:00<10:10:34,  1.55it/s]
                                                      
{'loss': 1.8033, 'learning_rate': 9.912195121951219e-07, 'epoch': 8.39}

  1%|▏         | 760/57600 [08:00<10:10:34,  1.55it/s]
  1%|▏         | 761/57600 [08:01<9:57:09,  1.59it/s] 
  1%|▏         | 762/57600 [08:01<10:10:34,  1.55it/s]
  1%|▏         | 763/57600 [08:02<10:30:35,  1.50it/s]
  1%|▏         | 764/57600 [08:03<10:17:14,  1.53it/s]
  1%|▏         | 765/57600 [08:03<10:06:08,  1.56it/s]
  1%|▏         | 766/57600 [08:04<10:22:20,  1.52it/s]
  1%|▏         | 767/57600 [08:05<10:25:11,  1.52it/s]
  1%|▏         | 768/57600 [08:05<10:09:07,  1.56it/s]
  1%|▏         | 769/57600 [08:06<9:57:07,  1.59it/s] 
  1%|▏         | 770/57600 [08:06<10:11:59,  1.55it/s]
  1%|▏         | 771/57600 [08:07<10:00:38,  1.58it/s]
  1%|▏         | 772/57600 [08:08<9:59:11,  1.58it/s] 
  1%|▏         | 773/57600 [08:08<9:49:17,  1.61it/s]
  1%|▏         | 774/57600 [08:09<9:58:34,  1.58it/s]
  1%|▏         | 775/57600 [08:09<9:43:08,  1.62it/s]
  1%|▏         | 776/57600 [08:10<9:32:32,  1.65it/s]
  1%|▏         | 777/57600 [08:11<9:41:10,  1.63it/s]
  1%|▏         | 778/57600 [08:11<9:54:57,  1.59it/s]
  1%|▏         | 779/57600 [08:12<10:04:21,  1.57it/s]
  1%|▏         | 780/57600 [08:13<9:53:16,  1.60it/s] 
                                                     
{'loss': 1.8283, 'learning_rate': 9.909059233449477e-07, 'epoch': 8.61}

  1%|▏         | 780/57600 [08:13<9:53:16,  1.60it/s]
  1%|▏         | 781/57600 [08:13<9:52:08,  1.60it/s]
  1%|▏         | 782/57600 [08:14<9:46:51,  1.61it/s]
  1%|▏         | 783/57600 [08:14<9:52:21,  1.60it/s]
  1%|▏         | 784/57600 [08:15<9:59:49,  1.58it/s]
  1%|▏         | 785/57600 [08:16<9:50:53,  1.60it/s]
  1%|▏         | 786/57600 [08:16<9:40:15,  1.63it/s]
  1%|▏         | 787/57600 [08:17<9:46:01,  1.62it/s]
  1%|▏         | 788/57600 [08:18<10:12:15,  1.55it/s]
  1%|▏         | 789/57600 [08:18<10:22:10,  1.52it/s]
  1%|▏         | 790/57600 [08:19<10:01:57,  1.57it/s]
  1%|▏         | 791/57600 [08:20<10:23:15,  1.52it/s]
  1%|▏         | 792/57600 [08:20<10:03:59,  1.57it/s]
  1%|▏         | 793/57600 [08:21<9:47:12,  1.61it/s] 
  1%|▏         | 794/57600 [08:21<9:39:23,  1.63it/s]
  1%|▏         | 795/57600 [08:22<9:29:52,  1.66it/s]
  1%|▏         | 796/57600 [08:23<9:45:18,  1.62it/s]
  1%|▏         | 797/57600 [08:23<9:34:34,  1.65it/s]
  1%|▏         | 798/57600 [08:24<9:59:53,  1.58it/s]
  1%|▏         | 799/57600 [08:25<9:50:52,  1.60it/s]
  1%|▏         | 800/57600 [08:25<9:46:28,  1.61it/s]
                                                     
{'loss': 1.8361, 'learning_rate': 9.905923344947734e-07, 'epoch': 8.83}

  1%|▏         | 800/57600 [08:25<9:46:28,  1.61it/s]
  1%|▏         | 801/57600 [08:26<9:47:10,  1.61it/s]
  1%|▏         | 802/57600 [08:26<10:08:33,  1.56it/s]
  1%|▏         | 803/57600 [08:27<10:06:14,  1.56it/s]
  1%|▏         | 804/57600 [08:28<10:04:38,  1.57it/s]
  1%|▏         | 805/57600 [08:28<9:53:02,  1.60it/s] 
  1%|▏         | 806/57600 [08:29<9:43:10,  1.62it/s]
  1%|▏         | 807/57600 [08:30<9:37:09,  1.64it/s]
  1%|▏         | 808/57600 [08:30<9:40:27,  1.63it/s]
  1%|▏         | 809/57600 [08:31<9:36:43,  1.64it/s]
  1%|▏         | 810/57600 [08:31<9:51:59,  1.60it/s]
  1%|▏         | 811/57600 [08:32<10:16:44,  1.53it/s]
  1%|▏         | 812/57600 [08:33<10:04:15,  1.57it/s]
  1%|▏         | 813/57600 [08:33<10:11:37,  1.55it/s]
  1%|▏         | 814/57600 [08:34<10:13:49,  1.54it/s]
  1%|▏         | 815/57600 [08:35<10:12:47,  1.54it/s]
  1%|▏         | 816/57600 [08:35<10:24:01,  1.52it/s]
  1%|▏         | 817/57600 [08:36<10:15:44,  1.54it/s]
  1%|▏         | 818/57600 [08:37<10:06:10,  1.56it/s]
  1%|▏         | 819/57600 [08:37<10:03:28,  1.57it/s]
  1%|▏         | 820/57600 [08:38<9:54:42,  1.59it/s] 
                                                     
{'loss': 1.8264, 'learning_rate': 9.902787456445992e-07, 'epoch': 9.05}

  1%|▏         | 820/57600 [08:38<9:54:42,  1.59it/s]
  1%|▏         | 821/57600 [08:38<9:52:35,  1.60it/s]
  1%|▏         | 822/57600 [08:39<9:56:20,  1.59it/s]
  1%|▏         | 823/57600 [08:40<9:46:21,  1.61it/s]
  1%|▏         | 824/57600 [08:40<10:33:32,  1.49it/s]
  1%|▏         | 825/57600 [08:41<10:26:54,  1.51it/s]
  1%|▏         | 826/57600 [08:42<10:18:15,  1.53it/s]
  1%|▏         | 827/57600 [08:42<9:55:39,  1.59it/s] 
  1%|▏         | 828/57600 [08:43<9:43:10,  1.62it/s]
  1%|▏         | 829/57600 [08:44<10:02:50,  1.57it/s]
  1%|▏         | 830/57600 [08:44<9:51:43,  1.60it/s] 
  1%|▏         | 831/57600 [08:45<9:41:08,  1.63it/s]
  1%|▏         | 832/57600 [08:45<9:50:36,  1.60it/s]
  1%|▏         | 833/57600 [08:46<9:48:03,  1.61it/s]
  1%|▏         | 834/57600 [08:47<9:39:50,  1.63it/s]
  1%|▏         | 835/57600 [08:47<10:02:43,  1.57it/s]
  1%|▏         | 836/57600 [08:48<10:10:22,  1.55it/s]
  1%|▏         | 837/57600 [08:49<9:50:35,  1.60it/s] 
  1%|▏         | 838/57600 [08:49<9:40:44,  1.63it/s]
  1%|▏         | 839/57600 [08:50<9:47:38,  1.61it/s]
  1%|▏         | 840/57600 [08:50<9:43:03,  1.62it/s]
                                                     
{'loss': 1.8157, 'learning_rate': 9.89965156794425e-07, 'epoch': 9.27}

  1%|▏         | 840/57600 [08:50<9:43:03,  1.62it/s]
  1%|▏         | 841/57600 [08:51<9:54:35,  1.59it/s]
  1%|▏         | 842/57600 [08:52<9:55:47,  1.59it/s]
  1%|▏         | 843/57600 [08:52<9:48:19,  1.61it/s]
  1%|▏         | 844/57600 [08:53<9:58:26,  1.58it/s]
  1%|▏         | 845/57600 [08:54<10:13:57,  1.54it/s]
  1%|▏         | 846/57600 [08:54<10:10:54,  1.55it/s]
  1%|▏         | 847/57600 [08:55<10:16:35,  1.53it/s]
  1%|▏         | 848/57600 [08:56<9:59:26,  1.58it/s] 
  1%|▏         | 849/57600 [08:56<10:10:19,  1.55it/s]
  1%|▏         | 850/57600 [08:57<9:52:38,  1.60it/s] 
  1%|▏         | 851/57600 [08:57<9:52:43,  1.60it/s]
  1%|▏         | 852/57600 [08:58<10:02:48,  1.57it/s]
  1%|▏         | 853/57600 [08:59<10:02:29,  1.57it/s]
  1%|▏         | 854/57600 [08:59<10:16:21,  1.53it/s]
  1%|▏         | 855/57600 [09:00<9:56:47,  1.58it/s] 
  1%|▏         | 856/57600 [09:01<9:48:50,  1.61it/s]
  1%|▏         | 857/57600 [09:01<9:42:11,  1.62it/s]
  1%|▏         | 858/57600 [09:02<9:28:02,  1.66it/s]
  1%|▏         | 859/57600 [09:02<9:32:51,  1.65it/s]
  1%|▏         | 860/57600 [09:03<10:08:39,  1.55it/s]
                                                      
{'loss': 1.8038, 'learning_rate': 9.89651567944251e-07, 'epoch': 9.49}

  1%|▏         | 860/57600 [09:03<10:08:39,  1.55it/s]
  1%|▏         | 861/57600 [09:04<10:31:50,  1.50it/s]
  1%|▏         | 862/57600 [09:04<10:26:41,  1.51it/s]
  1%|▏         | 863/57600 [09:05<10:18:27,  1.53it/s]
  2%|▏         | 864/57600 [09:06<10:14:59,  1.54it/s]
  2%|▏         | 865/57600 [09:06<9:56:33,  1.59it/s] 
  2%|▏         | 866/57600 [09:07<9:44:25,  1.62it/s]
  2%|▏         | 867/57600 [09:08<9:37:56,  1.64it/s]
  2%|▏         | 868/57600 [09:08<9:23:53,  1.68it/s]
  2%|▏         | 869/57600 [09:09<9:41:17,  1.63it/s]
  2%|▏         | 870/57600 [09:09<10:06:24,  1.56it/s]
  2%|▏         | 871/57600 [09:10<9:54:35,  1.59it/s] 
  2%|▏         | 872/57600 [09:11<10:09:17,  1.55it/s]
  2%|▏         | 873/57600 [09:11<10:07:59,  1.56it/s]
  2%|▏         | 874/57600 [09:12<10:17:34,  1.53it/s]
  2%|▏         | 875/57600 [09:13<10:24:48,  1.51it/s]
  2%|▏         | 876/57600 [09:13<10:03:00,  1.57it/s]
  2%|▏         | 877/57600 [09:14<9:45:30,  1.61it/s] 
  2%|▏         | 878/57600 [09:15<9:47:36,  1.61it/s]
  2%|▏         | 879/57600 [09:15<9:38:07,  1.64it/s]
  2%|▏         | 880/57600 [09:16<9:33:48,  1.65it/s]
                                                     
{'loss': 1.8495, 'learning_rate': 9.893379790940768e-07, 'epoch': 9.71}

  2%|▏         | 880/57600 [09:16<9:33:48,  1.65it/s]
  2%|▏         | 881/57600 [09:16<9:41:59,  1.62it/s]
  2%|▏         | 882/57600 [09:17<9:29:14,  1.66it/s]
  2%|▏         | 883/57600 [09:17<9:21:48,  1.68it/s]
  2%|▏         | 884/57600 [09:18<9:34:06,  1.65it/s]
  2%|▏         | 885/57600 [09:19<9:51:54,  1.60it/s]
  2%|▏         | 886/57600 [09:19<9:45:03,  1.62it/s]
  2%|▏         | 887/57600 [09:20<9:37:07,  1.64it/s]
  2%|▏         | 888/57600 [09:21<9:35:12,  1.64it/s]
  2%|▏         | 889/57600 [09:21<9:25:40,  1.67it/s]
  2%|▏         | 890/57600 [09:22<9:44:51,  1.62it/s]
  2%|▏         | 891/57600 [09:22<9:53:01,  1.59it/s]
  2%|▏         | 892/57600 [09:23<10:04:21,  1.56it/s]
  2%|▏         | 893/57600 [09:24<10:23:08,  1.52it/s]
  2%|▏         | 894/57600 [09:25<10:31:56,  1.50it/s]
  2%|▏         | 895/57600 [09:25<10:28:01,  1.50it/s]
  2%|▏         | 896/57600 [09:26<10:25:10,  1.51it/s]
  2%|▏         | 897/57600 [09:27<10:23:39,  1.52it/s]
  2%|▏         | 898/57600 [09:27<10:22:35,  1.52it/s]
  2%|▏         | 899/57600 [09:28<10:07:19,  1.56it/s]
  2%|▏         | 900/57600 [09:28<10:04:26,  1.56it/s]
                                                      
{'loss': 1.8379, 'learning_rate': 9.890243902439024e-07, 'epoch': 9.93}

  2%|▏         | 900/57600 [09:28<10:04:26,  1.56it/s]
  2%|▏         | 901/57600 [09:29<9:59:56,  1.58it/s] 
  2%|▏         | 902/57600 [09:30<9:47:50,  1.61it/s]
  2%|▏         | 903/57600 [09:30<10:09:58,  1.55it/s]
  2%|▏         | 904/57600 [09:31<9:53:47,  1.59it/s] 
  2%|▏         | 905/57600 [09:31<9:33:18,  1.65it/s]
  2%|▏         | 906/57600 [09:32<9:40:16,  1.63it/s]
  2%|▏         | 907/57600 [09:33<9:57:48,  1.58it/s]
  2%|▏         | 908/57600 [09:33<9:55:27,  1.59it/s]
  2%|▏         | 909/57600 [09:34<9:47:33,  1.61it/s]
  2%|▏         | 910/57600 [09:35<9:36:55,  1.64it/s]
  2%|▏         | 911/57600 [09:35<9:30:48,  1.66it/s]
  2%|▏         | 912/57600 [09:36<9:45:35,  1.61it/s]
  2%|▏         | 913/57600 [09:36<9:58:29,  1.58it/s]
  2%|▏         | 914/57600 [09:37<9:51:32,  1.60it/s]
  2%|▏         | 915/57600 [09:38<10:06:08,  1.56it/s]
  2%|▏         | 916/57600 [09:38<10:11:07,  1.55it/s]
  2%|▏         | 917/57600 [09:39<10:18:19,  1.53it/s]
  2%|▏         | 918/57600 [09:40<9:55:57,  1.59it/s] 
  2%|▏         | 919/57600 [09:40<9:38:53,  1.63it/s]
  2%|▏         | 920/57600 [09:41<10:01:53,  1.57it/s]
                                                      
{'loss': 1.807, 'learning_rate': 9.88710801393728e-07, 'epoch': 10.15}

  2%|▏         | 920/57600 [09:41<10:01:53,  1.57it/s]
  2%|▏         | 921/57600 [09:42<10:08:05,  1.55it/s]
  2%|▏         | 922/57600 [09:42<9:53:56,  1.59it/s] 
  2%|▏         | 923/57600 [09:43<9:45:29,  1.61it/s]
  2%|▏         | 924/57600 [09:44<10:09:28,  1.55it/s]
  2%|▏         | 925/57600 [09:44<9:53:33,  1.59it/s] 
  2%|▏         | 926/57600 [09:45<9:40:41,  1.63it/s]
  2%|▏         | 927/57600 [09:45<10:24:01,  1.51it/s]
  2%|▏         | 928/57600 [09:46<10:34:23,  1.49it/s]
  2%|▏         | 929/57600 [09:47<10:32:19,  1.49it/s]
  2%|▏         | 930/57600 [09:47<10:18:44,  1.53it/s]
  2%|▏         | 931/57600 [09:48<10:07:23,  1.55it/s]
  2%|▏         | 932/57600 [09:49<9:54:44,  1.59it/s] 
  2%|▏         | 933/57600 [09:49<9:39:21,  1.63it/s]
  2%|▏         | 934/57600 [09:50<9:54:00,  1.59it/s]
  2%|▏         | 935/57600 [09:50<9:36:29,  1.64it/s]
  2%|▏         | 936/57600 [09:51<9:36:12,  1.64it/s]
  2%|▏         | 937/57600 [09:52<9:33:41,  1.65it/s]
  2%|▏         | 938/57600 [09:52<9:54:04,  1.59it/s]
  2%|▏         | 939/57600 [09:53<9:56:10,  1.58it/s]
  2%|▏         | 940/57600 [09:54<10:15:55,  1.53it/s]
                                                      
{'loss': 1.7354, 'learning_rate': 9.88397212543554e-07, 'epoch': 10.38}

  2%|▏         | 940/57600 [09:54<10:15:55,  1.53it/s]
  2%|▏         | 941/57600 [09:54<10:09:41,  1.55it/s]
  2%|▏         | 942/57600 [09:55<10:15:16,  1.53it/s]
  2%|▏         | 943/57600 [09:56<10:04:47,  1.56it/s]
  2%|▏         | 944/57600 [09:56<10:07:38,  1.55it/s]
  2%|▏         | 945/57600 [09:57<10:07:40,  1.55it/s]
  2%|▏         | 946/57600 [09:57<9:49:43,  1.60it/s] 
  2%|▏         | 947/57600 [09:58<9:51:47,  1.60it/s]
  2%|▏         | 948/57600 [09:59<9:52:13,  1.59it/s]
  2%|▏         | 949/57600 [09:59<9:44:19,  1.62it/s]
  2%|▏         | 950/57600 [10:00<9:46:42,  1.61it/s]
  2%|▏         | 951/57600 [10:01<9:33:15,  1.65it/s]
  2%|▏         | 952/57600 [10:01<9:38:58,  1.63it/s]
  2%|▏         | 953/57600 [10:02<9:32:08,  1.65it/s]
  2%|▏         | 954/57600 [10:02<9:24:55,  1.67it/s]
  2%|▏         | 955/57600 [10:03<9:25:30,  1.67it/s]
  2%|▏         | 956/57600 [10:04<9:44:50,  1.61it/s]
  2%|▏         | 957/57600 [10:04<9:46:30,  1.61it/s]
  2%|▏         | 958/57600 [10:05<10:10:03,  1.55it/s]
  2%|▏         | 959/57600 [10:06<10:08:12,  1.55it/s]
  2%|▏         | 960/57600 [10:06<9:58:02,  1.58it/s] 
                                                     
{'loss': 1.7909, 'learning_rate': 9.880836236933798e-07, 'epoch': 10.6}

  2%|▏         | 960/57600 [10:06<9:58:02,  1.58it/s]
  2%|▏         | 961/57600 [10:07<9:59:02,  1.58it/s]
  2%|▏         | 962/57600 [10:07<10:09:15,  1.55it/s]
  2%|▏         | 963/57600 [10:08<9:56:28,  1.58it/s] 
  2%|▏         | 964/57600 [10:09<9:57:04,  1.58it/s]
  2%|▏         | 965/57600 [10:09<10:04:47,  1.56it/s]
  2%|▏         | 966/57600 [10:10<10:20:54,  1.52it/s]
  2%|▏         | 967/57600 [10:11<10:18:48,  1.53it/s]
  2%|▏         | 968/57600 [10:11<10:04:19,  1.56it/s]
  2%|▏         | 969/57600 [10:12<9:53:09,  1.59it/s] 
  2%|▏         | 970/57600 [10:13<10:06:43,  1.56it/s]
  2%|▏         | 971/57600 [10:13<10:13:47,  1.54it/s]
  2%|▏         | 972/57600 [10:14<9:56:19,  1.58it/s] 
  2%|▏         | 973/57600 [10:15<9:58:32,  1.58it/s]
  2%|▏         | 974/57600 [10:15<9:46:58,  1.61it/s]
  2%|▏         | 975/57600 [10:16<9:53:59,  1.59it/s]
  2%|▏         | 976/57600 [10:16<9:50:43,  1.60it/s]
  2%|▏         | 977/57600 [10:17<9:51:07,  1.60it/s]
  2%|▏         | 978/57600 [10:18<9:42:17,  1.62it/s]
  2%|▏         | 979/57600 [10:18<9:45:50,  1.61it/s]
  2%|▏         | 980/57600 [10:19<9:57:38,  1.58it/s]
                                                     
{'loss': 1.8504, 'learning_rate': 9.877700348432054e-07, 'epoch': 10.82}

  2%|▏         | 980/57600 [10:19<9:57:38,  1.58it/s]
  2%|▏         | 981/57600 [10:19<9:44:16,  1.62it/s]
  2%|▏         | 982/57600 [10:20<9:43:36,  1.62it/s]
  2%|▏         | 983/57600 [10:21<9:49:49,  1.60it/s]
  2%|▏         | 984/57600 [10:21<10:12:34,  1.54it/s]
  2%|▏         | 985/57600 [10:22<9:57:38,  1.58it/s] 
  2%|▏         | 986/57600 [10:23<9:56:44,  1.58it/s]
  2%|▏         | 987/57600 [10:23<10:03:45,  1.56it/s]
  2%|▏         | 988/57600 [10:24<10:30:06,  1.50it/s]
  2%|▏         | 989/57600 [10:25<10:22:19,  1.52it/s]
  2%|▏         | 990/57600 [10:25<10:08:57,  1.55it/s]
  2%|▏         | 991/57600 [10:26<10:01:31,  1.57it/s]
  2%|▏         | 992/57600 [10:27<9:48:45,  1.60it/s] 
  2%|▏         | 993/57600 [10:27<9:46:51,  1.61it/s]
  2%|▏         | 994/57600 [10:28<9:53:35,  1.59it/s]
  2%|▏         | 995/57600 [10:28<9:52:13,  1.59it/s]
  2%|▏         | 996/57600 [10:29<9:41:22,  1.62it/s]
  2%|▏         | 997/57600 [10:30<10:22:29,  1.52it/s]
  2%|▏         | 998/57600 [10:30<10:26:44,  1.51it/s]
  2%|▏         | 999/57600 [10:31<10:25:56,  1.51it/s]
  2%|▏         | 1000/57600 [10:32<10:12:04,  1.54it/s]
                                                       
{'loss': 1.7565, 'learning_rate': 9.874564459930313e-07, 'epoch': 11.04}

  2%|▏         | 1000/57600 [10:32<10:12:04,  1.54it/s]
  2%|▏         | 1001/57600 [10:32<9:52:29,  1.59it/s] 
  2%|▏         | 1002/57600 [10:33<9:32:07,  1.65it/s]
  2%|▏         | 1003/57600 [10:33<9:36:49,  1.64it/s]
  2%|▏         | 1004/57600 [10:34<9:30:57,  1.65it/s]
  2%|▏         | 1005/57600 [10:35<9:33:09,  1.65it/s]
  2%|▏         | 1006/57600 [10:35<9:46:37,  1.61it/s]
  2%|▏         | 1007/57600 [10:36<9:41:20,  1.62it/s]
  2%|▏         | 1008/57600 [10:37<10:01:29,  1.57it/s]
  2%|▏         | 1009/57600 [10:37<9:38:57,  1.63it/s] 
  2%|▏         | 1010/57600 [10:38<10:16:03,  1.53it/s]
  2%|▏         | 1011/57600 [10:38<9:55:30,  1.58it/s] 
  2%|▏         | 1012/57600 [10:39<10:02:53,  1.56it/s]
  2%|▏         | 1013/57600 [10:40<9:54:29,  1.59it/s] 
  2%|▏         | 1014/57600 [10:40<10:12:57,  1.54it/s]
  2%|▏         | 1015/57600 [10:41<10:04:11,  1.56it/s]
  2%|▏         | 1016/57600 [10:42<9:47:57,  1.60it/s] 
  2%|▏         | 1017/57600 [10:42<9:52:39,  1.59it/s]
  2%|▏         | 1018/57600 [10:43<9:29:05,  1.66it/s]
  2%|▏         | 1019/57600 [10:43<9:40:17,  1.63it/s]
  2%|▏         | 1020/57600 [10:44<9:40:24,  1.62it/s]
                                                      
{'loss': 1.8464, 'learning_rate': 9.871428571428572e-07, 'epoch': 11.26}

  2%|▏         | 1020/57600 [10:44<9:40:24,  1.62it/s]
  2%|▏         | 1021/57600 [10:45<9:49:39,  1.60it/s]
  2%|▏         | 1022/57600 [10:45<9:47:37,  1.60it/s]
  2%|▏         | 1023/57600 [10:46<9:49:37,  1.60it/s]
  2%|▏         | 1024/57600 [10:47<10:22:32,  1.51it/s]
  2%|▏         | 1025/57600 [10:47<10:21:51,  1.52it/s]
  2%|▏         | 1026/57600 [10:48<10:29:13,  1.50it/s]
  2%|▏         | 1027/57600 [10:49<10:29:58,  1.50it/s]
  2%|▏         | 1028/57600 [10:49<10:18:56,  1.52it/s]
  2%|▏         | 1029/57600 [10:50<10:17:55,  1.53it/s]
  2%|▏         | 1030/57600 [10:51<10:00:11,  1.57it/s]
  2%|▏         | 1031/57600 [10:51<9:56:18,  1.58it/s] 
  2%|▏         | 1032/57600 [10:52<9:57:41,  1.58it/s]
  2%|▏         | 1033/57600 [10:53<10:23:52,  1.51it/s]
  2%|▏         | 1034/57600 [10:53<10:28:36,  1.50it/s]
  2%|▏         | 1035/57600 [10:54<10:17:03,  1.53it/s]
  2%|▏         | 1036/57600 [10:55<10:00:55,  1.57it/s]
  2%|▏         | 1037/57600 [10:55<9:59:52,  1.57it/s] 
  2%|▏         | 1038/57600 [10:56<9:56:45,  1.58it/s]
  2%|▏         | 1039/57600 [10:56<9:46:25,  1.61it/s]
  2%|▏         | 1040/57600 [10:57<9:45:34,  1.61it/s]
                                                      
{'loss': 1.7463, 'learning_rate': 9.868292682926828e-07, 'epoch': 11.48}

  2%|▏         | 1040/57600 [10:57<9:45:34,  1.61it/s]
  2%|▏         | 1041/57600 [10:58<9:38:44,  1.63it/s]
  2%|▏         | 1042/57600 [10:58<9:26:52,  1.66it/s]
  2%|▏         | 1043/57600 [10:59<9:28:03,  1.66it/s]
  2%|▏         | 1044/57600 [10:59<9:43:50,  1.61it/s]
  2%|▏         | 1045/57600 [11:00<9:43:25,  1.62it/s]
  2%|▏         | 1046/57600 [11:01<9:31:51,  1.65it/s]
  2%|▏         | 1047/57600 [11:01<9:39:20,  1.63it/s]
  2%|▏         | 1048/57600 [11:02<9:59:16,  1.57it/s]
  2%|▏         | 1049/57600 [11:03<9:47:47,  1.60it/s]
  2%|▏         | 1050/57600 [11:03<9:43:13,  1.62it/s]
  2%|▏         | 1051/57600 [11:04<10:00:55,  1.57it/s]
  2%|▏         | 1052/57600 [11:04<9:52:39,  1.59it/s] 
  2%|▏         | 1053/57600 [11:05<10:26:16,  1.50it/s]
  2%|▏         | 1054/57600 [11:06<10:41:37,  1.47it/s]
  2%|▏         | 1055/57600 [11:06<10:10:46,  1.54it/s]
  2%|▏         | 1056/57600 [11:07<10:01:20,  1.57it/s]
  2%|▏         | 1057/57600 [11:08<9:44:55,  1.61it/s] 
  2%|▏         | 1058/57600 [11:08<9:48:05,  1.60it/s]
  2%|▏         | 1059/57600 [11:09<10:01:57,  1.57it/s]
  2%|▏         | 1060/57600 [11:10<9:53:29,  1.59it/s] 
                                                      
{'loss': 1.8286, 'learning_rate': 9.865156794425087e-07, 'epoch': 11.7}

  2%|▏         | 1060/57600 [11:10<9:53:29,  1.59it/s]
  2%|▏         | 1061/57600 [11:10<9:55:38,  1.58it/s]
  2%|▏         | 1062/57600 [11:11<9:55:19,  1.58it/s]
  2%|▏         | 1063/57600 [11:11<9:43:29,  1.61it/s]
  2%|▏         | 1064/57600 [11:12<9:50:59,  1.59it/s]
  2%|▏         | 1065/57600 [11:13<9:33:54,  1.64it/s]
  2%|▏         | 1066/57600 [11:13<9:49:05,  1.60it/s]
  2%|▏         | 1067/57600 [11:14<9:34:33,  1.64it/s]
  2%|▏         | 1068/57600 [11:15<9:40:28,  1.62it/s]
  2%|▏         | 1069/57600 [11:15<9:27:59,  1.66it/s]
  2%|▏         | 1070/57600 [11:16<9:32:30,  1.65it/s]
  2%|▏         | 1071/57600 [11:16<10:01:43,  1.57it/s]
  2%|▏         | 1072/57600 [11:17<9:49:36,  1.60it/s] 
  2%|▏         | 1073/57600 [11:18<9:50:02,  1.60it/s]
  2%|▏         | 1074/57600 [11:18<9:46:32,  1.61it/s]
  2%|▏         | 1075/57600 [11:19<9:56:01,  1.58it/s]
  2%|▏         | 1076/57600 [11:19<9:41:24,  1.62it/s]
  2%|▏         | 1077/57600 [11:20<9:56:16,  1.58it/s]
  2%|▏         | 1078/57600 [11:21<9:57:52,  1.58it/s]
  2%|▏         | 1079/57600 [11:21<9:58:42,  1.57it/s]
  2%|▏         | 1080/57600 [11:22<9:52:38,  1.59it/s]
                                                      
{'loss': 1.7821, 'learning_rate': 9.862020905923345e-07, 'epoch': 11.92}

  2%|▏         | 1080/57600 [11:22<9:52:38,  1.59it/s]
  2%|▏         | 1081/57600 [11:23<9:49:55,  1.60it/s]
  2%|▏         | 1082/57600 [11:23<9:39:19,  1.63it/s]
  2%|▏         | 1083/57600 [11:24<9:58:12,  1.57it/s]
  2%|▏         | 1084/57600 [11:25<9:46:24,  1.61it/s]
  2%|▏         | 1085/57600 [11:25<9:32:13,  1.65it/s]
  2%|▏         | 1086/57600 [11:26<9:53:20,  1.59it/s]
  2%|▏         | 1087/57600 [11:26<9:41:31,  1.62it/s]
  2%|▏         | 1088/57600 [11:27<9:52:24,  1.59it/s]
  2%|▏         | 1089/57600 [11:28<9:37:25,  1.63it/s]
  2%|▏         | 1090/57600 [11:28<9:40:18,  1.62it/s]
  2%|▏         | 1091/57600 [11:29<9:44:43,  1.61it/s]
  2%|▏         | 1092/57600 [11:29<9:45:58,  1.61it/s]
  2%|▏         | 1093/57600 [11:30<9:45:22,  1.61it/s]
  2%|▏         | 1094/57600 [11:31<10:24:17,  1.51it/s]
  2%|▏         | 1095/57600 [11:31<10:02:05,  1.56it/s]
  2%|▏         | 1096/57600 [11:32<9:52:42,  1.59it/s] 
  2%|▏         | 1097/57600 [11:33<9:56:34,  1.58it/s]
  2%|▏         | 1098/57600 [11:33<10:06:08,  1.55it/s]
  2%|▏         | 1099/57600 [11:34<10:19:47,  1.52it/s]
  2%|▏         | 1100/57600 [11:35<10:09:06,  1.55it/s]
                                                       
{'loss': 1.8069, 'learning_rate': 9.858885017421604e-07, 'epoch': 12.14}

  2%|▏         | 1100/57600 [11:35<10:09:06,  1.55it/s]
  2%|▏         | 1101/57600 [11:35<10:04:12,  1.56it/s]
  2%|▏         | 1102/57600 [11:36<10:20:13,  1.52it/s]
  2%|▏         | 1103/57600 [11:37<10:06:45,  1.55it/s]
  2%|▏         | 1104/57600 [11:37<9:49:33,  1.60it/s] 
  2%|▏         | 1105/57600 [11:38<9:38:07,  1.63it/s]
  2%|▏         | 1106/57600 [11:38<9:56:27,  1.58it/s]
  2%|▏         | 1107/57600 [11:39<10:22:34,  1.51it/s]
  2%|▏         | 1108/57600 [11:40<10:13:32,  1.53it/s]
  2%|▏         | 1109/57600 [11:40<10:10:33,  1.54it/s]
  2%|▏         | 1110/57600 [11:41<10:10:39,  1.54it/s]
  2%|▏         | 1111/57600 [11:42<10:18:20,  1.52it/s]
  2%|▏         | 1112/57600 [11:42<10:13:15,  1.54it/s]
  2%|▏         | 1113/57600 [11:43<10:02:58,  1.56it/s]
  2%|▏         | 1114/57600 [11:44<10:02:03,  1.56it/s]
  2%|▏         | 1115/57600 [11:44<9:58:27,  1.57it/s] 
  2%|▏         | 1116/57600 [11:45<9:59:53,  1.57it/s]
  2%|▏         | 1117/57600 [11:46<9:58:08,  1.57it/s]
  2%|▏         | 1118/57600 [11:46<10:07:58,  1.55it/s]
  2%|▏         | 1119/57600 [11:47<9:51:08,  1.59it/s] 
  2%|▏         | 1120/57600 [11:47<9:59:11,  1.57it/s]
                                                      
{'loss': 1.7943, 'learning_rate': 9.85574912891986e-07, 'epoch': 12.36}

  2%|▏         | 1120/57600 [11:47<9:59:11,  1.57it/s]
  2%|▏         | 1121/57600 [11:48<9:50:51,  1.59it/s]
  2%|▏         | 1122/57600 [11:49<9:58:04,  1.57it/s]
  2%|▏         | 1123/57600 [11:49<9:50:10,  1.59it/s]
  2%|▏         | 1124/57600 [11:50<9:46:50,  1.60it/s]
  2%|▏         | 1125/57600 [11:51<9:43:44,  1.61it/s]
  2%|▏         | 1126/57600 [11:51<9:49:23,  1.60it/s]
  2%|▏         | 1127/57600 [11:52<10:01:06,  1.57it/s]
  2%|▏         | 1128/57600 [11:52<9:50:21,  1.59it/s] 
  2%|▏         | 1129/57600 [11:53<10:11:28,  1.54it/s]
  2%|▏         | 1130/57600 [11:54<10:01:05,  1.57it/s]
  2%|▏         | 1131/57600 [11:54<9:52:29,  1.59it/s] 
  2%|▏         | 1132/57600 [11:55<10:27:28,  1.50it/s]
  2%|▏         | 1133/57600 [11:56<10:13:46,  1.53it/s]
  2%|▏         | 1134/57600 [11:56<9:43:42,  1.61it/s] 
  2%|▏         | 1135/57600 [11:57<9:42:01,  1.62it/s]
  2%|▏         | 1136/57600 [11:58<9:30:11,  1.65it/s]
  2%|▏         | 1137/57600 [11:58<9:49:07,  1.60it/s]
  2%|▏         | 1138/57600 [11:59<9:49:30,  1.60it/s]
  2%|▏         | 1139/57600 [11:59<9:50:01,  1.59it/s]
  2%|▏         | 1140/57600 [12:00<9:49:58,  1.59it/s]
                                                      
{'loss': 1.7535, 'learning_rate': 9.852613240418117e-07, 'epoch': 12.58}

  2%|▏         | 1140/57600 [12:00<9:49:58,  1.59it/s]
  2%|▏         | 1141/57600 [12:01<10:00:08,  1.57it/s]
  2%|▏         | 1142/57600 [12:01<10:19:40,  1.52it/s]
  2%|▏         | 1143/57600 [12:02<10:05:44,  1.55it/s]
  2%|▏         | 1144/57600 [12:03<10:16:45,  1.53it/s]
  2%|▏         | 1145/57600 [12:03<10:09:37,  1.54it/s]
  2%|▏         | 1146/57600 [12:04<10:21:11,  1.51it/s]
  2%|▏         | 1147/57600 [12:05<9:58:37,  1.57it/s] 
  2%|▏         | 1148/57600 [12:05<10:15:53,  1.53it/s]
  2%|▏         | 1149/57600 [12:06<10:09:12,  1.54it/s]
  2%|▏         | 1150/57600 [12:07<10:14:05,  1.53it/s]
  2%|▏         | 1151/57600 [12:07<9:58:51,  1.57it/s] 
  2%|▏         | 1152/57600 [12:08<9:53:00,  1.59it/s]
  2%|▏         | 1153/57600 [12:08<9:44:36,  1.61it/s]
  2%|▏         | 1154/57600 [12:09<9:37:05,  1.63it/s]
  2%|▏         | 1155/57600 [12:10<10:01:59,  1.56it/s]
  2%|▏         | 1156/57600 [12:10<9:54:28,  1.58it/s] 
  2%|▏         | 1157/57600 [12:11<9:44:57,  1.61it/s]
  2%|▏         | 1158/57600 [12:12<9:32:16,  1.64it/s]
  2%|▏         | 1159/57600 [12:12<9:23:28,  1.67it/s]
  2%|▏         | 1160/57600 [12:13<9:28:18,  1.66it/s]
                                                      
{'loss': 1.7881, 'learning_rate': 9.849477351916375e-07, 'epoch': 12.8}

  2%|▏         | 1160/57600 [12:13<9:28:18,  1.66it/s]
  2%|▏         | 1161/57600 [12:13<9:32:50,  1.64it/s]
  2%|▏         | 1162/57600 [12:14<9:39:27,  1.62it/s]
  2%|▏         | 1163/57600 [12:15<9:46:56,  1.60it/s]
  2%|▏         | 1164/57600 [12:15<9:51:54,  1.59it/s]
  2%|▏         | 1165/57600 [12:16<9:44:44,  1.61it/s]
  2%|▏         | 1166/57600 [12:17<9:57:13,  1.57it/s]
  2%|▏         | 1167/57600 [12:17<10:00:16,  1.57it/s]
  2%|▏         | 1168/57600 [12:18<9:57:29,  1.57it/s] 
  2%|▏         | 1169/57600 [12:18<9:53:06,  1.59it/s]
  2%|▏         | 1170/57600 [12:19<9:35:15,  1.63it/s]
  2%|▏         | 1171/57600 [12:20<9:56:07,  1.58it/s]
  2%|▏         | 1172/57600 [12:20<9:55:13,  1.58it/s]
  2%|▏         | 1173/57600 [12:21<9:53:38,  1.58it/s]
  2%|▏         | 1174/57600 [12:22<9:44:32,  1.61it/s]
  2%|▏         | 1175/57600 [12:22<9:42:30,  1.61it/s]
  2%|▏         | 1176/57600 [12:23<10:04:17,  1.56it/s]
  2%|▏         | 1177/57600 [12:23<9:55:38,  1.58it/s] 
  2%|▏         | 1178/57600 [12:24<10:11:38,  1.54it/s]
  2%|▏         | 1179/57600 [12:25<10:04:27,  1.56it/s]
  2%|▏         | 1180/57600 [12:26<10:32:23,  1.49it/s]
                                                       
{'loss': 1.815, 'learning_rate': 9.846341463414634e-07, 'epoch': 13.02}

  2%|▏         | 1180/57600 [12:26<10:32:23,  1.49it/s]
  2%|▏         | 1181/57600 [12:26<10:19:30,  1.52it/s]
  2%|▏         | 1182/57600 [12:27<10:09:18,  1.54it/s]
  2%|▏         | 1183/57600 [12:27<10:07:44,  1.55it/s]
  2%|▏         | 1184/57600 [12:28<9:52:36,  1.59it/s] 
  2%|▏         | 1185/57600 [12:29<9:40:31,  1.62it/s]
  2%|▏         | 1186/57600 [12:29<9:31:39,  1.64it/s]
  2%|▏         | 1187/57600 [12:30<10:00:13,  1.57it/s]
  2%|▏         | 1188/57600 [12:31<9:55:39,  1.58it/s] 
  2%|▏         | 1189/57600 [12:31<9:48:59,  1.60it/s]
  2%|▏         | 1190/57600 [12:32<9:51:55,  1.59it/s]
  2%|▏         | 1191/57600 [12:32<10:14:43,  1.53it/s]
  2%|▏         | 1192/57600 [12:33<9:59:32,  1.57it/s] 
  2%|▏         | 1193/57600 [12:34<9:49:51,  1.59it/s]
  2%|▏         | 1194/57600 [12:34<9:46:53,  1.60it/s]
  2%|▏         | 1195/57600 [12:35<9:42:53,  1.61it/s]
  2%|▏         | 1196/57600 [12:36<9:41:50,  1.62it/s]
  2%|▏         | 1197/57600 [12:36<9:35:48,  1.63it/s]
  2%|▏         | 1198/57600 [12:37<9:24:06,  1.67it/s]
  2%|▏         | 1199/57600 [12:37<9:26:23,  1.66it/s]
  2%|▏         | 1200/57600 [12:38<9:13:21,  1.70it/s]
                                                      
{'loss': 1.8258, 'learning_rate': 9.843205574912892e-07, 'epoch': 13.25}

  2%|▏         | 1200/57600 [12:38<9:13:21,  1.70it/s]
  2%|▏         | 1201/57600 [12:38<9:22:25,  1.67it/s]
  2%|▏         | 1202/57600 [12:39<9:41:50,  1.62it/s]
  2%|▏         | 1203/57600 [12:40<9:39:09,  1.62it/s]
  2%|▏         | 1204/57600 [12:40<9:46:19,  1.60it/s]
  2%|▏         | 1205/57600 [12:41<9:40:34,  1.62it/s]
  2%|▏         | 1206/57600 [12:42<9:39:15,  1.62it/s]
  2%|▏         | 1207/57600 [12:42<9:32:57,  1.64it/s]
  2%|▏         | 1208/57600 [12:43<9:39:56,  1.62it/s]
  2%|▏         | 1209/57600 [12:43<9:38:39,  1.62it/s]
  2%|▏         | 1210/57600 [12:44<9:39:03,  1.62it/s]
  2%|▏         | 1211/57600 [12:45<9:46:46,  1.60it/s]
  2%|▏         | 1212/57600 [12:45<10:09:32,  1.54it/s]
  2%|▏         | 1213/57600 [12:46<10:06:26,  1.55it/s]
  2%|▏         | 1214/57600 [12:47<9:49:22,  1.59it/s] 
  2%|▏         | 1215/57600 [12:47<10:01:01,  1.56it/s]
  2%|▏         | 1216/57600 [12:48<9:58:52,  1.57it/s] 
  2%|▏         | 1217/57600 [12:49<10:13:11,  1.53it/s]
  2%|▏         | 1218/57600 [12:49<9:58:33,  1.57it/s] 
  2%|▏         | 1219/57600 [12:50<10:23:31,  1.51it/s]
  2%|▏         | 1220/57600 [12:51<10:31:26,  1.49it/s]
                                                       
{'loss': 1.7228, 'learning_rate': 9.840069686411149e-07, 'epoch': 13.47}

  2%|▏         | 1220/57600 [12:51<10:31:26,  1.49it/s]
  2%|▏         | 1221/57600 [12:51<10:13:48,  1.53it/s]
  2%|▏         | 1222/57600 [12:52<10:04:14,  1.56it/s]
  2%|▏         | 1223/57600 [12:53<10:10:39,  1.54it/s]
  2%|▏         | 1224/57600 [12:53<10:03:33,  1.56it/s]
  2%|▏         | 1225/57600 [12:54<9:56:58,  1.57it/s] 
  2%|▏         | 1226/57600 [12:54<9:42:09,  1.61it/s]
  2%|▏         | 1227/57600 [12:55<9:31:28,  1.64it/s]
  2%|▏         | 1228/57600 [12:56<9:30:11,  1.65it/s]
  2%|▏         | 1229/57600 [12:56<9:31:25,  1.64it/s]
  2%|▏         | 1230/57600 [12:57<9:43:50,  1.61it/s]
  2%|▏         | 1231/57600 [12:57<9:42:30,  1.61it/s]
  2%|▏         | 1232/57600 [12:58<9:48:16,  1.60it/s]
  2%|▏         | 1233/57600 [12:59<9:42:29,  1.61it/s]
  2%|▏         | 1234/57600 [12:59<9:56:23,  1.58it/s]
  2%|▏         | 1235/57600 [13:00<9:51:09,  1.59it/s]
  2%|▏         | 1236/57600 [13:01<9:46:30,  1.60it/s]
  2%|▏         | 1237/57600 [13:01<9:49:17,  1.59it/s]
  2%|▏         | 1238/57600 [13:02<9:52:12,  1.59it/s]
  2%|▏         | 1239/57600 [13:02<9:33:40,  1.64it/s]
  2%|▏         | 1240/57600 [13:03<9:32:40,  1.64it/s]
                                                      
{'loss': 1.7866, 'learning_rate': 9.836933797909407e-07, 'epoch': 13.69}

  2%|▏         | 1240/57600 [13:03<9:32:40,  1.64it/s]
  2%|▏         | 1241/57600 [13:04<9:30:04,  1.65it/s]
  2%|▏         | 1242/57600 [13:04<9:32:18,  1.64it/s]
  2%|▏         | 1243/57600 [13:05<9:52:08,  1.59it/s]
  2%|▏         | 1244/57600 [13:06<9:53:42,  1.58it/s]
  2%|▏         | 1245/57600 [13:06<10:03:33,  1.56it/s]
  2%|▏         | 1246/57600 [13:07<9:39:17,  1.62it/s] 
  2%|▏         | 1247/57600 [13:07<9:47:50,  1.60it/s]
  2%|▏         | 1248/57600 [13:08<9:38:08,  1.62it/s]
  2%|▏         | 1249/57600 [13:09<9:22:25,  1.67it/s]
  2%|▏         | 1250/57600 [13:09<9:20:26,  1.68it/s]
  2%|▏         | 1251/57600 [13:10<9:50:23,  1.59it/s]
  2%|▏         | 1252/57600 [13:11<10:04:40,  1.55it/s]
  2%|▏         | 1253/57600 [13:11<9:51:03,  1.59it/s] 
  2%|▏         | 1254/57600 [13:12<10:04:38,  1.55it/s]
  2%|▏         | 1255/57600 [13:12<9:42:45,  1.61it/s] 
  2%|▏         | 1256/57600 [13:13<9:53:54,  1.58it/s]
  2%|▏         | 1257/57600 [13:14<9:55:52,  1.58it/s]
  2%|▏         | 1258/57600 [13:14<9:47:21,  1.60it/s]
  2%|▏         | 1259/57600 [13:15<9:45:42,  1.60it/s]
  2%|▏         | 1260/57600 [13:16<10:09:46,  1.54it/s]
                                                       
{'loss': 1.7871, 'learning_rate': 9.833797909407664e-07, 'epoch': 13.91}

  2%|▏         | 1260/57600 [13:16<10:09:46,  1.54it/s]
  2%|▏         | 1261/57600 [13:16<10:23:28,  1.51it/s]
  2%|▏         | 1262/57600 [13:17<10:19:56,  1.51it/s]
  2%|▏         | 1263/57600 [13:18<10:07:14,  1.55it/s]
  2%|▏         | 1264/57600 [13:18<10:18:35,  1.52it/s]
  2%|▏         | 1265/57600 [13:19<9:59:59,  1.56it/s] 
  2%|▏         | 1266/57600 [13:19<9:45:51,  1.60it/s]
  2%|▏         | 1267/57600 [13:20<10:01:44,  1.56it/s]
  2%|▏         | 1268/57600 [13:21<10:10:22,  1.54it/s]
  2%|▏         | 1269/57600 [13:22<10:36:54,  1.47it/s]
  2%|▏         | 1270/57600 [13:22<10:20:39,  1.51it/s]
  2%|▏         | 1271/57600 [13:23<10:15:46,  1.52it/s]
  2%|▏         | 1272/57600 [13:23<10:19:48,  1.51it/s]
  2%|▏         | 1273/57600 [13:24<10:05:25,  1.55it/s]
  2%|▏         | 1274/57600 [13:25<10:14:48,  1.53it/s]
  2%|▏         | 1275/57600 [13:25<9:59:05,  1.57it/s] 
  2%|▏         | 1276/57600 [13:26<10:03:14,  1.56it/s]
  2%|▏         | 1277/57600 [13:27<10:02:23,  1.56it/s]
  2%|▏         | 1278/57600 [13:27<10:29:20,  1.49it/s]
  2%|▏         | 1279/57600 [13:28<10:29:38,  1.49it/s]
  2%|▏         | 1280/57600 [13:29<10:20:08,  1.51it/s]
                                                       
{'loss': 1.7238, 'learning_rate': 9.830662020905923e-07, 'epoch': 14.13}

  2%|▏         | 1280/57600 [13:29<10:20:08,  1.51it/s]
  2%|▏         | 1281/57600 [13:29<10:07:37,  1.54it/s]
  2%|▏         | 1282/57600 [13:30<10:15:14,  1.53it/s]
  2%|▏         | 1283/57600 [13:31<9:53:22,  1.58it/s] 
  2%|▏         | 1284/57600 [13:31<9:56:03,  1.57it/s]
  2%|▏         | 1285/57600 [13:32<9:40:54,  1.62it/s]
  2%|▏         | 1286/57600 [13:32<9:31:21,  1.64it/s]
  2%|▏         | 1287/57600 [13:33<9:33:36,  1.64it/s]
  2%|▏         | 1288/57600 [13:34<9:47:24,  1.60it/s]
  2%|▏         | 1289/57600 [13:34<9:37:42,  1.62it/s]
  2%|▏         | 1290/57600 [13:35<9:39:41,  1.62it/s]
  2%|▏         | 1291/57600 [13:35<9:39:53,  1.62it/s]
  2%|▏         | 1292/57600 [13:36<9:52:54,  1.58it/s]
  2%|▏         | 1293/57600 [13:37<9:40:31,  1.62it/s]
  2%|▏         | 1294/57600 [13:37<9:43:30,  1.61it/s]
  2%|▏         | 1295/57600 [13:38<9:51:09,  1.59it/s]
  2%|▏         | 1296/57600 [13:39<9:50:11,  1.59it/s]
  2%|▏         | 1297/57600 [13:39<9:42:36,  1.61it/s]
  2%|▏         | 1298/57600 [13:40<9:28:00,  1.65it/s]
  2%|▏         | 1299/57600 [13:41<9:52:31,  1.58it/s]
  2%|▏         | 1300/57600 [13:41<9:43:16,  1.61it/s]
                                                      
{'loss': 1.805, 'learning_rate': 9.827526132404181e-07, 'epoch': 14.35}

  2%|▏         | 1300/57600 [13:41<9:43:16,  1.61it/s]
  2%|▏         | 1301/57600 [13:42<10:11:59,  1.53it/s]
  2%|▏         | 1302/57600 [13:42<10:11:45,  1.53it/s]
  2%|▏         | 1303/57600 [13:43<9:59:53,  1.56it/s] 
  2%|▏         | 1304/57600 [13:44<10:12:56,  1.53it/s]
  2%|▏         | 1305/57600 [13:44<10:16:50,  1.52it/s]
  2%|▏         | 1306/57600 [13:45<10:19:41,  1.51it/s]
  2%|▏         | 1307/57600 [13:46<10:16:45,  1.52it/s]
  2%|▏         | 1308/57600 [13:46<9:54:29,  1.58it/s] 
  2%|▏         | 1309/57600 [13:47<9:50:34,  1.59it/s]
  2%|▏         | 1310/57600 [13:48<10:05:32,  1.55it/s]
  2%|▏         | 1311/57600 [13:48<10:05:33,  1.55it/s]
  2%|▏         | 1312/57600 [13:49<10:10:02,  1.54it/s]
  2%|▏         | 1313/57600 [13:50<10:06:31,  1.55it/s]
  2%|▏         | 1314/57600 [13:50<9:59:32,  1.56it/s] 
  2%|▏         | 1315/57600 [13:51<10:02:42,  1.56it/s]
  2%|▏         | 1316/57600 [13:52<10:18:21,  1.52it/s]
  2%|▏         | 1317/57600 [13:52<9:56:52,  1.57it/s] 
  2%|▏         | 1318/57600 [13:53<9:54:45,  1.58it/s]
  2%|▏         | 1319/57600 [13:53<9:52:16,  1.58it/s]
  2%|▏         | 1320/57600 [13:54<9:34:41,  1.63it/s]
                                                      
{'loss': 1.7909, 'learning_rate': 9.82439024390244e-07, 'epoch': 14.57}

  2%|▏         | 1320/57600 [13:54<9:34:41,  1.63it/s]
  2%|▏         | 1321/57600 [13:55<9:36:54,  1.63it/s]
  2%|▏         | 1322/57600 [13:55<9:59:46,  1.56it/s]
  2%|▏         | 1323/57600 [13:56<10:02:53,  1.56it/s]
  2%|▏         | 1324/57600 [13:57<9:52:11,  1.58it/s] 
  2%|▏         | 1325/57600 [13:57<9:34:33,  1.63it/s]
  2%|▏         | 1326/57600 [13:58<9:31:40,  1.64it/s]
  2%|▏         | 1327/57600 [13:58<9:22:59,  1.67it/s]
  2%|▏         | 1328/57600 [13:59<9:38:55,  1.62it/s]
  2%|▏         | 1329/57600 [14:00<9:48:24,  1.59it/s]
  2%|▏         | 1330/57600 [14:00<9:42:50,  1.61it/s]
  2%|▏         | 1331/57600 [14:01<9:38:41,  1.62it/s]
  2%|▏         | 1332/57600 [14:01<9:32:01,  1.64it/s]
  2%|▏         | 1333/57600 [14:02<9:29:54,  1.65it/s]
  2%|▏         | 1334/57600 [14:03<9:37:00,  1.63it/s]
  2%|▏         | 1335/57600 [14:03<9:24:29,  1.66it/s]
  2%|▏         | 1336/57600 [14:04<9:30:13,  1.64it/s]
  2%|▏         | 1337/57600 [14:04<9:43:09,  1.61it/s]
  2%|▏         | 1338/57600 [14:05<9:50:45,  1.59it/s]
  2%|▏         | 1339/57600 [14:06<9:49:01,  1.59it/s]
  2%|▏         | 1340/57600 [14:06<10:13:59,  1.53it/s]
                                                       
{'loss': 1.7861, 'learning_rate': 9.821254355400698e-07, 'epoch': 14.79}

  2%|▏         | 1340/57600 [14:06<10:13:59,  1.53it/s]
  2%|▏         | 1341/57600 [14:07<10:11:33,  1.53it/s]
  2%|▏         | 1342/57600 [14:08<9:44:30,  1.60it/s] 
  2%|▏         | 1343/57600 [14:08<9:29:46,  1.65it/s]
  2%|▏         | 1344/57600 [14:09<9:24:28,  1.66it/s]
  2%|▏         | 1345/57600 [14:10<9:49:11,  1.59it/s]
  2%|▏         | 1346/57600 [14:10<10:21:09,  1.51it/s]
  2%|▏         | 1347/57600 [14:11<10:10:21,  1.54it/s]
  2%|▏         | 1348/57600 [14:11<9:48:16,  1.59it/s] 
  2%|▏         | 1349/57600 [14:12<9:48:49,  1.59it/s]
  2%|▏         | 1350/57600 [14:13<9:35:45,  1.63it/s]
  2%|▏         | 1351/57600 [14:13<9:50:25,  1.59it/s]
  2%|▏         | 1352/57600 [14:14<9:38:32,  1.62it/s]
  2%|▏         | 1353/57600 [14:15<9:40:45,  1.61it/s]
  2%|▏         | 1354/57600 [14:15<9:56:32,  1.57it/s]
  2%|▏         | 1355/57600 [14:16<9:52:01,  1.58it/s]
  2%|▏         | 1356/57600 [14:16<9:38:39,  1.62it/s]
  2%|▏         | 1357/57600 [14:17<9:51:52,  1.58it/s]
  2%|▏         | 1358/57600 [14:18<9:41:21,  1.61it/s]
  2%|▏         | 1359/57600 [14:18<9:52:33,  1.58it/s]
  2%|▏         | 1360/57600 [14:19<10:31:38,  1.48it/s]
                                                       
{'loss': 1.7651, 'learning_rate': 9.818118466898953e-07, 'epoch': 15.01}

  2%|▏         | 1360/57600 [14:19<10:31:38,  1.48it/s]
  2%|▏         | 1361/57600 [14:20<10:26:41,  1.50it/s]
  2%|▏         | 1362/57600 [14:20<10:14:12,  1.53it/s]
  2%|▏         | 1363/57600 [14:21<10:23:14,  1.50it/s]
  2%|▏         | 1364/57600 [14:22<10:12:52,  1.53it/s]
  2%|▏         | 1365/57600 [14:22<10:14:29,  1.53it/s]
  2%|▏         | 1366/57600 [14:23<10:41:31,  1.46it/s]
  2%|▏         | 1367/57600 [14:24<10:25:43,  1.50it/s]
  2%|▏         | 1368/57600 [14:24<10:30:25,  1.49it/s]
  2%|▏         | 1369/57600 [14:25<10:15:56,  1.52it/s]
  2%|▏         | 1370/57600 [14:26<10:08:12,  1.54it/s]
  2%|▏         | 1371/57600 [14:26<10:12:21,  1.53it/s]
  2%|▏         | 1372/57600 [14:27<9:52:36,  1.58it/s] 
  2%|▏         | 1373/57600 [14:28<9:40:24,  1.61it/s]
  2%|▏         | 1374/57600 [14:28<9:47:07,  1.60it/s]
  2%|▏         | 1375/57600 [14:29<9:32:55,  1.64it/s]
  2%|▏         | 1376/57600 [14:29<9:48:45,  1.59it/s]
  2%|▏         | 1377/57600 [14:30<9:39:56,  1.62it/s]
  2%|▏         | 1378/57600 [14:31<9:36:39,  1.62it/s]
  2%|▏         | 1379/57600 [14:31<9:37:49,  1.62it/s]
  2%|▏         | 1380/57600 [14:32<9:28:32,  1.65it/s]
                                                      
{'loss': 1.7666, 'learning_rate': 9.814982578397211e-07, 'epoch': 15.23}

  2%|▏         | 1380/57600 [14:32<9:28:32,  1.65it/s]
  2%|▏         | 1381/57600 [14:33<9:58:40,  1.57it/s]
  2%|▏         | 1382/57600 [14:33<10:04:10,  1.55it/s]
  2%|▏         | 1383/57600 [14:34<10:09:35,  1.54it/s]
  2%|▏         | 1384/57600 [14:35<10:21:43,  1.51it/s]
  2%|▏         | 1385/57600 [14:35<10:33:54,  1.48it/s]
  2%|▏         | 1386/57600 [14:36<10:03:07,  1.55it/s]
  2%|▏         | 1387/57600 [14:36<9:38:56,  1.62it/s] 
  2%|▏         | 1388/57600 [14:37<9:44:51,  1.60it/s]
  2%|▏         | 1389/57600 [14:38<9:32:46,  1.64it/s]
  2%|▏         | 1390/57600 [14:38<9:14:35,  1.69it/s]
  2%|▏         | 1391/57600 [14:39<9:16:22,  1.68it/s]
  2%|▏         | 1392/57600 [14:39<9:10:09,  1.70it/s]
  2%|▏         | 1393/57600 [14:40<9:46:02,  1.60it/s]
  2%|▏         | 1394/57600 [14:41<9:37:17,  1.62it/s]
  2%|▏         | 1395/57600 [14:41<9:41:45,  1.61it/s]
  2%|▏         | 1396/57600 [14:42<10:09:42,  1.54it/s]
  2%|▏         | 1397/57600 [14:43<10:07:51,  1.54it/s]
  2%|▏         | 1398/57600 [14:43<9:50:41,  1.59it/s] 
  2%|▏         | 1399/57600 [14:44<10:15:20,  1.52it/s]
  2%|▏         | 1400/57600 [14:45<10:11:41,  1.53it/s]
                                                       
{'loss': 1.7159, 'learning_rate': 9.81184668989547e-07, 'epoch': 15.45}

  2%|▏         | 1400/57600 [14:45<10:11:41,  1.53it/s]
  2%|▏         | 1401/57600 [14:45<9:58:38,  1.56it/s] 
  2%|▏         | 1402/57600 [14:46<10:08:01,  1.54it/s]
  2%|▏         | 1403/57600 [14:46<10:00:04,  1.56it/s]
  2%|▏         | 1404/57600 [14:47<9:53:04,  1.58it/s] 
  2%|▏         | 1405/57600 [14:48<9:51:47,  1.58it/s]
  2%|▏         | 1406/57600 [14:48<9:41:48,  1.61it/s]
  2%|▏         | 1407/57600 [14:49<9:25:13,  1.66it/s]
  2%|▏         | 1408/57600 [14:49<9:18:01,  1.68it/s]
  2%|▏         | 1409/57600 [14:50<9:16:49,  1.68it/s]
  2%|▏         | 1410/57600 [14:51<9:45:09,  1.60it/s]
  2%|▏         | 1411/57600 [14:51<9:56:16,  1.57it/s]
  2%|▏         | 1412/57600 [14:52<9:43:47,  1.60it/s]
  2%|▏         | 1413/57600 [14:53<9:47:15,  1.59it/s]
  2%|▏         | 1414/57600 [14:53<9:31:37,  1.64it/s]
  2%|▏         | 1415/57600 [14:54<9:39:11,  1.62it/s]
  2%|▏         | 1416/57600 [14:55<9:49:35,  1.59it/s]
  2%|▏         | 1417/57600 [14:55<10:00:57,  1.56it/s]
  2%|▏         | 1418/57600 [14:56<9:53:31,  1.58it/s] 
  2%|▏         | 1419/57600 [14:56<9:42:07,  1.61it/s]
  2%|▏         | 1420/57600 [14:57<9:36:02,  1.63it/s]
                                                      
{'loss': 1.7701, 'learning_rate': 9.808710801393728e-07, 'epoch': 15.67}

  2%|▏         | 1420/57600 [14:57<9:36:02,  1.63it/s]
  2%|▏         | 1421/57600 [14:58<9:33:20,  1.63it/s]
  2%|▏         | 1422/57600 [14:58<9:33:59,  1.63it/s]
  2%|▏         | 1423/57600 [14:59<9:22:36,  1.66it/s]
  2%|▏         | 1424/57600 [14:59<9:33:06,  1.63it/s]
  2%|▏         | 1425/57600 [15:00<9:28:36,  1.65it/s]
  2%|▏         | 1426/57600 [15:01<9:39:19,  1.62it/s]
  2%|▏         | 1427/57600 [15:01<9:32:30,  1.64it/s]
  2%|▏         | 1428/57600 [15:02<9:44:24,  1.60it/s]
  2%|▏         | 1429/57600 [15:03<9:52:06,  1.58it/s]
  2%|▏         | 1430/57600 [15:03<9:46:32,  1.60it/s]
  2%|▏         | 1431/57600 [15:04<9:36:05,  1.63it/s]
  2%|▏         | 1432/57600 [15:04<9:35:07,  1.63it/s]
  2%|▏         | 1433/57600 [15:05<9:53:20,  1.58it/s]
  2%|▏         | 1434/57600 [15:06<9:51:29,  1.58it/s]
  2%|▏         | 1435/57600 [15:06<10:02:16,  1.55it/s]
  2%|▏         | 1436/57600 [15:07<9:59:43,  1.56it/s] 
  2%|▏         | 1437/57600 [15:08<9:51:28,  1.58it/s]
  2%|▏         | 1438/57600 [15:08<9:40:33,  1.61it/s]
  2%|▏         | 1439/57600 [15:09<9:30:39,  1.64it/s]
  2%|▎         | 1440/57600 [15:09<9:38:58,  1.62it/s]
                                                      
{'loss': 1.7977, 'learning_rate': 9.805574912891987e-07, 'epoch': 15.89}

  2%|▎         | 1440/57600 [15:09<9:38:58,  1.62it/s]
  3%|▎         | 1441/57600 [15:10<9:36:44,  1.62it/s]
  3%|▎         | 1442/57600 [15:11<9:29:40,  1.64it/s]
  3%|▎         | 1443/57600 [15:11<9:34:51,  1.63it/s]
  3%|▎         | 1444/57600 [15:12<10:13:27,  1.53it/s]
  3%|▎         | 1445/57600 [15:13<10:19:42,  1.51it/s]
  3%|▎         | 1446/57600 [15:13<10:06:24,  1.54it/s]
  3%|▎         | 1447/57600 [15:14<9:45:13,  1.60it/s] 
  3%|▎         | 1448/57600 [15:14<9:39:49,  1.61it/s]
  3%|▎         | 1449/57600 [15:15<9:33:04,  1.63it/s]
  3%|▎         | 1450/57600 [15:16<10:16:08,  1.52it/s]
  3%|▎         | 1451/57600 [15:16<9:56:22,  1.57it/s] 
  3%|▎         | 1452/57600 [15:17<10:02:40,  1.55it/s]
  3%|▎         | 1453/57600 [15:18<9:57:28,  1.57it/s] 
  3%|▎         | 1454/57600 [15:18<9:51:17,  1.58it/s]
  3%|▎         | 1455/57600 [15:19<9:42:39,  1.61it/s]
  3%|▎         | 1456/57600 [15:20<9:41:10,  1.61it/s]
  3%|▎         | 1457/57600 [15:20<9:44:19,  1.60it/s]
  3%|▎         | 1458/57600 [15:21<9:28:03,  1.65it/s]
  3%|▎         | 1459/57600 [15:21<9:45:03,  1.60it/s]
  3%|▎         | 1460/57600 [15:22<9:45:04,  1.60it/s]
                                                      
{'loss': 1.7805, 'learning_rate': 9.802439024390243e-07, 'epoch': 16.11}

  3%|▎         | 1460/57600 [15:22<9:45:04,  1.60it/s]
  3%|▎         | 1461/57600 [15:23<9:57:03,  1.57it/s]
  3%|▎         | 1462/57600 [15:23<9:41:14,  1.61it/s]
  3%|▎         | 1463/57600 [15:24<9:23:56,  1.66it/s]
  3%|▎         | 1464/57600 [15:24<9:27:35,  1.65it/s]
  3%|▎         | 1465/57600 [15:25<9:18:24,  1.68it/s]
  3%|▎         | 1466/57600 [15:26<9:25:12,  1.66it/s]
  3%|▎         | 1467/57600 [15:26<9:36:05,  1.62it/s]
  3%|▎         | 1468/57600 [15:27<9:34:50,  1.63it/s]
  3%|▎         | 1469/57600 [15:27<9:26:46,  1.65it/s]
  3%|▎         | 1470/57600 [15:28<9:31:27,  1.64it/s]
  3%|▎         | 1471/57600 [15:29<9:22:10,  1.66it/s]
  3%|▎         | 1472/57600 [15:29<9:30:30,  1.64it/s]
  3%|▎         | 1473/57600 [15:30<9:17:44,  1.68it/s]
  3%|▎         | 1474/57600 [15:30<9:19:41,  1.67it/s]
  3%|▎         | 1475/57600 [15:31<9:25:01,  1.66it/s]
  3%|▎         | 1476/57600 [15:32<9:32:11,  1.63it/s]
  3%|▎         | 1477/57600 [15:32<9:24:10,  1.66it/s]
  3%|▎         | 1478/57600 [15:33<9:31:28,  1.64it/s]
  3%|▎         | 1479/57600 [15:34<9:30:20,  1.64it/s]
  3%|▎         | 1480/57600 [15:34<9:27:41,  1.65it/s]
                                                      
{'loss': 1.7711, 'learning_rate': 9.799303135888502e-07, 'epoch': 16.34}

  3%|▎         | 1480/57600 [15:34<9:27:41,  1.65it/s]
  3%|▎         | 1481/57600 [15:35<9:33:03,  1.63it/s]
  3%|▎         | 1482/57600 [15:35<9:26:57,  1.65it/s]
  3%|▎         | 1483/57600 [15:36<9:36:22,  1.62it/s]
  3%|▎         | 1484/57600 [15:37<9:27:06,  1.65it/s]
  3%|▎         | 1485/57600 [15:37<9:41:18,  1.61it/s]
  3%|▎         | 1486/57600 [15:38<9:46:34,  1.59it/s]
  3%|▎         | 1487/57600 [15:39<10:07:17,  1.54it/s]
  3%|▎         | 1488/57600 [15:39<10:27:09,  1.49it/s]
  3%|▎         | 1489/57600 [15:40<10:08:57,  1.54it/s]
  3%|▎         | 1490/57600 [15:41<10:09:25,  1.53it/s]
  3%|▎         | 1491/57600 [15:41<10:13:45,  1.52it/s]
  3%|▎         | 1492/57600 [15:42<10:06:28,  1.54it/s]
  3%|▎         | 1493/57600 [15:43<10:04:43,  1.55it/s]
  3%|▎         | 1494/57600 [15:43<10:09:16,  1.53it/s]
  3%|▎         | 1495/57600 [15:44<10:01:34,  1.55it/s]
  3%|▎         | 1496/57600 [15:44<9:50:55,  1.58it/s] 
  3%|▎         | 1497/57600 [15:45<10:00:50,  1.56it/s]
  3%|▎         | 1498/57600 [15:46<9:49:42,  1.59it/s] 
  3%|▎         | 1499/57600 [15:46<10:03:40,  1.55it/s]
  3%|▎         | 1500/57600 [15:47<10:08:54,  1.54it/s]
                                                       
{'loss': 1.6767, 'learning_rate': 9.796167247386758e-07, 'epoch': 16.56}

  3%|▎         | 1500/57600 [15:47<10:08:54,  1.54it/s]
  3%|▎         | 1501/57600 [15:48<9:58:30,  1.56it/s] 
  3%|▎         | 1502/57600 [15:48<9:49:15,  1.59it/s]
  3%|▎         | 1503/57600 [15:49<9:29:55,  1.64it/s]
  3%|▎         | 1504/57600 [15:50<9:59:28,  1.56it/s]
  3%|▎         | 1505/57600 [15:50<9:51:53,  1.58it/s]
  3%|▎         | 1506/57600 [15:51<9:44:18,  1.60it/s]
  3%|▎         | 1507/57600 [15:51<9:36:30,  1.62it/s]
  3%|▎         | 1508/57600 [15:52<9:40:45,  1.61it/s]
  3%|▎         | 1509/57600 [15:53<9:59:23,  1.56it/s]
  3%|▎         | 1510/57600 [15:53<10:01:38,  1.55it/s]
  3%|▎         | 1511/57600 [15:54<9:53:03,  1.58it/s] 
  3%|▎         | 1512/57600 [15:55<9:51:45,  1.58it/s]
  3%|▎         | 1513/57600 [15:55<10:01:15,  1.55it/s]
  3%|▎         | 1514/57600 [15:56<9:40:07,  1.61it/s] 
  3%|▎         | 1515/57600 [15:56<9:40:47,  1.61it/s]
  3%|▎         | 1516/57600 [15:57<9:46:09,  1.59it/s]
  3%|▎         | 1517/57600 [15:58<9:57:57,  1.56it/s]
  3%|▎         | 1518/57600 [15:58<9:40:52,  1.61it/s]
  3%|▎         | 1519/57600 [15:59<9:40:57,  1.61it/s]
  3%|▎         | 1520/57600 [16:00<9:57:55,  1.56it/s]
                                                      
{'loss': 1.722, 'learning_rate': 9.793031358885017e-07, 'epoch': 16.78}

  3%|▎         | 1520/57600 [16:00<9:57:55,  1.56it/s]
  3%|▎         | 1521/57600 [16:00<9:50:30,  1.58it/s]
  3%|▎         | 1522/57600 [16:01<9:30:40,  1.64it/s]
  3%|▎         | 1523/57600 [16:01<9:28:15,  1.64it/s]
  3%|▎         | 1524/57600 [16:02<9:10:53,  1.70it/s]
  3%|▎         | 1525/57600 [16:03<9:25:12,  1.65it/s]
  3%|▎         | 1526/57600 [16:03<9:12:27,  1.69it/s]
  3%|▎         | 1527/57600 [16:04<9:16:48,  1.68it/s]
  3%|▎         | 1528/57600 [16:04<9:10:49,  1.70it/s]
  3%|▎         | 1529/57600 [16:05<9:23:14,  1.66it/s]
  3%|▎         | 1530/57600 [16:06<9:31:12,  1.64it/s]
  3%|▎         | 1531/57600 [16:06<9:32:25,  1.63it/s]
  3%|▎         | 1532/57600 [16:07<9:40:46,  1.61it/s]
  3%|▎         | 1533/57600 [16:07<9:30:23,  1.64it/s]
  3%|▎         | 1534/57600 [16:08<9:47:18,  1.59it/s]
  3%|▎         | 1535/57600 [16:09<9:41:06,  1.61it/s]
  3%|▎         | 1536/57600 [16:09<9:43:39,  1.60it/s]
  3%|▎         | 1537/57600 [16:10<9:55:33,  1.57it/s]
  3%|▎         | 1538/57600 [16:11<9:38:24,  1.62it/s]
  3%|▎         | 1539/57600 [16:11<9:55:07,  1.57it/s]
  3%|▎         | 1540/57600 [16:12<9:53:03,  1.58it/s]
                                                      
{'loss': 1.783, 'learning_rate': 9.789895470383276e-07, 'epoch': 17.0}

  3%|▎         | 1540/57600 [16:12<9:53:03,  1.58it/s]
  3%|▎         | 1541/57600 [16:13<10:09:15,  1.53it/s]
  3%|▎         | 1542/57600 [16:13<10:04:11,  1.55it/s]
  3%|▎         | 1543/57600 [16:14<10:00:15,  1.56it/s]
  3%|▎         | 1544/57600 [16:14<9:55:34,  1.57it/s] 
  3%|▎         | 1545/57600 [16:15<9:52:59,  1.58it/s]
  3%|▎         | 1546/57600 [16:16<9:48:22,  1.59it/s]
  3%|▎         | 1547/57600 [16:16<9:50:14,  1.58it/s]
  3%|▎         | 1548/57600 [16:17<10:00:42,  1.56it/s]
  3%|▎         | 1549/57600 [16:18<9:48:01,  1.59it/s] 
  3%|▎         | 1550/57600 [16:18<9:43:21,  1.60it/s]
  3%|▎         | 1551/57600 [16:19<9:59:09,  1.56it/s]
  3%|▎         | 1552/57600 [16:20<9:59:23,  1.56it/s]
  3%|▎         | 1553/57600 [16:20<9:39:12,  1.61it/s]
  3%|▎         | 1554/57600 [16:21<9:25:35,  1.65it/s]
  3%|▎         | 1555/57600 [16:21<9:57:54,  1.56it/s]
  3%|▎         | 1556/57600 [16:22<9:51:13,  1.58it/s]
  3%|▎         | 1557/57600 [16:23<9:52:30,  1.58it/s]
  3%|▎         | 1558/57600 [16:23<9:48:53,  1.59it/s]
  3%|▎         | 1559/57600 [16:24<9:39:15,  1.61it/s]
  3%|▎         | 1560/57600 [16:24<9:26:14,  1.65it/s]
                                                      
{'loss': 1.7233, 'learning_rate': 9.786759581881534e-07, 'epoch': 17.22}

  3%|▎         | 1560/57600 [16:24<9:26:14,  1.65it/s]
  3%|▎         | 1561/57600 [16:25<9:29:56,  1.64it/s]
  3%|▎         | 1562/57600 [16:26<9:34:24,  1.63it/s]
  3%|▎         | 1563/57600 [16:26<9:45:34,  1.59it/s]
  3%|▎         | 1564/57600 [16:27<9:36:39,  1.62it/s]
  3%|▎         | 1565/57600 [16:28<9:37:46,  1.62it/s]
  3%|▎         | 1566/57600 [16:28<9:23:29,  1.66it/s]
  3%|▎         | 1567/57600 [16:29<9:30:29,  1.64it/s]
  3%|▎         | 1568/57600 [16:29<9:22:07,  1.66it/s]
  3%|▎         | 1569/57600 [16:30<9:34:08,  1.63it/s]
  3%|▎         | 1570/57600 [16:31<9:15:56,  1.68it/s]
  3%|▎         | 1571/57600 [16:31<9:39:41,  1.61it/s]
  3%|▎         | 1572/57600 [16:32<9:53:11,  1.57it/s]
  3%|▎         | 1573/57600 [16:32<9:40:02,  1.61it/s]
  3%|▎         | 1574/57600 [16:33<9:30:00,  1.64it/s]
  3%|▎         | 1575/57600 [16:34<9:41:56,  1.60it/s]
  3%|▎         | 1576/57600 [16:34<9:49:48,  1.58it/s]
  3%|▎         | 1577/57600 [16:35<9:56:35,  1.57it/s]
  3%|▎         | 1578/57600 [16:36<9:52:02,  1.58it/s]
  3%|▎         | 1579/57600 [16:36<9:49:51,  1.58it/s]
  3%|▎         | 1580/57600 [16:37<9:41:12,  1.61it/s]
                                                      
{'loss': 1.7209, 'learning_rate': 9.78362369337979e-07, 'epoch': 17.44}

  3%|▎         | 1580/57600 [16:37<9:41:12,  1.61it/s]
  3%|▎         | 1581/57600 [16:38<9:57:14,  1.56it/s]
  3%|▎         | 1582/57600 [16:38<9:44:15,  1.60it/s]
  3%|▎         | 1583/57600 [16:39<9:33:23,  1.63it/s]
  3%|▎         | 1584/57600 [16:39<9:33:03,  1.63it/s]
  3%|▎         | 1585/57600 [16:40<9:21:03,  1.66it/s]
  3%|▎         | 1586/57600 [16:41<9:35:45,  1.62it/s]
  3%|▎         | 1587/57600 [16:41<9:43:30,  1.60it/s]
  3%|▎         | 1588/57600 [16:42<9:55:48,  1.57it/s]
  3%|▎         | 1589/57600 [16:42<9:47:13,  1.59it/s]
  3%|▎         | 1590/57600 [16:43<10:04:21,  1.54it/s]
  3%|▎         | 1591/57600 [16:44<10:03:31,  1.55it/s]
  3%|▎         | 1592/57600 [16:44<9:52:43,  1.57it/s] 
  3%|▎         | 1593/57600 [16:45<10:02:44,  1.55it/s]
  3%|▎         | 1594/57600 [16:46<9:58:18,  1.56it/s] 
  3%|▎         | 1595/57600 [16:46<9:45:47,  1.59it/s]
  3%|▎         | 1596/57600 [16:47<9:34:30,  1.62it/s]
  3%|▎         | 1597/57600 [16:48<9:55:43,  1.57it/s]
  3%|▎         | 1598/57600 [16:48<10:01:35,  1.55it/s]
  3%|▎         | 1599/57600 [16:49<10:08:15,  1.53it/s]
  3%|▎         | 1600/57600 [16:50<10:09:30,  1.53it/s]
                                                       
{'loss': 1.6968, 'learning_rate': 9.780487804878047e-07, 'epoch': 17.66}

  3%|▎         | 1600/57600 [16:50<10:09:30,  1.53it/s]
  3%|▎         | 1601/57600 [16:50<10:36:20,  1.47it/s]
  3%|▎         | 1602/57600 [16:51<10:10:48,  1.53it/s]
  3%|▎         | 1603/57600 [16:52<10:22:14,  1.50it/s]
  3%|▎         | 1604/57600 [16:52<9:58:38,  1.56it/s] 
  3%|▎         | 1605/57600 [16:53<10:01:00,  1.55it/s]
  3%|▎         | 1606/57600 [16:53<9:54:39,  1.57it/s] 
  3%|▎         | 1607/57600 [16:54<9:59:47,  1.56it/s]
  3%|▎         | 1608/57600 [16:55<10:00:45,  1.55it/s]
  3%|▎         | 1609/57600 [16:55<9:37:46,  1.62it/s] 
  3%|▎         | 1610/57600 [16:56<10:06:41,  1.54it/s]
  3%|▎         | 1611/57600 [16:57<10:11:37,  1.53it/s]
  3%|▎         | 1612/57600 [16:57<9:57:36,  1.56it/s] 
  3%|▎         | 1613/57600 [16:58<9:55:16,  1.57it/s]
  3%|▎         | 1614/57600 [16:59<9:52:55,  1.57it/s]
  3%|▎         | 1615/57600 [16:59<9:45:13,  1.59it/s]
  3%|▎         | 1616/57600 [17:00<9:34:16,  1.62it/s]
  3%|▎         | 1617/57600 [17:00<9:50:24,  1.58it/s]
  3%|▎         | 1618/57600 [17:01<10:00:39,  1.55it/s]
  3%|▎         | 1619/57600 [17:02<9:39:35,  1.61it/s] 
  3%|▎         | 1620/57600 [17:02<10:01:55,  1.55it/s]
                                                       
{'loss': 1.6818, 'learning_rate': 9.777351916376306e-07, 'epoch': 17.88}

  3%|▎         | 1620/57600 [17:02<10:01:55,  1.55it/s]
  3%|▎         | 1621/57600 [17:03<9:58:24,  1.56it/s] 
  3%|▎         | 1622/57600 [17:04<9:45:59,  1.59it/s]
  3%|▎         | 1623/57600 [17:04<9:35:13,  1.62it/s]
  3%|▎         | 1624/57600 [17:05<9:18:13,  1.67it/s]
  3%|▎         | 1625/57600 [17:05<9:23:15,  1.66it/s]
  3%|▎         | 1626/57600 [17:06<9:23:02,  1.66it/s]
  3%|▎         | 1627/57600 [17:07<9:24:03,  1.65it/s]
  3%|▎         | 1628/57600 [17:07<9:12:22,  1.69it/s]
  3%|▎         | 1629/57600 [17:08<9:09:54,  1.70it/s]
  3%|▎         | 1630/57600 [17:08<9:17:18,  1.67it/s]
  3%|▎         | 1631/57600 [17:09<9:32:44,  1.63it/s]
  3%|▎         | 1632/57600 [17:10<9:15:38,  1.68it/s]
  3%|▎         | 1633/57600 [17:10<9:22:02,  1.66it/s]
  3%|▎         | 1634/57600 [17:11<9:22:25,  1.66it/s]
  3%|▎         | 1635/57600 [17:11<9:35:10,  1.62it/s]
  3%|▎         | 1636/57600 [17:12<9:30:14,  1.64it/s]
  3%|▎         | 1637/57600 [17:13<9:45:02,  1.59it/s]
  3%|▎         | 1638/57600 [17:13<9:47:28,  1.59it/s]
  3%|▎         | 1639/57600 [17:14<9:36:29,  1.62it/s]
  3%|▎         | 1640/57600 [17:15<9:40:43,  1.61it/s]
                                                      
{'loss': 1.7819, 'learning_rate': 9.774216027874564e-07, 'epoch': 18.1}

  3%|▎         | 1640/57600 [17:15<9:40:43,  1.61it/s]
  3%|▎         | 1641/57600 [17:15<9:53:33,  1.57it/s]
  3%|▎         | 1642/57600 [17:16<9:57:12,  1.56it/s]
  3%|▎         | 1643/57600 [17:16<9:41:31,  1.60it/s]
  3%|▎         | 1644/57600 [17:17<9:35:35,  1.62it/s]
  3%|▎         | 1645/57600 [17:18<9:44:19,  1.60it/s]
  3%|▎         | 1646/57600 [17:18<9:40:53,  1.61it/s]
  3%|▎         | 1647/57600 [17:19<9:33:09,  1.63it/s]
  3%|▎         | 1648/57600 [17:20<9:22:42,  1.66it/s]
  3%|▎         | 1649/57600 [17:20<9:56:23,  1.56it/s]
  3%|▎         | 1650/57600 [17:21<9:40:34,  1.61it/s]
  3%|▎         | 1651/57600 [17:21<9:33:45,  1.63it/s]
  3%|▎         | 1652/57600 [17:22<9:33:33,  1.63it/s]
  3%|▎         | 1653/57600 [17:23<9:37:58,  1.61it/s]
  3%|▎         | 1654/57600 [17:23<10:00:27,  1.55it/s]
  3%|▎         | 1655/57600 [17:24<9:34:37,  1.62it/s] 
  3%|▎         | 1656/57600 [17:25<9:32:21,  1.63it/s]
  3%|▎         | 1657/57600 [17:25<9:32:13,  1.63it/s]
  3%|▎         | 1658/57600 [17:26<9:34:15,  1.62it/s]
  3%|▎         | 1659/57600 [17:26<9:28:09,  1.64it/s]
  3%|▎         | 1660/57600 [17:27<9:46:06,  1.59it/s]
                                                      
{'loss': 1.7445, 'learning_rate': 9.771080139372823e-07, 'epoch': 18.32}

  3%|▎         | 1660/57600 [17:27<9:46:06,  1.59it/s]
  3%|▎         | 1661/57600 [17:28<9:44:28,  1.60it/s]
  3%|▎         | 1662/57600 [17:28<10:01:59,  1.55it/s]
  3%|▎         | 1663/57600 [17:29<9:51:37,  1.58it/s] 
  3%|▎         | 1664/57600 [17:30<9:38:20,  1.61it/s]
  3%|▎         | 1665/57600 [17:30<9:44:08,  1.60it/s]
  3%|▎         | 1666/57600 [17:31<9:31:10,  1.63it/s]
  3%|▎         | 1667/57600 [17:31<9:30:29,  1.63it/s]
  3%|▎         | 1668/57600 [17:32<9:38:50,  1.61it/s]
  3%|▎         | 1669/57600 [17:33<9:42:59,  1.60it/s]
  3%|▎         | 1670/57600 [17:33<9:39:05,  1.61it/s]
  3%|▎         | 1671/57600 [17:34<9:23:30,  1.65it/s]
  3%|▎         | 1672/57600 [17:35<9:54:15,  1.57it/s]
  3%|▎         | 1673/57600 [17:35<9:56:08,  1.56it/s]
  3%|▎         | 1674/57600 [17:36<9:49:28,  1.58it/s]
  3%|▎         | 1675/57600 [17:36<9:53:18,  1.57it/s]
  3%|▎         | 1676/57600 [17:37<9:50:37,  1.58it/s]
  3%|▎         | 1677/57600 [17:38<9:35:17,  1.62it/s]
  3%|▎         | 1678/57600 [17:38<9:30:30,  1.63it/s]
  3%|▎         | 1679/57600 [17:39<9:30:52,  1.63it/s]
  3%|▎         | 1680/57600 [17:39<9:26:46,  1.64it/s]
                                                      
{'loss': 1.6888, 'learning_rate': 9.76794425087108e-07, 'epoch': 18.54}

  3%|▎         | 1680/57600 [17:39<9:26:46,  1.64it/s]
  3%|▎         | 1681/57600 [17:40<9:28:25,  1.64it/s]
  3%|▎         | 1682/57600 [17:41<9:17:22,  1.67it/s]
  3%|▎         | 1683/57600 [17:41<9:29:33,  1.64it/s]
  3%|▎         | 1684/57600 [17:42<10:12:10,  1.52it/s]
  3%|▎         | 1685/57600 [17:43<9:47:43,  1.59it/s] 
  3%|▎         | 1686/57600 [17:43<9:16:35,  1.67it/s]
  3%|▎         | 1687/57600 [17:44<9:09:53,  1.69it/s]
  3%|▎         | 1688/57600 [17:44<9:13:35,  1.68it/s]
  3%|▎         | 1689/57600 [17:45<9:04:48,  1.71it/s]
  3%|▎         | 1690/57600 [17:45<9:02:54,  1.72it/s]
  3%|▎         | 1691/57600 [17:46<9:33:58,  1.62it/s]
  3%|▎         | 1692/57600 [17:47<9:40:22,  1.61it/s]
  3%|▎         | 1693/57600 [17:47<9:29:09,  1.64it/s]
  3%|▎         | 1694/57600 [17:48<9:25:54,  1.65it/s]
  3%|▎         | 1695/57600 [17:49<9:30:34,  1.63it/s]
  3%|▎         | 1696/57600 [17:49<9:25:51,  1.65it/s]
  3%|▎         | 1697/57600 [17:50<9:28:10,  1.64it/s]
  3%|▎         | 1698/57600 [17:50<9:27:52,  1.64it/s]
  3%|▎         | 1699/57600 [17:51<9:43:06,  1.60it/s]
  3%|▎         | 1700/57600 [17:52<9:23:18,  1.65it/s]
                                                      
{'loss': 1.7562, 'learning_rate': 9.764808362369338e-07, 'epoch': 18.76}

  3%|▎         | 1700/57600 [17:52<9:23:18,  1.65it/s]
  3%|▎         | 1701/57600 [17:52<9:18:32,  1.67it/s]
  3%|▎         | 1702/57600 [17:53<9:08:10,  1.70it/s]
  3%|▎         | 1703/57600 [17:53<9:08:47,  1.70it/s]
  3%|▎         | 1704/57600 [17:54<9:11:54,  1.69it/s]
  3%|▎         | 1705/57600 [17:55<9:26:50,  1.64it/s]
  3%|▎         | 1706/57600 [17:55<9:26:50,  1.64it/s]
  3%|▎         | 1707/57600 [17:56<9:33:21,  1.62it/s]
  3%|▎         | 1708/57600 [17:57<9:42:37,  1.60it/s]
  3%|▎         | 1709/57600 [17:57<9:32:17,  1.63it/s]
  3%|▎         | 1710/57600 [17:58<9:58:51,  1.56it/s]
  3%|▎         | 1711/57600 [17:58<10:00:57,  1.55it/s]
  3%|▎         | 1712/57600 [17:59<10:11:49,  1.52it/s]
  3%|▎         | 1713/57600 [18:00<10:14:10,  1.52it/s]
  3%|▎         | 1714/57600 [18:00<9:44:41,  1.59it/s] 
  3%|▎         | 1715/57600 [18:01<9:53:25,  1.57it/s]
  3%|▎         | 1716/57600 [18:02<9:49:48,  1.58it/s]
  3%|▎         | 1717/57600 [18:02<10:02:23,  1.55it/s]
  3%|▎         | 1718/57600 [18:03<10:28:58,  1.48it/s]
  3%|▎         | 1719/57600 [18:04<10:17:45,  1.51it/s]
  3%|▎         | 1720/57600 [18:04<10:10:27,  1.53it/s]
                                                       
{'loss': 1.7368, 'learning_rate': 9.761672473867594e-07, 'epoch': 18.98}

  3%|▎         | 1720/57600 [18:04<10:10:27,  1.53it/s]
  3%|▎         | 1721/57600 [18:05<10:07:22,  1.53it/s]
  3%|▎         | 1722/57600 [18:06<10:25:42,  1.49it/s]
  3%|▎         | 1723/57600 [18:06<10:07:33,  1.53it/s]
  3%|▎         | 1724/57600 [18:07<10:01:49,  1.55it/s]
  3%|▎         | 1725/57600 [18:08<9:51:01,  1.58it/s] 
  3%|▎         | 1726/57600 [18:08<9:44:10,  1.59it/s]
  3%|▎         | 1727/57600 [18:09<9:50:38,  1.58it/s]
  3%|▎         | 1728/57600 [18:09<9:41:49,  1.60it/s]
  3%|▎         | 1729/57600 [18:10<9:45:08,  1.59it/s]
  3%|▎         | 1730/57600 [18:11<9:45:39,  1.59it/s]
  3%|▎         | 1731/57600 [18:11<9:41:54,  1.60it/s]
  3%|▎         | 1732/57600 [18:12<9:50:31,  1.58it/s]
  3%|▎         | 1733/57600 [18:13<9:44:22,  1.59it/s]
  3%|▎         | 1734/57600 [18:13<9:56:28,  1.56it/s]
  3%|▎         | 1735/57600 [18:14<9:38:09,  1.61it/s]
  3%|▎         | 1736/57600 [18:14<9:33:53,  1.62it/s]
  3%|▎         | 1737/57600 [18:15<9:50:24,  1.58it/s]
  3%|▎         | 1738/57600 [18:16<10:04:00,  1.54it/s]
  3%|▎         | 1739/57600 [18:16<9:50:45,  1.58it/s] 
  3%|▎         | 1740/57600 [18:17<9:39:06,  1.61it/s]
                                                      
{'loss': 1.6816, 'learning_rate': 9.758536585365853e-07, 'epoch': 19.21}

  3%|▎         | 1740/57600 [18:17<9:39:06,  1.61it/s]
  3%|▎         | 1741/57600 [18:18<9:40:49,  1.60it/s]
  3%|▎         | 1742/57600 [18:18<9:36:10,  1.62it/s]
  3%|▎         | 1743/57600 [18:19<9:23:14,  1.65it/s]
  3%|▎         | 1744/57600 [18:19<9:27:29,  1.64it/s]
  3%|▎         | 1745/57600 [18:20<9:18:50,  1.67it/s]
  3%|▎         | 1746/57600 [18:21<9:19:37,  1.66it/s]
  3%|▎         | 1747/57600 [18:21<9:13:35,  1.68it/s]
  3%|▎         | 1748/57600 [18:22<9:13:18,  1.68it/s]
  3%|▎         | 1749/57600 [18:22<9:43:12,  1.60it/s]
  3%|▎         | 1750/57600 [18:23<9:58:42,  1.55it/s]
  3%|▎         | 1751/57600 [18:24<10:12:49,  1.52it/s]
  3%|▎         | 1752/57600 [18:24<10:10:09,  1.53it/s]
  3%|▎         | 1753/57600 [18:25<9:45:31,  1.59it/s] 
  3%|▎         | 1754/57600 [18:26<9:25:57,  1.64it/s]
  3%|▎         | 1755/57600 [18:26<9:24:42,  1.65it/s]
  3%|▎         | 1756/57600 [18:27<9:52:04,  1.57it/s]
  3%|▎         | 1757/57600 [18:27<9:31:43,  1.63it/s]
  3%|▎         | 1758/57600 [18:28<9:30:29,  1.63it/s]
  3%|▎         | 1759/57600 [18:29<9:25:05,  1.65it/s]
  3%|▎         | 1760/57600 [18:29<9:29:03,  1.64it/s]
                                                      
{'loss': 1.7307, 'learning_rate': 9.755400696864111e-07, 'epoch': 19.43}

  3%|▎         | 1760/57600 [18:29<9:29:03,  1.64it/s]
  3%|▎         | 1761/57600 [18:30<9:45:54,  1.59it/s]
  3%|▎         | 1762/57600 [18:31<9:36:38,  1.61it/s]
  3%|▎         | 1763/57600 [18:31<9:41:43,  1.60it/s]
  3%|▎         | 1764/57600 [18:32<9:24:30,  1.65it/s]
  3%|▎         | 1765/57600 [18:32<9:15:15,  1.68it/s]
  3%|▎         | 1766/57600 [18:33<9:23:42,  1.65it/s]
  3%|▎         | 1767/57600 [18:34<9:39:54,  1.60it/s]
  3%|▎         | 1768/57600 [18:34<10:03:03,  1.54it/s]
  3%|▎         | 1769/57600 [18:35<10:26:54,  1.48it/s]
  3%|▎         | 1770/57600 [18:36<10:14:04,  1.52it/s]
  3%|▎         | 1771/57600 [18:36<10:02:20,  1.54it/s]
  3%|▎         | 1772/57600 [18:37<10:01:18,  1.55it/s]
  3%|▎         | 1773/57600 [18:38<9:38:25,  1.61it/s] 
  3%|▎         | 1774/57600 [18:38<9:39:43,  1.60it/s]
  3%|▎         | 1775/57600 [18:39<9:26:35,  1.64it/s]
  3%|▎         | 1776/57600 [18:39<9:28:56,  1.64it/s]
  3%|▎         | 1777/57600 [18:40<9:23:43,  1.65it/s]
  3%|▎         | 1778/57600 [18:41<9:33:08,  1.62it/s]
  3%|▎         | 1779/57600 [18:41<9:33:50,  1.62it/s]
  3%|▎         | 1780/57600 [18:42<9:38:05,  1.61it/s]
                                                      
{'loss': 1.7313, 'learning_rate': 9.75226480836237e-07, 'epoch': 19.65}

  3%|▎         | 1780/57600 [18:42<9:38:05,  1.61it/s]
  3%|▎         | 1781/57600 [18:42<9:22:25,  1.65it/s]
  3%|▎         | 1782/57600 [18:43<9:38:11,  1.61it/s]
  3%|▎         | 1783/57600 [18:44<9:44:22,  1.59it/s]
  3%|▎         | 1784/57600 [18:44<9:44:57,  1.59it/s]
  3%|▎         | 1785/57600 [18:45<9:49:59,  1.58it/s]
  3%|▎         | 1786/57600 [18:46<9:41:57,  1.60it/s]
  3%|▎         | 1787/57600 [18:46<9:46:48,  1.59it/s]
  3%|▎         | 1788/57600 [18:47<9:41:54,  1.60it/s]
  3%|▎         | 1789/57600 [18:47<9:27:35,  1.64it/s]
  3%|▎         | 1790/57600 [18:48<9:24:17,  1.65it/s]
  3%|▎         | 1791/57600 [18:49<9:13:28,  1.68it/s]
  3%|▎         | 1792/57600 [18:49<9:24:21,  1.65it/s]
  3%|▎         | 1793/57600 [18:50<9:09:19,  1.69it/s]
  3%|▎         | 1794/57600 [18:51<9:52:56,  1.57it/s]
  3%|▎         | 1795/57600 [18:51<9:48:57,  1.58it/s]
  3%|▎         | 1796/57600 [18:52<9:33:02,  1.62it/s]
  3%|▎         | 1797/57600 [18:52<9:41:57,  1.60it/s]
  3%|▎         | 1798/57600 [18:53<9:38:40,  1.61it/s]
  3%|▎         | 1799/57600 [18:54<9:32:00,  1.63it/s]
  3%|▎         | 1800/57600 [18:54<9:46:56,  1.58it/s]
                                                      
{'loss': 1.7407, 'learning_rate': 9.749128919860627e-07, 'epoch': 19.87}

  3%|▎         | 1800/57600 [18:54<9:46:56,  1.58it/s]
  3%|▎         | 1801/57600 [18:55<9:42:34,  1.60it/s]
  3%|▎         | 1802/57600 [18:55<9:30:33,  1.63it/s]
  3%|▎         | 1803/57600 [18:56<9:46:05,  1.59it/s]
  3%|▎         | 1804/57600 [18:57<9:53:46,  1.57it/s]
  3%|▎         | 1805/57600 [18:57<10:08:01,  1.53it/s]
  3%|▎         | 1806/57600 [18:58<10:16:06,  1.51it/s]
  3%|▎         | 1807/57600 [18:59<9:56:56,  1.56it/s] 
  3%|▎         | 1808/57600 [18:59<10:05:45,  1.54it/s]
  3%|▎         | 1809/57600 [19:00<9:44:28,  1.59it/s] 
  3%|▎         | 1810/57600 [19:01<9:37:10,  1.61it/s]
  3%|▎         | 1811/57600 [19:01<9:50:55,  1.57it/s]
  3%|▎         | 1812/57600 [19:02<9:52:31,  1.57it/s]
  3%|▎         | 1813/57600 [19:03<9:54:57,  1.56it/s]
  3%|▎         | 1814/57600 [19:03<10:01:46,  1.55it/s]
  3%|▎         | 1815/57600 [19:04<9:59:15,  1.55it/s] 
  3%|▎         | 1816/57600 [19:05<10:06:49,  1.53it/s]
  3%|▎         | 1817/57600 [19:05<9:43:55,  1.59it/s] 
  3%|▎         | 1818/57600 [19:06<9:58:13,  1.55it/s]
  3%|▎         | 1819/57600 [19:06<9:51:43,  1.57it/s]
  3%|▎         | 1820/57600 [19:07<10:00:13,  1.55it/s]
                                                       
{'loss': 1.6885, 'learning_rate': 9.745993031358883e-07, 'epoch': 20.09}

  3%|▎         | 1820/57600 [19:07<10:00:13,  1.55it/s]
  3%|▎         | 1821/57600 [19:08<9:47:39,  1.58it/s] 
  3%|▎         | 1822/57600 [19:08<9:42:52,  1.59it/s]
  3%|▎         | 1823/57600 [19:09<9:36:11,  1.61it/s]
  3%|▎         | 1824/57600 [19:10<9:45:58,  1.59it/s]
  3%|▎         | 1825/57600 [19:10<9:59:40,  1.55it/s]
  3%|▎         | 1826/57600 [19:11<9:45:29,  1.59it/s]
  3%|▎         | 1827/57600 [19:11<9:45:40,  1.59it/s]
  3%|▎         | 1828/57600 [19:12<9:34:59,  1.62it/s]
  3%|▎         | 1829/57600 [19:13<9:47:09,  1.58it/s]
  3%|▎         | 1830/57600 [19:13<9:52:02,  1.57it/s]
  3%|▎         | 1831/57600 [19:14<9:49:17,  1.58it/s]
  3%|▎         | 1832/57600 [19:15<9:33:02,  1.62it/s]
  3%|▎         | 1833/57600 [19:15<9:23:55,  1.65it/s]
  3%|▎         | 1834/57600 [19:16<9:23:17,  1.65it/s]
  3%|▎         | 1835/57600 [19:16<9:44:54,  1.59it/s]
  3%|▎         | 1836/57600 [19:17<9:37:56,  1.61it/s]
  3%|▎         | 1837/57600 [19:18<9:38:29,  1.61it/s]
  3%|▎         | 1838/57600 [19:18<9:26:49,  1.64it/s]
  3%|▎         | 1839/57600 [19:19<9:35:13,  1.62it/s]
  3%|▎         | 1840/57600 [19:19<9:19:46,  1.66it/s]
                                                      
{'loss': 1.6741, 'learning_rate': 9.742857142857142e-07, 'epoch': 20.31}

  3%|▎         | 1840/57600 [19:19<9:19:46,  1.66it/s]
  3%|▎         | 1841/57600 [19:20<9:13:51,  1.68it/s]
  3%|▎         | 1842/57600 [19:21<9:28:51,  1.63it/s]
  3%|▎         | 1843/57600 [19:21<9:35:59,  1.61it/s]
  3%|▎         | 1844/57600 [19:22<9:32:13,  1.62it/s]
  3%|▎         | 1845/57600 [19:23<9:39:43,  1.60it/s]
  3%|▎         | 1846/57600 [19:23<9:49:31,  1.58it/s]
  3%|▎         | 1847/57600 [19:24<10:03:54,  1.54it/s]
  3%|▎         | 1848/57600 [19:24<9:52:26,  1.57it/s] 
  3%|▎         | 1849/57600 [19:25<9:43:59,  1.59it/s]
  3%|▎         | 1850/57600 [19:26<9:55:17,  1.56it/s]
  3%|▎         | 1851/57600 [19:26<9:45:37,  1.59it/s]
  3%|▎         | 1852/57600 [19:27<9:46:02,  1.59it/s]
  3%|▎         | 1853/57600 [19:28<9:39:23,  1.60it/s]
  3%|▎         | 1854/57600 [19:28<9:27:13,  1.64it/s]
  3%|▎         | 1855/57600 [19:29<9:39:39,  1.60it/s]
  3%|▎         | 1856/57600 [19:30<9:51:32,  1.57it/s]
  3%|▎         | 1857/57600 [19:30<10:05:57,  1.53it/s]
  3%|▎         | 1858/57600 [19:31<9:45:55,  1.59it/s] 
  3%|▎         | 1859/57600 [19:31<9:39:56,  1.60it/s]
  3%|▎         | 1860/57600 [19:32<9:34:32,  1.62it/s]
                                                      
{'loss': 1.6958, 'learning_rate': 9.7397212543554e-07, 'epoch': 20.53}

  3%|▎         | 1860/57600 [19:32<9:34:32,  1.62it/s]
  3%|▎         | 1861/57600 [19:33<9:55:45,  1.56it/s]
  3%|▎         | 1862/57600 [19:33<9:48:23,  1.58it/s]
  3%|▎         | 1863/57600 [19:34<9:50:40,  1.57it/s]
  3%|▎         | 1864/57600 [19:35<9:45:34,  1.59it/s]
  3%|▎         | 1865/57600 [19:35<9:41:13,  1.60it/s]
  3%|▎         | 1866/57600 [19:36<9:51:43,  1.57it/s]
  3%|▎         | 1867/57600 [19:36<9:47:47,  1.58it/s]
  3%|▎         | 1868/57600 [19:37<9:51:11,  1.57it/s]
  3%|▎         | 1869/57600 [19:38<9:44:17,  1.59it/s]
  3%|▎         | 1870/57600 [19:38<9:40:02,  1.60it/s]
  3%|▎         | 1871/57600 [19:39<9:32:58,  1.62it/s]
  3%|▎         | 1872/57600 [19:40<9:30:41,  1.63it/s]
  3%|▎         | 1873/57600 [19:40<9:28:22,  1.63it/s]
  3%|▎         | 1874/57600 [19:41<9:17:34,  1.67it/s]
  3%|▎         | 1875/57600 [19:41<9:28:53,  1.63it/s]
  3%|▎         | 1876/57600 [19:42<9:56:17,  1.56it/s]
  3%|▎         | 1877/57600 [19:43<9:57:41,  1.55it/s]
  3%|▎         | 1878/57600 [19:43<9:37:41,  1.61it/s]
  3%|▎         | 1879/57600 [19:44<9:36:13,  1.61it/s]
  3%|▎         | 1880/57600 [19:44<9:25:08,  1.64it/s]
                                                      
{'loss': 1.7036, 'learning_rate': 9.736585365853659e-07, 'epoch': 20.75}

  3%|▎         | 1880/57600 [19:44<9:25:08,  1.64it/s]
  3%|▎         | 1881/57600 [19:45<9:20:43,  1.66it/s]
  3%|▎         | 1882/57600 [19:46<9:43:36,  1.59it/s]
  3%|▎         | 1883/57600 [19:46<9:33:29,  1.62it/s]
  3%|▎         | 1884/57600 [19:47<9:48:18,  1.58it/s]
  3%|▎         | 1885/57600 [19:48<9:42:58,  1.59it/s]
  3%|▎         | 1886/57600 [19:48<10:18:36,  1.50it/s]
  3%|▎         | 1887/57600 [19:49<10:08:18,  1.53it/s]
  3%|▎         | 1888/57600 [19:50<10:02:09,  1.54it/s]
  3%|▎         | 1889/57600 [19:50<10:15:23,  1.51it/s]
  3%|▎         | 1890/57600 [19:51<9:48:22,  1.58it/s] 
  3%|▎         | 1891/57600 [19:52<9:34:09,  1.62it/s]
  3%|▎         | 1892/57600 [19:52<9:32:04,  1.62it/s]
  3%|▎         | 1893/57600 [19:53<9:46:19,  1.58it/s]
  3%|▎         | 1894/57600 [19:53<9:48:22,  1.58it/s]
  3%|▎         | 1895/57600 [19:54<9:53:58,  1.56it/s]
  3%|▎         | 1896/57600 [19:55<9:42:47,  1.59it/s]
  3%|▎         | 1897/57600 [19:55<9:51:52,  1.57it/s]
  3%|▎         | 1898/57600 [19:56<9:57:38,  1.55it/s]
  3%|▎         | 1899/57600 [19:57<9:34:34,  1.62it/s]
  3%|▎         | 1900/57600 [19:57<9:36:05,  1.61it/s]
                                                      
{'loss': 1.7489, 'learning_rate': 9.733449477351917e-07, 'epoch': 20.97}

  3%|▎         | 1900/57600 [19:57<9:36:05,  1.61it/s]
  3%|▎         | 1901/57600 [19:58<9:28:00,  1.63it/s]
  3%|▎         | 1902/57600 [19:58<9:32:58,  1.62it/s]
  3%|▎         | 1903/57600 [19:59<9:43:57,  1.59it/s]
  3%|▎         | 1904/57600 [20:00<9:35:04,  1.61it/s]
  3%|▎         | 1905/57600 [20:00<9:38:08,  1.61it/s]
  3%|▎         | 1906/57600 [20:01<9:47:32,  1.58it/s]
  3%|▎         | 1907/57600 [20:02<9:37:41,  1.61it/s]
  3%|▎         | 1908/57600 [20:02<9:44:55,  1.59it/s]
  3%|▎         | 1909/57600 [20:03<9:29:36,  1.63it/s]
  3%|▎         | 1910/57600 [20:03<9:26:43,  1.64it/s]
  3%|▎         | 1911/57600 [20:04<9:26:15,  1.64it/s]
  3%|▎         | 1912/57600 [20:05<10:01:59,  1.54it/s]
  3%|▎         | 1913/57600 [20:05<10:04:48,  1.53it/s]
  3%|▎         | 1914/57600 [20:06<9:57:18,  1.55it/s] 
  3%|▎         | 1915/57600 [20:07<9:49:46,  1.57it/s]
  3%|▎         | 1916/57600 [20:07<9:45:16,  1.59it/s]
  3%|▎         | 1917/57600 [20:08<9:51:03,  1.57it/s]
  3%|▎         | 1918/57600 [20:09<10:00:37,  1.55it/s]
  3%|▎         | 1919/57600 [20:09<9:44:17,  1.59it/s] 
  3%|▎         | 1920/57600 [20:10<9:41:07,  1.60it/s]
                                                      
{'loss': 1.7719, 'learning_rate': 9.730313588850174e-07, 'epoch': 21.19}

  3%|▎         | 1920/57600 [20:10<9:41:07,  1.60it/s]
  3%|▎         | 1921/57600 [20:10<9:59:45,  1.55it/s]
  3%|▎         | 1922/57600 [20:11<10:09:12,  1.52it/s]
  3%|▎         | 1923/57600 [20:12<10:02:41,  1.54it/s]
  3%|▎         | 1924/57600 [20:12<10:02:38,  1.54it/s]
  3%|▎         | 1925/57600 [20:13<9:52:08,  1.57it/s] 
  3%|▎         | 1926/57600 [20:14<9:46:19,  1.58it/s]
  3%|▎         | 1927/57600 [20:14<9:55:55,  1.56it/s]
  3%|▎         | 1928/57600 [20:15<9:52:57,  1.56it/s]
  3%|▎         | 1929/57600 [20:16<9:34:03,  1.62it/s]
  3%|▎         | 1930/57600 [20:16<10:12:25,  1.52it/s]
  3%|▎         | 1931/57600 [20:17<9:56:33,  1.56it/s] 
  3%|▎         | 1932/57600 [20:17<9:41:28,  1.60it/s]
  3%|▎         | 1933/57600 [20:18<9:34:26,  1.62it/s]
  3%|▎         | 1934/57600 [20:19<9:19:34,  1.66it/s]
  3%|▎         | 1935/57600 [20:19<9:19:11,  1.66it/s]
  3%|▎         | 1936/57600 [20:20<9:31:40,  1.62it/s]
  3%|▎         | 1937/57600 [20:21<9:41:02,  1.60it/s]
  3%|▎         | 1938/57600 [20:21<9:31:10,  1.62it/s]
  3%|▎         | 1939/57600 [20:22<9:53:08,  1.56it/s]
  3%|▎         | 1940/57600 [20:22<9:37:15,  1.61it/s]
                                                      
{'loss': 1.7401, 'learning_rate': 9.72717770034843e-07, 'epoch': 21.41}

  3%|▎         | 1940/57600 [20:22<9:37:15,  1.61it/s]
  3%|▎         | 1941/57600 [20:23<9:21:46,  1.65it/s]
  3%|▎         | 1942/57600 [20:24<9:36:46,  1.61it/s]
  3%|▎         | 1943/57600 [20:24<9:43:24,  1.59it/s]
  3%|▎         | 1944/57600 [20:25<9:35:00,  1.61it/s]
  3%|▎         | 1945/57600 [20:25<9:30:46,  1.63it/s]
  3%|▎         | 1946/57600 [20:26<9:39:19,  1.60it/s]
  3%|▎         | 1947/57600 [20:27<9:52:01,  1.57it/s]
  3%|▎         | 1948/57600 [20:27<9:47:55,  1.58it/s]
  3%|▎         | 1949/57600 [20:28<10:02:29,  1.54it/s]
  3%|▎         | 1950/57600 [20:29<9:40:27,  1.60it/s] 
  3%|▎         | 1951/57600 [20:29<9:49:05,  1.57it/s]
  3%|▎         | 1952/57600 [20:30<9:31:40,  1.62it/s]
  3%|▎         | 1953/57600 [20:31<10:01:15,  1.54it/s]
  3%|▎         | 1954/57600 [20:31<10:03:12,  1.54it/s]
  3%|▎         | 1955/57600 [20:32<9:46:03,  1.58it/s] 
  3%|▎         | 1956/57600 [20:33<9:43:26,  1.59it/s]
  3%|▎         | 1957/57600 [20:33<10:02:13,  1.54it/s]
  3%|▎         | 1958/57600 [20:34<9:57:31,  1.55it/s] 
  3%|▎         | 1959/57600 [20:34<9:51:08,  1.57it/s]
  3%|▎         | 1960/57600 [20:35<9:48:59,  1.57it/s]
                                                      
{'loss': 1.7247, 'learning_rate': 9.724041811846689e-07, 'epoch': 21.63}

  3%|▎         | 1960/57600 [20:35<9:48:59,  1.57it/s]
  3%|▎         | 1961/57600 [20:36<9:53:42,  1.56it/s]
  3%|▎         | 1962/57600 [20:36<9:51:20,  1.57it/s]
  3%|▎         | 1963/57600 [20:37<10:26:12,  1.48it/s]
  3%|▎         | 1964/57600 [20:38<9:59:12,  1.55it/s] 
  3%|▎         | 1965/57600 [20:38<10:01:37,  1.54it/s]
  3%|▎         | 1966/57600 [20:39<9:51:49,  1.57it/s] 
  3%|▎         | 1967/57600 [20:40<9:38:18,  1.60it/s]
  3%|▎         | 1968/57600 [20:40<9:33:48,  1.62it/s]
  3%|▎         | 1969/57600 [20:41<9:19:28,  1.66it/s]
  3%|▎         | 1970/57600 [20:41<9:20:56,  1.65it/s]
  3%|▎         | 1971/57600 [20:42<9:36:53,  1.61it/s]
  3%|▎         | 1972/57600 [20:43<9:42:33,  1.59it/s]
  3%|▎         | 1973/57600 [20:43<9:27:01,  1.64it/s]
  3%|▎         | 1974/57600 [20:44<9:18:21,  1.66it/s]
  3%|▎         | 1975/57600 [20:44<9:09:24,  1.69it/s]
  3%|▎         | 1976/57600 [20:45<9:26:32,  1.64it/s]
  3%|▎         | 1977/57600 [20:46<9:29:43,  1.63it/s]
  3%|▎         | 1978/57600 [20:46<9:30:33,  1.62it/s]
  3%|▎         | 1979/57600 [20:47<9:49:06,  1.57it/s]
  3%|▎         | 1980/57600 [20:48<9:37:45,  1.60it/s]
                                                      
{'loss': 1.7175, 'learning_rate': 9.720905923344947e-07, 'epoch': 21.85}

  3%|▎         | 1980/57600 [20:48<9:37:45,  1.60it/s]
  3%|▎         | 1981/57600 [20:48<9:24:23,  1.64it/s]
  3%|▎         | 1982/57600 [20:49<9:33:06,  1.62it/s]
  3%|▎         | 1983/57600 [20:49<9:49:48,  1.57it/s]
  3%|▎         | 1984/57600 [20:50<10:04:48,  1.53it/s]
  3%|▎         | 1985/57600 [20:51<9:47:17,  1.58it/s] 
  3%|▎         | 1986/57600 [20:51<9:33:20,  1.62it/s]
  3%|▎         | 1987/57600 [20:52<9:27:01,  1.63it/s]
  3%|▎         | 1988/57600 [20:53<9:37:40,  1.60it/s]
  3%|▎         | 1989/57600 [20:53<9:26:25,  1.64it/s]
  3%|▎         | 1990/57600 [20:54<9:23:21,  1.65it/s]
  3%|▎         | 1991/57600 [20:54<9:22:29,  1.65it/s]
  3%|▎         | 1992/57600 [20:55<9:26:22,  1.64it/s]
  3%|▎         | 1993/57600 [20:56<9:48:02,  1.58it/s]
  3%|▎         | 1994/57600 [20:56<10:16:04,  1.50it/s]
  3%|▎         | 1995/57600 [20:57<10:06:36,  1.53it/s]
  3%|▎         | 1996/57600 [20:58<9:53:30,  1.56it/s] 
  3%|▎         | 1997/57600 [20:58<9:42:54,  1.59it/s]
  3%|▎         | 1998/57600 [20:59<9:47:49,  1.58it/s]
  3%|▎         | 1999/57600 [20:59<9:38:57,  1.60it/s]
  3%|▎         | 2000/57600 [21:00<9:29:47,  1.63it/s]
                                                      
{'loss': 1.7288, 'learning_rate': 9.717770034843206e-07, 'epoch': 22.08}

  3%|▎         | 2000/57600 [21:00<9:29:47,  1.63it/s]
  3%|▎         | 2001/57600 [21:01<9:30:31,  1.62it/s]
  3%|▎         | 2002/57600 [21:01<10:01:40,  1.54it/s]
  3%|▎         | 2003/57600 [21:02<10:11:53,  1.51it/s]
  3%|▎         | 2004/57600 [21:03<10:04:40,  1.53it/s]
  3%|▎         | 2005/57600 [21:03<9:53:15,  1.56it/s] 
  3%|▎         | 2006/57600 [21:04<9:52:26,  1.56it/s]
  3%|▎         | 2007/57600 [21:05<9:40:40,  1.60it/s]
  3%|▎         | 2008/57600 [21:05<9:36:32,  1.61it/s]
  3%|▎         | 2009/57600 [21:06<9:37:29,  1.60it/s]
  3%|▎         | 2010/57600 [21:06<9:41:48,  1.59it/s]
  3%|▎         | 2011/57600 [21:07<9:44:05,  1.59it/s]
  3%|▎         | 2012/57600 [21:08<9:43:25,  1.59it/s]
  3%|▎         | 2013/57600 [21:08<9:51:40,  1.57it/s]
  3%|▎         | 2014/57600 [21:09<9:56:25,  1.55it/s]
  3%|▎         | 2015/57600 [21:10<9:33:49,  1.61it/s]
  4%|▎         | 2016/57600 [21:10<9:32:07,  1.62it/s]
  4%|▎         | 2017/57600 [21:11<9:22:31,  1.65it/s]
  4%|▎         | 2018/57600 [21:11<9:32:52,  1.62it/s]
  4%|▎         | 2019/57600 [21:12<9:27:09,  1.63it/s]
  4%|▎         | 2020/57600 [21:13<9:36:13,  1.61it/s]
                                                      
{'loss': 1.7068, 'learning_rate': 9.714634146341462e-07, 'epoch': 22.3}

  4%|▎         | 2020/57600 [21:13<9:36:13,  1.61it/s]
  4%|▎         | 2021/57600 [21:13<9:25:06,  1.64it/s]
  4%|▎         | 2022/57600 [21:14<9:26:39,  1.63it/s]
  4%|▎         | 2023/57600 [21:15<9:52:20,  1.56it/s]
  4%|▎         | 2024/57600 [21:15<9:41:37,  1.59it/s]
  4%|▎         | 2025/57600 [21:16<10:00:10,  1.54it/s]
  4%|▎         | 2026/57600 [21:17<9:56:26,  1.55it/s] 
  4%|▎         | 2027/57600 [21:17<9:36:08,  1.61it/s]
  4%|▎         | 2028/57600 [21:18<9:35:45,  1.61it/s]
  4%|▎         | 2029/57600 [21:18<9:29:09,  1.63it/s]
  4%|▎         | 2030/57600 [21:19<9:45:45,  1.58it/s]
  4%|▎         | 2031/57600 [21:20<9:48:39,  1.57it/s]
  4%|▎         | 2032/57600 [21:20<9:33:55,  1.61it/s]
  4%|▎         | 2033/57600 [21:21<9:35:16,  1.61it/s]
  4%|▎         | 2034/57600 [21:21<9:45:27,  1.58it/s]
  4%|▎         | 2035/57600 [21:22<9:56:02,  1.55it/s]
  4%|▎         | 2036/57600 [21:23<10:05:39,  1.53it/s]
  4%|▎         | 2037/57600 [21:23<9:54:03,  1.56it/s] 
  4%|▎         | 2038/57600 [21:24<9:46:01,  1.58it/s]
  4%|▎         | 2039/57600 [21:25<9:41:45,  1.59it/s]
  4%|▎         | 2040/57600 [21:25<9:37:09,  1.60it/s]
                                                      
{'loss': 1.6812, 'learning_rate': 9.71149825783972e-07, 'epoch': 22.52}

  4%|▎         | 2040/57600 [21:25<9:37:09,  1.60it/s]
  4%|▎         | 2041/57600 [21:26<9:45:33,  1.58it/s]
  4%|▎         | 2042/57600 [21:27<9:33:27,  1.61it/s]
  4%|▎         | 2043/57600 [21:27<9:30:39,  1.62it/s]
  4%|▎         | 2044/57600 [21:28<9:40:25,  1.60it/s]
  4%|▎         | 2045/57600 [21:28<9:59:21,  1.54it/s]
  4%|▎         | 2046/57600 [21:29<10:03:11,  1.53it/s]
  4%|▎         | 2047/57600 [21:30<10:00:42,  1.54it/s]
  4%|▎         | 2048/57600 [21:30<9:47:51,  1.57it/s] 
  4%|▎         | 2049/57600 [21:31<9:54:55,  1.56it/s]
  4%|▎         | 2050/57600 [21:32<10:11:42,  1.51it/s]
  4%|▎         | 2051/57600 [21:32<10:03:30,  1.53it/s]
  4%|▎         | 2052/57600 [21:33<9:57:08,  1.55it/s] 
  4%|▎         | 2053/57600 [21:34<9:58:11,  1.55it/s]
  4%|▎         | 2054/57600 [21:34<9:39:03,  1.60it/s]
  4%|▎         | 2055/57600 [21:35<9:34:04,  1.61it/s]
  4%|▎         | 2056/57600 [21:35<9:42:20,  1.59it/s]
  4%|▎         | 2057/57600 [21:36<10:02:16,  1.54it/s]
  4%|▎         | 2058/57600 [21:37<9:40:07,  1.60it/s] 
  4%|▎         | 2059/57600 [21:37<9:34:05,  1.61it/s]
  4%|▎         | 2060/57600 [21:38<9:48:02,  1.57it/s]
                                                      
{'loss': 1.6772, 'learning_rate': 9.708362369337977e-07, 'epoch': 22.74}

  4%|▎         | 2060/57600 [21:38<9:48:02,  1.57it/s]
  4%|▎         | 2061/57600 [21:39<9:47:17,  1.58it/s]
  4%|▎         | 2062/57600 [21:39<10:06:34,  1.53it/s]
  4%|▎         | 2063/57600 [21:40<10:08:47,  1.52it/s]
  4%|▎         | 2064/57600 [21:41<9:57:47,  1.55it/s] 
  4%|▎         | 2065/57600 [21:41<10:10:44,  1.52it/s]
  4%|▎         | 2066/57600 [21:42<10:04:18,  1.53it/s]
  4%|▎         | 2067/57600 [21:43<10:33:17,  1.46it/s]
  4%|▎         | 2068/57600 [21:43<10:23:05,  1.49it/s]
  4%|▎         | 2069/57600 [21:44<10:15:23,  1.50it/s]
  4%|▎         | 2070/57600 [21:45<10:06:34,  1.53it/s]
  4%|▎         | 2071/57600 [21:45<9:48:10,  1.57it/s] 
  4%|▎         | 2072/57600 [21:46<9:40:23,  1.59it/s]
  4%|▎         | 2073/57600 [21:47<9:44:23,  1.58it/s]
  4%|▎         | 2074/57600 [21:47<9:55:57,  1.55it/s]
  4%|▎         | 2075/57600 [21:48<9:50:06,  1.57it/s]
  4%|▎         | 2076/57600 [21:48<9:40:20,  1.59it/s]
  4%|▎         | 2077/57600 [21:49<9:47:55,  1.57it/s]
  4%|▎         | 2078/57600 [21:50<9:40:46,  1.59it/s]
  4%|▎         | 2079/57600 [21:50<9:49:20,  1.57it/s]
  4%|▎         | 2080/57600 [21:51<10:02:24,  1.54it/s]
                                                       
{'loss': 1.7103, 'learning_rate': 9.705226480836236e-07, 'epoch': 22.96}

  4%|▎         | 2080/57600 [21:51<10:02:24,  1.54it/s]
  4%|▎         | 2081/57600 [21:52<9:41:56,  1.59it/s] 
  4%|▎         | 2082/57600 [21:52<9:33:07,  1.61it/s]
  4%|▎         | 2083/57600 [21:53<9:30:36,  1.62it/s]
  4%|▎         | 2084/57600 [21:53<9:43:49,  1.58it/s]
  4%|▎         | 2085/57600 [21:54<10:10:55,  1.51it/s]
  4%|▎         | 2086/57600 [21:55<9:56:07,  1.55it/s] 
  4%|▎         | 2087/57600 [21:55<9:42:13,  1.59it/s]
  4%|▎         | 2088/57600 [21:56<10:03:36,  1.53it/s]
  4%|▎         | 2089/57600 [21:57<10:26:25,  1.48it/s]
  4%|▎         | 2090/57600 [21:57<10:18:01,  1.50it/s]
  4%|▎         | 2091/57600 [21:58<9:56:30,  1.55it/s] 
  4%|▎         | 2092/57600 [21:59<9:51:02,  1.57it/s]
  4%|▎         | 2093/57600 [21:59<9:40:34,  1.59it/s]
  4%|▎         | 2094/57600 [22:00<9:26:08,  1.63it/s]
  4%|▎         | 2095/57600 [22:01<9:35:57,  1.61it/s]
  4%|▎         | 2096/57600 [22:01<9:28:47,  1.63it/s]
  4%|▎         | 2097/57600 [22:02<9:42:54,  1.59it/s]
  4%|▎         | 2098/57600 [22:02<9:24:54,  1.64it/s]
  4%|▎         | 2099/57600 [22:03<9:38:29,  1.60it/s]
  4%|▎         | 2100/57600 [22:04<9:49:48,  1.57it/s]
                                                      
{'loss': 1.6984, 'learning_rate': 9.702090592334495e-07, 'epoch': 23.18}

  4%|▎         | 2100/57600 [22:04<9:49:48,  1.57it/s]
  4%|▎         | 2101/57600 [22:04<9:38:03,  1.60it/s]
  4%|▎         | 2102/57600 [22:05<9:29:23,  1.62it/s]
  4%|▎         | 2103/57600 [22:06<9:37:25,  1.60it/s]
  4%|▎         | 2104/57600 [22:06<10:15:25,  1.50it/s]
  4%|▎         | 2105/57600 [22:07<10:01:08,  1.54it/s]
  4%|▎         | 2106/57600 [22:07<9:34:20,  1.61it/s] 
  4%|▎         | 2107/57600 [22:08<10:01:01,  1.54it/s]
  4%|▎         | 2108/57600 [22:09<9:55:20,  1.55it/s] 
  4%|▎         | 2109/57600 [22:09<9:47:37,  1.57it/s]
  4%|▎         | 2110/57600 [22:10<9:49:28,  1.57it/s]
  4%|▎         | 2111/57600 [22:11<10:04:02,  1.53it/s]
  4%|▎         | 2112/57600 [22:11<10:11:57,  1.51it/s]
  4%|▎         | 2113/57600 [22:12<10:30:59,  1.47it/s]
  4%|▎         | 2114/57600 [22:13<10:02:18,  1.54it/s]
  4%|▎         | 2115/57600 [22:13<10:10:34,  1.51it/s]
  4%|▎         | 2116/57600 [22:14<10:08:16,  1.52it/s]
  4%|▎         | 2117/57600 [22:15<10:07:09,  1.52it/s]
  4%|▎         | 2118/57600 [22:15<9:55:57,  1.55it/s] 
  4%|▎         | 2119/57600 [22:16<10:14:44,  1.50it/s]
  4%|▎         | 2120/57600 [22:17<10:02:49,  1.53it/s]
                                                       
{'loss': 1.7281, 'learning_rate': 9.698954703832753e-07, 'epoch': 23.4}

  4%|▎         | 2120/57600 [22:17<10:02:49,  1.53it/s]
  4%|▎         | 2121/57600 [22:17<9:51:21,  1.56it/s] 
  4%|▎         | 2122/57600 [22:18<9:49:27,  1.57it/s]
  4%|▎         | 2123/57600 [22:19<9:37:31,  1.60it/s]
  4%|▎         | 2124/57600 [22:19<9:24:42,  1.64it/s]
  4%|▎         | 2125/57600 [22:20<9:19:13,  1.65it/s]
  4%|▎         | 2126/57600 [22:20<9:44:40,  1.58it/s]
  4%|▎         | 2127/57600 [22:21<9:52:43,  1.56it/s]
  4%|▎         | 2128/57600 [22:22<9:53:54,  1.56it/s]
  4%|▎         | 2129/57600 [22:22<9:48:11,  1.57it/s]
  4%|▎         | 2130/57600 [22:23<9:40:38,  1.59it/s]
  4%|▎         | 2131/57600 [22:24<9:39:14,  1.60it/s]
  4%|▎         | 2132/57600 [22:24<10:04:07,  1.53it/s]
  4%|▎         | 2133/57600 [22:25<10:22:38,  1.48it/s]
  4%|▎         | 2134/57600 [22:26<10:26:11,  1.48it/s]
  4%|▎         | 2135/57600 [22:26<10:02:54,  1.53it/s]
  4%|▎         | 2136/57600 [22:27<10:04:12,  1.53it/s]
  4%|▎         | 2137/57600 [22:28<9:54:52,  1.55it/s] 
  4%|▎         | 2138/57600 [22:28<9:53:54,  1.56it/s]
  4%|▎         | 2139/57600 [22:29<9:55:05,  1.55it/s]
  4%|▎         | 2140/57600 [22:29<9:44:40,  1.58it/s]
                                                      
{'loss': 1.7123, 'learning_rate': 9.695818815331012e-07, 'epoch': 23.62}

  4%|▎         | 2140/57600 [22:29<9:44:40,  1.58it/s]
  4%|▎         | 2141/57600 [22:30<9:57:19,  1.55it/s]
  4%|▎         | 2142/57600 [22:31<9:57:03,  1.55it/s]
  4%|▎         | 2143/57600 [22:31<9:46:42,  1.58it/s]
  4%|▎         | 2144/57600 [22:32<9:45:47,  1.58it/s]
  4%|▎         | 2145/57600 [22:33<9:20:49,  1.65it/s]
  4%|▎         | 2146/57600 [22:33<9:24:06,  1.64it/s]
  4%|▎         | 2147/57600 [22:34<9:32:35,  1.61it/s]
  4%|▎         | 2148/57600 [22:35<10:00:46,  1.54it/s]
  4%|▎         | 2149/57600 [22:35<9:47:22,  1.57it/s] 
  4%|▎         | 2150/57600 [22:36<9:43:26,  1.58it/s]
  4%|▎         | 2151/57600 [22:36<9:38:28,  1.60it/s]
  4%|▎         | 2152/57600 [22:37<9:50:32,  1.56it/s]
  4%|▎         | 2153/57600 [22:38<9:35:26,  1.61it/s]
  4%|▎         | 2154/57600 [22:38<9:33:09,  1.61it/s]
  4%|▎         | 2155/57600 [22:39<9:20:32,  1.65it/s]
  4%|▎         | 2156/57600 [22:39<9:36:58,  1.60it/s]
  4%|▎         | 2157/57600 [22:40<9:29:21,  1.62it/s]
  4%|▎         | 2158/57600 [22:41<9:26:30,  1.63it/s]
  4%|▎         | 2159/57600 [22:41<9:17:06,  1.66it/s]
  4%|▍         | 2160/57600 [22:42<9:14:58,  1.66it/s]
                                                      
{'loss': 1.7174, 'learning_rate': 9.692682926829266e-07, 'epoch': 23.84}

  4%|▍         | 2160/57600 [22:42<9:14:58,  1.66it/s]
  4%|▍         | 2161/57600 [22:42<9:25:47,  1.63it/s]
  4%|▍         | 2162/57600 [22:43<9:20:33,  1.65it/s]
  4%|▍         | 2163/57600 [22:44<9:33:33,  1.61it/s]
  4%|▍         | 2164/57600 [22:44<9:30:40,  1.62it/s]
  4%|▍         | 2165/57600 [22:45<9:34:02,  1.61it/s]
  4%|▍         | 2166/57600 [22:46<9:41:00,  1.59it/s]
  4%|▍         | 2167/57600 [22:46<9:40:03,  1.59it/s]
  4%|▍         | 2168/57600 [22:47<9:35:03,  1.61it/s]
  4%|▍         | 2169/57600 [22:47<9:45:46,  1.58it/s]
  4%|▍         | 2170/57600 [22:48<9:45:48,  1.58it/s]
  4%|▍         | 2171/57600 [22:49<9:36:19,  1.60it/s]
  4%|▍         | 2172/57600 [22:49<9:26:26,  1.63it/s]
  4%|▍         | 2173/57600 [22:50<9:24:35,  1.64it/s]
  4%|▍         | 2174/57600 [22:51<9:28:45,  1.62it/s]
  4%|▍         | 2175/57600 [22:51<10:01:54,  1.53it/s]
  4%|▍         | 2176/57600 [22:52<9:46:39,  1.57it/s] 
  4%|▍         | 2177/57600 [22:52<9:31:32,  1.62it/s]
  4%|▍         | 2178/57600 [22:53<9:28:57,  1.62it/s]
  4%|▍         | 2179/57600 [22:54<9:20:52,  1.65it/s]
  4%|▍         | 2180/57600 [22:54<9:21:48,  1.64it/s]
                                                      
{'loss': 1.7281, 'learning_rate': 9.689547038327525e-07, 'epoch': 24.06}

  4%|▍         | 2180/57600 [22:54<9:21:48,  1.64it/s]
  4%|▍         | 2181/57600 [22:55<9:22:59,  1.64it/s]
  4%|▍         | 2182/57600 [22:55<9:23:16,  1.64it/s]
  4%|▍         | 2183/57600 [22:56<9:34:30,  1.61it/s]
  4%|▍         | 2184/57600 [22:57<9:38:20,  1.60it/s]
  4%|▍         | 2185/57600 [22:57<9:22:40,  1.64it/s]
  4%|▍         | 2186/57600 [22:58<9:34:57,  1.61it/s]
  4%|▍         | 2187/57600 [22:59<9:43:08,  1.58it/s]
  4%|▍         | 2188/57600 [22:59<9:33:00,  1.61it/s]
  4%|▍         | 2189/57600 [23:00<9:28:39,  1.62it/s]
  4%|▍         | 2190/57600 [23:00<9:34:42,  1.61it/s]
  4%|▍         | 2191/57600 [23:01<9:24:52,  1.63it/s]
  4%|▍         | 2192/57600 [23:02<9:29:10,  1.62it/s]
  4%|▍         | 2193/57600 [23:02<9:49:34,  1.57it/s]
  4%|▍         | 2194/57600 [23:03<10:28:26,  1.47it/s]
  4%|▍         | 2195/57600 [23:04<10:04:41,  1.53it/s]
  4%|▍         | 2196/57600 [23:04<10:03:53,  1.53it/s]
  4%|▍         | 2197/57600 [23:05<9:59:03,  1.54it/s] 
  4%|▍         | 2198/57600 [23:06<9:52:31,  1.56it/s]
  4%|▍         | 2199/57600 [23:06<9:47:14,  1.57it/s]
  4%|▍         | 2200/57600 [23:07<9:37:21,  1.60it/s]
                                                      
{'loss': 1.7189, 'learning_rate': 9.686411149825783e-07, 'epoch': 24.28}

  4%|▍         | 2200/57600 [23:07<9:37:21,  1.60it/s]
  4%|▍         | 2201/57600 [23:08<9:32:34,  1.61it/s]
  4%|▍         | 2202/57600 [23:08<9:39:54,  1.59it/s]
  4%|▍         | 2203/57600 [23:09<9:31:21,  1.62it/s]
  4%|▍         | 2204/57600 [23:09<9:40:04,  1.59it/s]
  4%|▍         | 2205/57600 [23:10<9:32:01,  1.61it/s]
  4%|▍         | 2206/57600 [23:11<10:13:43,  1.50it/s]
  4%|▍         | 2207/57600 [23:11<10:16:01,  1.50it/s]
  4%|▍         | 2208/57600 [23:12<10:05:07,  1.53it/s]
  4%|▍         | 2209/57600 [23:13<10:20:57,  1.49it/s]
  4%|▍         | 2210/57600 [23:13<10:18:12,  1.49it/s]
  4%|▍         | 2211/57600 [23:14<10:16:01,  1.50it/s]
  4%|▍         | 2212/57600 [23:15<10:08:06,  1.52it/s]
  4%|▍         | 2213/57600 [23:15<9:51:11,  1.56it/s] 
  4%|▍         | 2214/57600 [23:16<9:58:53,  1.54it/s]
  4%|▍         | 2215/57600 [23:17<9:51:45,  1.56it/s]
  4%|▍         | 2216/57600 [23:17<9:55:46,  1.55it/s]
  4%|▍         | 2217/57600 [23:18<9:46:22,  1.57it/s]
  4%|▍         | 2218/57600 [23:19<10:03:01,  1.53it/s]
  4%|▍         | 2219/57600 [23:19<10:02:13,  1.53it/s]
  4%|▍         | 2220/57600 [23:20<9:41:37,  1.59it/s] 
                                                      
{'loss': 1.6272, 'learning_rate': 9.683275261324042e-07, 'epoch': 24.5}

  4%|▍         | 2220/57600 [23:20<9:41:37,  1.59it/s]
  4%|▍         | 2221/57600 [23:20<9:37:36,  1.60it/s]
  4%|▍         | 2222/57600 [23:21<9:32:55,  1.61it/s]
  4%|▍         | 2223/57600 [23:22<9:38:08,  1.60it/s]
  4%|▍         | 2224/57600 [23:22<9:34:39,  1.61it/s]
  4%|▍         | 2225/57600 [23:23<9:52:40,  1.56it/s]
  4%|▍         | 2226/57600 [23:24<9:45:47,  1.58it/s]
  4%|▍         | 2227/57600 [23:24<9:48:22,  1.57it/s]
  4%|▍         | 2228/57600 [23:25<9:58:09,  1.54it/s]
  4%|▍         | 2229/57600 [23:26<10:33:26,  1.46it/s]
  4%|▍         | 2230/57600 [23:26<10:29:36,  1.47it/s]
  4%|▍         | 2231/57600 [23:27<10:02:26,  1.53it/s]
  4%|▍         | 2232/57600 [23:28<10:06:35,  1.52it/s]
  4%|▍         | 2233/57600 [23:28<9:49:26,  1.57it/s] 
  4%|▍         | 2234/57600 [23:29<9:38:41,  1.59it/s]
  4%|▍         | 2235/57600 [23:29<9:29:46,  1.62it/s]
  4%|▍         | 2236/57600 [23:30<9:28:51,  1.62it/s]
  4%|▍         | 2237/57600 [23:31<9:29:10,  1.62it/s]
  4%|▍         | 2238/57600 [23:31<9:18:36,  1.65it/s]
  4%|▍         | 2239/57600 [23:32<9:33:52,  1.61it/s]
  4%|▍         | 2240/57600 [23:33<10:02:08,  1.53it/s]
                                                       
{'loss': 1.6588, 'learning_rate': 9.6801393728223e-07, 'epoch': 24.72}

  4%|▍         | 2240/57600 [23:33<10:02:08,  1.53it/s]
  4%|▍         | 2241/57600 [23:33<9:54:09,  1.55it/s] 
  4%|▍         | 2242/57600 [23:34<9:40:26,  1.59it/s]
  4%|▍         | 2243/57600 [23:35<9:49:13,  1.57it/s]
  4%|▍         | 2244/57600 [23:35<9:46:29,  1.57it/s]
  4%|▍         | 2245/57600 [23:36<9:49:42,  1.56it/s]
  4%|▍         | 2246/57600 [23:36<9:36:39,  1.60it/s]
  4%|▍         | 2247/57600 [23:37<9:42:22,  1.58it/s]
  4%|▍         | 2248/57600 [23:38<9:35:23,  1.60it/s]
  4%|▍         | 2249/57600 [23:38<9:36:50,  1.60it/s]
  4%|▍         | 2250/57600 [23:39<9:40:38,  1.59it/s]
  4%|▍         | 2251/57600 [23:40<9:42:30,  1.58it/s]
  4%|▍         | 2252/57600 [23:40<9:29:14,  1.62it/s]
  4%|▍         | 2253/57600 [23:41<9:34:29,  1.61it/s]
  4%|▍         | 2254/57600 [23:41<9:25:28,  1.63it/s]
  4%|▍         | 2255/57600 [23:42<9:57:32,  1.54it/s]
  4%|▍         | 2256/57600 [23:43<10:08:31,  1.52it/s]
  4%|▍         | 2257/57600 [23:43<9:55:53,  1.55it/s] 
  4%|▍         | 2258/57600 [23:44<9:42:12,  1.58it/s]
  4%|▍         | 2259/57600 [23:45<10:09:07,  1.51it/s]
  4%|▍         | 2260/57600 [23:45<10:19:50,  1.49it/s]
                                                       
{'loss': 1.6627, 'learning_rate': 9.677003484320557e-07, 'epoch': 24.94}

  4%|▍         | 2260/57600 [23:45<10:19:50,  1.49it/s]
  4%|▍         | 2261/57600 [23:46<10:15:57,  1.50it/s]
  4%|▍         | 2262/57600 [23:47<10:03:09,  1.53it/s]
  4%|▍         | 2263/57600 [23:47<10:00:02,  1.54it/s]
  4%|▍         | 2264/57600 [23:48<10:05:49,  1.52it/s]
  4%|▍         | 2265/57600 [23:49<9:53:04,  1.56it/s] 
  4%|▍         | 2266/57600 [23:49<10:21:45,  1.48it/s]
  4%|▍         | 2267/57600 [23:50<10:11:08,  1.51it/s]
  4%|▍         | 2268/57600 [23:51<9:55:21,  1.55it/s] 
  4%|▍         | 2269/57600 [23:51<9:36:05,  1.60it/s]
  4%|▍         | 2270/57600 [23:52<9:30:03,  1.62it/s]
  4%|▍         | 2271/57600 [23:52<9:26:44,  1.63it/s]
  4%|▍         | 2272/57600 [23:53<9:25:45,  1.63it/s]
  4%|▍         | 2273/57600 [23:54<9:39:47,  1.59it/s]
  4%|▍         | 2274/57600 [23:54<9:39:16,  1.59it/s]
  4%|▍         | 2275/57600 [23:55<9:27:57,  1.62it/s]
  4%|▍         | 2276/57600 [23:55<9:25:18,  1.63it/s]
  4%|▍         | 2277/57600 [23:56<9:32:52,  1.61it/s]
  4%|▍         | 2278/57600 [23:57<9:22:06,  1.64it/s]
  4%|▍         | 2279/57600 [23:57<9:35:34,  1.60it/s]
  4%|▍         | 2280/57600 [23:58<9:49:31,  1.56it/s]
                                                      
{'loss': 1.6504, 'learning_rate': 9.673867595818815e-07, 'epoch': 25.17}

  4%|▍         | 2280/57600 [23:58<9:49:31,  1.56it/s]
  4%|▍         | 2281/57600 [23:59<9:34:57,  1.60it/s]
  4%|▍         | 2282/57600 [23:59<9:30:34,  1.62it/s]
  4%|▍         | 2283/57600 [24:00<9:24:39,  1.63it/s]
  4%|▍         | 2284/57600 [24:00<9:27:11,  1.63it/s]
  4%|▍         | 2285/57600 [24:01<9:23:28,  1.64it/s]
  4%|▍         | 2286/57600 [24:02<9:23:10,  1.64it/s]
  4%|▍         | 2287/57600 [24:02<9:18:31,  1.65it/s]
  4%|▍         | 2288/57600 [24:03<9:21:23,  1.64it/s]
  4%|▍         | 2289/57600 [24:03<9:25:53,  1.63it/s]
  4%|▍         | 2290/57600 [24:04<9:29:15,  1.62it/s]
  4%|▍         | 2291/57600 [24:05<10:00:02,  1.54it/s]
  4%|▍         | 2292/57600 [24:06<10:21:45,  1.48it/s]
  4%|▍         | 2293/57600 [24:06<9:59:28,  1.54it/s] 
  4%|▍         | 2294/57600 [24:07<9:52:01,  1.56it/s]
  4%|▍         | 2295/57600 [24:07<9:55:56,  1.55it/s]
  4%|▍         | 2296/57600 [24:08<9:47:02,  1.57it/s]
  4%|▍         | 2297/57600 [24:09<9:41:54,  1.58it/s]
  4%|▍         | 2298/57600 [24:09<9:29:36,  1.62it/s]
  4%|▍         | 2299/57600 [24:10<10:15:01,  1.50it/s]
  4%|▍         | 2300/57600 [24:11<9:56:47,  1.54it/s] 
                                                      
{'loss': 1.6847, 'learning_rate': 9.670731707317072e-07, 'epoch': 25.39}

  4%|▍         | 2300/57600 [24:11<9:56:47,  1.54it/s]
  4%|▍         | 2301/57600 [24:11<9:53:54,  1.55it/s]
  4%|▍         | 2302/57600 [24:12<9:43:43,  1.58it/s]
  4%|▍         | 2303/57600 [24:13<9:42:26,  1.58it/s]
  4%|▍         | 2304/57600 [24:13<9:36:14,  1.60it/s]
  4%|▍         | 2305/57600 [24:14<9:38:03,  1.59it/s]
  4%|▍         | 2306/57600 [24:14<9:50:28,  1.56it/s]
  4%|▍         | 2307/57600 [24:15<9:58:51,  1.54it/s]
  4%|▍         | 2308/57600 [24:16<10:12:53,  1.50it/s]
  4%|▍         | 2309/57600 [24:16<9:59:50,  1.54it/s] 
  4%|▍         | 2310/57600 [24:17<9:55:34,  1.55it/s]
  4%|▍         | 2311/57600 [24:18<9:56:28,  1.54it/s]
  4%|▍         | 2312/57600 [24:18<9:37:03,  1.60it/s]
  4%|▍         | 2313/57600 [24:19<9:30:56,  1.61it/s]
  4%|▍         | 2314/57600 [24:20<9:44:07,  1.58it/s]
  4%|▍         | 2315/57600 [24:20<9:38:49,  1.59it/s]
  4%|▍         | 2316/57600 [24:21<9:40:47,  1.59it/s]
  4%|▍         | 2317/57600 [24:21<9:42:03,  1.58it/s]
  4%|▍         | 2318/57600 [24:22<9:58:24,  1.54it/s]
  4%|▍         | 2319/57600 [24:23<9:44:09,  1.58it/s]
  4%|▍         | 2320/57600 [24:23<9:25:45,  1.63it/s]
                                                      
{'loss': 1.6793, 'learning_rate': 9.66759581881533e-07, 'epoch': 25.61}

  4%|▍         | 2320/57600 [24:23<9:25:45,  1.63it/s]
  4%|▍         | 2321/57600 [24:24<9:35:57,  1.60it/s]
  4%|▍         | 2322/57600 [24:25<9:27:12,  1.62it/s]
  4%|▍         | 2323/57600 [24:25<9:23:43,  1.63it/s]
  4%|▍         | 2324/57600 [24:26<9:26:00,  1.63it/s]
  4%|▍         | 2325/57600 [24:26<9:17:48,  1.65it/s]
  4%|▍         | 2326/57600 [24:27<9:14:49,  1.66it/s]
  4%|▍         | 2327/57600 [24:28<9:22:35,  1.64it/s]
  4%|▍         | 2328/57600 [24:28<9:14:29,  1.66it/s]
  4%|▍         | 2329/57600 [24:29<9:16:13,  1.66it/s]
  4%|▍         | 2330/57600 [24:29<9:26:05,  1.63it/s]
  4%|▍         | 2331/57600 [24:30<9:34:45,  1.60it/s]
  4%|▍         | 2332/57600 [24:31<9:44:54,  1.57it/s]
  4%|▍         | 2333/57600 [24:31<9:37:04,  1.60it/s]
  4%|▍         | 2334/57600 [24:32<9:28:51,  1.62it/s]
  4%|▍         | 2335/57600 [24:33<9:28:26,  1.62it/s]
  4%|▍         | 2336/57600 [24:33<9:47:48,  1.57it/s]
  4%|▍         | 2337/57600 [24:34<9:37:55,  1.59it/s]
  4%|▍         | 2338/57600 [24:34<9:18:40,  1.65it/s]
  4%|▍         | 2339/57600 [24:35<9:36:08,  1.60it/s]
  4%|▍         | 2340/57600 [24:36<9:47:05,  1.57it/s]
                                                      
{'loss': 1.7009, 'learning_rate': 9.66445993031359e-07, 'epoch': 25.83}

  4%|▍         | 2340/57600 [24:36<9:47:05,  1.57it/s]
  4%|▍         | 2341/57600 [24:36<9:46:57,  1.57it/s]
  4%|▍         | 2342/57600 [24:37<9:34:46,  1.60it/s]
  4%|▍         | 2343/57600 [24:38<10:15:00,  1.50it/s]
  4%|▍         | 2344/57600 [24:38<9:48:50,  1.56it/s] 
  4%|▍         | 2345/57600 [24:39<9:48:49,  1.56it/s]
  4%|▍         | 2346/57600 [24:40<9:57:28,  1.54it/s]
  4%|▍         | 2347/57600 [24:40<10:04:18,  1.52it/s]
  4%|▍         | 2348/57600 [24:41<9:45:33,  1.57it/s] 
  4%|▍         | 2349/57600 [24:42<10:21:48,  1.48it/s]
  4%|▍         | 2350/57600 [24:42<10:31:42,  1.46it/s]
  4%|▍         | 2351/57600 [24:43<10:13:16,  1.50it/s]
  4%|▍         | 2352/57600 [24:44<10:01:28,  1.53it/s]
  4%|▍         | 2353/57600 [24:44<9:48:07,  1.57it/s] 
  4%|▍         | 2354/57600 [24:45<9:55:05,  1.55it/s]
  4%|▍         | 2355/57600 [24:46<9:56:18,  1.54it/s]
  4%|▍         | 2356/57600 [24:46<9:59:40,  1.54it/s]
  4%|▍         | 2357/57600 [24:47<9:45:19,  1.57it/s]
  4%|▍         | 2358/57600 [24:47<9:56:29,  1.54it/s]
  4%|▍         | 2359/57600 [24:48<9:52:46,  1.55it/s]
  4%|▍         | 2360/57600 [24:49<9:46:14,  1.57it/s]
                                                      
{'loss': 1.6581, 'learning_rate': 9.661324041811848e-07, 'epoch': 26.05}

  4%|▍         | 2360/57600 [24:49<9:46:14,  1.57it/s]
  4%|▍         | 2361/57600 [24:49<10:05:01,  1.52it/s]
  4%|▍         | 2362/57600 [24:50<10:01:35,  1.53it/s]
  4%|▍         | 2363/57600 [24:51<9:59:41,  1.54it/s] 
  4%|▍         | 2364/57600 [24:51<9:53:25,  1.55it/s]
  4%|▍         | 2365/57600 [24:52<9:44:32,  1.57it/s]
  4%|▍         | 2366/57600 [24:53<9:40:20,  1.59it/s]
  4%|▍         | 2367/57600 [24:53<9:46:30,  1.57it/s]
  4%|▍         | 2368/57600 [24:54<9:39:08,  1.59it/s]
  4%|▍         | 2369/57600 [24:54<9:36:28,  1.60it/s]
  4%|▍         | 2370/57600 [24:55<9:29:07,  1.62it/s]
  4%|▍         | 2371/57600 [24:56<9:39:04,  1.59it/s]
  4%|▍         | 2372/57600 [24:56<9:52:52,  1.55it/s]
  4%|▍         | 2373/57600 [24:57<9:41:22,  1.58it/s]
  4%|▍         | 2374/57600 [24:58<9:54:02,  1.55it/s]
  4%|▍         | 2375/57600 [24:58<10:00:56,  1.53it/s]
  4%|▍         | 2376/57600 [24:59<10:09:23,  1.51it/s]
  4%|▍         | 2377/57600 [25:00<9:43:59,  1.58it/s] 
  4%|▍         | 2378/57600 [25:00<9:59:05,  1.54it/s]
  4%|▍         | 2379/57600 [25:01<9:56:00,  1.54it/s]
  4%|▍         | 2380/57600 [25:02<9:54:26,  1.55it/s]
                                                      
{'loss': 1.6648, 'learning_rate': 9.658188153310104e-07, 'epoch': 26.27}

  4%|▍         | 2380/57600 [25:02<9:54:26,  1.55it/s]
  4%|▍         | 2381/57600 [25:02<9:49:34,  1.56it/s]
  4%|▍         | 2382/57600 [25:03<9:42:26,  1.58it/s]
  4%|▍         | 2383/57600 [25:03<9:44:32,  1.57it/s]
  4%|▍         | 2384/57600 [25:04<9:39:01,  1.59it/s]
  4%|▍         | 2385/57600 [25:05<9:50:35,  1.56it/s]
  4%|▍         | 2386/57600 [25:05<9:46:59,  1.57it/s]
  4%|▍         | 2387/57600 [25:06<9:56:43,  1.54it/s]
  4%|▍         | 2388/57600 [25:07<9:34:34,  1.60it/s]
  4%|▍         | 2389/57600 [25:07<9:35:57,  1.60it/s]
  4%|▍         | 2390/57600 [25:08<9:37:58,  1.59it/s]
  4%|▍         | 2391/57600 [25:08<9:28:34,  1.62it/s]
  4%|▍         | 2392/57600 [25:09<9:19:55,  1.64it/s]
  4%|▍         | 2393/57600 [25:10<9:14:19,  1.66it/s]
  4%|▍         | 2394/57600 [25:10<9:19:47,  1.64it/s]
  4%|▍         | 2395/57600 [25:11<9:38:49,  1.59it/s]
  4%|▍         | 2396/57600 [25:12<9:45:37,  1.57it/s]
  4%|▍         | 2397/57600 [25:12<10:10:31,  1.51it/s]
  4%|▍         | 2398/57600 [25:13<9:56:48,  1.54it/s] 
  4%|▍         | 2399/57600 [25:14<10:00:59,  1.53it/s]
  4%|▍         | 2400/57600 [25:14<10:23:09,  1.48it/s]
                                                       
{'loss': 1.6303, 'learning_rate': 9.65505226480836e-07, 'epoch': 26.49}

  4%|▍         | 2400/57600 [25:14<10:23:09,  1.48it/s]
  4%|▍         | 2401/57600 [25:15<10:17:00,  1.49it/s]
  4%|▍         | 2402/57600 [25:16<9:59:49,  1.53it/s] 
  4%|▍         | 2403/57600 [25:16<9:44:41,  1.57it/s]
  4%|▍         | 2404/57600 [25:17<9:25:06,  1.63it/s]
  4%|▍         | 2405/57600 [25:17<10:03:26,  1.52it/s]
  4%|▍         | 2406/57600 [25:18<9:48:58,  1.56it/s] 
  4%|▍         | 2407/57600 [25:19<9:56:03,  1.54it/s]
  4%|▍         | 2408/57600 [25:19<9:52:02,  1.55it/s]
  4%|▍         | 2409/57600 [25:20<9:58:10,  1.54it/s]
  4%|▍         | 2410/57600 [25:21<9:46:35,  1.57it/s]
  4%|▍         | 2411/57600 [25:21<9:25:31,  1.63it/s]
  4%|▍         | 2412/57600 [25:22<9:24:45,  1.63it/s]
  4%|▍         | 2413/57600 [25:22<9:16:04,  1.65it/s]
  4%|▍         | 2414/57600 [25:23<9:35:53,  1.60it/s]
  4%|▍         | 2415/57600 [25:24<9:29:39,  1.61it/s]
  4%|▍         | 2416/57600 [25:24<9:26:56,  1.62it/s]
  4%|▍         | 2417/57600 [25:25<9:19:42,  1.64it/s]
  4%|▍         | 2418/57600 [25:26<9:18:54,  1.65it/s]
  4%|▍         | 2419/57600 [25:26<9:33:27,  1.60it/s]
  4%|▍         | 2420/57600 [25:27<9:24:37,  1.63it/s]
                                                      
{'loss': 1.7222, 'learning_rate': 9.65191637630662e-07, 'epoch': 26.71}

  4%|▍         | 2420/57600 [25:27<9:24:37,  1.63it/s]
  4%|▍         | 2421/57600 [25:27<9:15:18,  1.66it/s]
  4%|▍         | 2422/57600 [25:28<9:17:57,  1.65it/s]
  4%|▍         | 2423/57600 [25:29<9:14:16,  1.66it/s]
  4%|▍         | 2424/57600 [25:29<9:10:48,  1.67it/s]
  4%|▍         | 2425/57600 [25:30<9:13:26,  1.66it/s]
  4%|▍         | 2426/57600 [25:30<9:06:45,  1.68it/s]
  4%|▍         | 2427/57600 [25:31<9:15:32,  1.66it/s]
  4%|▍         | 2428/57600 [25:32<9:11:15,  1.67it/s]
  4%|▍         | 2429/57600 [25:32<9:27:42,  1.62it/s]
  4%|▍         | 2430/57600 [25:33<9:16:17,  1.65it/s]
  4%|▍         | 2431/57600 [25:33<9:09:07,  1.67it/s]
  4%|▍         | 2432/57600 [25:34<9:17:58,  1.65it/s]
  4%|▍         | 2433/57600 [25:35<9:08:15,  1.68it/s]
  4%|▍         | 2434/57600 [25:35<9:28:47,  1.62it/s]
  4%|▍         | 2435/57600 [25:36<9:58:50,  1.54it/s]
  4%|▍         | 2436/57600 [25:37<9:47:30,  1.56it/s]
  4%|▍         | 2437/57600 [25:37<9:55:41,  1.54it/s]
  4%|▍         | 2438/57600 [25:38<9:55:39,  1.54it/s]
  4%|▍         | 2439/57600 [25:38<9:37:38,  1.59it/s]
  4%|▍         | 2440/57600 [25:39<9:35:21,  1.60it/s]
                                                      
{'loss': 1.7164, 'learning_rate': 9.648780487804878e-07, 'epoch': 26.93}

  4%|▍         | 2440/57600 [25:39<9:35:21,  1.60it/s]
  4%|▍         | 2441/57600 [25:40<9:36:49,  1.59it/s]
  4%|▍         | 2442/57600 [25:40<9:28:10,  1.62it/s]
  4%|▍         | 2443/57600 [25:41<9:16:57,  1.65it/s]
  4%|▍         | 2444/57600 [25:41<9:19:38,  1.64it/s]
  4%|▍         | 2445/57600 [25:42<9:24:34,  1.63it/s]
  4%|▍         | 2446/57600 [25:43<9:30:05,  1.61it/s]
  4%|▍         | 2447/57600 [25:44<10:13:09,  1.50it/s]
  4%|▍         | 2448/57600 [25:44<9:47:16,  1.57it/s] 
  4%|▍         | 2449/57600 [25:45<9:44:11,  1.57it/s]
  4%|▍         | 2450/57600 [25:45<9:40:52,  1.58it/s]
  4%|▍         | 2451/57600 [25:46<9:56:19,  1.54it/s]
  4%|▍         | 2452/57600 [25:47<10:04:52,  1.52it/s]
  4%|▍         | 2453/57600 [25:47<9:57:09,  1.54it/s] 
  4%|▍         | 2454/57600 [25:48<9:43:57,  1.57it/s]
  4%|▍         | 2455/57600 [25:49<9:58:48,  1.53it/s]
  4%|▍         | 2456/57600 [25:49<9:38:22,  1.59it/s]
  4%|▍         | 2457/57600 [25:50<9:45:50,  1.57it/s]
  4%|▍         | 2458/57600 [25:51<9:46:54,  1.57it/s]
  4%|▍         | 2459/57600 [25:51<9:32:55,  1.60it/s]
  4%|▍         | 2460/57600 [25:52<9:40:26,  1.58it/s]
                                                      
{'loss': 1.6894, 'learning_rate': 9.645644599303136e-07, 'epoch': 27.15}

  4%|▍         | 2460/57600 [25:52<9:40:26,  1.58it/s]
  4%|▍         | 2461/57600 [25:52<9:48:07,  1.56it/s]
  4%|▍         | 2462/57600 [25:53<9:29:12,  1.61it/s]
  4%|▍         | 2463/57600 [25:54<9:46:46,  1.57it/s]
  4%|▍         | 2464/57600 [25:54<9:32:14,  1.61it/s]
  4%|▍         | 2465/57600 [25:55<9:31:20,  1.61it/s]
  4%|▍         | 2466/57600 [25:56<9:35:51,  1.60it/s]
  4%|▍         | 2467/57600 [25:56<9:37:37,  1.59it/s]
  4%|▍         | 2468/57600 [25:57<9:25:02,  1.63it/s]
  4%|▍         | 2469/57600 [25:57<9:28:07,  1.62it/s]
  4%|▍         | 2470/57600 [25:58<9:36:52,  1.59it/s]
  4%|▍         | 2471/57600 [25:59<9:44:05,  1.57it/s]
  4%|▍         | 2472/57600 [25:59<9:33:13,  1.60it/s]
  4%|▍         | 2473/57600 [26:00<9:40:59,  1.58it/s]
  4%|▍         | 2474/57600 [26:01<9:31:52,  1.61it/s]
  4%|▍         | 2475/57600 [26:01<9:18:37,  1.64it/s]
  4%|▍         | 2476/57600 [26:02<9:31:57,  1.61it/s]
  4%|▍         | 2477/57600 [26:02<9:17:17,  1.65it/s]
  4%|▍         | 2478/57600 [26:03<9:36:21,  1.59it/s]
  4%|▍         | 2479/57600 [26:04<9:42:50,  1.58it/s]
  4%|▍         | 2480/57600 [26:04<9:44:32,  1.57it/s]
                                                      
{'loss': 1.6904, 'learning_rate': 9.642508710801393e-07, 'epoch': 27.37}

  4%|▍         | 2480/57600 [26:04<9:44:32,  1.57it/s]
  4%|▍         | 2481/57600 [26:05<9:35:31,  1.60it/s]
  4%|▍         | 2482/57600 [26:06<9:37:47,  1.59it/s]
  4%|▍         | 2483/57600 [26:06<9:53:38,  1.55it/s]
  4%|▍         | 2484/57600 [26:07<10:06:08,  1.52it/s]
  4%|▍         | 2485/57600 [26:08<9:55:54,  1.54it/s] 
  4%|▍         | 2486/57600 [26:08<9:45:00,  1.57it/s]
  4%|▍         | 2487/57600 [26:09<9:40:47,  1.58it/s]
  4%|▍         | 2488/57600 [26:09<9:20:10,  1.64it/s]
  4%|▍         | 2489/57600 [26:10<9:35:26,  1.60it/s]
  4%|▍         | 2490/57600 [26:11<9:34:12,  1.60it/s]
  4%|▍         | 2491/57600 [26:11<9:21:58,  1.63it/s]
  4%|▍         | 2492/57600 [26:12<9:26:20,  1.62it/s]
  4%|▍         | 2493/57600 [26:12<9:12:41,  1.66it/s]
  4%|▍         | 2494/57600 [26:13<9:13:22,  1.66it/s]
  4%|▍         | 2495/57600 [26:14<9:23:28,  1.63it/s]
  4%|▍         | 2496/57600 [26:14<9:15:38,  1.65it/s]
  4%|▍         | 2497/57600 [26:15<9:34:43,  1.60it/s]
  4%|▍         | 2498/57600 [26:15<9:28:28,  1.62it/s]
  4%|▍         | 2499/57600 [26:16<9:30:28,  1.61it/s]
  4%|▍         | 2500/57600 [26:17<9:44:42,  1.57it/s]
                                                      
{'loss': 1.6133, 'learning_rate': 9.639372822299651e-07, 'epoch': 27.59}

  4%|▍         | 2500/57600 [26:17<9:44:42,  1.57it/s]
  4%|▍         | 2501/57600 [26:17<9:36:27,  1.59it/s]
  4%|▍         | 2502/57600 [26:18<9:43:19,  1.57it/s]
  4%|▍         | 2503/57600 [26:19<9:48:24,  1.56it/s]
  4%|▍         | 2504/57600 [26:19<9:40:19,  1.58it/s]
  4%|▍         | 2505/57600 [26:20<9:46:58,  1.56it/s]
  4%|▍         | 2506/57600 [26:21<9:44:12,  1.57it/s]
  4%|▍         | 2507/57600 [26:21<9:36:18,  1.59it/s]
  4%|▍         | 2508/57600 [26:22<9:29:56,  1.61it/s]
  4%|▍         | 2509/57600 [26:22<9:45:57,  1.57it/s]
  4%|▍         | 2510/57600 [26:23<9:35:36,  1.60it/s]
  4%|▍         | 2511/57600 [26:24<9:41:05,  1.58it/s]
  4%|▍         | 2512/57600 [26:24<9:47:37,  1.56it/s]
  4%|▍         | 2513/57600 [26:25<9:36:29,  1.59it/s]
  4%|▍         | 2514/57600 [26:26<9:45:44,  1.57it/s]
  4%|▍         | 2515/57600 [26:26<9:48:19,  1.56it/s]
  4%|▍         | 2516/57600 [26:27<9:46:52,  1.56it/s]
  4%|▍         | 2517/57600 [26:28<9:42:17,  1.58it/s]
  4%|▍         | 2518/57600 [26:28<9:46:07,  1.57it/s]
  4%|▍         | 2519/57600 [26:29<9:44:29,  1.57it/s]
  4%|▍         | 2520/57600 [26:29<9:45:21,  1.57it/s]
                                                      
{'loss': 1.6445, 'learning_rate': 9.636236933797908e-07, 'epoch': 27.81}

  4%|▍         | 2520/57600 [26:29<9:45:21,  1.57it/s]
  4%|▍         | 2521/57600 [26:30<9:39:07,  1.59it/s]
  4%|▍         | 2522/57600 [26:31<9:49:57,  1.56it/s]
  4%|▍         | 2523/57600 [26:31<9:33:52,  1.60it/s]
  4%|▍         | 2524/57600 [26:32<9:59:17,  1.53it/s]
  4%|▍         | 2525/57600 [26:33<10:05:25,  1.52it/s]
  4%|▍         | 2526/57600 [26:33<10:14:51,  1.49it/s]
  4%|▍         | 2527/57600 [26:34<9:58:42,  1.53it/s] 
  4%|▍         | 2528/57600 [26:35<9:52:02,  1.55it/s]
  4%|▍         | 2529/57600 [26:35<9:46:37,  1.56it/s]
  4%|▍         | 2530/57600 [26:36<9:50:22,  1.55it/s]
  4%|▍         | 2531/57600 [26:37<9:39:33,  1.58it/s]
  4%|▍         | 2532/57600 [26:37<9:45:26,  1.57it/s]
  4%|▍         | 2533/57600 [26:38<9:35:57,  1.59it/s]
  4%|▍         | 2534/57600 [26:38<9:35:13,  1.60it/s]
  4%|▍         | 2535/57600 [26:39<9:26:33,  1.62it/s]
  4%|▍         | 2536/57600 [26:40<9:19:22,  1.64it/s]
  4%|▍         | 2537/57600 [26:40<9:32:51,  1.60it/s]
  4%|▍         | 2538/57600 [26:41<9:20:13,  1.64it/s]
  4%|▍         | 2539/57600 [26:41<9:31:00,  1.61it/s]
  4%|▍         | 2540/57600 [26:42<9:23:08,  1.63it/s]
                                                      
{'loss': 1.6421, 'learning_rate': 9.633101045296166e-07, 'epoch': 28.04}

  4%|▍         | 2540/57600 [26:42<9:23:08,  1.63it/s]
  4%|▍         | 2541/57600 [26:43<9:22:59,  1.63it/s]
  4%|▍         | 2542/57600 [26:43<9:48:24,  1.56it/s]
  4%|▍         | 2543/57600 [26:44<9:38:08,  1.59it/s]
  4%|▍         | 2544/57600 [26:45<9:55:47,  1.54it/s]
  4%|▍         | 2545/57600 [26:45<9:57:51,  1.53it/s]
  4%|▍         | 2546/57600 [26:46<10:07:22,  1.51it/s]
  4%|▍         | 2547/57600 [26:47<10:19:59,  1.48it/s]
  4%|▍         | 2548/57600 [26:47<9:57:29,  1.54it/s] 
  4%|▍         | 2549/57600 [26:48<9:54:20,  1.54it/s]
  4%|▍         | 2550/57600 [26:49<9:40:29,  1.58it/s]
  4%|▍         | 2551/57600 [26:49<9:43:19,  1.57it/s]
  4%|▍         | 2552/57600 [26:50<9:27:50,  1.62it/s]
  4%|▍         | 2553/57600 [26:50<9:42:33,  1.57it/s]
  4%|▍         | 2554/57600 [26:51<9:47:19,  1.56it/s]
  4%|▍         | 2555/57600 [26:52<9:42:47,  1.57it/s]
  4%|▍         | 2556/57600 [26:52<10:01:38,  1.52it/s]
  4%|▍         | 2557/57600 [26:53<9:48:52,  1.56it/s] 
  4%|▍         | 2558/57600 [26:54<9:53:25,  1.55it/s]
  4%|▍         | 2559/57600 [26:54<9:49:14,  1.56it/s]
  4%|▍         | 2560/57600 [26:55<9:39:46,  1.58it/s]
                                                      
{'loss': 1.672, 'learning_rate': 9.629965156794425e-07, 'epoch': 28.26}

  4%|▍         | 2560/57600 [26:55<9:39:46,  1.58it/s]
  4%|▍         | 2561/57600 [26:56<9:32:42,  1.60it/s]
  4%|▍         | 2562/57600 [26:56<9:39:49,  1.58it/s]
  4%|▍         | 2563/57600 [26:57<9:20:36,  1.64it/s]
  4%|▍         | 2564/57600 [26:57<9:33:07,  1.60it/s]
  4%|▍         | 2565/57600 [26:58<9:28:29,  1.61it/s]
  4%|▍         | 2566/57600 [26:59<9:30:13,  1.61it/s]
  4%|▍         | 2567/57600 [26:59<9:30:10,  1.61it/s]
  4%|▍         | 2568/57600 [27:00<9:35:38,  1.59it/s]
  4%|▍         | 2569/57600 [27:01<9:39:22,  1.58it/s]
  4%|▍         | 2570/57600 [27:01<9:26:43,  1.62it/s]
  4%|▍         | 2571/57600 [27:02<9:31:53,  1.60it/s]
  4%|▍         | 2572/57600 [27:02<9:38:08,  1.59it/s]
  4%|▍         | 2573/57600 [27:03<9:51:21,  1.55it/s]
  4%|▍         | 2574/57600 [27:04<10:10:34,  1.50it/s]
  4%|▍         | 2575/57600 [27:05<10:07:18,  1.51it/s]
  4%|▍         | 2576/57600 [27:05<9:44:45,  1.57it/s] 
  4%|▍         | 2577/57600 [27:06<9:40:04,  1.58it/s]
  4%|▍         | 2578/57600 [27:06<9:42:19,  1.57it/s]
  4%|▍         | 2579/57600 [27:07<9:52:20,  1.55it/s]
  4%|▍         | 2580/57600 [27:08<9:46:18,  1.56it/s]
                                                      
{'loss': 1.6592, 'learning_rate': 9.626829268292684e-07, 'epoch': 28.48}

  4%|▍         | 2580/57600 [27:08<9:46:18,  1.56it/s]
  4%|▍         | 2581/57600 [27:08<9:36:08,  1.59it/s]
  4%|▍         | 2582/57600 [27:09<9:32:47,  1.60it/s]
  4%|▍         | 2583/57600 [27:09<9:21:33,  1.63it/s]
  4%|▍         | 2584/57600 [27:10<9:16:37,  1.65it/s]
  4%|▍         | 2585/57600 [27:11<9:40:10,  1.58it/s]
  4%|▍         | 2586/57600 [27:11<9:43:09,  1.57it/s]
  4%|▍         | 2587/57600 [27:12<10:05:51,  1.51it/s]
  4%|▍         | 2588/57600 [27:13<9:54:28,  1.54it/s] 
  4%|▍         | 2589/57600 [27:13<9:34:33,  1.60it/s]
  4%|▍         | 2590/57600 [27:14<9:23:19,  1.63it/s]
  4%|▍         | 2591/57600 [27:14<9:17:44,  1.64it/s]
  4%|▍         | 2592/57600 [27:15<9:14:42,  1.65it/s]
  5%|▍         | 2593/57600 [27:16<9:24:40,  1.62it/s]
  5%|▍         | 2594/57600 [27:16<9:41:01,  1.58it/s]
  5%|▍         | 2595/57600 [27:17<9:35:21,  1.59it/s]
  5%|▍         | 2596/57600 [27:18<9:28:37,  1.61it/s]
  5%|▍         | 2597/57600 [27:18<9:54:31,  1.54it/s]
  5%|▍         | 2598/57600 [27:19<9:33:35,  1.60it/s]
  5%|▍         | 2599/57600 [27:19<9:19:28,  1.64it/s]
  5%|▍         | 2600/57600 [27:20<9:25:35,  1.62it/s]
                                                      
{'loss': 1.649, 'learning_rate': 9.62369337979094e-07, 'epoch': 28.7}

  5%|▍         | 2600/57600 [27:20<9:25:35,  1.62it/s]
  5%|▍         | 2601/57600 [27:21<9:20:20,  1.64it/s]
  5%|▍         | 2602/57600 [27:21<9:16:15,  1.65it/s]
  5%|▍         | 2603/57600 [27:22<9:04:03,  1.68it/s]
  5%|▍         | 2604/57600 [27:23<9:33:05,  1.60it/s]
  5%|▍         | 2605/57600 [27:23<9:31:32,  1.60it/s]
  5%|▍         | 2606/57600 [27:24<9:29:25,  1.61it/s]
  5%|▍         | 2607/57600 [27:24<9:36:56,  1.59it/s]
  5%|▍         | 2608/57600 [27:25<10:10:05,  1.50it/s]
  5%|▍         | 2609/57600 [27:26<9:55:33,  1.54it/s] 
  5%|▍         | 2610/57600 [27:26<9:50:08,  1.55it/s]
  5%|▍         | 2611/57600 [27:27<9:40:32,  1.58it/s]
  5%|▍         | 2612/57600 [27:28<9:30:42,  1.61it/s]
  5%|▍         | 2613/57600 [27:28<9:31:44,  1.60it/s]
  5%|▍         | 2614/57600 [27:29<9:35:42,  1.59it/s]
  5%|▍         | 2615/57600 [27:30<9:28:44,  1.61it/s]
  5%|▍         | 2616/57600 [27:30<9:33:51,  1.60it/s]
  5%|▍         | 2617/57600 [27:31<9:38:18,  1.58it/s]
  5%|▍         | 2618/57600 [27:31<9:50:07,  1.55it/s]
  5%|▍         | 2619/57600 [27:32<9:39:37,  1.58it/s]
  5%|▍         | 2620/57600 [27:33<9:43:23,  1.57it/s]
                                                      
{'loss': 1.6667, 'learning_rate': 9.620557491289199e-07, 'epoch': 28.92}

  5%|▍         | 2620/57600 [27:33<9:43:23,  1.57it/s]
  5%|▍         | 2621/57600 [27:33<9:27:14,  1.62it/s]
  5%|▍         | 2622/57600 [27:34<9:21:32,  1.63it/s]
  5%|▍         | 2623/57600 [27:35<9:49:08,  1.56it/s]
  5%|▍         | 2624/57600 [27:35<9:39:46,  1.58it/s]
  5%|▍         | 2625/57600 [27:36<9:44:50,  1.57it/s]
  5%|▍         | 2626/57600 [27:37<9:46:53,  1.56it/s]
  5%|▍         | 2627/57600 [27:37<9:23:27,  1.63it/s]
  5%|▍         | 2628/57600 [27:38<9:48:51,  1.56it/s]
  5%|▍         | 2629/57600 [27:38<9:34:08,  1.60it/s]
  5%|▍         | 2630/57600 [27:39<9:40:39,  1.58it/s]
  5%|▍         | 2631/57600 [27:40<9:37:02,  1.59it/s]
  5%|▍         | 2632/57600 [27:40<9:48:22,  1.56it/s]
  5%|▍         | 2633/57600 [27:41<9:37:46,  1.59it/s]
  5%|▍         | 2634/57600 [27:42<9:37:03,  1.59it/s]
  5%|▍         | 2635/57600 [27:42<9:34:43,  1.59it/s]
  5%|▍         | 2636/57600 [27:43<9:25:21,  1.62it/s]
  5%|▍         | 2637/57600 [27:43<9:28:48,  1.61it/s]
  5%|▍         | 2638/57600 [27:44<9:25:57,  1.62it/s]
  5%|▍         | 2639/57600 [27:45<9:35:20,  1.59it/s]
  5%|▍         | 2640/57600 [27:45<9:39:07,  1.58it/s]
                                                      
{'loss': 1.6172, 'learning_rate': 9.617421602787455e-07, 'epoch': 29.14}

  5%|▍         | 2640/57600 [27:45<9:39:07,  1.58it/s]
  5%|▍         | 2641/57600 [27:46<9:37:14,  1.59it/s]
  5%|▍         | 2642/57600 [27:46<9:22:20,  1.63it/s]
  5%|▍         | 2643/57600 [27:47<9:12:54,  1.66it/s]
  5%|▍         | 2644/57600 [27:48<9:28:38,  1.61it/s]
  5%|▍         | 2645/57600 [27:48<9:27:28,  1.61it/s]
  5%|▍         | 2646/57600 [27:49<9:18:21,  1.64it/s]
  5%|▍         | 2647/57600 [27:50<9:38:28,  1.58it/s]
  5%|▍         | 2648/57600 [27:50<9:36:39,  1.59it/s]
  5%|▍         | 2649/57600 [27:51<9:43:30,  1.57it/s]
  5%|▍         | 2650/57600 [27:52<10:07:41,  1.51it/s]
  5%|▍         | 2651/57600 [27:52<9:47:16,  1.56it/s] 
  5%|▍         | 2652/57600 [27:53<10:00:47,  1.52it/s]
  5%|▍         | 2653/57600 [27:53<9:34:15,  1.59it/s] 
  5%|▍         | 2654/57600 [27:54<9:16:57,  1.64it/s]
  5%|▍         | 2655/57600 [27:55<9:31:59,  1.60it/s]
  5%|▍         | 2656/57600 [27:55<9:38:55,  1.58it/s]
  5%|▍         | 2657/57600 [27:56<9:28:33,  1.61it/s]
  5%|▍         | 2658/57600 [27:57<9:39:45,  1.58it/s]
  5%|▍         | 2659/57600 [27:57<9:32:30,  1.60it/s]
  5%|▍         | 2660/57600 [27:58<9:32:32,  1.60it/s]
                                                      
{'loss': 1.6696, 'learning_rate': 9.614285714285714e-07, 'epoch': 29.36}

  5%|▍         | 2660/57600 [27:58<9:32:32,  1.60it/s]
  5%|▍         | 2661/57600 [27:58<9:19:17,  1.64it/s]
  5%|▍         | 2662/57600 [27:59<9:29:54,  1.61it/s]
  5%|▍         | 2663/57600 [28:00<9:22:39,  1.63it/s]
  5%|▍         | 2664/57600 [28:00<9:12:54,  1.66it/s]
  5%|▍         | 2665/57600 [28:01<9:17:17,  1.64it/s]
  5%|▍         | 2666/57600 [28:02<9:35:42,  1.59it/s]
  5%|▍         | 2667/57600 [28:02<9:55:50,  1.54it/s]
  5%|▍         | 2668/57600 [28:03<9:32:55,  1.60it/s]
  5%|▍         | 2669/57600 [28:03<9:33:20,  1.60it/s]
  5%|▍         | 2670/57600 [28:04<9:46:09,  1.56it/s]
  5%|▍         | 2671/57600 [28:05<9:34:25,  1.59it/s]
  5%|▍         | 2672/57600 [28:05<9:24:39,  1.62it/s]
  5%|▍         | 2673/57600 [28:06<9:25:06,  1.62it/s]
  5%|▍         | 2674/57600 [28:07<9:25:45,  1.62it/s]
  5%|▍         | 2675/57600 [28:07<9:22:10,  1.63it/s]
  5%|▍         | 2676/57600 [28:08<9:19:26,  1.64it/s]
  5%|▍         | 2677/57600 [28:08<9:24:34,  1.62it/s]
  5%|▍         | 2678/57600 [28:09<9:26:39,  1.62it/s]
  5%|▍         | 2679/57600 [28:10<9:35:27,  1.59it/s]
  5%|▍         | 2680/57600 [28:10<9:23:28,  1.62it/s]
                                                      
{'loss': 1.7091, 'learning_rate': 9.611149825783972e-07, 'epoch': 29.58}

  5%|▍         | 2680/57600 [28:10<9:23:28,  1.62it/s]
  5%|▍         | 2681/57600 [28:11<9:26:02,  1.62it/s]
  5%|▍         | 2682/57600 [28:12<9:41:27,  1.57it/s]
  5%|▍         | 2683/57600 [28:12<9:28:32,  1.61it/s]
  5%|▍         | 2684/57600 [28:13<9:49:34,  1.55it/s]
  5%|▍         | 2685/57600 [28:13<9:57:06,  1.53it/s]
  5%|▍         | 2686/57600 [28:14<10:17:13,  1.48it/s]
  5%|▍         | 2687/57600 [28:15<10:08:10,  1.50it/s]
  5%|▍         | 2688/57600 [28:15<9:41:41,  1.57it/s] 
  5%|▍         | 2689/57600 [28:16<9:39:14,  1.58it/s]
  5%|▍         | 2690/57600 [28:17<9:57:13,  1.53it/s]
  5%|▍         | 2691/57600 [28:17<9:38:35,  1.58it/s]
  5%|▍         | 2692/57600 [28:18<9:41:07,  1.57it/s]
  5%|▍         | 2693/57600 [28:19<9:31:26,  1.60it/s]
  5%|▍         | 2694/57600 [28:19<9:22:59,  1.63it/s]
  5%|▍         | 2695/57600 [28:20<9:33:04,  1.60it/s]
  5%|▍         | 2696/57600 [28:20<9:19:17,  1.64it/s]
  5%|▍         | 2697/57600 [28:21<9:31:47,  1.60it/s]
  5%|▍         | 2698/57600 [28:22<9:48:32,  1.55it/s]
  5%|▍         | 2699/57600 [28:22<9:49:59,  1.55it/s]
  5%|▍         | 2700/57600 [28:23<9:53:24,  1.54it/s]
                                                      
{'loss': 1.6111, 'learning_rate': 9.60801393728223e-07, 'epoch': 29.8}

  5%|▍         | 2700/57600 [28:23<9:53:24,  1.54it/s]
  5%|▍         | 2701/57600 [28:24<10:09:10,  1.50it/s]
  5%|▍         | 2702/57600 [28:24<10:07:32,  1.51it/s]
  5%|▍         | 2703/57600 [28:25<9:55:16,  1.54it/s] 
  5%|▍         | 2704/57600 [28:26<9:45:01,  1.56it/s]
  5%|▍         | 2705/57600 [28:26<9:51:47,  1.55it/s]
  5%|▍         | 2706/57600 [28:27<9:30:42,  1.60it/s]
  5%|▍         | 2707/57600 [28:27<9:28:21,  1.61it/s]
  5%|▍         | 2708/57600 [28:28<9:42:19,  1.57it/s]
  5%|▍         | 2709/57600 [28:29<10:07:07,  1.51it/s]
  5%|▍         | 2710/57600 [28:30<10:01:26,  1.52it/s]
  5%|▍         | 2711/57600 [28:30<9:50:08,  1.55it/s] 
  5%|▍         | 2712/57600 [28:31<9:49:45,  1.55it/s]
  5%|▍         | 2713/57600 [28:31<9:55:02,  1.54it/s]
  5%|▍         | 2714/57600 [28:32<10:02:11,  1.52it/s]
  5%|▍         | 2715/57600 [28:33<9:48:37,  1.55it/s] 
  5%|▍         | 2716/57600 [28:33<9:45:15,  1.56it/s]
  5%|▍         | 2717/57600 [28:34<9:45:45,  1.56it/s]
  5%|▍         | 2718/57600 [28:35<9:30:17,  1.60it/s]
  5%|▍         | 2719/57600 [28:35<9:45:16,  1.56it/s]
  5%|▍         | 2720/57600 [28:36<9:44:42,  1.56it/s]
                                                      
{'loss': 1.6274, 'learning_rate': 9.604878048780487e-07, 'epoch': 30.02}

  5%|▍         | 2720/57600 [28:36<9:44:42,  1.56it/s]
  5%|▍         | 2721/57600 [28:36<9:33:25,  1.60it/s]
  5%|▍         | 2722/57600 [28:37<9:21:33,  1.63it/s]
  5%|▍         | 2723/57600 [28:38<9:28:24,  1.61it/s]
  5%|▍         | 2724/57600 [28:38<9:38:57,  1.58it/s]
  5%|▍         | 2725/57600 [28:39<9:34:02,  1.59it/s]
  5%|▍         | 2726/57600 [28:40<9:56:56,  1.53it/s]
  5%|▍         | 2727/57600 [28:40<10:06:38,  1.51it/s]
  5%|▍         | 2728/57600 [28:41<9:50:05,  1.55it/s] 
  5%|▍         | 2729/57600 [28:42<9:53:58,  1.54it/s]
  5%|▍         | 2730/57600 [28:42<9:52:54,  1.54it/s]
  5%|▍         | 2731/57600 [28:43<9:38:02,  1.58it/s]
  5%|▍         | 2732/57600 [28:44<9:57:31,  1.53it/s]
  5%|▍         | 2733/57600 [28:44<9:59:05,  1.53it/s]
  5%|▍         | 2734/57600 [28:45<10:17:13,  1.48it/s]
  5%|▍         | 2735/57600 [28:46<10:05:14,  1.51it/s]
  5%|▍         | 2736/57600 [28:46<9:59:40,  1.52it/s] 
  5%|▍         | 2737/57600 [28:47<10:06:46,  1.51it/s]
  5%|▍         | 2738/57600 [28:48<10:05:31,  1.51it/s]
  5%|▍         | 2739/57600 [28:48<9:49:39,  1.55it/s] 
  5%|▍         | 2740/57600 [28:49<9:47:25,  1.56it/s]
                                                      
{'loss': 1.6186, 'learning_rate': 9.601742160278746e-07, 'epoch': 30.24}

  5%|▍         | 2740/57600 [28:49<9:47:25,  1.56it/s]
  5%|▍         | 2741/57600 [28:49<9:40:49,  1.57it/s]
  5%|▍         | 2742/57600 [28:50<9:45:24,  1.56it/s]
  5%|▍         | 2743/57600 [28:51<9:45:01,  1.56it/s]
  5%|▍         | 2744/57600 [28:51<9:47:00,  1.56it/s]
  5%|▍         | 2745/57600 [28:52<9:37:39,  1.58it/s]
  5%|▍         | 2746/57600 [28:53<9:32:40,  1.60it/s]
  5%|▍         | 2747/57600 [28:53<9:34:03,  1.59it/s]
  5%|▍         | 2748/57600 [28:54<9:27:10,  1.61it/s]
  5%|▍         | 2749/57600 [28:54<9:28:58,  1.61it/s]
  5%|▍         | 2750/57600 [28:55<9:14:32,  1.65it/s]
  5%|▍         | 2751/57600 [28:56<9:14:51,  1.65it/s]
  5%|▍         | 2752/57600 [28:56<9:24:05,  1.62it/s]
  5%|▍         | 2753/57600 [28:57<9:28:48,  1.61it/s]
  5%|▍         | 2754/57600 [28:58<9:41:57,  1.57it/s]
  5%|▍         | 2755/57600 [28:58<9:39:31,  1.58it/s]
  5%|▍         | 2756/57600 [28:59<9:45:15,  1.56it/s]
  5%|▍         | 2757/57600 [29:00<9:58:37,  1.53it/s]
  5%|▍         | 2758/57600 [29:00<10:02:21,  1.52it/s]
  5%|▍         | 2759/57600 [29:01<9:38:13,  1.58it/s] 
  5%|▍         | 2760/57600 [29:01<9:20:25,  1.63it/s]
                                                      
{'loss': 1.6336, 'learning_rate': 9.598606271777002e-07, 'epoch': 30.46}

  5%|▍         | 2760/57600 [29:01<9:20:25,  1.63it/s]
  5%|▍         | 2761/57600 [29:02<9:06:46,  1.67it/s]
  5%|▍         | 2762/57600 [29:03<9:11:21,  1.66it/s]
  5%|▍         | 2763/57600 [29:03<9:06:26,  1.67it/s]
  5%|▍         | 2764/57600 [29:04<9:31:45,  1.60it/s]
  5%|▍         | 2765/57600 [29:04<9:42:24,  1.57it/s]
  5%|▍         | 2766/57600 [29:05<9:27:24,  1.61it/s]
  5%|▍         | 2767/57600 [29:06<9:34:20,  1.59it/s]
  5%|▍         | 2768/57600 [29:06<9:28:28,  1.61it/s]
  5%|▍         | 2769/57600 [29:07<10:08:30,  1.50it/s]
  5%|▍         | 2770/57600 [29:08<9:58:54,  1.53it/s] 
  5%|▍         | 2771/57600 [29:08<9:45:48,  1.56it/s]
  5%|▍         | 2772/57600 [29:09<9:38:32,  1.58it/s]
  5%|▍         | 2773/57600 [29:10<9:40:56,  1.57it/s]
  5%|▍         | 2774/57600 [29:10<9:42:24,  1.57it/s]
  5%|▍         | 2775/57600 [29:11<9:35:55,  1.59it/s]
  5%|▍         | 2776/57600 [29:11<9:21:46,  1.63it/s]
  5%|▍         | 2777/57600 [29:12<9:25:06,  1.62it/s]
  5%|▍         | 2778/57600 [29:13<9:33:33,  1.59it/s]
  5%|▍         | 2779/57600 [29:13<9:23:09,  1.62it/s]
  5%|▍         | 2780/57600 [29:14<9:15:55,  1.64it/s]
                                                      
{'loss': 1.6414, 'learning_rate': 9.59547038327526e-07, 'epoch': 30.68}

  5%|▍         | 2780/57600 [29:14<9:15:55,  1.64it/s]
  5%|▍         | 2781/57600 [29:15<9:32:27,  1.60it/s]
  5%|▍         | 2782/57600 [29:15<9:17:49,  1.64it/s]
  5%|▍         | 2783/57600 [29:16<9:09:15,  1.66it/s]
  5%|▍         | 2784/57600 [29:16<9:23:06,  1.62it/s]
  5%|▍         | 2785/57600 [29:17<9:22:20,  1.62it/s]
  5%|▍         | 2786/57600 [29:18<9:16:46,  1.64it/s]
  5%|▍         | 2787/57600 [29:18<9:42:21,  1.57it/s]
  5%|▍         | 2788/57600 [29:19<9:36:13,  1.59it/s]
  5%|▍         | 2789/57600 [29:19<9:30:21,  1.60it/s]
  5%|▍         | 2790/57600 [29:20<9:40:32,  1.57it/s]
  5%|▍         | 2791/57600 [29:21<9:21:03,  1.63it/s]
  5%|▍         | 2792/57600 [29:21<9:26:36,  1.61it/s]
  5%|▍         | 2793/57600 [29:22<9:23:01,  1.62it/s]
  5%|▍         | 2794/57600 [29:23<9:36:06,  1.59it/s]
  5%|▍         | 2795/57600 [29:23<9:31:45,  1.60it/s]
  5%|▍         | 2796/57600 [29:24<9:26:37,  1.61it/s]
  5%|▍         | 2797/57600 [29:25<9:45:44,  1.56it/s]
  5%|▍         | 2798/57600 [29:25<9:36:13,  1.59it/s]
  5%|▍         | 2799/57600 [29:26<9:43:42,  1.56it/s]
  5%|▍         | 2800/57600 [29:26<9:40:56,  1.57it/s]
                                                      
{'loss': 1.6628, 'learning_rate': 9.59233449477352e-07, 'epoch': 30.91}

  5%|▍         | 2800/57600 [29:26<9:40:56,  1.57it/s]
  5%|▍         | 2801/57600 [29:27<9:50:26,  1.55it/s]
  5%|▍         | 2802/57600 [29:28<9:33:03,  1.59it/s]
  5%|▍         | 2803/57600 [29:28<9:22:27,  1.62it/s]
  5%|▍         | 2804/57600 [29:29<9:34:41,  1.59it/s]
  5%|▍         | 2805/57600 [29:30<9:43:45,  1.56it/s]
  5%|▍         | 2806/57600 [29:30<10:00:43,  1.52it/s]
  5%|▍         | 2807/57600 [29:31<9:57:00,  1.53it/s] 
  5%|▍         | 2808/57600 [29:32<9:49:29,  1.55it/s]
  5%|▍         | 2809/57600 [29:32<9:57:54,  1.53it/s]
  5%|▍         | 2810/57600 [29:33<9:39:12,  1.58it/s]
  5%|▍         | 2811/57600 [29:33<9:42:05,  1.57it/s]
  5%|▍         | 2812/57600 [29:34<9:45:29,  1.56it/s]
  5%|▍         | 2813/57600 [29:35<10:06:00,  1.51it/s]
  5%|▍         | 2814/57600 [29:35<10:03:43,  1.51it/s]
  5%|▍         | 2815/57600 [29:36<9:58:18,  1.53it/s] 
  5%|▍         | 2816/57600 [29:37<10:12:30,  1.49it/s]
  5%|▍         | 2817/57600 [29:37<9:47:27,  1.55it/s] 
  5%|▍         | 2818/57600 [29:38<9:36:28,  1.58it/s]
  5%|▍         | 2819/57600 [29:39<9:40:17,  1.57it/s]
  5%|▍         | 2820/57600 [29:39<9:40:32,  1.57it/s]
                                                      
{'loss': 1.6092, 'learning_rate': 9.589198606271776e-07, 'epoch': 31.13}

  5%|▍         | 2820/57600 [29:39<9:40:32,  1.57it/s]
  5%|▍         | 2821/57600 [29:40<9:32:48,  1.59it/s]
  5%|▍         | 2822/57600 [29:41<9:26:25,  1.61it/s]
  5%|▍         | 2823/57600 [29:41<9:41:22,  1.57it/s]
  5%|▍         | 2824/57600 [29:42<9:30:07,  1.60it/s]
  5%|▍         | 2825/57600 [29:42<9:38:23,  1.58it/s]
  5%|▍         | 2826/57600 [29:43<9:29:28,  1.60it/s]
  5%|▍         | 2827/57600 [29:44<9:34:05,  1.59it/s]
  5%|▍         | 2828/57600 [29:44<9:25:03,  1.62it/s]
  5%|▍         | 2829/57600 [29:45<9:20:57,  1.63it/s]
  5%|▍         | 2830/57600 [29:46<9:22:33,  1.62it/s]
  5%|▍         | 2831/57600 [29:46<9:25:32,  1.61it/s]
  5%|▍         | 2832/57600 [29:47<9:21:42,  1.63it/s]
  5%|▍         | 2833/57600 [29:47<9:40:04,  1.57it/s]
  5%|▍         | 2834/57600 [29:48<9:49:03,  1.55it/s]
  5%|▍         | 2835/57600 [29:49<9:48:30,  1.55it/s]
  5%|▍         | 2836/57600 [29:50<10:34:34,  1.44it/s]
  5%|▍         | 2837/57600 [29:50<10:32:07,  1.44it/s]
  5%|▍         | 2838/57600 [29:51<10:11:56,  1.49it/s]
  5%|▍         | 2839/57600 [29:51<9:58:59,  1.52it/s] 
  5%|▍         | 2840/57600 [29:52<9:43:03,  1.57it/s]
                                                      
{'loss': 1.669, 'learning_rate': 9.586062717770034e-07, 'epoch': 31.35}

  5%|▍         | 2840/57600 [29:52<9:43:03,  1.57it/s]
  5%|▍         | 2841/57600 [29:53<9:45:26,  1.56it/s]
  5%|▍         | 2842/57600 [29:53<9:45:13,  1.56it/s]
  5%|▍         | 2843/57600 [29:54<9:43:25,  1.56it/s]
  5%|▍         | 2844/57600 [29:55<9:44:46,  1.56it/s]
  5%|▍         | 2845/57600 [29:55<9:36:38,  1.58it/s]
  5%|▍         | 2846/57600 [29:56<9:50:32,  1.55it/s]
  5%|▍         | 2847/57600 [29:57<9:35:57,  1.58it/s]
  5%|▍         | 2848/57600 [29:57<9:22:34,  1.62it/s]
  5%|▍         | 2849/57600 [29:58<9:22:55,  1.62it/s]
  5%|▍         | 2850/57600 [29:58<9:22:46,  1.62it/s]
  5%|▍         | 2851/57600 [29:59<9:29:48,  1.60it/s]
  5%|▍         | 2852/57600 [30:00<9:16:53,  1.64it/s]
  5%|▍         | 2853/57600 [30:00<9:13:56,  1.65it/s]
  5%|▍         | 2854/57600 [30:01<9:11:02,  1.66it/s]
  5%|▍         | 2855/57600 [30:01<9:04:16,  1.68it/s]
  5%|▍         | 2856/57600 [30:02<9:00:09,  1.69it/s]
  5%|▍         | 2857/57600 [30:03<9:10:02,  1.66it/s]
  5%|▍         | 2858/57600 [30:03<9:09:58,  1.66it/s]
  5%|▍         | 2859/57600 [30:04<9:20:04,  1.63it/s]
  5%|▍         | 2860/57600 [30:04<9:15:37,  1.64it/s]
                                                      
{'loss': 1.6597, 'learning_rate': 9.58292682926829e-07, 'epoch': 31.57}

  5%|▍         | 2860/57600 [30:04<9:15:37,  1.64it/s]
  5%|▍         | 2861/57600 [30:05<9:38:50,  1.58it/s]
  5%|▍         | 2862/57600 [30:06<9:47:08,  1.55it/s]
  5%|▍         | 2863/57600 [30:06<9:34:14,  1.59it/s]
  5%|▍         | 2864/57600 [30:07<9:31:57,  1.59it/s]
  5%|▍         | 2865/57600 [30:08<9:30:35,  1.60it/s]
  5%|▍         | 2866/57600 [30:08<9:35:56,  1.58it/s]
  5%|▍         | 2867/57600 [30:09<9:34:01,  1.59it/s]
  5%|▍         | 2868/57600 [30:09<9:34:22,  1.59it/s]
  5%|▍         | 2869/57600 [30:10<9:32:41,  1.59it/s]
  5%|▍         | 2870/57600 [30:11<9:37:18,  1.58it/s]
  5%|▍         | 2871/57600 [30:11<9:41:51,  1.57it/s]
  5%|▍         | 2872/57600 [30:12<9:38:51,  1.58it/s]
  5%|▍         | 2873/57600 [30:13<9:50:41,  1.54it/s]
  5%|▍         | 2874/57600 [30:13<10:02:53,  1.51it/s]
  5%|▍         | 2875/57600 [30:14<9:52:01,  1.54it/s] 
  5%|▍         | 2876/57600 [30:15<9:45:59,  1.56it/s]
  5%|▍         | 2877/57600 [30:15<10:06:21,  1.50it/s]
  5%|▍         | 2878/57600 [30:16<10:21:43,  1.47it/s]
  5%|▍         | 2879/57600 [30:17<10:35:00,  1.44it/s]
  5%|▌         | 2880/57600 [30:17<10:26:44,  1.46it/s]
                                                       
{'loss': 1.5658, 'learning_rate': 9.57979094076655e-07, 'epoch': 31.79}

  5%|▌         | 2880/57600 [30:17<10:26:44,  1.46it/s]
  5%|▌         | 2881/57600 [30:18<9:55:45,  1.53it/s] 
  5%|▌         | 2882/57600 [30:19<9:39:22,  1.57it/s]
  5%|▌         | 2883/57600 [30:19<9:44:54,  1.56it/s]
  5%|▌         | 2884/57600 [30:20<9:27:08,  1.61it/s]
  5%|▌         | 2885/57600 [30:20<9:21:49,  1.62it/s]
  5%|▌         | 2886/57600 [30:21<9:31:12,  1.60it/s]
  5%|▌         | 2887/57600 [30:22<9:37:05,  1.58it/s]
  5%|▌         | 2888/57600 [30:22<9:40:20,  1.57it/s]
  5%|▌         | 2889/57600 [30:23<9:36:09,  1.58it/s]
  5%|▌         | 2890/57600 [30:24<9:48:37,  1.55it/s]
  5%|▌         | 2891/57600 [30:24<9:53:28,  1.54it/s]
  5%|▌         | 2892/57600 [30:25<9:47:44,  1.55it/s]
  5%|▌         | 2893/57600 [30:26<9:47:58,  1.55it/s]
  5%|▌         | 2894/57600 [30:26<10:06:51,  1.50it/s]
  5%|▌         | 2895/57600 [30:27<9:42:15,  1.57it/s] 
  5%|▌         | 2896/57600 [30:28<9:44:49,  1.56it/s]
  5%|▌         | 2897/57600 [30:28<10:15:33,  1.48it/s]
  5%|▌         | 2898/57600 [30:29<10:00:06,  1.52it/s]
  5%|▌         | 2899/57600 [30:30<9:44:10,  1.56it/s] 
  5%|▌         | 2900/57600 [30:30<10:06:17,  1.50it/s]
                                                       
{'loss': 1.6662, 'learning_rate': 9.576655052264808e-07, 'epoch': 32.01}

  5%|▌         | 2900/57600 [30:30<10:06:17,  1.50it/s]
  5%|▌         | 2901/57600 [30:31<9:58:04,  1.52it/s] 
  5%|▌         | 2902/57600 [30:32<9:52:41,  1.54it/s]
  5%|▌         | 2903/57600 [30:32<9:36:37,  1.58it/s]
  5%|▌         | 2904/57600 [30:33<9:28:14,  1.60it/s]
  5%|▌         | 2905/57600 [30:33<9:38:13,  1.58it/s]
  5%|▌         | 2906/57600 [30:34<9:39:37,  1.57it/s]
  5%|▌         | 2907/57600 [30:35<9:45:57,  1.56it/s]
  5%|▌         | 2908/57600 [30:35<9:38:50,  1.57it/s]
  5%|▌         | 2909/57600 [30:36<10:01:54,  1.51it/s]
  5%|▌         | 2910/57600 [30:37<9:37:54,  1.58it/s] 
  5%|▌         | 2911/57600 [30:37<9:23:28,  1.62it/s]
  5%|▌         | 2912/57600 [30:38<9:36:58,  1.58it/s]
  5%|▌         | 2913/57600 [30:39<9:52:57,  1.54it/s]
  5%|▌         | 2914/57600 [30:39<9:59:56,  1.52it/s]
  5%|▌         | 2915/57600 [30:40<9:59:14,  1.52it/s]
  5%|▌         | 2916/57600 [30:41<9:44:48,  1.56it/s]
  5%|▌         | 2917/57600 [30:41<10:08:20,  1.50it/s]
  5%|▌         | 2918/57600 [30:42<10:01:16,  1.52it/s]
  5%|▌         | 2919/57600 [30:42<9:38:39,  1.57it/s] 
  5%|▌         | 2920/57600 [30:43<9:22:57,  1.62it/s]
                                                      
{'loss': 1.6241, 'learning_rate': 9.573519163763067e-07, 'epoch': 32.23}

  5%|▌         | 2920/57600 [30:43<9:22:57,  1.62it/s]
  5%|▌         | 2921/57600 [30:44<9:19:45,  1.63it/s]
  5%|▌         | 2922/57600 [30:44<9:33:44,  1.59it/s]
  5%|▌         | 2923/57600 [30:45<9:58:10,  1.52it/s]
  5%|▌         | 2924/57600 [30:46<9:44:46,  1.56it/s]
  5%|▌         | 2925/57600 [30:46<9:42:53,  1.56it/s]
  5%|▌         | 2926/57600 [30:47<9:37:41,  1.58it/s]
  5%|▌         | 2927/57600 [30:48<9:32:18,  1.59it/s]
  5%|▌         | 2928/57600 [30:48<9:41:13,  1.57it/s]
  5%|▌         | 2929/57600 [30:49<9:37:01,  1.58it/s]
  5%|▌         | 2930/57600 [30:50<10:12:37,  1.49it/s]
  5%|▌         | 2931/57600 [30:50<9:51:56,  1.54it/s] 
  5%|▌         | 2932/57600 [30:51<10:01:44,  1.51it/s]
  5%|▌         | 2933/57600 [30:51<10:00:55,  1.52it/s]
  5%|▌         | 2934/57600 [30:52<9:56:47,  1.53it/s] 
  5%|▌         | 2935/57600 [30:53<9:35:41,  1.58it/s]
  5%|▌         | 2936/57600 [30:53<9:23:44,  1.62it/s]
  5%|▌         | 2937/57600 [30:54<9:27:38,  1.60it/s]
  5%|▌         | 2938/57600 [30:55<9:34:34,  1.59it/s]
  5%|▌         | 2939/57600 [30:55<9:34:42,  1.59it/s]
  5%|▌         | 2940/57600 [30:56<9:29:57,  1.60it/s]
                                                      
{'loss': 1.6181, 'learning_rate': 9.570383275261325e-07, 'epoch': 32.45}

  5%|▌         | 2940/57600 [30:56<9:29:57,  1.60it/s]
  5%|▌         | 2941/57600 [30:56<9:39:58,  1.57it/s]
  5%|▌         | 2942/57600 [30:57<9:56:12,  1.53it/s]
  5%|▌         | 2943/57600 [30:58<10:04:14,  1.51it/s]
  5%|▌         | 2944/57600 [30:59<10:10:09,  1.49it/s]
  5%|▌         | 2945/57600 [30:59<9:54:55,  1.53it/s] 
  5%|▌         | 2946/57600 [31:00<9:35:09,  1.58it/s]
  5%|▌         | 2947/57600 [31:00<9:28:26,  1.60it/s]
  5%|▌         | 2948/57600 [31:01<9:16:12,  1.64it/s]
  5%|▌         | 2949/57600 [31:02<9:10:21,  1.66it/s]
  5%|▌         | 2950/57600 [31:02<9:04:27,  1.67it/s]
  5%|▌         | 2951/57600 [31:03<9:03:28,  1.68it/s]
  5%|▌         | 2952/57600 [31:03<9:07:10,  1.66it/s]
  5%|▌         | 2953/57600 [31:04<8:59:24,  1.69it/s]
  5%|▌         | 2954/57600 [31:05<9:06:02,  1.67it/s]
  5%|▌         | 2955/57600 [31:05<9:22:34,  1.62it/s]
  5%|▌         | 2956/57600 [31:06<9:28:12,  1.60it/s]
  5%|▌         | 2957/57600 [31:06<9:27:11,  1.61it/s]
  5%|▌         | 2958/57600 [31:07<9:31:03,  1.59it/s]
  5%|▌         | 2959/57600 [31:08<9:35:02,  1.58it/s]
  5%|▌         | 2960/57600 [31:08<9:33:22,  1.59it/s]
                                                      
{'loss': 1.6561, 'learning_rate': 9.567247386759582e-07, 'epoch': 32.67}

  5%|▌         | 2960/57600 [31:08<9:33:22,  1.59it/s]
  5%|▌         | 2961/57600 [31:09<9:20:42,  1.62it/s]
  5%|▌         | 2962/57600 [31:10<9:25:45,  1.61it/s]
  5%|▌         | 2963/57600 [31:10<9:43:40,  1.56it/s]
  5%|▌         | 2964/57600 [31:11<9:34:58,  1.58it/s]
  5%|▌         | 2965/57600 [31:11<9:43:07,  1.56it/s]
  5%|▌         | 2966/57600 [31:12<9:52:05,  1.54it/s]
  5%|▌         | 2967/57600 [31:13<9:53:14,  1.53it/s]
  5%|▌         | 2968/57600 [31:14<10:06:41,  1.50it/s]
  5%|▌         | 2969/57600 [31:14<10:00:50,  1.52it/s]
  5%|▌         | 2970/57600 [31:15<10:01:20,  1.51it/s]
  5%|▌         | 2971/57600 [31:15<9:52:25,  1.54it/s] 
  5%|▌         | 2972/57600 [31:16<9:48:32,  1.55it/s]
  5%|▌         | 2973/57600 [31:17<9:37:08,  1.58it/s]
  5%|▌         | 2974/57600 [31:17<9:25:18,  1.61it/s]
  5%|▌         | 2975/57600 [31:18<9:35:14,  1.58it/s]
  5%|▌         | 2976/57600 [31:19<9:45:16,  1.56it/s]
  5%|▌         | 2977/57600 [31:19<9:29:13,  1.60it/s]
  5%|▌         | 2978/57600 [31:20<9:33:25,  1.59it/s]
  5%|▌         | 2979/57600 [31:20<9:25:38,  1.61it/s]
  5%|▌         | 2980/57600 [31:21<9:34:53,  1.58it/s]
                                                      
{'loss': 1.6176, 'learning_rate': 9.564111498257838e-07, 'epoch': 32.89}

  5%|▌         | 2980/57600 [31:21<9:34:53,  1.58it/s]
  5%|▌         | 2981/57600 [31:22<9:33:40,  1.59it/s]
  5%|▌         | 2982/57600 [31:22<9:39:36,  1.57it/s]
  5%|▌         | 2983/57600 [31:23<9:27:14,  1.60it/s]
  5%|▌         | 2984/57600 [31:24<9:16:22,  1.64it/s]
  5%|▌         | 2985/57600 [31:24<9:25:13,  1.61it/s]
  5%|▌         | 2986/57600 [31:25<9:28:32,  1.60it/s]
  5%|▌         | 2987/57600 [31:25<9:08:44,  1.66it/s]
  5%|▌         | 2988/57600 [31:26<9:19:13,  1.63it/s]
  5%|▌         | 2989/57600 [31:27<9:28:38,  1.60it/s]
  5%|▌         | 2990/57600 [31:27<10:01:57,  1.51it/s]
  5%|▌         | 2991/57600 [31:28<9:40:14,  1.57it/s] 
  5%|▌         | 2992/57600 [31:29<9:28:25,  1.60it/s]
  5%|▌         | 2993/57600 [31:29<9:23:20,  1.62it/s]
  5%|▌         | 2994/57600 [31:30<9:12:24,  1.65it/s]
  5%|▌         | 2995/57600 [31:30<9:13:33,  1.64it/s]
  5%|▌         | 2996/57600 [31:31<9:32:15,  1.59it/s]
  5%|▌         | 2997/57600 [31:32<9:24:51,  1.61it/s]
  5%|▌         | 2998/57600 [31:32<9:21:44,  1.62it/s]
  5%|▌         | 2999/57600 [31:33<9:19:20,  1.63it/s]
  5%|▌         | 3000/57600 [31:33<9:12:10,  1.65it/s]
                                                      
{'loss': 1.686, 'learning_rate': 9.560975609756097e-07, 'epoch': 33.11}

  5%|▌         | 3000/57600 [31:33<9:12:10,  1.65it/s]
  5%|▌         | 3001/57600 [31:34<9:14:59,  1.64it/s]
  5%|▌         | 3002/57600 [31:35<9:24:46,  1.61it/s]
  5%|▌         | 3003/57600 [31:35<9:14:55,  1.64it/s]
  5%|▌         | 3004/57600 [31:36<9:22:59,  1.62it/s]
  5%|▌         | 3005/57600 [31:37<9:31:53,  1.59it/s]
  5%|▌         | 3006/57600 [31:37<9:38:03,  1.57it/s]
  5%|▌         | 3007/57600 [31:38<9:45:26,  1.55it/s]
  5%|▌         | 3008/57600 [31:39<9:39:29,  1.57it/s]
  5%|▌         | 3009/57600 [31:39<9:47:40,  1.55it/s]
  5%|▌         | 3010/57600 [31:40<9:45:02,  1.56it/s]
  5%|▌         | 3011/57600 [31:41<9:50:40,  1.54it/s]
  5%|▌         | 3012/57600 [31:41<9:46:23,  1.55it/s]
  5%|▌         | 3013/57600 [31:42<9:45:41,  1.55it/s]
  5%|▌         | 3014/57600 [31:42<9:45:00,  1.56it/s]
  5%|▌         | 3015/57600 [31:43<9:50:36,  1.54it/s]
  5%|▌         | 3016/57600 [31:44<9:55:52,  1.53it/s]
  5%|▌         | 3017/57600 [31:44<9:39:59,  1.57it/s]
  5%|▌         | 3018/57600 [31:45<9:39:35,  1.57it/s]
  5%|▌         | 3019/57600 [31:46<9:23:48,  1.61it/s]
  5%|▌         | 3020/57600 [31:46<9:50:14,  1.54it/s]
                                                      
{'loss': 1.5938, 'learning_rate': 9.557839721254355e-07, 'epoch': 33.33}

  5%|▌         | 3020/57600 [31:46<9:50:14,  1.54it/s]
  5%|▌         | 3021/57600 [31:47<9:52:15,  1.54it/s]
  5%|▌         | 3022/57600 [31:48<9:33:52,  1.59it/s]
  5%|▌         | 3023/57600 [31:48<9:30:52,  1.59it/s]
  5%|▌         | 3024/57600 [31:49<9:28:52,  1.60it/s]
  5%|▌         | 3025/57600 [31:49<9:31:08,  1.59it/s]
  5%|▌         | 3026/57600 [31:50<9:40:27,  1.57it/s]
  5%|▌         | 3027/57600 [31:51<9:45:20,  1.55it/s]
  5%|▌         | 3028/57600 [31:51<9:45:49,  1.55it/s]
  5%|▌         | 3029/57600 [31:52<9:33:24,  1.59it/s]
  5%|▌         | 3030/57600 [31:53<9:29:00,  1.60it/s]
  5%|▌         | 3031/57600 [31:53<9:39:02,  1.57it/s]
  5%|▌         | 3032/57600 [31:54<9:59:59,  1.52it/s]
  5%|▌         | 3033/57600 [31:55<9:51:51,  1.54it/s]
  5%|▌         | 3034/57600 [31:55<9:47:14,  1.55it/s]
  5%|▌         | 3035/57600 [31:56<9:37:28,  1.57it/s]
  5%|▌         | 3036/57600 [31:56<9:23:26,  1.61it/s]
  5%|▌         | 3037/57600 [31:57<9:07:28,  1.66it/s]
  5%|▌         | 3038/57600 [31:58<9:10:08,  1.65it/s]
  5%|▌         | 3039/57600 [31:58<9:11:36,  1.65it/s]
  5%|▌         | 3040/57600 [31:59<9:20:27,  1.62it/s]
                                                      
{'loss': 1.5952, 'learning_rate': 9.554703832752614e-07, 'epoch': 33.55}

  5%|▌         | 3040/57600 [31:59<9:20:27,  1.62it/s]
  5%|▌         | 3041/57600 [31:59<9:16:23,  1.63it/s]
  5%|▌         | 3042/57600 [32:00<9:04:06,  1.67it/s]
  5%|▌         | 3043/57600 [32:01<9:04:55,  1.67it/s]
  5%|▌         | 3044/57600 [32:01<9:23:52,  1.61it/s]
  5%|▌         | 3045/57600 [32:02<9:25:39,  1.61it/s]
  5%|▌         | 3046/57600 [32:03<9:44:34,  1.56it/s]
  5%|▌         | 3047/57600 [32:03<9:35:18,  1.58it/s]
  5%|▌         | 3048/57600 [32:04<10:07:24,  1.50it/s]
  5%|▌         | 3049/57600 [32:05<9:39:51,  1.57it/s] 
  5%|▌         | 3050/57600 [32:05<9:30:43,  1.59it/s]
  5%|▌         | 3051/57600 [32:06<9:39:06,  1.57it/s]
  5%|▌         | 3052/57600 [32:06<9:29:19,  1.60it/s]
  5%|▌         | 3053/57600 [32:07<9:24:39,  1.61it/s]
  5%|▌         | 3054/57600 [32:08<9:33:17,  1.59it/s]
  5%|▌         | 3055/57600 [32:08<9:58:33,  1.52it/s]
  5%|▌         | 3056/57600 [32:09<9:42:03,  1.56it/s]
  5%|▌         | 3057/57600 [32:10<9:39:00,  1.57it/s]
  5%|▌         | 3058/57600 [32:10<9:49:38,  1.54it/s]
  5%|▌         | 3059/57600 [32:11<9:40:40,  1.57it/s]
  5%|▌         | 3060/57600 [32:12<9:41:18,  1.56it/s]
                                                      
{'loss': 1.5772, 'learning_rate': 9.55156794425087e-07, 'epoch': 33.77}

  5%|▌         | 3060/57600 [32:12<9:41:18,  1.56it/s]
  5%|▌         | 3061/57600 [32:12<9:40:15,  1.57it/s]
  5%|▌         | 3062/57600 [32:13<9:51:36,  1.54it/s]
  5%|▌         | 3063/57600 [32:14<10:00:56,  1.51it/s]
  5%|▌         | 3064/57600 [32:14<9:59:05,  1.52it/s] 
  5%|▌         | 3065/57600 [32:15<9:54:20,  1.53it/s]
  5%|▌         | 3066/57600 [32:15<9:57:38,  1.52it/s]
  5%|▌         | 3067/57600 [32:16<9:51:50,  1.54it/s]
  5%|▌         | 3068/57600 [32:17<9:40:29,  1.57it/s]
  5%|▌         | 3069/57600 [32:17<9:38:51,  1.57it/s]
  5%|▌         | 3070/57600 [32:18<9:43:37,  1.56it/s]
  5%|▌         | 3071/57600 [32:19<9:52:39,  1.53it/s]
  5%|▌         | 3072/57600 [32:19<10:02:24,  1.51it/s]
  5%|▌         | 3073/57600 [32:20<9:55:03,  1.53it/s] 
  5%|▌         | 3074/57600 [32:21<9:51:18,  1.54it/s]
  5%|▌         | 3075/57600 [32:21<9:35:58,  1.58it/s]
  5%|▌         | 3076/57600 [32:22<9:30:01,  1.59it/s]
  5%|▌         | 3077/57600 [32:23<9:30:53,  1.59it/s]
  5%|▌         | 3078/57600 [32:23<9:21:12,  1.62it/s]
  5%|▌         | 3079/57600 [32:24<9:40:44,  1.56it/s]
  5%|▌         | 3080/57600 [32:24<9:36:59,  1.57it/s]
                                                      
{'loss': 1.5889, 'learning_rate': 9.548432055749129e-07, 'epoch': 34.0}

  5%|▌         | 3080/57600 [32:24<9:36:59,  1.57it/s]
  5%|▌         | 3081/57600 [32:25<10:07:45,  1.50it/s]
  5%|▌         | 3082/57600 [32:26<9:48:10,  1.54it/s] 
  5%|▌         | 3083/57600 [32:26<9:51:48,  1.54it/s]
  5%|▌         | 3084/57600 [32:27<9:55:29,  1.53it/s]
  5%|▌         | 3085/57600 [32:28<9:47:42,  1.55it/s]
  5%|▌         | 3086/57600 [32:28<9:56:03,  1.52it/s]
  5%|▌         | 3087/57600 [32:29<9:42:57,  1.56it/s]
  5%|▌         | 3088/57600 [32:30<10:02:47,  1.51it/s]
  5%|▌         | 3089/57600 [32:30<10:05:13,  1.50it/s]
  5%|▌         | 3090/57600 [32:31<9:54:46,  1.53it/s] 
  5%|▌         | 3091/57600 [32:32<10:13:26,  1.48it/s]
  5%|▌         | 3092/57600 [32:32<9:59:50,  1.51it/s] 
  5%|▌         | 3093/57600 [32:33<9:52:38,  1.53it/s]
  5%|▌         | 3094/57600 [32:34<9:47:24,  1.55it/s]
  5%|▌         | 3095/57600 [32:34<9:49:11,  1.54it/s]
  5%|▌         | 3096/57600 [32:35<10:00:21,  1.51it/s]
  5%|▌         | 3097/57600 [32:36<9:51:17,  1.54it/s] 
  5%|▌         | 3098/57600 [32:36<9:46:11,  1.55it/s]
  5%|▌         | 3099/57600 [32:37<9:37:51,  1.57it/s]
  5%|▌         | 3100/57600 [32:37<9:37:38,  1.57it/s]
                                                      
{'loss': 1.5953, 'learning_rate': 9.545296167247385e-07, 'epoch': 34.22}

  5%|▌         | 3100/57600 [32:37<9:37:38,  1.57it/s]
  5%|▌         | 3101/57600 [32:38<9:56:14,  1.52it/s]
  5%|▌         | 3102/57600 [32:39<9:50:43,  1.54it/s]
  5%|▌         | 3103/57600 [32:39<9:36:28,  1.58it/s]
  5%|▌         | 3104/57600 [32:40<9:49:19,  1.54it/s]
  5%|▌         | 3105/57600 [32:41<9:40:46,  1.56it/s]
  5%|▌         | 3106/57600 [32:41<9:26:39,  1.60it/s]
  5%|▌         | 3107/57600 [32:42<9:22:48,  1.61it/s]
  5%|▌         | 3108/57600 [32:43<9:19:07,  1.62it/s]
  5%|▌         | 3109/57600 [32:43<9:17:40,  1.63it/s]
  5%|▌         | 3110/57600 [32:44<9:30:19,  1.59it/s]
  5%|▌         | 3111/57600 [32:44<9:32:30,  1.59it/s]
  5%|▌         | 3112/57600 [32:45<9:30:16,  1.59it/s]
  5%|▌         | 3113/57600 [32:46<9:27:14,  1.60it/s]
  5%|▌         | 3114/57600 [32:46<9:23:46,  1.61it/s]
  5%|▌         | 3115/57600 [32:47<9:25:20,  1.61it/s]
  5%|▌         | 3116/57600 [32:48<9:35:41,  1.58it/s]
  5%|▌         | 3117/57600 [32:48<9:33:20,  1.58it/s]
  5%|▌         | 3118/57600 [32:49<9:26:05,  1.60it/s]
  5%|▌         | 3119/57600 [32:49<9:21:28,  1.62it/s]
  5%|▌         | 3120/57600 [32:50<9:22:24,  1.61it/s]
                                                      
{'loss': 1.6379, 'learning_rate': 9.542160278745644e-07, 'epoch': 34.44}

  5%|▌         | 3120/57600 [32:50<9:22:24,  1.61it/s]
  5%|▌         | 3121/57600 [32:51<9:28:33,  1.60it/s]
  5%|▌         | 3122/57600 [32:51<9:13:59,  1.64it/s]
  5%|▌         | 3123/57600 [32:52<9:28:48,  1.60it/s]
  5%|▌         | 3124/57600 [32:53<9:38:18,  1.57it/s]
  5%|▌         | 3125/57600 [32:53<9:22:07,  1.62it/s]
  5%|▌         | 3126/57600 [32:54<9:26:49,  1.60it/s]
  5%|▌         | 3127/57600 [32:54<9:36:17,  1.58it/s]
  5%|▌         | 3128/57600 [32:55<9:42:21,  1.56it/s]
  5%|▌         | 3129/57600 [32:56<9:50:35,  1.54it/s]
  5%|▌         | 3130/57600 [32:56<9:57:05,  1.52it/s]
  5%|▌         | 3131/57600 [32:57<9:47:25,  1.55it/s]
  5%|▌         | 3132/57600 [32:58<9:26:07,  1.60it/s]
  5%|▌         | 3133/57600 [32:58<9:43:23,  1.56it/s]
  5%|▌         | 3134/57600 [32:59<9:30:30,  1.59it/s]
  5%|▌         | 3135/57600 [33:00<9:19:36,  1.62it/s]
  5%|▌         | 3136/57600 [33:00<9:16:31,  1.63it/s]
  5%|▌         | 3137/57600 [33:01<9:07:34,  1.66it/s]
  5%|▌         | 3138/57600 [33:01<9:29:26,  1.59it/s]
  5%|▌         | 3139/57600 [33:02<9:17:39,  1.63it/s]
  5%|▌         | 3140/57600 [33:03<9:09:25,  1.65it/s]
                                                      
{'loss': 1.6252, 'learning_rate': 9.539024390243903e-07, 'epoch': 34.66}

  5%|▌         | 3140/57600 [33:03<9:09:25,  1.65it/s]
  5%|▌         | 3141/57600 [33:03<9:28:23,  1.60it/s]
  5%|▌         | 3142/57600 [33:04<9:21:28,  1.62it/s]
  5%|▌         | 3143/57600 [33:05<9:41:11,  1.56it/s]
  5%|▌         | 3144/57600 [33:05<9:36:16,  1.57it/s]
  5%|▌         | 3145/57600 [33:06<9:29:49,  1.59it/s]
  5%|▌         | 3146/57600 [33:06<9:30:46,  1.59it/s]
  5%|▌         | 3147/57600 [33:07<9:21:01,  1.62it/s]
  5%|▌         | 3148/57600 [33:08<9:11:34,  1.65it/s]
  5%|▌         | 3149/57600 [33:08<9:07:12,  1.66it/s]
  5%|▌         | 3150/57600 [33:09<9:20:48,  1.62it/s]
  5%|▌         | 3151/57600 [33:09<9:30:27,  1.59it/s]
  5%|▌         | 3152/57600 [33:10<9:18:50,  1.62it/s]
  5%|▌         | 3153/57600 [33:11<9:42:43,  1.56it/s]
  5%|▌         | 3154/57600 [33:11<10:05:42,  1.50it/s]
  5%|▌         | 3155/57600 [33:12<9:46:58,  1.55it/s] 
  5%|▌         | 3156/57600 [33:13<9:47:25,  1.54it/s]
  5%|▌         | 3157/57600 [33:13<9:24:09,  1.61it/s]
  5%|▌         | 3158/57600 [33:14<9:32:18,  1.59it/s]
  5%|▌         | 3159/57600 [33:15<9:26:11,  1.60it/s]
  5%|▌         | 3160/57600 [33:15<9:12:08,  1.64it/s]
                                                      
{'loss': 1.628, 'learning_rate': 9.53588850174216e-07, 'epoch': 34.88}

  5%|▌         | 3160/57600 [33:15<9:12:08,  1.64it/s]
  5%|▌         | 3161/57600 [33:16<9:02:46,  1.67it/s]
  5%|▌         | 3162/57600 [33:16<9:04:37,  1.67it/s]
  5%|▌         | 3163/57600 [33:17<9:30:55,  1.59it/s]
  5%|▌         | 3164/57600 [33:18<9:24:59,  1.61it/s]
  5%|▌         | 3165/57600 [33:18<9:27:05,  1.60it/s]
  5%|▌         | 3166/57600 [33:19<9:25:14,  1.61it/s]
  5%|▌         | 3167/57600 [33:19<9:28:54,  1.59it/s]
  6%|▌         | 3168/57600 [33:20<9:45:12,  1.55it/s]
  6%|▌         | 3169/57600 [33:21<9:55:13,  1.52it/s]
  6%|▌         | 3170/57600 [33:21<9:40:28,  1.56it/s]
  6%|▌         | 3171/57600 [33:22<9:28:26,  1.60it/s]
  6%|▌         | 3172/57600 [33:23<9:43:37,  1.55it/s]
  6%|▌         | 3173/57600 [33:23<9:32:53,  1.58it/s]
  6%|▌         | 3174/57600 [33:24<9:20:12,  1.62it/s]
  6%|▌         | 3175/57600 [33:25<9:23:55,  1.61it/s]
  6%|▌         | 3176/57600 [33:25<9:23:23,  1.61it/s]
  6%|▌         | 3177/57600 [33:26<9:25:33,  1.60it/s]
  6%|▌         | 3178/57600 [33:26<9:15:09,  1.63it/s]
  6%|▌         | 3179/57600 [33:27<9:30:03,  1.59it/s]
  6%|▌         | 3180/57600 [33:28<9:15:18,  1.63it/s]
                                                      
{'loss': 1.6547, 'learning_rate': 9.532752613240419e-07, 'epoch': 35.1}

  6%|▌         | 3180/57600 [33:28<9:15:18,  1.63it/s]
  6%|▌         | 3181/57600 [33:28<9:12:29,  1.64it/s]
  6%|▌         | 3182/57600 [33:29<9:01:43,  1.67it/s]
  6%|▌         | 3183/57600 [33:29<9:27:53,  1.60it/s]
  6%|▌         | 3184/57600 [33:30<9:15:50,  1.63it/s]
  6%|▌         | 3185/57600 [33:31<9:12:26,  1.64it/s]
  6%|▌         | 3186/57600 [33:31<9:07:35,  1.66it/s]
  6%|▌         | 3187/57600 [33:32<9:06:26,  1.66it/s]
  6%|▌         | 3188/57600 [33:33<9:17:00,  1.63it/s]
  6%|▌         | 3189/57600 [33:33<9:29:23,  1.59it/s]
  6%|▌         | 3190/57600 [33:34<9:36:40,  1.57it/s]
  6%|▌         | 3191/57600 [33:34<9:20:47,  1.62it/s]
  6%|▌         | 3192/57600 [33:35<9:42:45,  1.56it/s]
  6%|▌         | 3193/57600 [33:36<9:22:48,  1.61it/s]
  6%|▌         | 3194/57600 [33:36<9:30:28,  1.59it/s]
  6%|▌         | 3195/57600 [33:37<9:38:55,  1.57it/s]
  6%|▌         | 3196/57600 [33:38<9:27:03,  1.60it/s]
  6%|▌         | 3197/57600 [33:38<9:13:23,  1.64it/s]
  6%|▌         | 3198/57600 [33:39<9:19:06,  1.62it/s]
  6%|▌         | 3199/57600 [33:39<9:09:05,  1.65it/s]
  6%|▌         | 3200/57600 [33:40<8:57:42,  1.69it/s]
                                                      
{'loss': 1.6308, 'learning_rate': 9.529616724738675e-07, 'epoch': 35.32}

  6%|▌         | 3200/57600 [33:40<8:57:42,  1.69it/s]
  6%|▌         | 3201/57600 [33:41<9:00:00,  1.68it/s]
  6%|▌         | 3202/57600 [33:41<9:17:25,  1.63it/s]
  6%|▌         | 3203/57600 [33:42<9:39:33,  1.56it/s]
  6%|▌         | 3204/57600 [33:43<9:49:04,  1.54it/s]
  6%|▌         | 3205/57600 [33:43<9:50:23,  1.54it/s]
  6%|▌         | 3206/57600 [33:44<9:49:00,  1.54it/s]
  6%|▌         | 3207/57600 [33:44<9:32:55,  1.58it/s]
  6%|▌         | 3208/57600 [33:45<9:31:07,  1.59it/s]
  6%|▌         | 3209/57600 [33:46<9:33:15,  1.58it/s]
  6%|▌         | 3210/57600 [33:46<9:20:19,  1.62it/s]
  6%|▌         | 3211/57600 [33:47<9:16:00,  1.63it/s]
  6%|▌         | 3212/57600 [33:48<9:22:50,  1.61it/s]
  6%|▌         | 3213/57600 [33:48<9:23:46,  1.61it/s]
  6%|▌         | 3214/57600 [33:49<9:17:16,  1.63it/s]
  6%|▌         | 3215/57600 [33:49<9:25:04,  1.60it/s]
  6%|▌         | 3216/57600 [33:50<9:20:22,  1.62it/s]
  6%|▌         | 3217/57600 [33:51<9:22:54,  1.61it/s]
  6%|▌         | 3218/57600 [33:51<9:37:39,  1.57it/s]
  6%|▌         | 3219/57600 [33:52<9:39:13,  1.56it/s]
  6%|▌         | 3220/57600 [33:53<9:44:06,  1.55it/s]
                                                      
{'loss': 1.599, 'learning_rate': 9.526480836236935e-07, 'epoch': 35.54}

  6%|▌         | 3220/57600 [33:53<9:44:06,  1.55it/s]
  6%|▌         | 3221/57600 [33:53<9:45:41,  1.55it/s]
  6%|▌         | 3222/57600 [33:54<10:00:11,  1.51it/s]
  6%|▌         | 3223/57600 [33:55<9:51:50,  1.53it/s] 
  6%|▌         | 3224/57600 [33:55<9:45:17,  1.55it/s]
  6%|▌         | 3225/57600 [33:56<9:55:44,  1.52it/s]
  6%|▌         | 3226/57600 [33:57<9:51:09,  1.53it/s]
  6%|▌         | 3227/57600 [33:57<9:33:12,  1.58it/s]
  6%|▌         | 3228/57600 [33:58<9:33:22,  1.58it/s]
  6%|▌         | 3229/57600 [33:58<9:27:37,  1.60it/s]
  6%|▌         | 3230/57600 [33:59<9:34:56,  1.58it/s]
  6%|▌         | 3231/57600 [34:00<9:46:30,  1.55it/s]
  6%|▌         | 3232/57600 [34:00<9:34:46,  1.58it/s]
  6%|▌         | 3233/57600 [34:01<9:28:35,  1.59it/s]
  6%|▌         | 3234/57600 [34:02<9:30:09,  1.59it/s]
  6%|▌         | 3235/57600 [34:02<9:37:21,  1.57it/s]
  6%|▌         | 3236/57600 [34:03<9:35:58,  1.57it/s]
  6%|▌         | 3237/57600 [34:03<9:38:51,  1.57it/s]
  6%|▌         | 3238/57600 [34:04<9:42:20,  1.56it/s]
  6%|▌         | 3239/57600 [34:05<9:39:07,  1.56it/s]
  6%|▌         | 3240/57600 [34:05<9:22:02,  1.61it/s]
                                                      
{'loss': 1.6198, 'learning_rate': 9.523344947735191e-07, 'epoch': 35.76}

  6%|▌         | 3240/57600 [34:05<9:22:02,  1.61it/s]
  6%|▌         | 3241/57600 [34:06<9:41:40,  1.56it/s]
  6%|▌         | 3242/57600 [34:07<9:46:08,  1.55it/s]
  6%|▌         | 3243/57600 [34:07<9:41:12,  1.56it/s]
  6%|▌         | 3244/57600 [34:08<9:40:43,  1.56it/s]
  6%|▌         | 3245/57600 [34:09<9:43:09,  1.55it/s]
  6%|▌         | 3246/57600 [34:09<9:45:44,  1.55it/s]
  6%|▌         | 3247/57600 [34:10<9:46:31,  1.54it/s]
  6%|▌         | 3248/57600 [34:11<9:44:21,  1.55it/s]
  6%|▌         | 3249/57600 [34:11<9:29:40,  1.59it/s]
  6%|▌         | 3250/57600 [34:12<9:39:07,  1.56it/s]
  6%|▌         | 3251/57600 [34:12<9:41:31,  1.56it/s]
  6%|▌         | 3252/57600 [34:13<9:31:36,  1.58it/s]
  6%|▌         | 3253/57600 [34:14<9:26:35,  1.60it/s]
  6%|▌         | 3254/57600 [34:14<9:37:11,  1.57it/s]
  6%|▌         | 3255/57600 [34:15<9:26:38,  1.60it/s]
  6%|▌         | 3256/57600 [34:16<9:35:14,  1.57it/s]
  6%|▌         | 3257/57600 [34:16<9:28:01,  1.59it/s]
  6%|▌         | 3258/57600 [34:17<9:44:18,  1.55it/s]
  6%|▌         | 3259/57600 [34:18<9:44:22,  1.55it/s]
  6%|▌         | 3260/57600 [34:18<9:25:30,  1.60it/s]
                                                      
{'loss': 1.6248, 'learning_rate': 9.520209059233449e-07, 'epoch': 35.98}

  6%|▌         | 3260/57600 [34:18<9:25:30,  1.60it/s]
  6%|▌         | 3261/57600 [34:19<9:10:26,  1.65it/s]
  6%|▌         | 3262/57600 [34:19<9:24:50,  1.60it/s]
  6%|▌         | 3263/57600 [34:20<9:28:02,  1.59it/s]
  6%|▌         | 3264/57600 [34:21<9:16:58,  1.63it/s]
  6%|▌         | 3265/57600 [34:21<9:34:56,  1.58it/s]
  6%|▌         | 3266/57600 [34:22<9:39:31,  1.56it/s]
  6%|▌         | 3267/57600 [34:23<9:45:44,  1.55it/s]
  6%|▌         | 3268/57600 [34:23<9:41:00,  1.56it/s]
  6%|▌         | 3269/57600 [34:24<9:50:05,  1.53it/s]
  6%|▌         | 3270/57600 [34:24<9:30:05,  1.59it/s]
  6%|▌         | 3271/57600 [34:25<9:30:47,  1.59it/s]
  6%|▌         | 3272/57600 [34:26<9:14:17,  1.63it/s]
  6%|▌         | 3273/57600 [34:26<9:19:32,  1.62it/s]
  6%|▌         | 3274/57600 [34:27<9:30:20,  1.59it/s]
  6%|▌         | 3275/57600 [34:28<9:15:52,  1.63it/s]
  6%|▌         | 3276/57600 [34:28<9:35:40,  1.57it/s]
  6%|▌         | 3277/57600 [34:29<9:38:34,  1.56it/s]
  6%|▌         | 3278/57600 [34:29<9:38:59,  1.56it/s]
  6%|▌         | 3279/57600 [34:30<9:29:34,  1.59it/s]
  6%|▌         | 3280/57600 [34:31<9:30:58,  1.59it/s]
                                                      
{'loss': 1.576, 'learning_rate': 9.517073170731706e-07, 'epoch': 36.2}

  6%|▌         | 3280/57600 [34:31<9:30:58,  1.59it/s]
  6%|▌         | 3281/57600 [34:31<9:37:55,  1.57it/s]
  6%|▌         | 3282/57600 [34:32<9:54:18,  1.52it/s]
  6%|▌         | 3283/57600 [34:33<9:40:27,  1.56it/s]
  6%|▌         | 3284/57600 [34:33<9:38:26,  1.56it/s]
  6%|▌         | 3285/57600 [34:34<9:20:17,  1.62it/s]
  6%|▌         | 3286/57600 [34:35<9:26:47,  1.60it/s]
  6%|▌         | 3287/57600 [34:35<9:35:42,  1.57it/s]
  6%|▌         | 3288/57600 [34:36<9:31:08,  1.58it/s]
  6%|▌         | 3289/57600 [34:36<9:41:38,  1.56it/s]
  6%|▌         | 3290/57600 [34:37<9:22:00,  1.61it/s]
  6%|▌         | 3291/57600 [34:38<9:28:38,  1.59it/s]
  6%|▌         | 3292/57600 [34:38<9:16:10,  1.63it/s]
  6%|▌         | 3293/57600 [34:39<9:10:51,  1.64it/s]
  6%|▌         | 3294/57600 [34:40<9:23:08,  1.61it/s]
  6%|▌         | 3295/57600 [34:40<9:11:06,  1.64it/s]
  6%|▌         | 3296/57600 [34:41<9:18:34,  1.62it/s]
  6%|▌         | 3297/57600 [34:41<8:58:32,  1.68it/s]
  6%|▌         | 3298/57600 [34:42<9:03:43,  1.66it/s]
  6%|▌         | 3299/57600 [34:43<9:05:25,  1.66it/s]
  6%|▌         | 3300/57600 [34:43<9:07:56,  1.65it/s]
                                                      
{'loss': 1.6648, 'learning_rate': 9.513937282229965e-07, 'epoch': 36.42}

  6%|▌         | 3300/57600 [34:43<9:07:56,  1.65it/s]
  6%|▌         | 3301/57600 [34:44<9:21:29,  1.61it/s]
  6%|▌         | 3302/57600 [34:44<9:10:19,  1.64it/s]
  6%|▌         | 3303/57600 [34:45<9:05:13,  1.66it/s]
  6%|▌         | 3304/57600 [34:46<9:21:51,  1.61it/s]
  6%|▌         | 3305/57600 [34:46<9:24:46,  1.60it/s]
  6%|▌         | 3306/57600 [34:47<9:09:14,  1.65it/s]
  6%|▌         | 3307/57600 [34:47<9:07:51,  1.65it/s]
  6%|▌         | 3308/57600 [34:48<9:28:09,  1.59it/s]
  6%|▌         | 3309/57600 [34:49<9:28:03,  1.59it/s]
  6%|▌         | 3310/57600 [34:49<9:22:00,  1.61it/s]
  6%|▌         | 3311/57600 [34:50<9:46:51,  1.54it/s]
  6%|▌         | 3312/57600 [34:51<9:41:03,  1.56it/s]
  6%|▌         | 3313/57600 [34:51<9:21:02,  1.61it/s]
  6%|▌         | 3314/57600 [34:52<9:26:57,  1.60it/s]
  6%|▌         | 3315/57600 [34:53<9:37:22,  1.57it/s]
  6%|▌         | 3316/57600 [34:53<9:59:15,  1.51it/s]
  6%|▌         | 3317/57600 [34:54<10:08:00,  1.49it/s]
  6%|▌         | 3318/57600 [34:55<9:57:43,  1.51it/s] 
  6%|▌         | 3319/57600 [34:55<9:43:51,  1.55it/s]
  6%|▌         | 3320/57600 [34:56<10:01:22,  1.50it/s]
                                                       
{'loss': 1.6035, 'learning_rate': 9.510801393728223e-07, 'epoch': 36.64}

  6%|▌         | 3320/57600 [34:56<10:01:22,  1.50it/s]
  6%|▌         | 3321/57600 [34:57<10:01:08,  1.50it/s]
  6%|▌         | 3322/57600 [34:57<10:04:02,  1.50it/s]
  6%|▌         | 3323/57600 [34:58<9:53:36,  1.52it/s] 
  6%|▌         | 3324/57600 [34:58<9:41:04,  1.56it/s]
  6%|▌         | 3325/57600 [34:59<9:38:35,  1.56it/s]
  6%|▌         | 3326/57600 [35:00<9:51:19,  1.53it/s]
  6%|▌         | 3327/57600 [35:00<9:39:51,  1.56it/s]
  6%|▌         | 3328/57600 [35:01<9:28:58,  1.59it/s]
  6%|▌         | 3329/57600 [35:02<9:31:09,  1.58it/s]
  6%|▌         | 3330/57600 [35:02<9:11:59,  1.64it/s]
  6%|▌         | 3331/57600 [35:03<9:13:27,  1.63it/s]
  6%|▌         | 3332/57600 [35:03<9:15:21,  1.63it/s]
  6%|▌         | 3333/57600 [35:04<9:20:32,  1.61it/s]
  6%|▌         | 3334/57600 [35:05<9:37:36,  1.57it/s]
  6%|▌         | 3335/57600 [35:05<9:53:29,  1.52it/s]
  6%|▌         | 3336/57600 [35:06<10:01:13,  1.50it/s]
  6%|▌         | 3337/57600 [35:07<9:49:09,  1.54it/s] 
  6%|▌         | 3338/57600 [35:07<9:32:00,  1.58it/s]
  6%|▌         | 3339/57600 [35:08<9:40:41,  1.56it/s]
  6%|▌         | 3340/57600 [35:09<9:29:12,  1.59it/s]
                                                      
{'loss': 1.6051, 'learning_rate': 9.50766550522648e-07, 'epoch': 36.87}

  6%|▌         | 3340/57600 [35:09<9:29:12,  1.59it/s]
  6%|▌         | 3341/57600 [35:09<9:31:25,  1.58it/s]
  6%|▌         | 3342/57600 [35:10<9:29:45,  1.59it/s]
  6%|▌         | 3343/57600 [35:11<9:25:34,  1.60it/s]
  6%|▌         | 3344/57600 [35:11<9:26:40,  1.60it/s]
  6%|▌         | 3345/57600 [35:12<9:15:09,  1.63it/s]
  6%|▌         | 3346/57600 [35:12<9:21:30,  1.61it/s]
  6%|▌         | 3347/57600 [35:13<9:21:05,  1.61it/s]
  6%|▌         | 3348/57600 [35:14<9:33:08,  1.58it/s]
  6%|▌         | 3349/57600 [35:14<9:44:13,  1.55it/s]
  6%|▌         | 3350/57600 [35:15<9:26:09,  1.60it/s]
  6%|▌         | 3351/57600 [35:15<9:17:04,  1.62it/s]
  6%|▌         | 3352/57600 [35:16<9:16:26,  1.62it/s]
  6%|▌         | 3353/57600 [35:17<9:43:50,  1.55it/s]
  6%|▌         | 3354/57600 [35:18<9:58:21,  1.51it/s]
  6%|▌         | 3355/57600 [35:18<10:12:12,  1.48it/s]
  6%|▌         | 3356/57600 [35:19<10:07:18,  1.49it/s]
  6%|▌         | 3357/57600 [35:19<9:44:07,  1.55it/s] 
  6%|▌         | 3358/57600 [35:20<9:35:50,  1.57it/s]
  6%|▌         | 3359/57600 [35:21<9:28:49,  1.59it/s]
  6%|▌         | 3360/57600 [35:21<9:33:01,  1.58it/s]
                                                      
{'loss': 1.6052, 'learning_rate': 9.504529616724738e-07, 'epoch': 37.09}

  6%|▌         | 3360/57600 [35:21<9:33:01,  1.58it/s]
  6%|▌         | 3361/57600 [35:22<9:37:22,  1.57it/s]
  6%|▌         | 3362/57600 [35:23<9:29:37,  1.59it/s]
  6%|▌         | 3363/57600 [35:23<9:37:23,  1.57it/s]
  6%|▌         | 3364/57600 [35:24<10:05:25,  1.49it/s]
  6%|▌         | 3365/57600 [35:25<10:06:13,  1.49it/s]
  6%|▌         | 3366/57600 [35:25<10:14:05,  1.47it/s]
  6%|▌         | 3367/57600 [35:26<10:03:20,  1.50it/s]
  6%|▌         | 3368/57600 [35:27<9:52:22,  1.53it/s] 
  6%|▌         | 3369/57600 [35:27<9:39:31,  1.56it/s]
  6%|▌         | 3370/57600 [35:28<9:38:13,  1.56it/s]
  6%|▌         | 3371/57600 [35:29<9:35:45,  1.57it/s]
  6%|▌         | 3372/57600 [35:29<9:34:41,  1.57it/s]
  6%|▌         | 3373/57600 [35:30<9:25:37,  1.60it/s]
  6%|▌         | 3374/57600 [35:30<9:37:14,  1.57it/s]
  6%|▌         | 3375/57600 [35:31<9:22:01,  1.61it/s]
  6%|▌         | 3376/57600 [35:32<9:28:19,  1.59it/s]
  6%|▌         | 3377/57600 [35:32<9:27:12,  1.59it/s]
  6%|▌         | 3378/57600 [35:33<9:22:32,  1.61it/s]
  6%|▌         | 3379/57600 [35:34<9:29:32,  1.59it/s]
  6%|▌         | 3380/57600 [35:34<9:32:25,  1.58it/s]
                                                      
{'loss': 1.6081, 'learning_rate': 9.501393728222996e-07, 'epoch': 37.31}

  6%|▌         | 3380/57600 [35:34<9:32:25,  1.58it/s]
  6%|▌         | 3381/57600 [35:35<9:26:14,  1.60it/s]
  6%|▌         | 3382/57600 [35:35<9:47:06,  1.54it/s]
  6%|▌         | 3383/57600 [35:36<10:02:02,  1.50it/s]
  6%|▌         | 3384/57600 [35:37<9:46:14,  1.54it/s] 
  6%|▌         | 3385/57600 [35:37<9:55:41,  1.52it/s]
  6%|▌         | 3386/57600 [35:38<9:36:23,  1.57it/s]
  6%|▌         | 3387/57600 [35:39<9:34:33,  1.57it/s]
  6%|▌         | 3388/57600 [35:39<9:26:42,  1.59it/s]
  6%|▌         | 3389/57600 [35:40<9:34:08,  1.57it/s]
  6%|▌         | 3390/57600 [35:41<9:20:32,  1.61it/s]
  6%|▌         | 3391/57600 [35:41<9:27:11,  1.59it/s]
  6%|▌         | 3392/57600 [35:42<9:28:47,  1.59it/s]
  6%|▌         | 3393/57600 [35:42<9:18:38,  1.62it/s]
  6%|▌         | 3394/57600 [35:43<9:27:56,  1.59it/s]
  6%|▌         | 3395/57600 [35:44<9:21:35,  1.61it/s]
  6%|▌         | 3396/57600 [35:44<9:30:23,  1.58it/s]
  6%|▌         | 3397/57600 [35:45<9:38:16,  1.56it/s]
  6%|▌         | 3398/57600 [35:46<9:18:38,  1.62it/s]
  6%|▌         | 3399/57600 [35:46<9:31:34,  1.58it/s]
  6%|▌         | 3400/57600 [35:47<9:33:41,  1.57it/s]
                                                      
{'loss': 1.6066, 'learning_rate': 9.498257839721255e-07, 'epoch': 37.53}

  6%|▌         | 3400/57600 [35:47<9:33:41,  1.57it/s]
  6%|▌         | 3401/57600 [35:48<9:59:34,  1.51it/s]
  6%|▌         | 3402/57600 [35:48<9:52:44,  1.52it/s]
  6%|▌         | 3403/57600 [35:49<9:42:40,  1.55it/s]
  6%|▌         | 3404/57600 [35:49<9:34:45,  1.57it/s]
  6%|▌         | 3405/57600 [35:50<9:52:51,  1.52it/s]
  6%|▌         | 3406/57600 [35:51<9:53:21,  1.52it/s]
  6%|▌         | 3407/57600 [35:52<9:59:30,  1.51it/s]
  6%|▌         | 3408/57600 [35:52<9:57:22,  1.51it/s]
  6%|▌         | 3409/57600 [35:53<9:34:53,  1.57it/s]
  6%|▌         | 3410/57600 [35:53<9:29:58,  1.58it/s]
  6%|▌         | 3411/57600 [35:54<9:28:18,  1.59it/s]
  6%|▌         | 3412/57600 [35:55<9:44:05,  1.55it/s]
  6%|▌         | 3413/57600 [35:55<9:50:25,  1.53it/s]
  6%|▌         | 3414/57600 [35:56<9:40:03,  1.56it/s]
  6%|▌         | 3415/57600 [35:57<9:32:47,  1.58it/s]
  6%|▌         | 3416/57600 [35:57<9:32:26,  1.58it/s]
  6%|▌         | 3417/57600 [35:58<9:55:27,  1.52it/s]
  6%|▌         | 3418/57600 [35:59<9:44:16,  1.55it/s]
  6%|▌         | 3419/57600 [35:59<9:24:34,  1.60it/s]
  6%|▌         | 3420/57600 [36:00<9:43:15,  1.55it/s]
                                                      
{'loss': 1.5763, 'learning_rate': 9.495121951219511e-07, 'epoch': 37.75}

  6%|▌         | 3420/57600 [36:00<9:43:15,  1.55it/s]
  6%|▌         | 3421/57600 [36:00<9:28:26,  1.59it/s]
  6%|▌         | 3422/57600 [36:01<9:30:54,  1.58it/s]
  6%|▌         | 3423/57600 [36:02<9:33:49,  1.57it/s]
  6%|▌         | 3424/57600 [36:02<9:37:35,  1.56it/s]
  6%|▌         | 3425/57600 [36:03<9:43:23,  1.55it/s]
  6%|▌         | 3426/57600 [36:04<9:33:20,  1.57it/s]
  6%|▌         | 3427/57600 [36:04<9:18:13,  1.62it/s]
  6%|▌         | 3428/57600 [36:05<9:20:58,  1.61it/s]
  6%|▌         | 3429/57600 [36:05<9:12:35,  1.63it/s]
  6%|▌         | 3430/57600 [36:06<9:21:26,  1.61it/s]
  6%|▌         | 3431/57600 [36:07<9:36:00,  1.57it/s]
  6%|▌         | 3432/57600 [36:07<9:41:19,  1.55it/s]
  6%|▌         | 3433/57600 [36:08<9:42:41,  1.55it/s]
  6%|▌         | 3434/57600 [36:09<9:26:12,  1.59it/s]
  6%|▌         | 3435/57600 [36:09<9:30:04,  1.58it/s]
  6%|▌         | 3436/57600 [36:10<9:14:47,  1.63it/s]
  6%|▌         | 3437/57600 [36:10<9:18:27,  1.62it/s]
  6%|▌         | 3438/57600 [36:11<9:09:17,  1.64it/s]
  6%|▌         | 3439/57600 [36:12<9:20:45,  1.61it/s]
  6%|▌         | 3440/57600 [36:12<9:20:31,  1.61it/s]
                                                      
{'loss': 1.6039, 'learning_rate': 9.49198606271777e-07, 'epoch': 37.97}

  6%|▌         | 3440/57600 [36:12<9:20:31,  1.61it/s]
  6%|▌         | 3441/57600 [36:13<9:18:49,  1.62it/s]
  6%|▌         | 3442/57600 [36:14<9:23:08,  1.60it/s]
  6%|▌         | 3443/57600 [36:14<9:43:37,  1.55it/s]
  6%|▌         | 3444/57600 [36:15<9:30:38,  1.58it/s]
  6%|▌         | 3445/57600 [36:16<9:31:40,  1.58it/s]
  6%|▌         | 3446/57600 [36:16<9:33:01,  1.58it/s]
  6%|▌         | 3447/57600 [36:17<9:43:31,  1.55it/s]
  6%|▌         | 3448/57600 [36:17<9:36:57,  1.56it/s]
  6%|▌         | 3449/57600 [36:18<9:25:06,  1.60it/s]
  6%|▌         | 3450/57600 [36:19<9:33:24,  1.57it/s]
  6%|▌         | 3451/57600 [36:19<9:33:11,  1.57it/s]
  6%|▌         | 3452/57600 [36:20<9:30:36,  1.58it/s]
  6%|▌         | 3453/57600 [36:21<9:28:07,  1.59it/s]
  6%|▌         | 3454/57600 [36:21<9:12:39,  1.63it/s]
  6%|▌         | 3455/57600 [36:22<9:09:26,  1.64it/s]
  6%|▌         | 3456/57600 [36:22<9:04:03,  1.66it/s]
  6%|▌         | 3457/57600 [36:23<9:15:34,  1.62it/s]
  6%|▌         | 3458/57600 [36:24<9:32:31,  1.58it/s]
  6%|▌         | 3459/57600 [36:24<9:31:30,  1.58it/s]
  6%|▌         | 3460/57600 [36:25<9:26:25,  1.59it/s]
                                                      
{'loss': 1.6203, 'learning_rate': 9.488850174216028e-07, 'epoch': 38.19}

  6%|▌         | 3460/57600 [36:25<9:26:25,  1.59it/s]
  6%|▌         | 3461/57600 [36:26<9:23:26,  1.60it/s]
  6%|▌         | 3462/57600 [36:26<9:44:31,  1.54it/s]
  6%|▌         | 3463/57600 [36:27<9:40:13,  1.56it/s]
  6%|▌         | 3464/57600 [36:27<9:28:39,  1.59it/s]
  6%|▌         | 3465/57600 [36:28<9:59:17,  1.51it/s]
  6%|▌         | 3466/57600 [36:29<9:44:52,  1.54it/s]
  6%|▌         | 3467/57600 [36:29<9:30:00,  1.58it/s]
  6%|▌         | 3468/57600 [36:30<9:27:50,  1.59it/s]
  6%|▌         | 3469/57600 [36:31<9:16:30,  1.62it/s]
  6%|▌         | 3470/57600 [36:31<9:37:39,  1.56it/s]
  6%|▌         | 3471/57600 [36:32<9:55:17,  1.52it/s]
  6%|▌         | 3472/57600 [36:33<9:58:17,  1.51it/s]
  6%|▌         | 3473/57600 [36:33<9:57:29,  1.51it/s]
  6%|▌         | 3474/57600 [36:34<9:53:23,  1.52it/s]
  6%|▌         | 3475/57600 [36:35<9:40:17,  1.55it/s]
  6%|▌         | 3476/57600 [36:35<9:57:44,  1.51it/s]
  6%|▌         | 3477/57600 [36:36<9:42:54,  1.55it/s]
  6%|▌         | 3478/57600 [36:37<9:41:54,  1.55it/s]
  6%|▌         | 3479/57600 [36:37<9:24:49,  1.60it/s]
  6%|▌         | 3480/57600 [36:38<9:15:08,  1.62it/s]
                                                      
{'loss': 1.619, 'learning_rate': 9.485714285714285e-07, 'epoch': 38.41}

  6%|▌         | 3480/57600 [36:38<9:15:08,  1.62it/s]
  6%|▌         | 3481/57600 [36:38<9:15:30,  1.62it/s]
  6%|▌         | 3482/57600 [36:39<9:11:56,  1.63it/s]
  6%|▌         | 3483/57600 [36:40<9:10:15,  1.64it/s]
  6%|▌         | 3484/57600 [36:40<9:16:40,  1.62it/s]
  6%|▌         | 3485/57600 [36:41<9:08:26,  1.64it/s]
  6%|▌         | 3486/57600 [36:41<9:06:49,  1.65it/s]
  6%|▌         | 3487/57600 [36:42<9:08:56,  1.64it/s]
  6%|▌         | 3488/57600 [36:43<9:12:06,  1.63it/s]
  6%|▌         | 3489/57600 [36:43<9:09:11,  1.64it/s]
  6%|▌         | 3490/57600 [36:44<9:18:09,  1.62it/s]
  6%|▌         | 3491/57600 [36:45<9:32:49,  1.57it/s]
  6%|▌         | 3492/57600 [36:45<9:18:12,  1.62it/s]
  6%|▌         | 3493/57600 [36:46<9:27:15,  1.59it/s]
  6%|▌         | 3494/57600 [36:46<9:45:08,  1.54it/s]
  6%|▌         | 3495/57600 [36:47<9:51:39,  1.52it/s]
  6%|▌         | 3496/57600 [36:48<9:42:26,  1.55it/s]
  6%|▌         | 3497/57600 [36:48<9:37:01,  1.56it/s]
  6%|▌         | 3498/57600 [36:49<9:42:23,  1.55it/s]
  6%|▌         | 3499/57600 [36:50<10:01:32,  1.50it/s]
  6%|▌         | 3500/57600 [36:50<9:47:34,  1.53it/s] 
                                                      
{'loss': 1.6055, 'learning_rate': 9.482578397212543e-07, 'epoch': 38.63}

  6%|▌         | 3500/57600 [36:50<9:47:34,  1.53it/s]
  6%|▌         | 3501/57600 [36:51<9:38:50,  1.56it/s]
  6%|▌         | 3502/57600 [36:52<9:32:19,  1.58it/s]
  6%|▌         | 3503/57600 [36:52<9:33:36,  1.57it/s]
  6%|▌         | 3504/57600 [36:53<9:48:18,  1.53it/s]
  6%|▌         | 3505/57600 [36:54<9:44:42,  1.54it/s]
  6%|▌         | 3506/57600 [36:54<9:59:03,  1.50it/s]
  6%|▌         | 3507/57600 [36:55<9:38:35,  1.56it/s]
  6%|▌         | 3508/57600 [36:56<9:45:11,  1.54it/s]
  6%|▌         | 3509/57600 [36:56<9:37:27,  1.56it/s]
  6%|▌         | 3510/57600 [36:57<10:00:38,  1.50it/s]
  6%|▌         | 3511/57600 [36:58<10:14:03,  1.47it/s]
  6%|▌         | 3512/57600 [36:58<10:21:35,  1.45it/s]
  6%|▌         | 3513/57600 [36:59<10:30:06,  1.43it/s]
  6%|▌         | 3514/57600 [37:00<10:01:37,  1.50it/s]
  6%|▌         | 3515/57600 [37:00<9:55:39,  1.51it/s] 
  6%|▌         | 3516/57600 [37:01<9:44:30,  1.54it/s]
  6%|▌         | 3517/57600 [37:02<9:43:35,  1.54it/s]
  6%|▌         | 3518/57600 [37:02<9:33:45,  1.57it/s]
  6%|▌         | 3519/57600 [37:03<9:28:23,  1.59it/s]
  6%|▌         | 3520/57600 [37:03<9:32:10,  1.58it/s]
                                                      
{'loss': 1.6037, 'learning_rate': 9.479442508710801e-07, 'epoch': 38.85}

  6%|▌         | 3520/57600 [37:03<9:32:10,  1.58it/s]
  6%|▌         | 3521/57600 [37:04<9:15:57,  1.62it/s]
  6%|▌         | 3522/57600 [37:05<9:14:06,  1.63it/s]
  6%|▌         | 3523/57600 [37:05<9:07:52,  1.65it/s]
  6%|▌         | 3524/57600 [37:06<9:14:40,  1.62it/s]
  6%|▌         | 3525/57600 [37:06<9:06:55,  1.65it/s]
  6%|▌         | 3526/57600 [37:07<9:26:53,  1.59it/s]
  6%|▌         | 3527/57600 [37:08<9:19:25,  1.61it/s]
  6%|▌         | 3528/57600 [37:08<9:36:47,  1.56it/s]
  6%|▌         | 3529/57600 [37:09<9:34:22,  1.57it/s]
  6%|▌         | 3530/57600 [37:10<9:24:25,  1.60it/s]
  6%|▌         | 3531/57600 [37:10<9:34:20,  1.57it/s]
  6%|▌         | 3532/57600 [37:11<9:19:26,  1.61it/s]
  6%|▌         | 3533/57600 [37:11<9:24:53,  1.60it/s]
  6%|▌         | 3534/57600 [37:12<9:39:17,  1.56it/s]
  6%|▌         | 3535/57600 [37:13<9:31:12,  1.58it/s]
  6%|▌         | 3536/57600 [37:13<9:25:42,  1.59it/s]
  6%|▌         | 3537/57600 [37:14<9:28:10,  1.59it/s]
  6%|▌         | 3538/57600 [37:15<9:34:58,  1.57it/s]
  6%|▌         | 3539/57600 [37:15<9:34:43,  1.57it/s]
  6%|▌         | 3540/57600 [37:16<9:32:34,  1.57it/s]
                                                      
{'loss': 1.6259, 'learning_rate': 9.476306620209059e-07, 'epoch': 39.07}

  6%|▌         | 3540/57600 [37:16<9:32:34,  1.57it/s]
  6%|▌         | 3541/57600 [37:17<9:22:07,  1.60it/s]
  6%|▌         | 3542/57600 [37:17<9:35:20,  1.57it/s]
  6%|▌         | 3543/57600 [37:18<9:46:22,  1.54it/s]
  6%|▌         | 3544/57600 [37:19<9:33:33,  1.57it/s]
  6%|▌         | 3545/57600 [37:19<9:45:09,  1.54it/s]
  6%|▌         | 3546/57600 [37:20<9:47:43,  1.53it/s]
  6%|▌         | 3547/57600 [37:21<9:47:35,  1.53it/s]
  6%|▌         | 3548/57600 [37:21<9:49:02,  1.53it/s]
  6%|▌         | 3549/57600 [37:22<9:35:53,  1.56it/s]
  6%|▌         | 3550/57600 [37:22<9:31:30,  1.58it/s]
  6%|▌         | 3551/57600 [37:23<9:43:34,  1.54it/s]
  6%|▌         | 3552/57600 [37:24<9:40:43,  1.55it/s]
  6%|▌         | 3553/57600 [37:24<9:33:35,  1.57it/s]
  6%|▌         | 3554/57600 [37:25<9:19:14,  1.61it/s]
  6%|▌         | 3555/57600 [37:25<9:07:55,  1.64it/s]
  6%|▌         | 3556/57600 [37:26<9:16:15,  1.62it/s]
  6%|▌         | 3557/57600 [37:27<9:22:12,  1.60it/s]
  6%|▌         | 3558/57600 [37:27<9:18:16,  1.61it/s]
  6%|▌         | 3559/57600 [37:28<9:20:52,  1.61it/s]
  6%|▌         | 3560/57600 [37:29<9:24:20,  1.60it/s]
                                                      
{'loss': 1.5917, 'learning_rate': 9.473170731707316e-07, 'epoch': 39.29}

  6%|▌         | 3560/57600 [37:29<9:24:20,  1.60it/s]
  6%|▌         | 3561/57600 [37:29<9:19:31,  1.61it/s]
  6%|▌         | 3562/57600 [37:30<9:24:32,  1.60it/s]
  6%|▌         | 3563/57600 [37:31<9:26:57,  1.59it/s]
  6%|▌         | 3564/57600 [37:31<9:17:40,  1.61it/s]
  6%|▌         | 3565/57600 [37:32<9:22:11,  1.60it/s]
  6%|▌         | 3566/57600 [37:32<9:19:48,  1.61it/s]
  6%|▌         | 3567/57600 [37:33<9:28:44,  1.58it/s]
  6%|▌         | 3568/57600 [37:34<9:20:59,  1.61it/s]
  6%|▌         | 3569/57600 [37:34<9:16:04,  1.62it/s]
  6%|▌         | 3570/57600 [37:35<9:37:01,  1.56it/s]
  6%|▌         | 3571/57600 [37:36<9:32:36,  1.57it/s]
  6%|▌         | 3572/57600 [37:36<9:34:16,  1.57it/s]
  6%|▌         | 3573/57600 [37:37<9:35:28,  1.56it/s]
  6%|▌         | 3574/57600 [37:38<9:47:41,  1.53it/s]
  6%|▌         | 3575/57600 [37:38<9:48:34,  1.53it/s]
  6%|▌         | 3576/57600 [37:39<9:39:22,  1.55it/s]
  6%|▌         | 3577/57600 [37:39<9:52:31,  1.52it/s]
  6%|▌         | 3578/57600 [37:40<9:37:12,  1.56it/s]
  6%|▌         | 3579/57600 [37:41<9:20:40,  1.61it/s]
  6%|▌         | 3580/57600 [37:41<9:29:15,  1.58it/s]
                                                      
{'loss': 1.6039, 'learning_rate': 9.470034843205574e-07, 'epoch': 39.51}

  6%|▌         | 3580/57600 [37:41<9:29:15,  1.58it/s]
  6%|▌         | 3581/57600 [37:42<9:37:12,  1.56it/s]
  6%|▌         | 3582/57600 [37:43<9:33:42,  1.57it/s]
  6%|▌         | 3583/57600 [37:43<9:23:16,  1.60it/s]
  6%|▌         | 3584/57600 [37:44<9:26:19,  1.59it/s]
  6%|▌         | 3585/57600 [37:44<9:18:08,  1.61it/s]
  6%|▌         | 3586/57600 [37:45<9:11:53,  1.63it/s]
  6%|▌         | 3587/57600 [37:46<9:16:29,  1.62it/s]
  6%|▌         | 3588/57600 [37:46<9:46:40,  1.53it/s]
  6%|▌         | 3589/57600 [37:47<9:33:15,  1.57it/s]
  6%|▌         | 3590/57600 [37:48<9:34:06,  1.57it/s]
  6%|▌         | 3591/57600 [37:48<9:46:55,  1.53it/s]
  6%|▌         | 3592/57600 [37:49<10:00:42,  1.50it/s]
  6%|▌         | 3593/57600 [37:50<9:42:58,  1.54it/s] 
  6%|▌         | 3594/57600 [37:50<9:44:44,  1.54it/s]
  6%|▌         | 3595/57600 [37:51<9:36:23,  1.56it/s]
  6%|▌         | 3596/57600 [37:52<9:29:09,  1.58it/s]
  6%|▌         | 3597/57600 [37:52<9:41:07,  1.55it/s]
  6%|▌         | 3598/57600 [37:53<9:30:30,  1.58it/s]
  6%|▌         | 3599/57600 [37:54<9:53:17,  1.52it/s]
  6%|▋         | 3600/57600 [37:54<9:54:29,  1.51it/s]
                                                      
{'loss': 1.5364, 'learning_rate': 9.466898954703833e-07, 'epoch': 39.74}

  6%|▋         | 3600/57600 [37:54<9:54:29,  1.51it/s]Generation Kwargs:
{'max_length': 384, 'max_gen_length': 380, 'num_beams': 5}


  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  9.02it/s]

 50%|█████     | 3/6 [00:00<00:00,  5.83it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.38it/s]

 83%|████████▎ | 5/6 [00:01<00:00,  3.48it/s]

100%|██████████| 6/6 [00:01<00:00,  2.62it/s]{'score': 41.135867840420225, 'counts': [147, 94, 64, 45], 'totals': [241, 211, 181, 151], 'precisions': [60.995850622406635, 44.54976303317535, 35.35911602209945, 29.801324503311257], 'bp': 1.0, 'sys_len': 241, 'ref_len': 207}

                                                      

                                             
{'eval_loss': 2.0473527908325195, 'eval_bleu': 41.1359, 'eval_gen_len': 9.5667, 'eval_runtime': 3.9497, 'eval_samples_per_second': 7.596, 'eval_steps_per_second': 1.519, 'epoch': 39.74}

  6%|▋         | 3600/57600 [37:58<9:54:29,  1.51it/s]

100%|██████████| 6/6 [00:03<00:00,  2.62it/s]

                                             [WARNING|configuration_utils.py:448] 2024-10-02 07:32:11,487 >> Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co./docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
Non-default generation parameters: {'max_length': 200, 'early_stopping': True, 'num_beams': 5, 'forced_eos_token_id': 2}

  6%|▋         | 3601/57600 [38:10<77:18:32,  5.15s/it]
  6%|▋         | 3602/57600 [38:10<56:58:09,  3.80s/it]
  6%|▋         | 3603/57600 [38:11<42:32:48,  2.84s/it]
  6%|▋         | 3604/57600 [38:12<33:09:29,  2.21s/it]
  6%|▋         | 3605/57600 [38:13<26:21:20,  1.76s/it]
  6%|▋         | 3606/57600 [38:13<21:24:38,  1.43s/it]
  6%|▋         | 3607/57600 [38:14<18:00:56,  1.20s/it]
  6%|▋         | 3608/57600 [38:15<15:36:26,  1.04s/it]
  6%|▋         | 3609/57600 [38:15<14:03:05,  1.07it/s]
  6%|▋         | 3610/57600 [38:16<12:49:33,  1.17it/s]
  6%|▋         | 3611/57600 [38:17<11:52:32,  1.26it/s]
  6%|▋         | 3612/57600 [38:17<11:01:44,  1.36it/s]
  6%|▋         | 3613/57600 [38:18<10:45:01,  1.39it/s]
  6%|▋         | 3614/57600 [38:18<10:24:02,  1.44it/s]
  6%|▋         | 3615/57600 [38:19<10:36:15,  1.41it/s]
  6%|▋         | 3616/57600 [38:20<10:26:30,  1.44it/s]
  6%|▋         | 3617/57600 [38:20<10:11:00,  1.47it/s]
  6%|▋         | 3618/57600 [38:21<9:57:48,  1.51it/s] 
  6%|▋         | 3619/57600 [38:22<9:35:15,  1.56it/s]
  6%|▋         | 3620/57600 [38:22<9:30:56,  1.58it/s]
                                                      
{'loss': 1.6224, 'learning_rate': 9.46376306620209e-07, 'epoch': 39.96}

  6%|▋         | 3620/57600 [38:22<9:30:56,  1.58it/s]
  6%|▋         | 3621/57600 [38:23<9:27:30,  1.59it/s]
  6%|▋         | 3622/57600 [38:24<9:40:11,  1.55it/s]
  6%|▋         | 3623/57600 [38:24<9:45:42,  1.54it/s]
  6%|▋         | 3624/57600 [38:25<9:47:09,  1.53it/s]/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

  6%|▋         | 3625/57600 [38:26<10:44:05,  1.40it/s]
  6%|▋         | 3626/57600 [38:27<10:48:36,  1.39it/s]
  6%|▋         | 3627/57600 [38:27<10:24:37,  1.44it/s]
  6%|▋         | 3628/57600 [38:28<10:15:02,  1.46it/s]
  6%|▋         | 3629/57600 [38:28<9:58:55,  1.50it/s] 
  6%|▋         | 3630/57600 [38:29<10:07:58,  1.48it/s]
  6%|▋         | 3631/57600 [38:30<10:12:33,  1.47it/s]
  6%|▋         | 3632/57600 [38:31<10:10:27,  1.47it/s]
  6%|▋         | 3633/57600 [38:31<10:17:02,  1.46it/s]
  6%|▋         | 3634/57600 [38:32<10:05:00,  1.49it/s]
  6%|▋         | 3635/57600 [38:33<10:30:39,  1.43it/s]
  6%|▋         | 3636/57600 [38:33<10:22:58,  1.44it/s]
  6%|▋         | 3637/57600 [38:34<10:25:13,  1.44it/s]
  6%|▋         | 3638/57600 [38:35<10:09:49,  1.47it/s]
  6%|▋         | 3639/57600 [38:35<10:01:33,  1.50it/s]
  6%|▋         | 3640/57600 [38:36<10:04:11,  1.49it/s]
                                                       
{'loss': 1.5808, 'learning_rate': 9.460627177700348e-07, 'epoch': 40.18}

  6%|▋         | 3640/57600 [38:36<10:04:11,  1.49it/s]
  6%|▋         | 3641/57600 [38:37<10:16:48,  1.46it/s]
  6%|▋         | 3642/57600 [38:37<10:19:03,  1.45it/s]
  6%|▋         | 3643/57600 [38:38<10:01:49,  1.49it/s]
  6%|▋         | 3644/57600 [38:39<10:07:37,  1.48it/s]
  6%|▋         | 3645/57600 [38:39<10:08:04,  1.48it/s]
  6%|▋         | 3646/57600 [38:40<10:00:50,  1.50it/s]
  6%|▋         | 3647/57600 [38:41<10:01:40,  1.49it/s]
  6%|▋         | 3648/57600 [38:41<9:59:15,  1.50it/s] 
  6%|▋         | 3649/57600 [38:42<9:49:19,  1.53it/s]
  6%|▋         | 3650/57600 [38:43<9:42:36,  1.54it/s]
  6%|▋         | 3651/57600 [38:43<9:37:36,  1.56it/s]
  6%|▋         | 3652/57600 [38:44<9:33:28,  1.57it/s]
  6%|▋         | 3653/57600 [38:44<9:14:42,  1.62it/s]
  6%|▋         | 3654/57600 [38:45<9:21:59,  1.60it/s]
  6%|▋         | 3655/57600 [38:46<9:26:05,  1.59it/s]
  6%|▋         | 3656/57600 [38:46<9:36:17,  1.56it/s]
  6%|▋         | 3657/57600 [38:47<9:43:08,  1.54it/s]
  6%|▋         | 3658/57600 [38:48<9:43:14,  1.54it/s]
  6%|▋         | 3659/57600 [38:48<9:45:57,  1.53it/s]
  6%|▋         | 3660/57600 [38:49<9:43:23,  1.54it/s]
                                                      
{'loss': 1.6187, 'learning_rate': 9.457491289198605e-07, 'epoch': 40.4}

  6%|▋         | 3660/57600 [38:49<9:43:23,  1.54it/s]
  6%|▋         | 3661/57600 [38:50<9:34:42,  1.56it/s]
  6%|▋         | 3662/57600 [38:50<9:45:25,  1.54it/s]
  6%|▋         | 3663/57600 [38:51<10:01:29,  1.49it/s]
  6%|▋         | 3664/57600 [38:52<10:10:18,  1.47it/s]
  6%|▋         | 3665/57600 [38:52<9:54:31,  1.51it/s] 
  6%|▋         | 3666/57600 [38:53<9:45:01,  1.54it/s]
  6%|▋         | 3667/57600 [38:54<9:29:23,  1.58it/s]
  6%|▋         | 3668/57600 [38:54<9:28:24,  1.58it/s]
  6%|▋         | 3669/57600 [38:55<9:09:31,  1.64it/s]
  6%|▋         | 3670/57600 [38:55<9:34:01,  1.57it/s]
  6%|▋         | 3671/57600 [38:56<9:21:37,  1.60it/s]
  6%|▋         | 3672/57600 [38:57<9:55:03,  1.51it/s]
  6%|▋         | 3673/57600 [38:58<10:16:21,  1.46it/s]
  6%|▋         | 3674/57600 [38:58<10:13:03,  1.47it/s]
  6%|▋         | 3675/57600 [38:59<10:06:49,  1.48it/s]
  6%|▋         | 3676/57600 [39:00<10:07:25,  1.48it/s]
  6%|▋         | 3677/57600 [39:00<9:48:35,  1.53it/s]