The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling `transformers.utils.move_cache()`.

0it [00:00, ?it/s]
0it [00:00, ?it/s]
/opt/conda/lib/python3.10/site-packages/transformers/deepspeed.py:23: FutureWarning: transformers.deepspeed module is deprecated and will be removed in a future version. Please import deepspeed modules directly from transformers.integrations
  warnings.warn(
2024-07-08 02:33:31.611669: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2024-07-08 02:33:31.611802: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2024-07-08 02:33:31.733720: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
/opt/conda/lib/python3.10/site-packages/datasets/load.py:929: FutureWarning: The repository for data contains custom code which must be executed to correctly load the dataset. You can inspect the repository content at /kaggle/working/amr-tst-indo/AMRBART-id/fine-tune/data_interface/data.py
You can avoid this message in future by passing the argument `trust_remote_code=True`.
Passing `trust_remote_code=True` will be mandatory to load this dataset from the next major release of `datasets`.
  warnings.warn(

Generating train split: 0 examples [00:00, ? examples/s]
Generating train split: 910 examples [00:00, 6388.63 examples/s]
Generating train split: 2179 examples [00:00, 9541.79 examples/s]
Generating train split: 4000 examples [00:00, 12920.39 examples/s]
Generating train split: 5731 examples [00:00, 14536.55 examples/s]
Generating train split: 7433 examples [00:00, 15387.46 examples/s]
Generating train split: 9198 examples [00:00, 16130.27 examples/s]
Generating train split: 11012 examples [00:00, 16770.68 examples/s]
Generating train split: 12988 examples [00:00, 17482.82 examples/s]
Generating train split: 14804 examples [00:00, 17688.95 examples/s]
Generating train split: 16622 examples [00:01, 17835.09 examples/s]
Generating train split: 18456 examples [00:01, 17984.89 examples/s]
Generating train split: 21128 examples [00:01, 17913.62 examples/s]
Generating train split: 23000 examples [00:01, 17988.98 examples/s]
Generating train split: 24816 examples [00:01, 18035.20 examples/s]
Generating train split: 27249 examples [00:01, 17350.85 examples/s]
Generating train split: 29820 examples [00:01, 17274.44 examples/s]
Generating train split: 32359 examples [00:01, 17154.67 examples/s]
Generating train split: 34145 examples [00:02, 17322.67 examples/s]
Generating train split: 36000 examples [00:02, 17464.84 examples/s]
Generating train split: 37896 examples [00:02, 17860.10 examples/s]
Generating train split: 40555 examples [00:02, 17809.96 examples/s]
Generating train split: 43160 examples [00:02, 17657.60 examples/s]
Generating train split: 45000 examples [00:02, 17688.66 examples/s]
Generating train split: 46856 examples [00:02, 17912.31 examples/s]
Generating train split: 49558 examples [00:02, 17944.34 examples/s]
Generating train split: 52189 examples [00:03, 17805.48 examples/s]
Generating train split: 54000 examples [00:03, 17758.31 examples/s]
Generating train split: 55838 examples [00:03, 17914.36 examples/s]
Generating train split: 58295 examples [00:03, 17368.33 examples/s]
Generating train split: 61000 examples [00:03, 17419.11 examples/s]
Generating train split: 62890 examples [00:03, 17774.57 examples/s]
Generating train split: 65553 examples [00:03, 17762.46 examples/s]
Generating train split: 67347 examples [00:03, 17804.38 examples/s]
Generating train split: 70014 examples [00:04, 17791.06 examples/s]
Generating train split: 71882 examples [00:04, 18008.16 examples/s]
Generating train split: 74530 examples [00:04, 17882.74 examples/s]
Generating train split: 77188 examples [00:04, 17825.89 examples/s]
Generating train split: 79000 examples [00:04, 17817.18 examples/s]
Generating train split: 80852 examples [00:04, 17993.99 examples/s]
Generating train split: 83460 examples [00:04, 17775.38 examples/s]
Generating train split: 86142 examples [00:04, 17807.61 examples/s]
Generating train split: 88000 examples [00:05, 17787.91 examples/s]
Generating train split: 89859 examples [00:05, 17989.80 examples/s]
Generating train split: 92436 examples [00:05, 17699.63 examples/s]
Generating train split: 92867 examples [00:05, 17307.23 examples/s]

Running tokenizer on train dataset:   0%|          | 0/92867 [00:00<?, ? examples/s]/opt/conda/lib/python3.10/site-packages/transformers/tokenization_utils_base.py:3946: UserWarning: `as_target_tokenizer` is deprecated and will be removed in v5 of Transformers. You can tokenize your labels by using the argument `text_target` of the regular `__call__` method (either in the same call as your input texts if you use the same keyword arguments, or in a separate call.
  warnings.warn(

Running tokenizer on train dataset:   1%|          | 1000/92867 [00:01<02:31, 605.02 examples/s]
Running tokenizer on train dataset:   2%|▏         | 2000/92867 [00:02<01:56, 778.48 examples/s]
Running tokenizer on train dataset:   3%|▎         | 3000/92867 [00:04<02:08, 697.68 examples/s]
Running tokenizer on train dataset:   4%|▍         | 4000/92867 [00:06<02:25, 611.94 examples/s]
Running tokenizer on train dataset:   5%|▌         | 5000/92867 [00:08<02:28, 592.38 examples/s]
Running tokenizer on train dataset:   6%|▋         | 6000/92867 [00:09<02:29, 579.18 examples/s]
Running tokenizer on train dataset:   8%|▊         | 7000/92867 [00:11<02:32, 564.19 examples/s]
Running tokenizer on train dataset:   9%|▊         | 8000/92867 [00:13<02:32, 555.61 examples/s]
Running tokenizer on train dataset:  10%|▉         | 9000/92867 [00:15<02:26, 572.68 examples/s]
Running tokenizer on train dataset:  11%|█         | 10000/92867 [00:16<02:09, 640.33 examples/s]
Running tokenizer on train dataset:  12%|█▏        | 11000/92867 [00:17<01:58, 691.77 examples/s]
Running tokenizer on train dataset:  13%|█▎        | 12000/92867 [00:18<01:53, 710.09 examples/s]
Running tokenizer on train dataset:  14%|█▍        | 13000/92867 [00:20<01:50, 722.25 examples/s]
Running tokenizer on train dataset:  15%|█▌        | 14000/92867 [00:21<01:42, 768.51 examples/s]
Running tokenizer on train dataset:  16%|█▌        | 15000/92867 [00:22<01:38, 794.18 examples/s]
Running tokenizer on train dataset:  17%|█▋        | 16000/92867 [00:23<01:33, 819.18 examples/s]
Running tokenizer on train dataset:  18%|█▊        | 17000/92867 [00:24<01:31, 831.59 examples/s]
Running tokenizer on train dataset:  19%|█▉        | 18000/92867 [00:25<01:29, 834.37 examples/s]
Running tokenizer on train dataset:  20%|██        | 19000/92867 [00:27<01:32, 800.79 examples/s]
Running tokenizer on train dataset:  22%|██▏       | 20000/92867 [00:28<01:29, 811.25 examples/s]
Running tokenizer on train dataset:  23%|██▎       | 21000/92867 [00:29<01:26, 827.05 examples/s]
Running tokenizer on train dataset:  24%|██▎       | 22000/92867 [00:30<01:25, 832.81 examples/s]
Running tokenizer on train dataset:  25%|██▍       | 23000/92867 [00:32<01:26, 811.75 examples/s]
Running tokenizer on train dataset:  26%|██▌       | 24000/92867 [00:33<01:28, 776.32 examples/s]
Running tokenizer on train dataset:  27%|██▋       | 25000/92867 [00:34<01:27, 775.67 examples/s]
Running tokenizer on train dataset:  28%|██▊       | 26000/92867 [00:36<01:26, 769.17 examples/s]
Running tokenizer on train dataset:  29%|██▉       | 27000/92867 [00:37<01:26, 762.52 examples/s]
Running tokenizer on train dataset:  30%|███       | 28000/92867 [00:39<01:29, 726.23 examples/s]
Running tokenizer on train dataset:  31%|███       | 29000/92867 [00:40<01:30, 703.89 examples/s]
Running tokenizer on train dataset:  32%|███▏      | 30000/92867 [00:42<01:30, 695.96 examples/s]
Running tokenizer on train dataset:  33%|███▎      | 31000/92867 [00:43<01:31, 673.33 examples/s]
Running tokenizer on train dataset:  34%|███▍      | 32000/92867 [00:45<01:34, 642.58 examples/s]
Running tokenizer on train dataset:  36%|███▌      | 33000/92867 [00:46<01:32, 644.39 examples/s]
Running tokenizer on train dataset:  37%|███▋      | 34000/92867 [00:48<01:32, 635.43 examples/s]
Running tokenizer on train dataset:  38%|███▊      | 35000/92867 [00:50<01:31, 634.13 examples/s]
Running tokenizer on train dataset:  39%|███▉      | 36000/92867 [00:51<01:30, 627.93 examples/s]
Running tokenizer on train dataset:  40%|███▉      | 37000/92867 [00:53<01:27, 640.62 examples/s]
Running tokenizer on train dataset:  41%|████      | 38000/92867 [00:54<01:28, 619.55 examples/s]
Running tokenizer on train dataset:  42%|████▏     | 39000/92867 [00:56<01:25, 630.38 examples/s]
Running tokenizer on train dataset:  43%|████▎     | 40000/92867 [00:58<01:26, 614.13 examples/s]
Running tokenizer on train dataset:  44%|████▍     | 41000/92867 [01:00<01:37, 533.94 examples/s]
Running tokenizer on train dataset:  45%|████▌     | 42000/92867 [01:02<01:33, 544.42 examples/s]
Running tokenizer on train dataset:  46%|████▋     | 43000/92867 [01:03<01:28, 565.14 examples/s]
Running tokenizer on train dataset:  47%|████▋     | 44000/92867 [01:05<01:23, 588.57 examples/s]
Running tokenizer on train dataset:  48%|████▊     | 45000/92867 [01:07<01:21, 589.65 examples/s]
Running tokenizer on train dataset:  50%|████▉     | 46000/92867 [01:08<01:20, 585.48 examples/s]
Running tokenizer on train dataset:  51%|█████     | 47000/92867 [01:10<01:16, 603.36 examples/s]
Running tokenizer on train dataset:  52%|█████▏    | 48000/92867 [01:12<01:17, 582.46 examples/s]
Running tokenizer on train dataset:  53%|█████▎    | 49000/92867 [01:13<01:12, 604.81 examples/s]
Running tokenizer on train dataset:  54%|█████▍    | 50000/92867 [01:15<01:15, 566.80 examples/s]
Running tokenizer on train dataset:  55%|█████▍    | 51000/92867 [01:17<01:17, 538.39 examples/s]
Running tokenizer on train dataset:  56%|█████▌    | 52000/92867 [01:19<01:16, 535.23 examples/s]
Running tokenizer on train dataset:  57%|█████▋    | 53000/92867 [01:21<01:16, 523.58 examples/s]
Running tokenizer on train dataset:  58%|█████▊    | 54000/92867 [01:23<01:12, 536.71 examples/s]
Running tokenizer on train dataset:  59%|█████▉    | 55000/92867 [01:25<01:08, 550.64 examples/s]
Running tokenizer on train dataset:  60%|██████    | 56000/92867 [01:27<01:10, 522.72 examples/s]
Running tokenizer on train dataset:  61%|██████▏   | 57000/92867 [01:29<01:10, 508.52 examples/s]
Running tokenizer on train dataset:  62%|██████▏   | 58000/92867 [01:31<01:09, 500.91 examples/s]
Running tokenizer on train dataset:  64%|██████▎   | 59000/92867 [01:33<01:08, 495.48 examples/s]
Running tokenizer on train dataset:  65%|██████▍   | 60000/92867 [01:34<00:59, 557.04 examples/s]
Running tokenizer on train dataset:  66%|██████▌   | 61000/92867 [01:36<00:53, 597.97 examples/s]
Running tokenizer on train dataset:  67%|██████▋   | 62000/92867 [01:37<00:49, 618.97 examples/s]
Running tokenizer on train dataset:  68%|██████▊   | 63000/92867 [01:39<00:45, 656.59 examples/s]
Running tokenizer on train dataset:  69%|██████▉   | 64000/92867 [01:40<00:41, 696.14 examples/s]
Running tokenizer on train dataset:  70%|██████▉   | 65000/92867 [01:41<00:39, 708.45 examples/s]
Running tokenizer on train dataset:  71%|███████   | 66000/92867 [01:43<00:37, 710.91 examples/s]
Running tokenizer on train dataset:  72%|███████▏  | 67000/92867 [01:44<00:36, 703.68 examples/s]
Running tokenizer on train dataset:  73%|███████▎  | 68000/92867 [01:45<00:35, 710.00 examples/s]
Running tokenizer on train dataset:  74%|███████▍  | 69000/92867 [01:47<00:33, 711.65 examples/s]
Running tokenizer on train dataset:  75%|███████▌  | 70000/92867 [01:48<00:32, 694.95 examples/s]
Running tokenizer on train dataset:  76%|███████▋  | 71000/92867 [01:50<00:31, 688.83 examples/s]
Running tokenizer on train dataset:  78%|███████▊  | 72000/92867 [01:51<00:30, 680.31 examples/s]
Running tokenizer on train dataset:  79%|███████▊  | 73000/92867 [01:53<00:30, 655.67 examples/s]
Running tokenizer on train dataset:  80%|███████▉  | 74000/92867 [01:55<00:29, 637.61 examples/s]
Running tokenizer on train dataset:  81%|████████  | 75000/92867 [01:56<00:28, 631.27 examples/s]
Running tokenizer on train dataset:  82%|████████▏ | 76000/92867 [01:58<00:27, 602.61 examples/s]
Running tokenizer on train dataset:  83%|████████▎ | 77000/92867 [02:00<00:26, 593.39 examples/s]
Running tokenizer on train dataset:  84%|████████▍ | 78000/92867 [02:02<00:25, 580.64 examples/s]
Running tokenizer on train dataset:  85%|████████▌ | 79000/92867 [02:03<00:24, 574.66 examples/s]
Running tokenizer on train dataset:  86%|████████▌ | 80000/92867 [02:05<00:22, 575.18 examples/s]
Running tokenizer on train dataset:  87%|████████▋ | 81000/92867 [02:07<00:20, 584.41 examples/s]
Running tokenizer on train dataset:  88%|████████▊ | 82000/92867 [02:08<00:18, 598.20 examples/s]
Running tokenizer on train dataset:  89%|████████▉ | 83000/92867 [02:11<00:19, 514.21 examples/s]
Running tokenizer on train dataset:  90%|█████████ | 84000/92867 [02:13<00:17, 506.84 examples/s]
Running tokenizer on train dataset:  92%|█████████▏| 85000/92867 [02:15<00:14, 524.89 examples/s]
Running tokenizer on train dataset:  93%|█████████▎| 86000/92867 [02:16<00:12, 545.19 examples/s]
Running tokenizer on train dataset:  94%|█████████▎| 87000/92867 [02:18<00:10, 535.57 examples/s]
Running tokenizer on train dataset:  95%|█████████▍| 88000/92867 [02:20<00:08, 544.77 examples/s]
Running tokenizer on train dataset:  96%|█████████▌| 89000/92867 [02:22<00:07, 536.75 examples/s]
Running tokenizer on train dataset:  97%|█████████▋| 90000/92867 [02:24<00:05, 546.24 examples/s]
Running tokenizer on train dataset:  98%|█████████▊| 91000/92867 [02:26<00:03, 506.02 examples/s]
Running tokenizer on train dataset:  99%|█████████▉| 92000/92867 [02:28<00:01, 500.71 examples/s]
Running tokenizer on train dataset: 100%|██████████| 92867/92867 [02:30<00:00, 493.16 examples/s]
Running tokenizer on train dataset: 100%|██████████| 92867/92867 [02:30<00:00, 616.86 examples/s]
Saving cached train data ...

Saving the dataset (0/1 shards):   0%|          | 0/92867 [00:00<?, ? examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 92867/92867 [00:00<00:00, 933751.16 examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 92867/92867 [00:00<00:00, 931424.54 examples/s]
/kaggle/working/amr-tst-indo/AMRBART-id/fine-tune/main.py:283: FutureWarning: load_metric is deprecated and will be removed in the next major version of datasets. Use 'evaluate.load' instead, from the new library 🤗 Evaluate: https://huggingface.co./docs/evaluate
  metric = load_metric(path="metric/sacrebleu.py") if training_args.task == "amr2text" else None
/opt/conda/lib/python3.10/site-packages/datasets/load.py:855: FutureWarning: The repository for sacrebleu contains custom code which must be executed to correctly load the metric. You can inspect the repository content at metric/sacrebleu.py
You can avoid this message in future by passing the argument `trust_remote_code=True`.
Passing `trust_remote_code=True` will be mandatory to load this metric from the next major release of `datasets`.
  warnings.warn(
/opt/conda/lib/python3.10/site-packages/transformers/optimization.py:588: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning
  warnings.warn(
All 371472 steps, warm_up steps: 200
wandb: WARNING The `run_name` is currently set to the same value as `TrainingArguments.output_dir`. If this was not intended, please specify a different run name by setting the `TrainingArguments.run_name` parameter.
wandb: Currently logged in as: abdiharyadi. Use `wandb login --relogin` to force relogin
wandb: wandb version 0.17.4 is available!  To upgrade, please run:
wandb:  $ pip install wandb --upgrade
wandb: Tracking run with wandb version 0.17.0
wandb: Run data is saved locally in /kaggle/working/amr-tst-indo/AMRBART-id/fine-tune/wandb/run-20240708_023621-oolm2rnr
wandb: Run `wandb offline` to turn off syncing.
wandb: Syncing run /kaggle/working/amr-tst-indo/AMRBART-id/fine-tune/../outputs/mbart-en-id-smaller-fted
wandb: ⭐️ View project at https://wandb.ai/abdiharyadi/huggingface
wandb: 🚀 View run at https://wandb.ai/abdiharyadi/huggingface/runs/oolm2rnr

  0%|          | 0/371472 [00:00<?, ?it/s]/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

  0%|          | 1/371472 [00:00<87:58:08,  1.17it/s]
                                                     
{'loss': 15.2085, 'learning_rate': 5e-09, 'epoch': 0.0}

  0%|          | 1/371472 [00:00<87:58:08,  1.17it/s]
  0%|          | 2/371472 [00:01<56:07:07,  1.84it/s]
  0%|          | 3/371472 [00:01<42:53:44,  2.41it/s]
  0%|          | 4/371472 [00:01<38:20:25,  2.69it/s]
  0%|          | 5/371472 [00:02<34:18:11,  3.01it/s]
  0%|          | 6/371472 [00:02<33:59:12,  3.04it/s]
  0%|          | 7/371472 [00:02<31:18:27,  3.30it/s]
  0%|          | 8/371472 [00:02<29:41:21,  3.48it/s]
  0%|          | 9/371472 [00:03<30:23:00,  3.40it/s]
  0%|          | 10/371472 [00:03<30:04:06,  3.43it/s]
  0%|          | 11/371472 [00:03<30:02:57,  3.43it/s]
  0%|          | 12/371472 [00:03<29:20:07,  3.52it/s]
  0%|          | 13/371472 [00:04<32:46:54,  3.15it/s]
  0%|          | 14/371472 [00:04<31:43:54,  3.25it/s]
  0%|          | 15/371472 [00:04<30:25:21,  3.39it/s]
  0%|          | 16/371472 [00:05<29:29:46,  3.50it/s]
  0%|          | 17/371472 [00:05<31:04:47,  3.32it/s]
  0%|          | 18/371472 [00:05<30:33:20,  3.38it/s]
  0%|          | 19/371472 [00:06<29:22:27,  3.51it/s]
  0%|          | 20/371472 [00:06<28:33:03,  3.61it/s]
                                                      
{'loss': 13.4227, 'learning_rate': 1e-07, 'epoch': 0.0}

  0%|          | 20/371472 [00:06<28:33:03,  3.61it/s]
  0%|          | 21/371472 [00:06<29:03:34,  3.55it/s]
  0%|          | 22/371472 [00:06<29:37:53,  3.48it/s]
  0%|          | 23/371472 [00:07<29:26:11,  3.51it/s]
  0%|          | 24/371472 [00:07<28:41:55,  3.60it/s]
  0%|          | 25/371472 [00:07<29:34:52,  3.49it/s]
  0%|          | 26/371472 [00:08<30:04:09,  3.43it/s]
  0%|          | 27/371472 [00:08<30:15:53,  3.41it/s]
  0%|          | 28/371472 [00:08<29:43:56,  3.47it/s]
  0%|          | 29/371472 [00:08<30:30:43,  3.38it/s]
  0%|          | 30/371472 [00:09<28:58:05,  3.56it/s]
  0%|          | 31/371472 [00:09<27:53:38,  3.70it/s]
  0%|          | 32/371472 [00:09<28:04:24,  3.68it/s]
  0%|          | 33/371472 [00:10<29:53:16,  3.45it/s]
  0%|          | 34/371472 [00:10<29:41:46,  3.47it/s]
  0%|          | 35/371472 [00:10<31:12:42,  3.31it/s]
  0%|          | 36/371472 [00:10<30:14:19,  3.41it/s]
  0%|          | 37/371472 [00:11<29:59:21,  3.44it/s]
  0%|          | 38/371472 [00:11<29:58:51,  3.44it/s]
  0%|          | 39/371472 [00:11<30:07:40,  3.42it/s]
  0%|          | 40/371472 [00:12<29:21:52,  3.51it/s]
                                                      
{'loss': 12.2855, 'learning_rate': 2e-07, 'epoch': 0.0}

  0%|          | 40/371472 [00:12<29:21:52,  3.51it/s]
  0%|          | 41/371472 [00:12<29:34:26,  3.49it/s]
  0%|          | 42/371472 [00:12<29:02:27,  3.55it/s]
  0%|          | 43/371472 [00:12<29:00:30,  3.56it/s]
  0%|          | 44/371472 [00:13<30:58:56,  3.33it/s]
  0%|          | 45/371472 [00:13<32:02:22,  3.22it/s]
  0%|          | 46/371472 [00:13<33:57:07,  3.04it/s]
  0%|          | 47/371472 [00:14<33:32:01,  3.08it/s]
  0%|          | 48/371472 [00:14<33:05:53,  3.12it/s]
  0%|          | 49/371472 [00:14<31:32:17,  3.27it/s]
  0%|          | 50/371472 [00:15<38:26:25,  2.68it/s]
  0%|          | 51/371472 [00:15<35:30:08,  2.91it/s]
  0%|          | 52/371472 [00:15<33:51:55,  3.05it/s]
  0%|          | 53/371472 [00:16<32:07:21,  3.21it/s]
  0%|          | 54/371472 [00:16<31:01:21,  3.33it/s]
  0%|          | 55/371472 [00:16<30:40:46,  3.36it/s]
  0%|          | 56/371472 [00:17<30:21:05,  3.40it/s]
  0%|          | 57/371472 [00:17<29:58:11,  3.44it/s]
  0%|          | 58/371472 [00:17<32:34:20,  3.17it/s]
  0%|          | 59/371472 [00:18<32:57:27,  3.13it/s]
  0%|          | 60/371472 [00:18<31:07:52,  3.31it/s]
                                                      
{'loss': 12.1044, 'learning_rate': 3e-07, 'epoch': 0.0}

  0%|          | 60/371472 [00:18<31:07:52,  3.31it/s]
  0%|          | 61/371472 [00:18<30:23:48,  3.39it/s]
  0%|          | 62/371472 [00:18<29:22:10,  3.51it/s]
  0%|          | 63/371472 [00:19<29:37:26,  3.48it/s]
  0%|          | 64/371472 [00:19<28:35:28,  3.61it/s]
  0%|          | 65/371472 [00:19<28:42:47,  3.59it/s]
  0%|          | 66/371472 [00:19<28:20:32,  3.64it/s]
  0%|          | 67/371472 [00:20<28:01:50,  3.68it/s]
  0%|          | 68/371472 [00:20<28:49:17,  3.58it/s]
  0%|          | 69/371472 [00:20<29:05:08,  3.55it/s]
  0%|          | 70/371472 [00:21<28:41:47,  3.60it/s]
  0%|          | 71/371472 [00:21<29:21:47,  3.51it/s]
  0%|          | 72/371472 [00:21<29:37:43,  3.48it/s]
  0%|          | 73/371472 [00:21<29:58:16,  3.44it/s]
  0%|          | 74/371472 [00:22<28:49:28,  3.58it/s]
  0%|          | 75/371472 [00:22<30:07:31,  3.42it/s]
  0%|          | 76/371472 [00:22<29:05:44,  3.55it/s]
  0%|          | 77/371472 [00:23<30:11:14,  3.42it/s]
  0%|          | 78/371472 [00:23<29:49:50,  3.46it/s]
  0%|          | 79/371472 [00:23<29:53:40,  3.45it/s]
  0%|          | 80/371472 [00:23<29:00:23,  3.56it/s]
                                                      
{'loss': 10.705, 'learning_rate': 4e-07, 'epoch': 0.0}

  0%|          | 80/371472 [00:23<29:00:23,  3.56it/s]
  0%|          | 81/371472 [00:24<29:07:47,  3.54it/s]
  0%|          | 82/371472 [00:24<30:27:16,  3.39it/s]
  0%|          | 83/371472 [00:24<32:13:19,  3.20it/s]
  0%|          | 84/371472 [00:25<32:05:23,  3.21it/s]
  0%|          | 85/371472 [00:25<30:27:15,  3.39it/s]
  0%|          | 86/371472 [00:25<32:13:10,  3.20it/s]
  0%|          | 87/371472 [00:26<30:27:17,  3.39it/s]
  0%|          | 88/371472 [00:26<31:55:10,  3.23it/s]
  0%|          | 89/371472 [00:26<30:09:32,  3.42it/s]
  0%|          | 90/371472 [00:27<31:21:27,  3.29it/s]
  0%|          | 91/371472 [00:27<29:26:36,  3.50it/s]
  0%|          | 92/371472 [00:27<28:56:01,  3.57it/s]
  0%|          | 93/371472 [00:27<29:06:11,  3.54it/s]
  0%|          | 94/371472 [00:28<28:04:06,  3.68it/s]
  0%|          | 95/371472 [00:28<29:08:26,  3.54it/s]
  0%|          | 96/371472 [00:28<29:44:00,  3.47it/s]
  0%|          | 97/371472 [00:28<29:16:09,  3.52it/s]
  0%|          | 98/371472 [00:29<29:04:45,  3.55it/s]
  0%|          | 99/371472 [00:29<30:19:10,  3.40it/s]
  0%|          | 100/371472 [00:29<29:12:26,  3.53it/s]
                                                       
{'loss': 10.2652, 'learning_rate': 5e-07, 'epoch': 0.0}

  0%|          | 100/371472 [00:29<29:12:26,  3.53it/s]
  0%|          | 101/371472 [00:30<29:32:43,  3.49it/s]
  0%|          | 102/371472 [00:30<30:35:49,  3.37it/s]
  0%|          | 103/371472 [00:30<29:22:06,  3.51it/s]
  0%|          | 104/371472 [00:31<30:06:33,  3.43it/s]
  0%|          | 105/371472 [00:31<30:11:51,  3.42it/s]
  0%|          | 106/371472 [00:31<29:15:40,  3.53it/s]
  0%|          | 107/371472 [00:31<28:20:37,  3.64it/s]
  0%|          | 108/371472 [00:32<29:17:44,  3.52it/s]
  0%|          | 109/371472 [00:32<32:17:01,  3.20it/s]
  0%|          | 110/371472 [00:32<31:35:22,  3.27it/s]
  0%|          | 111/371472 [00:33<31:25:52,  3.28it/s]
  0%|          | 112/371472 [00:33<30:05:56,  3.43it/s]
  0%|          | 113/371472 [00:33<28:55:02,  3.57it/s]
  0%|          | 114/371472 [00:33<28:50:08,  3.58it/s]
  0%|          | 115/371472 [00:34<28:51:35,  3.57it/s]
  0%|          | 116/371472 [00:34<28:13:48,  3.65it/s]
  0%|          | 117/371472 [00:34<27:58:31,  3.69it/s]
  0%|          | 118/371472 [00:34<27:57:37,  3.69it/s]
  0%|          | 119/371472 [00:35<27:35:03,  3.74it/s]
  0%|          | 120/371472 [00:35<29:07:33,  3.54it/s]
                                                       
{'loss': 8.8297, 'learning_rate': 6e-07, 'epoch': 0.01}

  0%|          | 120/371472 [00:35<29:07:33,  3.54it/s]
  0%|          | 121/371472 [00:35<28:51:25,  3.57it/s]
  0%|          | 122/371472 [00:36<28:53:29,  3.57it/s]
  0%|          | 123/371472 [00:36<29:18:41,  3.52it/s]
  0%|          | 124/371472 [00:36<29:15:33,  3.53it/s]
  0%|          | 125/371472 [00:36<29:06:42,  3.54it/s]
  0%|          | 126/371472 [00:37<29:03:40,  3.55it/s]
  0%|          | 127/371472 [00:37<27:47:10,  3.71it/s]
  0%|          | 128/371472 [00:37<28:56:47,  3.56it/s]
  0%|          | 129/371472 [00:38<28:21:20,  3.64it/s]
  0%|          | 130/371472 [00:38<27:49:05,  3.71it/s]
  0%|          | 131/371472 [00:38<28:20:53,  3.64it/s]
  0%|          | 132/371472 [00:38<30:13:51,  3.41it/s]
  0%|          | 133/371472 [00:39<29:44:07,  3.47it/s]
  0%|          | 134/371472 [00:39<28:19:05,  3.64it/s]
  0%|          | 135/371472 [00:39<28:45:47,  3.59it/s]
  0%|          | 136/371472 [00:40<28:27:26,  3.62it/s]
  0%|          | 137/371472 [00:40<28:50:55,  3.58it/s]
  0%|          | 138/371472 [00:40<28:18:45,  3.64it/s]
  0%|          | 139/371472 [00:40<30:00:36,  3.44it/s]
  0%|          | 140/371472 [00:41<31:04:50,  3.32it/s]
                                                       
{'loss': 8.3154, 'learning_rate': 7e-07, 'epoch': 0.01}

  0%|          | 140/371472 [00:41<31:04:50,  3.32it/s]
  0%|          | 141/371472 [00:41<31:14:45,  3.30it/s]
  0%|          | 142/371472 [00:41<30:01:25,  3.44it/s]
  0%|          | 143/371472 [00:42<29:32:00,  3.49it/s]
  0%|          | 144/371472 [00:42<29:04:23,  3.55it/s]
  0%|          | 145/371472 [00:42<30:28:53,  3.38it/s]
  0%|          | 146/371472 [00:42<31:24:07,  3.28it/s]
  0%|          | 147/371472 [00:43<31:03:54,  3.32it/s]
  0%|          | 148/371472 [00:43<31:27:15,  3.28it/s]
  0%|          | 149/371472 [00:43<30:27:17,  3.39it/s]
  0%|          | 150/371472 [00:44<31:42:34,  3.25it/s]
  0%|          | 151/371472 [00:44<30:33:29,  3.38it/s]
  0%|          | 152/371472 [00:44<29:15:15,  3.53it/s]
  0%|          | 153/371472 [00:44<28:22:35,  3.63it/s]
  0%|          | 154/371472 [00:45<29:45:15,  3.47it/s]
  0%|          | 155/371472 [00:45<29:30:48,  3.49it/s]
  0%|          | 156/371472 [00:45<29:48:07,  3.46it/s]
  0%|          | 157/371472 [00:46<29:05:50,  3.54it/s]
  0%|          | 158/371472 [00:46<28:57:55,  3.56it/s]
  0%|          | 159/371472 [00:46<29:49:07,  3.46it/s]
  0%|          | 160/371472 [00:46<28:41:06,  3.60it/s]
                                                       
{'loss': 7.722, 'learning_rate': 8e-07, 'epoch': 0.01}

  0%|          | 160/371472 [00:46<28:41:06,  3.60it/s]
  0%|          | 161/371472 [00:47<27:53:22,  3.70it/s]
  0%|          | 162/371472 [00:47<29:57:10,  3.44it/s]
  0%|          | 163/371472 [00:47<29:10:59,  3.53it/s]
  0%|          | 164/371472 [00:48<29:17:08,  3.52it/s]
  0%|          | 165/371472 [00:48<28:30:59,  3.62it/s]
  0%|          | 166/371472 [00:48<28:31:32,  3.62it/s]
  0%|          | 167/371472 [00:48<29:05:35,  3.55it/s]
  0%|          | 168/371472 [00:49<28:49:07,  3.58it/s]
  0%|          | 169/371472 [00:49<27:37:42,  3.73it/s]
  0%|          | 170/371472 [00:49<29:37:18,  3.48it/s]
  0%|          | 171/371472 [00:50<29:47:12,  3.46it/s]
  0%|          | 172/371472 [00:50<28:57:33,  3.56it/s]
  0%|          | 173/371472 [00:50<28:29:38,  3.62it/s]
  0%|          | 174/371472 [00:50<28:08:41,  3.66it/s]
  0%|          | 175/371472 [00:51<29:45:39,  3.47it/s]
  0%|          | 176/371472 [00:51<28:42:40,  3.59it/s]
  0%|          | 177/371472 [00:51<28:15:02,  3.65it/s]
  0%|          | 178/371472 [00:51<27:55:54,  3.69it/s]
  0%|          | 179/371472 [00:52<33:09:10,  3.11it/s]
  0%|          | 180/371472 [00:52<32:55:33,  3.13it/s]
                                                       
{'loss': 7.6096, 'learning_rate': 9e-07, 'epoch': 0.01}

  0%|          | 180/371472 [00:52<32:55:33,  3.13it/s]
  0%|          | 181/371472 [00:53<31:46:50,  3.25it/s]
  0%|          | 182/371472 [00:53<30:50:24,  3.34it/s]
  0%|          | 183/371472 [00:53<30:49:42,  3.35it/s]
  0%|          | 184/371472 [00:53<30:08:55,  3.42it/s]
  0%|          | 185/371472 [00:54<29:51:53,  3.45it/s]
  0%|          | 186/371472 [00:54<30:30:52,  3.38it/s]
  0%|          | 187/371472 [00:54<33:02:12,  3.12it/s]
  0%|          | 188/371472 [00:55<37:41:56,  2.74it/s]
  0%|          | 189/371472 [00:55<38:02:57,  2.71it/s]
  0%|          | 190/371472 [00:55<34:44:04,  2.97it/s]
  0%|          | 191/371472 [00:56<32:47:11,  3.15it/s]
  0%|          | 192/371472 [00:56<30:51:30,  3.34it/s]
  0%|          | 193/371472 [00:56<30:44:54,  3.35it/s]
  0%|          | 194/371472 [00:57<29:59:59,  3.44it/s]
  0%|          | 195/371472 [00:57<29:48:00,  3.46it/s]
  0%|          | 196/371472 [00:57<29:25:41,  3.50it/s]
  0%|          | 197/371472 [00:57<29:16:01,  3.52it/s]
  0%|          | 198/371472 [00:58<29:04:52,  3.55it/s]
  0%|          | 199/371472 [00:58<28:08:40,  3.66it/s]
  0%|          | 200/371472 [00:58<28:14:27,  3.65it/s]
                                                       
{'loss': 7.394, 'learning_rate': 1e-06, 'epoch': 0.01}

  0%|          | 200/371472 [00:58<28:14:27,  3.65it/s]
  0%|          | 201/371472 [00:59<29:15:05,  3.53it/s]
  0%|          | 202/371472 [00:59<30:36:08,  3.37it/s]
  0%|          | 203/371472 [00:59<29:56:28,  3.44it/s]
  0%|          | 204/371472 [00:59<30:45:44,  3.35it/s]
  0%|          | 205/371472 [01:00<31:42:57,  3.25it/s]
  0%|          | 206/371472 [01:00<30:27:30,  3.39it/s]
  0%|          | 207/371472 [01:00<30:10:56,  3.42it/s]
  0%|          | 208/371472 [01:01<29:06:13,  3.54it/s]
  0%|          | 209/371472 [01:01<28:24:30,  3.63it/s]
  0%|          | 210/371472 [01:01<27:42:36,  3.72it/s]
  0%|          | 211/371472 [01:01<31:07:52,  3.31it/s]
  0%|          | 212/371472 [01:02<31:47:08,  3.24it/s]
  0%|          | 213/371472 [01:02<30:53:26,  3.34it/s]
  0%|          | 214/371472 [01:02<30:43:36,  3.36it/s]
  0%|          | 215/371472 [01:03<30:15:09,  3.41it/s]
  0%|          | 216/371472 [01:03<29:16:37,  3.52it/s]
  0%|          | 217/371472 [01:03<29:15:01,  3.53it/s]
  0%|          | 218/371472 [01:03<29:27:30,  3.50it/s]
  0%|          | 219/371472 [01:04<28:45:51,  3.59it/s]
  0%|          | 220/371472 [01:04<28:03:30,  3.68it/s]
                                                       
{'loss': 7.0227, 'learning_rate': 9.99951518024521e-07, 'epoch': 0.01}

  0%|          | 220/371472 [01:04<28:03:30,  3.68it/s]
  0%|          | 221/371472 [01:04<28:12:53,  3.65it/s]
  0%|          | 222/371472 [01:05<27:56:51,  3.69it/s]
  0%|          | 223/371472 [01:05<28:44:48,  3.59it/s]
  0%|          | 224/371472 [01:05<28:33:09,  3.61it/s]
  0%|          | 225/371472 [01:05<31:12:23,  3.30it/s]
  0%|          | 226/371472 [01:06<35:40:26,  2.89it/s]
  0%|          | 227/371472 [01:06<32:57:11,  3.13it/s]
  0%|          | 228/371472 [01:06<30:51:29,  3.34it/s]
  0%|          | 229/371472 [01:07<30:40:46,  3.36it/s]
  0%|          | 230/371472 [01:07<30:38:59,  3.36it/s]
  0%|          | 231/371472 [01:07<29:11:07,  3.53it/s]
  0%|          | 232/371472 [01:08<29:08:51,  3.54it/s]
  0%|          | 233/371472 [01:08<29:51:19,  3.45it/s]
  0%|          | 234/371472 [01:08<29:20:06,  3.52it/s]
  0%|          | 235/371472 [01:08<28:37:27,  3.60it/s]
  0%|          | 236/371472 [01:09<28:31:21,  3.62it/s]
  0%|          | 237/371472 [01:09<28:22:04,  3.64it/s]
  0%|          | 238/371472 [01:09<28:10:41,  3.66it/s]
  0%|          | 239/371472 [01:09<28:47:15,  3.58it/s]
  0%|          | 240/371472 [01:10<29:08:49,  3.54it/s]
                                                       
{'loss': 7.7254, 'learning_rate': 9.999030360490423e-07, 'epoch': 0.01}

  0%|          | 240/371472 [01:10<29:08:49,  3.54it/s]
  0%|          | 241/371472 [01:10<31:46:00,  3.25it/s]
  0%|          | 242/371472 [01:10<30:20:06,  3.40it/s]
  0%|          | 243/371472 [01:11<29:52:34,  3.45it/s]
  0%|          | 244/371472 [01:11<29:32:30,  3.49it/s]
  0%|          | 245/371472 [01:11<29:00:11,  3.56it/s]
  0%|          | 246/371472 [01:12<30:12:27,  3.41it/s]
  0%|          | 247/371472 [01:12<30:22:21,  3.40it/s]
  0%|          | 248/371472 [01:12<28:53:19,  3.57it/s]
  0%|          | 249/371472 [01:12<28:00:31,  3.68it/s]
  0%|          | 250/371472 [01:13<27:48:02,  3.71it/s]
  0%|          | 251/371472 [01:13<27:26:15,  3.76it/s]
  0%|          | 252/371472 [01:13<28:12:09,  3.66it/s]
  0%|          | 253/371472 [01:14<30:47:14,  3.35it/s]
  0%|          | 254/371472 [01:14<29:59:57,  3.44it/s]
  0%|          | 255/371472 [01:14<29:01:49,  3.55it/s]
  0%|          | 256/371472 [01:14<29:13:27,  3.53it/s]
  0%|          | 257/371472 [01:15<28:38:24,  3.60it/s]
  0%|          | 258/371472 [01:15<29:06:24,  3.54it/s]
  0%|          | 259/371472 [01:15<29:36:25,  3.48it/s]
  0%|          | 260/371472 [01:15<28:44:10,  3.59it/s]
                                                       
{'loss': 7.6063, 'learning_rate': 9.998545540735632e-07, 'epoch': 0.01}

  0%|          | 260/371472 [01:15<28:44:10,  3.59it/s]
  0%|          | 261/371472 [01:16<27:58:47,  3.69it/s]
  0%|          | 262/371472 [01:16<28:31:22,  3.62it/s]
  0%|          | 263/371472 [01:16<27:58:28,  3.69it/s]
  0%|          | 264/371472 [01:17<27:28:56,  3.75it/s]
  0%|          | 265/371472 [01:17<28:39:24,  3.60it/s]
  0%|          | 266/371472 [01:17<31:30:18,  3.27it/s]
  0%|          | 267/371472 [01:18<32:31:22,  3.17it/s]
  0%|          | 268/371472 [01:18<32:11:34,  3.20it/s]
  0%|          | 269/371472 [01:18<32:39:34,  3.16it/s]
  0%|          | 270/371472 [01:19<33:43:56,  3.06it/s]
  0%|          | 271/371472 [01:19<33:04:16,  3.12it/s]
  0%|          | 272/371472 [01:19<31:00:13,  3.33it/s]
  0%|          | 273/371472 [01:19<33:29:25,  3.08it/s]
  0%|          | 274/371472 [01:20<31:33:10,  3.27it/s]
  0%|          | 275/371472 [01:20<33:14:06,  3.10it/s]
  0%|          | 276/371472 [01:20<31:27:14,  3.28it/s]
  0%|          | 277/371472 [01:21<30:35:07,  3.37it/s]
  0%|          | 278/371472 [01:21<30:05:48,  3.43it/s]
  0%|          | 279/371472 [01:21<29:19:20,  3.52it/s]
  0%|          | 280/371472 [01:21<28:50:17,  3.58it/s]
                                                       
{'loss': 6.9029, 'learning_rate': 9.998060720980845e-07, 'epoch': 0.01}

  0%|          | 280/371472 [01:21<28:50:17,  3.58it/s]
  0%|          | 281/371472 [01:22<28:16:50,  3.65it/s]
  0%|          | 282/371472 [01:22<29:04:31,  3.55it/s]
  0%|          | 283/371472 [01:22<28:59:03,  3.56it/s]
  0%|          | 284/371472 [01:23<30:53:10,  3.34it/s]
  0%|          | 285/371472 [01:23<29:48:33,  3.46it/s]
  0%|          | 286/371472 [01:23<30:55:00,  3.33it/s]
  0%|          | 287/371472 [01:23<29:38:31,  3.48it/s]
  0%|          | 288/371472 [01:24<29:13:37,  3.53it/s]
  0%|          | 289/371472 [01:24<28:01:04,  3.68it/s]
  0%|          | 290/371472 [01:24<27:45:17,  3.71it/s]
  0%|          | 291/371472 [01:25<28:01:23,  3.68it/s]
  0%|          | 292/371472 [01:25<28:38:46,  3.60it/s]
  0%|          | 293/371472 [01:25<29:05:00,  3.55it/s]
  0%|          | 294/371472 [01:25<28:46:05,  3.58it/s]
  0%|          | 295/371472 [01:26<30:49:04,  3.35it/s]
  0%|          | 296/371472 [01:26<29:31:57,  3.49it/s]
  0%|          | 297/371472 [01:26<29:18:30,  3.52it/s]
  0%|          | 298/371472 [01:27<29:40:33,  3.47it/s]
  0%|          | 299/371472 [01:27<28:13:55,  3.65it/s]
  0%|          | 300/371472 [01:27<31:00:29,  3.33it/s]
                                                       
{'loss': 7.0533, 'learning_rate': 9.997575901226053e-07, 'epoch': 0.01}

  0%|          | 300/371472 [01:27<31:00:29,  3.33it/s]
  0%|          | 301/371472 [01:27<30:41:43,  3.36it/s]
  0%|          | 302/371472 [01:28<29:39:13,  3.48it/s]
  0%|          | 303/371472 [01:28<30:25:46,  3.39it/s]
  0%|          | 304/371472 [01:28<33:07:40,  3.11it/s]
  0%|          | 305/371472 [01:29<31:09:58,  3.31it/s]
  0%|          | 306/371472 [01:29<29:26:01,  3.50it/s]
  0%|          | 307/371472 [01:29<28:32:31,  3.61it/s]
  0%|          | 308/371472 [01:29<28:13:37,  3.65it/s]
  0%|          | 309/371472 [01:30<29:35:17,  3.48it/s]
  0%|          | 310/371472 [01:30<29:47:58,  3.46it/s]
  0%|          | 311/371472 [01:30<30:04:12,  3.43it/s]
  0%|          | 312/371472 [01:31<28:41:05,  3.59it/s]
  0%|          | 313/371472 [01:31<31:08:16,  3.31it/s]
  0%|          | 314/371472 [01:31<31:27:32,  3.28it/s]
  0%|          | 315/371472 [01:32<30:20:33,  3.40it/s]
  0%|          | 316/371472 [01:32<30:27:10,  3.39it/s]
  0%|          | 317/371472 [01:32<30:39:11,  3.36it/s]
  0%|          | 318/371472 [01:32<29:13:50,  3.53it/s]
  0%|          | 319/371472 [01:33<29:01:52,  3.55it/s]
  0%|          | 320/371472 [01:33<30:06:08,  3.42it/s]
                                                       
{'loss': 6.9369, 'learning_rate': 9.997091081471266e-07, 'epoch': 0.01}

  0%|          | 320/371472 [01:33<30:06:08,  3.42it/s]
  0%|          | 321/371472 [01:33<29:49:35,  3.46it/s]
  0%|          | 322/371472 [01:34<29:45:43,  3.46it/s]
  0%|          | 323/371472 [01:34<29:48:50,  3.46it/s]
  0%|          | 324/371472 [01:34<28:42:22,  3.59it/s]
  0%|          | 325/371472 [01:34<28:11:51,  3.66it/s]
  0%|          | 326/371472 [01:35<28:14:37,  3.65it/s]
  0%|          | 327/371472 [01:35<29:38:42,  3.48it/s]
  0%|          | 328/371472 [01:35<30:27:32,  3.38it/s]
  0%|          | 329/371472 [01:36<30:05:39,  3.43it/s]
  0%|          | 330/371472 [01:36<28:48:12,  3.58it/s]
  0%|          | 331/371472 [01:36<30:20:35,  3.40it/s]
  0%|          | 332/371472 [01:37<34:16:14,  3.01it/s]
  0%|          | 333/371472 [01:37<32:13:18,  3.20it/s]
  0%|          | 334/371472 [01:37<31:41:11,  3.25it/s]
  0%|          | 335/371472 [01:37<30:15:50,  3.41it/s]
  0%|          | 336/371472 [01:38<29:19:42,  3.52it/s]
  0%|          | 337/371472 [01:38<28:29:41,  3.62it/s]
  0%|          | 338/371472 [01:38<28:35:05,  3.61it/s]
  0%|          | 339/371472 [01:38<28:18:17,  3.64it/s]
  0%|          | 340/371472 [01:39<29:24:00,  3.51it/s]
                                                       
{'loss': 7.2298, 'learning_rate': 9.996606261716477e-07, 'epoch': 0.01}

  0%|          | 340/371472 [01:39<29:24:00,  3.51it/s]
  0%|          | 341/371472 [01:39<28:52:14,  3.57it/s]
  0%|          | 342/371472 [01:39<29:51:13,  3.45it/s]
  0%|          | 343/371472 [01:40<32:35:46,  3.16it/s]
  0%|          | 344/371472 [01:40<30:57:28,  3.33it/s]
  0%|          | 345/371472 [01:40<29:33:47,  3.49it/s]
  0%|          | 346/371472 [01:41<30:08:14,  3.42it/s]
  0%|          | 347/371472 [01:41<29:42:36,  3.47it/s]
  0%|          | 348/371472 [01:41<29:31:35,  3.49it/s]
  0%|          | 349/371472 [01:41<29:30:51,  3.49it/s]
  0%|          | 350/371472 [01:42<29:13:44,  3.53it/s]
  0%|          | 351/371472 [01:42<29:34:59,  3.48it/s]
  0%|          | 352/371472 [01:42<30:35:16,  3.37it/s]
  0%|          | 353/371472 [01:43<29:37:09,  3.48it/s]
  0%|          | 354/371472 [01:43<30:18:57,  3.40it/s]
  0%|          | 355/371472 [01:43<29:06:18,  3.54it/s]
  0%|          | 356/371472 [01:43<29:12:10,  3.53it/s]
  0%|          | 357/371472 [01:44<29:09:15,  3.54it/s]
  0%|          | 358/371472 [01:44<29:16:49,  3.52it/s]
  0%|          | 359/371472 [01:44<29:07:44,  3.54it/s]
  0%|          | 360/371472 [01:45<30:10:10,  3.42it/s]
                                                       
{'loss': 6.9774, 'learning_rate': 9.996121441961687e-07, 'epoch': 0.02}

  0%|          | 360/371472 [01:45<30:10:10,  3.42it/s]
  0%|          | 361/371472 [01:45<30:59:33,  3.33it/s]
  0%|          | 362/371472 [01:45<33:07:30,  3.11it/s]
  0%|          | 363/371472 [01:45<31:06:40,  3.31it/s]
  0%|          | 364/371472 [01:46<33:13:39,  3.10it/s]
  0%|          | 365/371472 [01:46<31:28:24,  3.28it/s]
  0%|          | 366/371472 [01:46<30:43:32,  3.36it/s]
  0%|          | 367/371472 [01:47<30:20:59,  3.40it/s]
  0%|          | 368/371472 [01:47<28:44:00,  3.59it/s]
  0%|          | 369/371472 [01:47<33:19:55,  3.09it/s]
  0%|          | 370/371472 [01:48<31:19:48,  3.29it/s]
  0%|          | 371/371472 [01:48<30:11:43,  3.41it/s]
  0%|          | 372/371472 [01:48<30:37:29,  3.37it/s]
  0%|          | 373/371472 [01:48<29:50:28,  3.45it/s]
  0%|          | 374/371472 [01:49<29:03:44,  3.55it/s]
  0%|          | 375/371472 [01:49<28:04:06,  3.67it/s]
  0%|          | 376/371472 [01:49<28:25:31,  3.63it/s]
  0%|          | 377/371472 [01:50<29:20:15,  3.51it/s]
  0%|          | 378/371472 [01:50<32:19:36,  3.19it/s]
  0%|          | 379/371472 [01:50<30:52:19,  3.34it/s]
  0%|          | 380/371472 [01:50<29:41:52,  3.47it/s]
                                                       
{'loss': 6.6153, 'learning_rate': 9.9956366222069e-07, 'epoch': 0.02}

  0%|          | 380/371472 [01:50<29:41:52,  3.47it/s]
  0%|          | 381/371472 [01:51<30:34:45,  3.37it/s]
  0%|          | 382/371472 [01:51<29:38:00,  3.48it/s]
  0%|          | 383/371472 [01:51<28:52:51,  3.57it/s]
  0%|          | 384/371472 [01:52<32:10:29,  3.20it/s]
  0%|          | 385/371472 [01:52<31:23:40,  3.28it/s]
  0%|          | 386/371472 [01:52<29:50:11,  3.45it/s]
  0%|          | 387/371472 [01:53<28:46:11,  3.58it/s]
  0%|          | 388/371472 [01:53<28:22:47,  3.63it/s]
  0%|          | 389/371472 [01:53<29:26:24,  3.50it/s]
  0%|          | 390/371472 [01:53<29:35:04,  3.48it/s]
  0%|          | 391/371472 [01:54<28:18:05,  3.64it/s]
  0%|          | 392/371472 [01:54<28:15:32,  3.65it/s]
  0%|          | 393/371472 [01:54<28:43:29,  3.59it/s]
  0%|          | 394/371472 [01:54<29:31:17,  3.49it/s]
  0%|          | 395/371472 [01:55<29:06:30,  3.54it/s]
  0%|          | 396/371472 [01:55<28:25:34,  3.63it/s]
  0%|          | 397/371472 [01:55<28:04:04,  3.67it/s]
  0%|          | 398/371472 [01:56<27:11:43,  3.79it/s]
  0%|          | 399/371472 [01:56<27:39:56,  3.73it/s]
  0%|          | 400/371472 [01:56<27:00:34,  3.82it/s]
                                                       
{'loss': 6.7399, 'learning_rate': 9.995151802452109e-07, 'epoch': 0.02}

  0%|          | 400/371472 [01:56<27:00:34,  3.82it/s]
  0%|          | 401/371472 [01:56<28:47:10,  3.58it/s]
  0%|          | 402/371472 [01:57<29:10:11,  3.53it/s]
  0%|          | 403/371472 [01:57<31:02:13,  3.32it/s]
  0%|          | 404/371472 [01:57<31:17:15,  3.29it/s]
  0%|          | 405/371472 [01:58<29:52:53,  3.45it/s]
  0%|          | 406/371472 [01:58<32:01:14,  3.22it/s]
  0%|          | 407/371472 [01:58<32:29:21,  3.17it/s]
  0%|          | 408/371472 [01:59<31:14:23,  3.30it/s]
  0%|          | 409/371472 [01:59<30:39:28,  3.36it/s]
  0%|          | 410/371472 [01:59<33:09:56,  3.11it/s]
  0%|          | 411/371472 [02:00<33:47:26,  3.05it/s]
  0%|          | 412/371472 [02:00<34:01:48,  3.03it/s]
  0%|          | 413/371472 [02:00<32:58:16,  3.13it/s]
  0%|          | 414/371472 [02:00<32:02:34,  3.22it/s]
  0%|          | 415/371472 [02:01<31:14:03,  3.30it/s]
  0%|          | 416/371472 [02:01<30:07:27,  3.42it/s]
  0%|          | 417/371472 [02:01<28:56:57,  3.56it/s]
  0%|          | 418/371472 [02:02<34:37:10,  2.98it/s]
  0%|          | 419/371472 [02:02<32:38:26,  3.16it/s]
  0%|          | 420/371472 [02:02<32:42:35,  3.15it/s]
                                                       
{'loss': 6.5775, 'learning_rate': 9.994666982697322e-07, 'epoch': 0.02}

  0%|          | 420/371472 [02:02<32:42:35,  3.15it/s]
  0%|          | 421/371472 [02:03<32:00:45,  3.22it/s]
  0%|          | 422/371472 [02:03<34:33:07,  2.98it/s]
  0%|          | 423/371472 [02:03<33:17:53,  3.10it/s]
  0%|          | 424/371472 [02:04<32:51:17,  3.14it/s]
  0%|          | 425/371472 [02:04<32:14:34,  3.20it/s]
  0%|          | 426/371472 [02:04<30:51:52,  3.34it/s]
  0%|          | 427/371472 [02:04<29:43:05,  3.47it/s]
  0%|          | 428/371472 [02:05<32:45:34,  3.15it/s]
  0%|          | 429/371472 [02:05<31:36:02,  3.26it/s]
  0%|          | 430/371472 [02:05<31:15:29,  3.30it/s]
  0%|          | 431/371472 [02:06<30:40:05,  3.36it/s]
  0%|          | 432/371472 [02:06<30:51:59,  3.34it/s]
  0%|          | 433/371472 [02:06<29:48:09,  3.46it/s]
  0%|          | 434/371472 [02:07<29:29:54,  3.49it/s]
  0%|          | 435/371472 [02:07<37:51:07,  2.72it/s]
  0%|          | 436/371472 [02:07<35:04:20,  2.94it/s]
  0%|          | 437/371472 [02:08<33:43:37,  3.06it/s]
  0%|          | 438/371472 [02:08<31:55:35,  3.23it/s]
  0%|          | 439/371472 [02:08<31:00:56,  3.32it/s]
  0%|          | 440/371472 [02:08<29:25:25,  3.50it/s]
                                                       
{'loss': 6.9794, 'learning_rate': 9.994182162942532e-07, 'epoch': 0.02}

  0%|          | 440/371472 [02:08<29:25:25,  3.50it/s]
  0%|          | 441/371472 [02:09<30:15:12,  3.41it/s]
  0%|          | 442/371472 [02:09<28:33:29,  3.61it/s]
  0%|          | 443/371472 [02:09<28:46:02,  3.58it/s]
  0%|          | 444/371472 [02:10<28:09:26,  3.66it/s]
  0%|          | 445/371472 [02:10<29:59:03,  3.44it/s]
  0%|          | 446/371472 [02:10<31:48:34,  3.24it/s]
  0%|          | 447/371472 [02:11<32:56:24,  3.13it/s]
  0%|          | 448/371472 [02:11<31:53:38,  3.23it/s]
  0%|          | 449/371472 [02:11<30:50:14,  3.34it/s]
  0%|          | 450/371472 [02:11<29:49:39,  3.46it/s]
  0%|          | 451/371472 [02:12<34:04:23,  3.02it/s]
  0%|          | 452/371472 [02:12<32:10:12,  3.20it/s]
  0%|          | 453/371472 [02:12<31:40:59,  3.25it/s]
  0%|          | 454/371472 [02:13<30:15:14,  3.41it/s]
  0%|          | 455/371472 [02:13<28:50:42,  3.57it/s]
  0%|          | 456/371472 [02:13<29:50:09,  3.45it/s]
  0%|          | 457/371472 [02:14<29:24:28,  3.50it/s]
  0%|          | 458/371472 [02:14<28:41:06,  3.59it/s]
  0%|          | 459/371472 [02:14<29:00:51,  3.55it/s]
  0%|          | 460/371472 [02:14<30:03:58,  3.43it/s]
                                                       
{'loss': 6.662, 'learning_rate': 9.993697343187743e-07, 'epoch': 0.02}

  0%|          | 460/371472 [02:14<30:03:58,  3.43it/s]
  0%|          | 461/371472 [02:15<30:45:30,  3.35it/s]
  0%|          | 462/371472 [02:15<29:24:17,  3.50it/s]
  0%|          | 463/371472 [02:15<28:24:38,  3.63it/s]
  0%|          | 464/371472 [02:15<27:52:18,  3.70it/s]
  0%|          | 465/371472 [02:16<27:50:01,  3.70it/s]
  0%|          | 466/371472 [02:16<27:38:33,  3.73it/s]
  0%|          | 467/371472 [02:16<27:35:18,  3.74it/s]
  0%|          | 468/371472 [02:17<27:59:15,  3.68it/s]
  0%|          | 469/371472 [02:17<28:47:10,  3.58it/s]
  0%|          | 470/371472 [02:17<28:16:44,  3.64it/s]
  0%|          | 471/371472 [02:17<28:29:57,  3.62it/s]
  0%|          | 472/371472 [02:18<27:36:39,  3.73it/s]
  0%|          | 473/371472 [02:18<27:43:16,  3.72it/s]
  0%|          | 474/371472 [02:18<29:29:10,  3.50it/s]
  0%|          | 475/371472 [02:19<29:37:15,  3.48it/s]
  0%|          | 476/371472 [02:19<31:47:53,  3.24it/s]
  0%|          | 477/371472 [02:19<31:58:41,  3.22it/s]
  0%|          | 478/371472 [02:19<30:01:02,  3.43it/s]
  0%|          | 479/371472 [02:20<29:16:43,  3.52it/s]
  0%|          | 480/371472 [02:20<30:52:20,  3.34it/s]
                                                       
{'loss': 6.7392, 'learning_rate': 9.993212523432956e-07, 'epoch': 0.02}

  0%|          | 480/371472 [02:20<30:52:20,  3.34it/s]
  0%|          | 481/371472 [02:20<30:37:59,  3.36it/s]
  0%|          | 482/371472 [02:21<29:58:22,  3.44it/s]
  0%|          | 483/371472 [02:21<32:35:07,  3.16it/s]
  0%|          | 484/371472 [02:21<30:29:25,  3.38it/s]
  0%|          | 485/371472 [02:22<30:21:38,  3.39it/s]
  0%|          | 486/371472 [02:22<29:13:20,  3.53it/s]
  0%|          | 487/371472 [02:22<29:43:13,  3.47it/s]
  0%|          | 488/371472 [02:22<28:42:26,  3.59it/s]
  0%|          | 489/371472 [02:23<28:24:39,  3.63it/s]
  0%|          | 490/371472 [02:23<29:27:29,  3.50it/s]
  0%|          | 491/371472 [02:23<28:51:44,  3.57it/s]
  0%|          | 492/371472 [02:23<28:43:37,  3.59it/s]
  0%|          | 493/371472 [02:24<28:56:38,  3.56it/s]
  0%|          | 494/371472 [02:24<31:07:55,  3.31it/s]
  0%|          | 495/371472 [02:24<29:33:55,  3.49it/s]
  0%|          | 496/371472 [02:25<29:19:27,  3.51it/s]
  0%|          | 497/371472 [02:25<29:19:29,  3.51it/s]
  0%|          | 498/371472 [02:25<28:21:05,  3.63it/s]
  0%|          | 499/371472 [02:25<28:28:50,  3.62it/s]
  0%|          | 500/371472 [02:26<28:18:17,  3.64it/s]
                                                       
{'loss': 6.7243, 'learning_rate': 9.992727703678165e-07, 'epoch': 0.02}

  0%|          | 500/371472 [02:26<28:18:17,  3.64it/s]
  0%|          | 501/371472 [02:26<28:45:12,  3.58it/s]
  0%|          | 502/371472 [02:26<28:22:41,  3.63it/s]
  0%|          | 503/371472 [02:27<29:56:07,  3.44it/s]
  0%|          | 504/371472 [02:27<30:24:59,  3.39it/s]
  0%|          | 505/371472 [02:27<30:54:59,  3.33it/s]
  0%|          | 506/371472 [02:28<32:21:28,  3.18it/s]
  0%|          | 507/371472 [02:28<31:15:48,  3.30it/s]
  0%|          | 508/371472 [02:28<31:26:35,  3.28it/s]
  0%|          | 509/371472 [02:28<29:58:36,  3.44it/s]
  0%|          | 510/371472 [02:29<28:55:26,  3.56it/s]
  0%|          | 511/371472 [02:29<28:54:56,  3.56it/s]
  0%|          | 512/371472 [02:29<27:59:28,  3.68it/s]
  0%|          | 513/371472 [02:29<27:39:35,  3.73it/s]
  0%|          | 514/371472 [02:30<27:42:51,  3.72it/s]
  0%|          | 515/371472 [02:30<29:23:21,  3.51it/s]
  0%|          | 516/371472 [02:30<29:28:46,  3.50it/s]
  0%|          | 517/371472 [02:31<30:31:01,  3.38it/s]
  0%|          | 518/371472 [02:31<29:42:16,  3.47it/s]
  0%|          | 519/371472 [02:31<28:57:49,  3.56it/s]
  0%|          | 520/371472 [02:31<29:31:26,  3.49it/s]
                                                       
{'loss': 6.9017, 'learning_rate': 9.992242883923377e-07, 'epoch': 0.02}

  0%|          | 520/371472 [02:31<29:31:26,  3.49it/s]
  0%|          | 521/371472 [02:32<29:20:12,  3.51it/s]
  0%|          | 522/371472 [02:32<30:21:54,  3.39it/s]
  0%|          | 523/371472 [02:32<28:46:06,  3.58it/s]
  0%|          | 524/371472 [02:33<30:14:53,  3.41it/s]
  0%|          | 525/371472 [02:33<29:14:52,  3.52it/s]
  0%|          | 526/371472 [02:33<29:42:44,  3.47it/s]
  0%|          | 527/371472 [02:33<28:27:32,  3.62it/s]
  0%|          | 528/371472 [02:34<27:45:46,  3.71it/s]
  0%|          | 529/371472 [02:34<27:46:51,  3.71it/s]
  0%|          | 530/371472 [02:34<28:00:44,  3.68it/s]
  0%|          | 531/371472 [02:35<27:23:56,  3.76it/s]
  0%|          | 532/371472 [02:35<27:06:02,  3.80it/s]
  0%|          | 533/371472 [02:35<28:02:21,  3.67it/s]
  0%|          | 534/371472 [02:35<30:10:52,  3.41it/s]
  0%|          | 535/371472 [02:36<31:59:52,  3.22it/s]
  0%|          | 536/371472 [02:36<31:29:32,  3.27it/s]
  0%|          | 537/371472 [02:36<30:23:10,  3.39it/s]
  0%|          | 538/371472 [02:37<31:24:49,  3.28it/s]
  0%|          | 539/371472 [02:37<31:56:17,  3.23it/s]
  0%|          | 540/371472 [02:37<30:52:13,  3.34it/s]
                                                       
{'loss': 6.3385, 'learning_rate': 9.991758064168586e-07, 'epoch': 0.02}

  0%|          | 540/371472 [02:37<30:52:13,  3.34it/s]
  0%|          | 541/371472 [02:38<29:37:17,  3.48it/s]
  0%|          | 542/371472 [02:38<29:12:20,  3.53it/s]
  0%|          | 543/371472 [02:38<28:23:15,  3.63it/s]
  0%|          | 544/371472 [02:38<27:40:05,  3.72it/s]
  0%|          | 545/371472 [02:39<28:21:48,  3.63it/s]
  0%|          | 546/371472 [02:39<27:46:02,  3.71it/s]
  0%|          | 547/371472 [02:39<27:41:16,  3.72it/s]
  0%|          | 548/371472 [02:39<27:35:43,  3.73it/s]
  0%|          | 549/371472 [02:40<28:10:23,  3.66it/s]
  0%|          | 550/371472 [02:40<27:25:00,  3.76it/s]
  0%|          | 551/371472 [02:40<29:21:10,  3.51it/s]
  0%|          | 552/371472 [02:41<30:01:00,  3.43it/s]
  0%|          | 553/371472 [02:41<29:11:14,  3.53it/s]
  0%|          | 554/371472 [02:41<28:32:56,  3.61it/s]
  0%|          | 555/371472 [02:41<29:18:21,  3.52it/s]
  0%|          | 556/371472 [02:42<31:14:08,  3.30it/s]
  0%|          | 557/371472 [02:42<30:43:34,  3.35it/s]
  0%|          | 558/371472 [02:42<30:31:27,  3.38it/s]
  0%|          | 559/371472 [02:43<29:34:20,  3.48it/s]
  0%|          | 560/371472 [02:43<30:53:51,  3.33it/s]
                                                       
{'loss': 6.436, 'learning_rate': 9.991273244413799e-07, 'epoch': 0.02}

  0%|          | 560/371472 [02:43<30:53:51,  3.33it/s]
  0%|          | 561/371472 [02:43<30:00:29,  3.43it/s]
  0%|          | 562/371472 [02:43<28:58:49,  3.56it/s]
  0%|          | 563/371472 [02:44<28:20:39,  3.63it/s]
  0%|          | 564/371472 [02:44<27:34:41,  3.74it/s]
  0%|          | 565/371472 [02:44<29:05:41,  3.54it/s]
  0%|          | 566/371472 [02:45<28:47:33,  3.58it/s]
  0%|          | 567/371472 [02:45<28:31:43,  3.61it/s]
  0%|          | 568/371472 [02:45<28:06:52,  3.66it/s]
  0%|          | 569/371472 [02:45<29:10:35,  3.53it/s]
  0%|          | 570/371472 [02:46<28:54:07,  3.56it/s]
  0%|          | 571/371472 [02:46<28:25:01,  3.63it/s]
  0%|          | 572/371472 [02:46<28:39:11,  3.60it/s]
  0%|          | 573/371472 [02:46<28:12:38,  3.65it/s]
  0%|          | 574/371472 [02:47<30:47:14,  3.35it/s]
  0%|          | 575/371472 [02:47<30:01:34,  3.43it/s]
  0%|          | 576/371472 [02:47<30:17:16,  3.40it/s]
  0%|          | 577/371472 [02:48<34:02:23,  3.03it/s]
  0%|          | 578/371472 [02:48<31:50:22,  3.24it/s]
  0%|          | 579/371472 [02:48<32:54:14,  3.13it/s]
  0%|          | 580/371472 [02:49<31:16:53,  3.29it/s]
                                                       
{'loss': 6.7753, 'learning_rate': 9.99078842465901e-07, 'epoch': 0.02}

  0%|          | 580/371472 [02:49<31:16:53,  3.29it/s]
  0%|          | 581/371472 [02:49<30:21:32,  3.39it/s]
  0%|          | 582/371472 [02:49<29:51:15,  3.45it/s]
  0%|          | 583/371472 [02:50<32:13:59,  3.20it/s]
  0%|          | 584/371472 [02:50<30:41:16,  3.36it/s]
  0%|          | 585/371472 [02:50<30:38:30,  3.36it/s]
  0%|          | 586/371472 [02:50<29:25:33,  3.50it/s]
  0%|          | 587/371472 [02:51<28:58:38,  3.56it/s]
  0%|          | 588/371472 [02:51<28:06:10,  3.67it/s]
  0%|          | 589/371472 [02:51<27:27:23,  3.75it/s]
  0%|          | 590/371472 [02:51<27:03:58,  3.81it/s]
  0%|          | 591/371472 [02:52<28:27:20,  3.62it/s]
  0%|          | 592/371472 [02:52<28:06:14,  3.67it/s]
  0%|          | 593/371472 [02:52<30:38:22,  3.36it/s]
  0%|          | 594/371472 [02:53<29:59:06,  3.44it/s]
  0%|          | 595/371472 [02:53<29:57:11,  3.44it/s]
  0%|          | 596/371472 [02:53<33:53:09,  3.04it/s]
  0%|          | 597/371472 [02:54<32:24:39,  3.18it/s]
  0%|          | 598/371472 [02:54<32:48:24,  3.14it/s]
  0%|          | 599/371472 [02:54<32:31:34,  3.17it/s]
  0%|          | 600/371472 [02:55<31:51:28,  3.23it/s]
                                                       
{'loss': 6.2456, 'learning_rate': 9.99030360490422e-07, 'epoch': 0.03}

  0%|          | 600/371472 [02:55<31:51:28,  3.23it/s]
  0%|          | 601/371472 [02:55<30:02:57,  3.43it/s]
  0%|          | 602/371472 [02:55<29:05:49,  3.54it/s]
  0%|          | 603/371472 [02:55<28:51:28,  3.57it/s]
  0%|          | 604/371472 [02:56<31:30:04,  3.27it/s]
  0%|          | 605/371472 [02:56<33:21:53,  3.09it/s]
  0%|          | 606/371472 [02:56<32:35:49,  3.16it/s]
  0%|          | 607/371472 [02:57<30:53:48,  3.33it/s]
  0%|          | 608/371472 [02:57<30:53:51,  3.33it/s]
  0%|          | 609/371472 [02:57<30:06:57,  3.42it/s]
  0%|          | 610/371472 [02:57<29:00:08,  3.55it/s]
  0%|          | 611/371472 [02:58<29:45:19,  3.46it/s]
  0%|          | 612/371472 [02:58<28:54:43,  3.56it/s]
  0%|          | 613/371472 [02:58<28:35:27,  3.60it/s]
  0%|          | 614/371472 [02:59<28:19:26,  3.64it/s]
  0%|          | 615/371472 [02:59<28:21:59,  3.63it/s]
  0%|          | 616/371472 [02:59<28:04:04,  3.67it/s]
  0%|          | 617/371472 [02:59<30:44:16,  3.35it/s]
  0%|          | 618/371472 [03:00<30:25:41,  3.39it/s]
  0%|          | 619/371472 [03:00<29:55:13,  3.44it/s]
  0%|          | 620/371472 [03:00<29:15:38,  3.52it/s]
                                                       
{'loss': 6.6402, 'learning_rate': 9.989818785149433e-07, 'epoch': 0.03}

  0%|          | 620/371472 [03:00<29:15:38,  3.52it/s]
  0%|          | 621/371472 [03:01<29:22:28,  3.51it/s]
  0%|          | 622/371472 [03:01<28:34:55,  3.60it/s]
  0%|          | 623/371472 [03:01<28:38:54,  3.60it/s]
  0%|          | 624/371472 [03:01<28:55:49,  3.56it/s]
  0%|          | 625/371472 [03:02<28:06:32,  3.66it/s]
  0%|          | 626/371472 [03:02<27:56:58,  3.69it/s]
  0%|          | 627/371472 [03:02<29:22:56,  3.51it/s]
  0%|          | 628/371472 [03:03<29:17:38,  3.52it/s]
  0%|          | 629/371472 [03:03<29:13:20,  3.53it/s]
  0%|          | 630/371472 [03:03<27:58:51,  3.68it/s]
  0%|          | 631/371472 [03:03<28:57:46,  3.56it/s]
  0%|          | 632/371472 [03:04<30:51:36,  3.34it/s]
  0%|          | 633/371472 [03:04<29:30:43,  3.49it/s]
  0%|          | 634/371472 [03:04<28:58:57,  3.55it/s]
  0%|          | 635/371472 [03:05<28:15:51,  3.64it/s]
  0%|          | 636/371472 [03:05<29:50:25,  3.45it/s]
  0%|          | 637/371472 [03:05<29:59:23,  3.43it/s]
  0%|          | 638/371472 [03:05<30:15:48,  3.40it/s]
  0%|          | 639/371472 [03:06<30:31:48,  3.37it/s]
  0%|          | 640/371472 [03:06<29:04:05,  3.54it/s]
                                                       
{'loss': 6.3705, 'learning_rate': 9.989333965394644e-07, 'epoch': 0.03}

  0%|          | 640/371472 [03:06<29:04:05,  3.54it/s]
  0%|          | 641/371472 [03:06<28:43:22,  3.59it/s]
  0%|          | 642/371472 [03:07<28:20:29,  3.63it/s]
  0%|          | 643/371472 [03:07<29:50:54,  3.45it/s]
  0%|          | 644/371472 [03:07<28:35:42,  3.60it/s]
  0%|          | 645/371472 [03:07<28:51:55,  3.57it/s]
  0%|          | 646/371472 [03:08<28:17:49,  3.64it/s]
  0%|          | 647/371472 [03:08<29:09:05,  3.53it/s]
  0%|          | 648/371472 [03:08<30:05:15,  3.42it/s]
  0%|          | 649/371472 [03:09<28:54:51,  3.56it/s]
  0%|          | 650/371472 [03:09<30:28:26,  3.38it/s]
  0%|          | 651/371472 [03:09<30:20:31,  3.39it/s]
  0%|          | 652/371472 [03:09<32:28:05,  3.17it/s]
  0%|          | 653/371472 [03:10<32:17:45,  3.19it/s]
  0%|          | 654/371472 [03:10<30:54:42,  3.33it/s]
  0%|          | 655/371472 [03:10<29:57:53,  3.44it/s]
  0%|          | 656/371472 [03:11<29:16:33,  3.52it/s]
  0%|          | 657/371472 [03:11<30:24:38,  3.39it/s]
  0%|          | 658/371472 [03:11<29:59:10,  3.44it/s]
  0%|          | 659/371472 [03:12<30:44:04,  3.35it/s]
  0%|          | 660/371472 [03:12<31:51:33,  3.23it/s]
                                                       
{'loss': 6.1228, 'learning_rate': 9.988849145639854e-07, 'epoch': 0.03}

  0%|          | 660/371472 [03:12<31:51:33,  3.23it/s]
  0%|          | 661/371472 [03:12<32:42:40,  3.15it/s]
  0%|          | 662/371472 [03:13<34:49:23,  2.96it/s]
  0%|          | 663/371472 [03:13<33:56:41,  3.03it/s]
  0%|          | 664/371472 [03:13<33:10:37,  3.10it/s]
  0%|          | 665/371472 [03:13<31:30:34,  3.27it/s]
  0%|          | 666/371472 [03:14<30:57:36,  3.33it/s]
  0%|          | 667/371472 [03:14<31:11:57,  3.30it/s]
  0%|          | 668/371472 [03:14<29:58:47,  3.44it/s]
  0%|          | 669/371472 [03:15<28:53:02,  3.57it/s]
  0%|          | 670/371472 [03:15<28:25:43,  3.62it/s]
  0%|          | 671/371472 [03:15<28:18:50,  3.64it/s]
  0%|          | 672/371472 [03:15<28:57:06,  3.56it/s]
  0%|          | 673/371472 [03:16<28:31:45,  3.61it/s]
  0%|          | 674/371472 [03:16<28:03:16,  3.67it/s]
  0%|          | 675/371472 [03:16<27:58:11,  3.68it/s]
  0%|          | 676/371472 [03:16<27:45:31,  3.71it/s]
  0%|          | 677/371472 [03:17<30:30:25,  3.38it/s]
  0%|          | 678/371472 [03:17<30:06:00,  3.42it/s]
  0%|          | 679/371472 [03:17<28:42:35,  3.59it/s]
  0%|          | 680/371472 [03:18<28:18:42,  3.64it/s]
                                                       
{'loss': 6.377, 'learning_rate': 9.988364325885065e-07, 'epoch': 0.03}

  0%|          | 680/371472 [03:18<28:18:42,  3.64it/s]
  0%|          | 681/371472 [03:18<27:46:21,  3.71it/s]
  0%|          | 682/371472 [03:18<27:45:06,  3.71it/s]
  0%|          | 683/371472 [03:18<28:55:50,  3.56it/s]
  0%|          | 684/371472 [03:19<29:26:13,  3.50it/s]
  0%|          | 685/371472 [03:19<29:13:34,  3.52it/s]
  0%|          | 686/371472 [03:19<30:23:06,  3.39it/s]
  0%|          | 687/371472 [03:20<30:01:54,  3.43it/s]
  0%|          | 688/371472 [03:20<29:08:14,  3.53it/s]
  0%|          | 689/371472 [03:20<29:31:25,  3.49it/s]
  0%|          | 690/371472 [03:20<29:17:14,  3.52it/s]
  0%|          | 691/371472 [03:21<29:15:09,  3.52it/s]
  0%|          | 692/371472 [03:21<28:58:16,  3.56it/s]
  0%|          | 693/371472 [03:21<28:01:43,  3.67it/s]
  0%|          | 694/371472 [03:22<28:12:33,  3.65it/s]
  0%|          | 695/371472 [03:22<27:43:04,  3.72it/s]
  0%|          | 696/371472 [03:22<28:21:34,  3.63it/s]
  0%|          | 697/371472 [03:22<28:37:21,  3.60it/s]
  0%|          | 698/371472 [03:23<30:19:25,  3.40it/s]
  0%|          | 699/371472 [03:23<29:09:34,  3.53it/s]
  0%|          | 700/371472 [03:23<28:47:09,  3.58it/s]
                                                       
{'loss': 6.5323, 'learning_rate': 9.987879506130276e-07, 'epoch': 0.03}

  0%|          | 700/371472 [03:23<28:47:09,  3.58it/s]
  0%|          | 701/371472 [03:24<33:03:48,  3.11it/s]
  0%|          | 702/371472 [03:24<32:37:02,  3.16it/s]
  0%|          | 703/371472 [03:24<32:16:07,  3.19it/s]
  0%|          | 704/371472 [03:25<31:56:48,  3.22it/s]
  0%|          | 705/371472 [03:25<31:40:09,  3.25it/s]
  0%|          | 706/371472 [03:25<30:07:56,  3.42it/s]
  0%|          | 707/371472 [03:25<29:06:10,  3.54it/s]
  0%|          | 708/371472 [03:26<28:41:42,  3.59it/s]
  0%|          | 709/371472 [03:26<29:30:59,  3.49it/s]
  0%|          | 710/371472 [03:26<29:30:15,  3.49it/s]
  0%|          | 711/371472 [03:27<28:37:26,  3.60it/s]
  0%|          | 712/371472 [03:27<28:12:54,  3.65it/s]
  0%|          | 713/371472 [03:27<29:05:13,  3.54it/s]
  0%|          | 714/371472 [03:27<28:08:35,  3.66it/s]
  0%|          | 715/371472 [03:28<28:28:59,  3.62it/s]
  0%|          | 716/371472 [03:28<27:47:55,  3.70it/s]
  0%|          | 717/371472 [03:28<28:09:26,  3.66it/s]
  0%|          | 718/371472 [03:28<27:42:36,  3.72it/s]
  0%|          | 719/371472 [03:29<28:00:34,  3.68it/s]
  0%|          | 720/371472 [03:29<28:29:49,  3.61it/s]
                                                       
{'loss': 6.5611, 'learning_rate': 9.987394686375489e-07, 'epoch': 0.03}

  0%|          | 720/371472 [03:29<28:29:49,  3.61it/s]
  0%|          | 721/371472 [03:29<28:46:38,  3.58it/s]
  0%|          | 722/371472 [03:30<28:24:15,  3.63it/s]
  0%|          | 723/371472 [03:30<29:30:14,  3.49it/s]
  0%|          | 724/371472 [03:30<28:58:16,  3.55it/s]
  0%|          | 725/371472 [03:30<28:54:56,  3.56it/s]
  0%|          | 726/371472 [03:31<28:13:29,  3.65it/s]
  0%|          | 727/371472 [03:31<30:10:07,  3.41it/s]
  0%|          | 728/371472 [03:31<29:16:56,  3.52it/s]
  0%|          | 729/371472 [03:32<30:11:07,  3.41it/s]
  0%|          | 730/371472 [03:32<29:00:25,  3.55it/s]
  0%|          | 731/371472 [03:32<29:25:08,  3.50it/s]
  0%|          | 732/371472 [03:32<28:24:54,  3.62it/s]
  0%|          | 733/371472 [03:33<28:19:43,  3.64it/s]
  0%|          | 734/371472 [03:33<28:06:05,  3.66it/s]
  0%|          | 735/371472 [03:33<27:54:21,  3.69it/s]
  0%|          | 736/371472 [03:34<29:49:24,  3.45it/s]
  0%|          | 737/371472 [03:34<31:16:15,  3.29it/s]
  0%|          | 738/371472 [03:34<30:17:17,  3.40it/s]
  0%|          | 739/371472 [03:34<30:22:43,  3.39it/s]
  0%|          | 740/371472 [03:35<32:59:03,  3.12it/s]
                                                       
{'loss': 6.5353, 'learning_rate': 9.986909866620697e-07, 'epoch': 0.03}

  0%|          | 740/371472 [03:35<32:59:03,  3.12it/s]
  0%|          | 741/371472 [03:35<31:16:05,  3.29it/s]
  0%|          | 742/371472 [03:35<31:19:16,  3.29it/s]
  0%|          | 743/371472 [03:36<31:40:05,  3.25it/s]
  0%|          | 744/371472 [03:36<30:51:29,  3.34it/s]
  0%|          | 745/371472 [03:36<31:00:24,  3.32it/s]
  0%|          | 746/371472 [03:37<29:51:29,  3.45it/s]
  0%|          | 747/371472 [03:37<31:36:46,  3.26it/s]
  0%|          | 748/371472 [03:37<30:42:34,  3.35it/s]
  0%|          | 749/371472 [03:37<29:21:54,  3.51it/s]
  0%|          | 750/371472 [03:38<28:50:47,  3.57it/s]
  0%|          | 751/371472 [03:38<29:36:30,  3.48it/s]
  0%|          | 752/371472 [03:38<29:45:29,  3.46it/s]
  0%|          | 753/371472 [03:39<29:36:26,  3.48it/s]
  0%|          | 754/371472 [03:39<28:32:54,  3.61it/s]
  0%|          | 755/371472 [03:39<28:04:41,  3.67it/s]
  0%|          | 756/371472 [03:39<27:34:38,  3.73it/s]
  0%|          | 757/371472 [03:40<28:32:36,  3.61it/s]
  0%|          | 758/371472 [03:40<29:32:53,  3.49it/s]
  0%|          | 759/371472 [03:40<28:46:08,  3.58it/s]
  0%|          | 760/371472 [03:41<29:01:21,  3.55it/s]
                                                       
{'loss': 6.5194, 'learning_rate': 9.98642504686591e-07, 'epoch': 0.03}

  0%|          | 760/371472 [03:41<29:01:21,  3.55it/s]
  0%|          | 761/371472 [03:41<32:12:35,  3.20it/s]
  0%|          | 762/371472 [03:41<30:30:17,  3.38it/s]
  0%|          | 763/371472 [03:41<29:38:55,  3.47it/s]
  0%|          | 764/371472 [03:42<28:55:51,  3.56it/s]
  0%|          | 765/371472 [03:42<29:26:01,  3.50it/s]
  0%|          | 766/371472 [03:42<28:41:02,  3.59it/s]
  0%|          | 767/371472 [03:43<28:46:55,  3.58it/s]
  0%|          | 768/371472 [03:43<28:51:10,  3.57it/s]
  0%|          | 769/371472 [03:43<28:02:29,  3.67it/s]
  0%|          | 770/371472 [03:43<29:07:29,  3.54it/s]
  0%|          | 771/371472 [03:44<31:05:34,  3.31it/s]
  0%|          | 772/371472 [03:44<31:10:29,  3.30it/s]
  0%|          | 773/371472 [03:44<30:29:13,  3.38it/s]
  0%|          | 774/371472 [03:45<31:09:16,  3.31it/s]
  0%|          | 775/371472 [03:45<30:57:44,  3.33it/s]
  0%|          | 776/371472 [03:45<30:43:05,  3.35it/s]
  0%|          | 777/371472 [03:45<29:57:08,  3.44it/s]
  0%|          | 778/371472 [03:46<29:14:51,  3.52it/s]
  0%|          | 779/371472 [03:46<30:18:16,  3.40it/s]
  0%|          | 780/371472 [03:46<29:46:04,  3.46it/s]
                                                       
{'loss': 6.4292, 'learning_rate': 9.985940227111119e-07, 'epoch': 0.03}

  0%|          | 780/371472 [03:46<29:46:04,  3.46it/s]
  0%|          | 781/371472 [03:47<28:36:48,  3.60it/s]
  0%|          | 782/371472 [03:47<29:23:21,  3.50it/s]
  0%|          | 783/371472 [03:47<31:32:41,  3.26it/s]
  0%|          | 784/371472 [03:48<30:45:22,  3.35it/s]
  0%|          | 785/371472 [03:48<31:44:25,  3.24it/s]
  0%|          | 786/371472 [03:48<32:44:57,  3.14it/s]
  0%|          | 787/371472 [03:49<33:35:35,  3.07it/s]
  0%|          | 788/371472 [03:49<31:22:46,  3.28it/s]
  0%|          | 789/371472 [03:49<29:38:33,  3.47it/s]
  0%|          | 790/371472 [03:49<29:04:51,  3.54it/s]
  0%|          | 791/371472 [03:50<28:58:56,  3.55it/s]
  0%|          | 792/371472 [03:50<29:56:14,  3.44it/s]
  0%|          | 793/371472 [03:50<30:09:46,  3.41it/s]
  0%|          | 794/371472 [03:50<29:41:22,  3.47it/s]
  0%|          | 795/371472 [03:51<30:03:36,  3.43it/s]
  0%|          | 796/371472 [03:51<31:12:01,  3.30it/s]
  0%|          | 797/371472 [03:51<31:04:18,  3.31it/s]
  0%|          | 798/371472 [03:52<31:00:16,  3.32it/s]
  0%|          | 799/371472 [03:52<29:11:10,  3.53it/s]
  0%|          | 800/371472 [03:52<29:41:35,  3.47it/s]
                                                       
{'loss': 6.311, 'learning_rate': 9.985455407356332e-07, 'epoch': 0.03}

  0%|          | 800/371472 [03:52<29:41:35,  3.47it/s]
  0%|          | 801/371472 [03:53<29:32:58,  3.48it/s]
  0%|          | 802/371472 [03:53<29:26:45,  3.50it/s]
  0%|          | 803/371472 [03:53<30:00:49,  3.43it/s]
  0%|          | 804/371472 [03:53<29:55:15,  3.44it/s]
  0%|          | 805/371472 [03:54<30:45:10,  3.35it/s]
  0%|          | 806/371472 [03:54<30:09:44,  3.41it/s]
  0%|          | 807/371472 [03:54<30:04:52,  3.42it/s]
  0%|          | 808/371472 [03:55<29:54:25,  3.44it/s]
  0%|          | 809/371472 [03:55<29:42:10,  3.47it/s]
  0%|          | 810/371472 [03:55<28:58:48,  3.55it/s]
  0%|          | 811/371472 [03:55<30:01:35,  3.43it/s]
  0%|          | 812/371472 [03:56<29:28:33,  3.49it/s]
  0%|          | 813/371472 [03:56<29:34:53,  3.48it/s]
  0%|          | 814/371472 [03:56<28:59:41,  3.55it/s]
  0%|          | 815/371472 [03:57<30:56:13,  3.33it/s]
  0%|          | 816/371472 [03:57<29:25:41,  3.50it/s]
  0%|          | 817/371472 [03:57<32:04:09,  3.21it/s]
  0%|          | 818/371472 [03:58<30:23:52,  3.39it/s]
  0%|          | 819/371472 [03:58<29:46:37,  3.46it/s]
  0%|          | 820/371472 [03:58<29:01:17,  3.55it/s]
                                                       
{'loss': 6.4556, 'learning_rate': 9.984970587601542e-07, 'epoch': 0.04}

  0%|          | 820/371472 [03:58<29:01:17,  3.55it/s]
  0%|          | 821/371472 [03:58<28:18:28,  3.64it/s]
  0%|          | 822/371472 [03:59<27:30:25,  3.74it/s]
  0%|          | 823/371472 [03:59<28:22:41,  3.63it/s]
  0%|          | 824/371472 [03:59<28:28:41,  3.62it/s]
  0%|          | 825/371472 [03:59<28:17:31,  3.64it/s]
  0%|          | 826/371472 [04:00<29:44:55,  3.46it/s]
  0%|          | 827/371472 [04:00<29:22:27,  3.51it/s]
  0%|          | 828/371472 [04:00<29:26:53,  3.50it/s]
  0%|          | 829/371472 [04:01<29:14:47,  3.52it/s]
  0%|          | 830/371472 [04:01<29:03:34,  3.54it/s]
  0%|          | 831/371472 [04:01<31:53:52,  3.23it/s]
  0%|          | 832/371472 [04:01<30:34:13,  3.37it/s]
  0%|          | 833/371472 [04:02<30:04:52,  3.42it/s]
  0%|          | 834/371472 [04:02<29:00:46,  3.55it/s]
  0%|          | 835/371472 [04:02<33:06:58,  3.11it/s]
  0%|          | 836/371472 [04:03<31:45:53,  3.24it/s]
  0%|          | 837/371472 [04:03<30:12:07,  3.41it/s]
  0%|          | 838/371472 [04:03<28:54:44,  3.56it/s]
  0%|          | 839/371472 [04:04<30:28:06,  3.38it/s]
  0%|          | 840/371472 [04:04<29:12:56,  3.52it/s]
                                                       
{'loss': 6.3878, 'learning_rate': 9.984485767846753e-07, 'epoch': 0.04}

  0%|          | 840/371472 [04:04<29:12:56,  3.52it/s]
  0%|          | 841/371472 [04:04<29:04:11,  3.54it/s]
  0%|          | 842/371472 [04:04<28:58:10,  3.55it/s]
  0%|          | 843/371472 [04:05<32:37:37,  3.16it/s]
  0%|          | 844/371472 [04:05<30:58:25,  3.32it/s]
  0%|          | 845/371472 [04:05<29:39:26,  3.47it/s]
  0%|          | 846/371472 [04:06<32:20:41,  3.18it/s]
  0%|          | 847/371472 [04:06<30:20:24,  3.39it/s]
  0%|          | 848/371472 [04:06<29:57:21,  3.44it/s]
  0%|          | 849/371472 [04:06<28:46:13,  3.58it/s]
  0%|          | 850/371472 [04:07<27:57:48,  3.68it/s]
  0%|          | 851/371472 [04:07<27:25:32,  3.75it/s]
  0%|          | 852/371472 [04:07<27:29:44,  3.74it/s]
  0%|          | 853/371472 [04:07<26:51:23,  3.83it/s]
  0%|          | 854/371472 [04:08<28:26:10,  3.62it/s]
  0%|          | 855/371472 [04:08<31:33:11,  3.26it/s]
  0%|          | 856/371472 [04:09<33:12:06,  3.10it/s]
  0%|          | 857/371472 [04:09<31:50:26,  3.23it/s]
  0%|          | 858/371472 [04:09<29:33:27,  3.48it/s]
  0%|          | 859/371472 [04:09<28:15:53,  3.64it/s]
  0%|          | 860/371472 [04:10<27:58:09,  3.68it/s]
                                                       
{'loss': 6.2106, 'learning_rate': 9.984000948091966e-07, 'epoch': 0.04}

  0%|          | 860/371472 [04:10<27:58:09,  3.68it/s]
  0%|          | 861/371472 [04:10<28:13:01,  3.65it/s]
  0%|          | 862/371472 [04:10<27:32:29,  3.74it/s]
  0%|          | 863/371472 [04:10<28:00:48,  3.67it/s]
  0%|          | 864/371472 [04:11<27:19:22,  3.77it/s]
  0%|          | 865/371472 [04:11<29:26:34,  3.50it/s]
  0%|          | 866/371472 [04:11<30:07:47,  3.42it/s]
  0%|          | 867/371472 [04:12<29:40:52,  3.47it/s]
  0%|          | 868/371472 [04:12<29:54:46,  3.44it/s]
  0%|          | 869/371472 [04:12<28:44:50,  3.58it/s]
  0%|          | 870/371472 [04:12<27:54:02,  3.69it/s]
  0%|          | 871/371472 [04:13<30:28:34,  3.38it/s]
  0%|          | 872/371472 [04:13<31:53:25,  3.23it/s]
  0%|          | 873/371472 [04:13<31:00:08,  3.32it/s]
  0%|          | 874/371472 [04:14<33:43:51,  3.05it/s]
  0%|          | 875/371472 [04:14<33:42:06,  3.05it/s]
  0%|          | 876/371472 [04:14<34:11:23,  3.01it/s]
  0%|          | 877/371472 [04:15<32:44:25,  3.14it/s]
  0%|          | 878/371472 [04:15<31:58:44,  3.22it/s]
  0%|          | 879/371472 [04:15<31:13:48,  3.30it/s]
  0%|          | 880/371472 [04:16<30:07:53,  3.42it/s]
                                                       
{'loss': 6.4038, 'learning_rate': 9.983516128337174e-07, 'epoch': 0.04}

  0%|          | 880/371472 [04:16<30:07:53,  3.42it/s]
  0%|          | 881/371472 [04:16<28:45:03,  3.58it/s]
  0%|          | 882/371472 [04:16<28:28:45,  3.61it/s]
  0%|          | 883/371472 [04:16<31:33:31,  3.26it/s]
  0%|          | 884/371472 [04:17<30:21:10,  3.39it/s]
  0%|          | 885/371472 [04:17<29:23:45,  3.50it/s]
  0%|          | 886/371472 [04:17<30:02:17,  3.43it/s]
  0%|          | 887/371472 [04:18<30:15:24,  3.40it/s]
  0%|          | 888/371472 [04:18<30:51:45,  3.34it/s]
  0%|          | 889/371472 [04:18<29:45:25,  3.46it/s]
  0%|          | 890/371472 [04:18<29:50:55,  3.45it/s]
  0%|          | 891/371472 [04:19<29:14:50,  3.52it/s]
  0%|          | 892/371472 [04:19<28:57:27,  3.55it/s]
  0%|          | 893/371472 [04:19<29:48:51,  3.45it/s]
  0%|          | 894/371472 [04:20<32:23:06,  3.18it/s]
  0%|          | 895/371472 [04:20<32:04:55,  3.21it/s]
  0%|          | 896/371472 [04:20<35:04:11,  2.94it/s]
  0%|          | 897/371472 [04:21<33:36:13,  3.06it/s]
  0%|          | 898/371472 [04:21<32:06:26,  3.21it/s]
  0%|          | 899/371472 [04:21<31:45:53,  3.24it/s]
  0%|          | 900/371472 [04:22<31:52:06,  3.23it/s]
                                                       
{'loss': 6.554, 'learning_rate': 9.983031308582387e-07, 'epoch': 0.04}

  0%|          | 900/371472 [04:22<31:52:06,  3.23it/s]
  0%|          | 901/371472 [04:22<32:08:34,  3.20it/s]
  0%|          | 902/371472 [04:22<30:19:22,  3.39it/s]
  0%|          | 903/371472 [04:22<30:59:24,  3.32it/s]
  0%|          | 904/371472 [04:23<29:59:40,  3.43it/s]
  0%|          | 905/371472 [04:23<30:18:23,  3.40it/s]
  0%|          | 906/371472 [04:23<31:43:49,  3.24it/s]
  0%|          | 907/371472 [04:24<30:06:47,  3.42it/s]
  0%|          | 908/371472 [04:24<29:07:01,  3.54it/s]
  0%|          | 909/371472 [04:24<28:47:17,  3.58it/s]
  0%|          | 910/371472 [04:24<30:51:04,  3.34it/s]
  0%|          | 911/371472 [04:25<29:54:12,  3.44it/s]
  0%|          | 912/371472 [04:25<29:02:58,  3.54it/s]
  0%|          | 913/371472 [04:25<27:40:37,  3.72it/s]
  0%|          | 914/371472 [04:25<27:17:37,  3.77it/s]
  0%|          | 915/371472 [04:26<28:07:48,  3.66it/s]
  0%|          | 916/371472 [04:26<27:42:20,  3.72it/s]
  0%|          | 917/371472 [04:26<27:23:36,  3.76it/s]
  0%|          | 918/371472 [04:27<28:07:23,  3.66it/s]
  0%|          | 919/371472 [04:27<27:36:01,  3.73it/s]
  0%|          | 920/371472 [04:27<30:15:17,  3.40it/s]
                                                       
{'loss': 6.5065, 'learning_rate': 9.982546488827596e-07, 'epoch': 0.04}

  0%|          | 920/371472 [04:27<30:15:17,  3.40it/s]
  0%|          | 921/371472 [04:28<33:05:49,  3.11it/s]
  0%|          | 922/371472 [04:28<31:17:26,  3.29it/s]
  0%|          | 923/371472 [04:28<30:14:47,  3.40it/s]
  0%|          | 924/371472 [04:28<30:19:09,  3.39it/s]
  0%|          | 925/371472 [04:29<29:44:03,  3.46it/s]
  0%|          | 926/371472 [04:29<29:52:58,  3.44it/s]
  0%|          | 927/371472 [04:29<31:27:05,  3.27it/s]
  0%|          | 928/371472 [04:30<32:58:25,  3.12it/s]
  0%|          | 929/371472 [04:30<32:29:53,  3.17it/s]
  0%|          | 930/371472 [04:30<31:01:35,  3.32it/s]
  0%|          | 931/371472 [04:31<31:45:12,  3.24it/s]
  0%|          | 932/371472 [04:31<30:01:54,  3.43it/s]
  0%|          | 933/371472 [04:31<29:44:45,  3.46it/s]
  0%|          | 934/371472 [04:31<29:05:25,  3.54it/s]
  0%|          | 935/371472 [04:32<28:56:06,  3.56it/s]
  0%|          | 936/371472 [04:32<28:55:39,  3.56it/s]
  0%|          | 937/371472 [04:32<31:35:04,  3.26it/s]
  0%|          | 938/371472 [04:33<30:14:00,  3.40it/s]
  0%|          | 939/371472 [04:33<32:36:20,  3.16it/s]
  0%|          | 940/371472 [04:33<31:21:17,  3.28it/s]
                                                       
{'loss': 6.2372, 'learning_rate': 9.982061669072809e-07, 'epoch': 0.04}

  0%|          | 940/371472 [04:33<31:21:17,  3.28it/s]
  0%|          | 941/371472 [04:33<29:38:09,  3.47it/s]
  0%|          | 942/371472 [04:34<30:53:46,  3.33it/s]
  0%|          | 943/371472 [04:34<29:46:21,  3.46it/s]
  0%|          | 944/371472 [04:34<28:43:13,  3.58it/s]
  0%|          | 945/371472 [04:35<28:32:27,  3.61it/s]
  0%|          | 946/371472 [04:35<28:28:31,  3.61it/s]
  0%|          | 947/371472 [04:35<29:22:20,  3.50it/s]
  0%|          | 948/371472 [04:35<28:35:36,  3.60it/s]
  0%|          | 949/371472 [04:36<29:14:40,  3.52it/s]
  0%|          | 950/371472 [04:36<30:03:10,  3.42it/s]
  0%|          | 951/371472 [04:36<28:56:58,  3.56it/s]
  0%|          | 952/371472 [04:37<31:24:31,  3.28it/s]
  0%|          | 953/371472 [04:37<30:36:10,  3.36it/s]
  0%|          | 954/371472 [04:37<29:39:16,  3.47it/s]
  0%|          | 955/371472 [04:38<30:03:37,  3.42it/s]
  0%|          | 956/371472 [04:38<29:08:50,  3.53it/s]
  0%|          | 957/371472 [04:38<28:23:53,  3.62it/s]
  0%|          | 958/371472 [04:38<28:01:04,  3.67it/s]
  0%|          | 959/371472 [04:39<27:09:52,  3.79it/s]
  0%|          | 960/371472 [04:39<27:48:28,  3.70it/s]
                                                       
{'loss': 6.6843, 'learning_rate': 9.98157684931802e-07, 'epoch': 0.04}

  0%|          | 960/371472 [04:39<27:48:28,  3.70it/s]
  0%|          | 961/371472 [04:39<28:39:56,  3.59it/s]
  0%|          | 962/371472 [04:39<31:34:15,  3.26it/s]
  0%|          | 963/371472 [04:40<30:06:13,  3.42it/s]
  0%|          | 964/371472 [04:40<29:36:10,  3.48it/s]
  0%|          | 965/371472 [04:40<29:40:13,  3.47it/s]
  0%|          | 966/371472 [04:41<28:24:54,  3.62it/s]
  0%|          | 967/371472 [04:41<29:13:03,  3.52it/s]
  0%|          | 968/371472 [04:41<30:28:27,  3.38it/s]
  0%|          | 969/371472 [04:42<31:20:48,  3.28it/s]
  0%|          | 970/371472 [04:42<32:04:53,  3.21it/s]
  0%|          | 971/371472 [04:42<30:42:27,  3.35it/s]
  0%|          | 972/371472 [04:43<33:57:22,  3.03it/s]
  0%|          | 973/371472 [04:43<32:54:29,  3.13it/s]
  0%|          | 974/371472 [04:43<30:58:27,  3.32it/s]
  0%|          | 975/371472 [04:43<30:48:29,  3.34it/s]
  0%|          | 976/371472 [04:44<29:23:56,  3.50it/s]
  0%|          | 977/371472 [04:44<28:33:14,  3.60it/s]
  0%|          | 978/371472 [04:44<30:14:08,  3.40it/s]
  0%|          | 979/371472 [04:44<29:48:22,  3.45it/s]
  0%|          | 980/371472 [04:45<29:37:35,  3.47it/s]
                                                       
{'loss': 6.3941, 'learning_rate': 9.98109202956323e-07, 'epoch': 0.04}

  0%|          | 980/371472 [04:45<29:37:35,  3.47it/s]
  0%|          | 981/371472 [04:45<29:24:34,  3.50it/s]
  0%|          | 982/371472 [04:45<31:29:37,  3.27it/s]
  0%|          | 983/371472 [04:46<30:14:58,  3.40it/s]
  0%|          | 984/371472 [04:46<32:15:02,  3.19it/s]
  0%|          | 985/371472 [04:46<31:47:18,  3.24it/s]
  0%|          | 986/371472 [04:47<30:31:28,  3.37it/s]
  0%|          | 987/371472 [04:47<29:13:05,  3.52it/s]
  0%|          | 988/371472 [04:47<28:25:15,  3.62it/s]
  0%|          | 989/371472 [04:47<29:22:14,  3.50it/s]
  0%|          | 990/371472 [04:48<29:23:37,  3.50it/s]
  0%|          | 991/371472 [04:48<29:07:41,  3.53it/s]
  0%|          | 992/371472 [04:48<29:23:40,  3.50it/s]
  0%|          | 993/371472 [04:49<29:16:00,  3.52it/s]
  0%|          | 994/371472 [04:49<28:27:49,  3.62it/s]
  0%|          | 995/371472 [04:49<30:12:41,  3.41it/s]
  0%|          | 996/371472 [04:49<29:39:42,  3.47it/s]
  0%|          | 997/371472 [04:50<28:44:38,  3.58it/s]
  0%|          | 998/371472 [04:50<29:07:13,  3.53it/s]
  0%|          | 999/371472 [04:50<30:10:45,  3.41it/s]
  0%|          | 1000/371472 [04:51<30:27:45,  3.38it/s]
                                                        
{'loss': 6.0508, 'learning_rate': 9.980607209808443e-07, 'epoch': 0.04}

  0%|          | 1000/371472 [04:51<30:27:45,  3.38it/s]
  0%|          | 1001/371472 [04:51<31:05:32,  3.31it/s]
  0%|          | 1002/371472 [04:51<31:00:20,  3.32it/s]
  0%|          | 1003/371472 [04:51<30:24:35,  3.38it/s]
  0%|          | 1004/371472 [04:52<31:25:39,  3.27it/s]
  0%|          | 1005/371472 [04:52<32:19:26,  3.18it/s]
  0%|          | 1006/371472 [04:52<31:07:40,  3.31it/s]
  0%|          | 1007/371472 [04:53<29:56:13,  3.44it/s]
  0%|          | 1008/371472 [04:53<29:19:55,  3.51it/s]
  0%|          | 1009/371472 [04:53<29:48:03,  3.45it/s]
  0%|          | 1010/371472 [04:54<29:17:31,  3.51it/s]
  0%|          | 1011/371472 [04:54<30:08:56,  3.41it/s]
  0%|          | 1012/371472 [04:54<29:40:42,  3.47it/s]
  0%|          | 1013/371472 [04:54<30:10:04,  3.41it/s]
  0%|          | 1014/371472 [04:55<29:15:30,  3.52it/s]
  0%|          | 1015/371472 [04:55<29:16:34,  3.51it/s]
  0%|          | 1016/371472 [04:55<28:34:42,  3.60it/s]
  0%|          | 1017/371472 [04:55<28:07:10,  3.66it/s]
  0%|          | 1018/371472 [04:56<27:37:19,  3.73it/s]
  0%|          | 1019/371472 [04:56<27:35:09,  3.73it/s]
  0%|          | 1020/371472 [04:56<28:00:07,  3.67it/s]
                                                        
{'loss': 6.1723, 'learning_rate': 9.980122390053654e-07, 'epoch': 0.04}

  0%|          | 1020/371472 [04:56<28:00:07,  3.67it/s]
  0%|          | 1021/371472 [04:57<27:31:52,  3.74it/s]
  0%|          | 1022/371472 [04:57<29:06:09,  3.54it/s]
  0%|          | 1023/371472 [04:57<30:32:28,  3.37it/s]
  0%|          | 1024/371472 [04:57<29:30:32,  3.49it/s]
  0%|          | 1025/371472 [04:58<28:34:01,  3.60it/s]
  0%|          | 1026/371472 [04:58<27:38:11,  3.72it/s]
  0%|          | 1027/371472 [04:58<26:58:03,  3.82it/s]
  0%|          | 1028/371472 [04:59<28:46:19,  3.58it/s]
  0%|          | 1029/371472 [04:59<28:57:06,  3.55it/s]
  0%|          | 1030/371472 [04:59<31:17:09,  3.29it/s]
  0%|          | 1031/371472 [04:59<29:55:19,  3.44it/s]
  0%|          | 1032/371472 [05:00<28:31:26,  3.61it/s]
  0%|          | 1033/371472 [05:00<28:02:33,  3.67it/s]
  0%|          | 1034/371472 [05:00<28:57:11,  3.55it/s]
  0%|          | 1035/371472 [05:01<28:57:17,  3.55it/s]
  0%|          | 1036/371472 [05:01<27:52:22,  3.69it/s]
  0%|          | 1037/371472 [05:01<27:51:09,  3.69it/s]
  0%|          | 1038/371472 [05:01<27:34:10,  3.73it/s]
  0%|          | 1039/371472 [05:02<28:16:04,  3.64it/s]
  0%|          | 1040/371472 [05:02<29:34:37,  3.48it/s]
                                                        
{'loss': 6.5495, 'learning_rate': 9.979637570298864e-07, 'epoch': 0.04}

  0%|          | 1040/371472 [05:02<29:34:37,  3.48it/s]
  0%|          | 1041/371472 [05:02<33:12:52,  3.10it/s]
  0%|          | 1042/371472 [05:03<32:37:32,  3.15it/s]
  0%|          | 1043/371472 [05:03<32:53:07,  3.13it/s]
  0%|          | 1044/371472 [05:03<31:18:19,  3.29it/s]
  0%|          | 1045/371472 [05:04<30:49:50,  3.34it/s]
  0%|          | 1046/371472 [05:04<30:27:12,  3.38it/s]
  0%|          | 1047/371472 [05:04<29:36:59,  3.47it/s]
  0%|          | 1048/371472 [05:04<28:38:21,  3.59it/s]
  0%|          | 1049/371472 [05:05<28:16:52,  3.64it/s]
  0%|          | 1050/371472 [05:05<27:34:45,  3.73it/s]
  0%|          | 1051/371472 [05:05<27:12:07,  3.78it/s]
  0%|          | 1052/371472 [05:05<27:09:53,  3.79it/s]
  0%|          | 1053/371472 [05:06<27:32:30,  3.74it/s]
  0%|          | 1054/371472 [05:06<27:03:40,  3.80it/s]
  0%|          | 1055/371472 [05:06<27:11:22,  3.78it/s]
  0%|          | 1056/371472 [05:06<26:53:20,  3.83it/s]
  0%|          | 1057/371472 [05:07<27:37:05,  3.73it/s]
  0%|          | 1058/371472 [05:07<29:20:49,  3.51it/s]
  0%|          | 1059/371472 [05:07<28:35:08,  3.60it/s]
  0%|          | 1060/371472 [05:08<28:59:05,  3.55it/s]
                                                        
{'loss': 6.4215, 'learning_rate': 9.979152750544075e-07, 'epoch': 0.05}

  0%|          | 1060/371472 [05:08<28:59:05,  3.55it/s]
  0%|          | 1061/371472 [05:08<28:20:04,  3.63it/s]
  0%|          | 1062/371472 [05:08<31:00:30,  3.32it/s]
  0%|          | 1063/371472 [05:08<29:48:20,  3.45it/s]
  0%|          | 1064/371472 [05:09<28:21:32,  3.63it/s]
  0%|          | 1065/371472 [05:09<31:36:55,  3.25it/s]
  0%|          | 1066/371472 [05:09<30:52:55,  3.33it/s]
  0%|          | 1067/371472 [05:10<29:51:32,  3.45it/s]
  0%|          | 1068/371472 [05:10<29:13:30,  3.52it/s]
  0%|          | 1069/371472 [05:10<30:13:40,  3.40it/s]
  0%|          | 1070/371472 [05:10<29:23:38,  3.50it/s]
  0%|          | 1071/371472 [05:11<28:46:39,  3.58it/s]
  0%|          | 1072/371472 [05:11<29:38:39,  3.47it/s]
  0%|          | 1073/371472 [05:11<29:18:29,  3.51it/s]
  0%|          | 1074/371472 [05:12<29:27:55,  3.49it/s]
  0%|          | 1075/371472 [05:12<29:56:27,  3.44it/s]
  0%|          | 1076/371472 [05:12<30:30:38,  3.37it/s]
  0%|          | 1077/371472 [05:12<28:48:55,  3.57it/s]
  0%|          | 1078/371472 [05:13<28:11:42,  3.65it/s]
  0%|          | 1079/371472 [05:13<28:14:20,  3.64it/s]
  0%|          | 1080/371472 [05:13<30:16:03,  3.40it/s]
                                                        
{'loss': 6.2316, 'learning_rate': 9.978667930789286e-07, 'epoch': 0.05}

  0%|          | 1080/371472 [05:13<30:16:03,  3.40it/s]
  0%|          | 1081/371472 [05:14<35:31:08,  2.90it/s]
  0%|          | 1082/371472 [05:14<33:50:25,  3.04it/s]
  0%|          | 1083/371472 [05:14<35:00:17,  2.94it/s]
  0%|          | 1084/371472 [05:15<32:53:26,  3.13it/s]
  0%|          | 1085/371472 [05:15<31:30:10,  3.27it/s]
  0%|          | 1086/371472 [05:15<30:04:29,  3.42it/s]
  0%|          | 1087/371472 [05:16<29:07:11,  3.53it/s]
  0%|          | 1088/371472 [05:16<29:09:09,  3.53it/s]
  0%|          | 1089/371472 [05:16<30:08:00,  3.41it/s]
  0%|          | 1090/371472 [05:16<30:12:14,  3.41it/s]
  0%|          | 1091/371472 [05:17<29:09:51,  3.53it/s]
  0%|          | 1092/371472 [05:17<28:35:55,  3.60it/s]
  0%|          | 1093/371472 [05:17<29:43:45,  3.46it/s]
  0%|          | 1094/371472 [05:18<30:43:41,  3.35it/s]
  0%|          | 1095/371472 [05:18<30:04:29,  3.42it/s]
  0%|          | 1096/371472 [05:18<30:08:41,  3.41it/s]
  0%|          | 1097/371472 [05:18<28:52:06,  3.56it/s]
  0%|          | 1098/371472 [05:19<28:43:21,  3.58it/s]
  0%|          | 1099/371472 [05:19<27:53:52,  3.69it/s]
  0%|          | 1100/371472 [05:19<28:20:41,  3.63it/s]
                                                        
{'loss': 6.291, 'learning_rate': 9.978183111034499e-07, 'epoch': 0.05}

  0%|          | 1100/371472 [05:19<28:20:41,  3.63it/s]
  0%|          | 1101/371472 [05:20<28:07:14,  3.66it/s]
  0%|          | 1102/371472 [05:20<27:52:31,  3.69it/s]
  0%|          | 1103/371472 [05:20<27:51:03,  3.69it/s]
  0%|          | 1104/371472 [05:20<31:24:24,  3.28it/s]
  0%|          | 1105/371472 [05:21<31:03:51,  3.31it/s]
  0%|          | 1106/371472 [05:21<29:29:27,  3.49it/s]
  0%|          | 1107/371472 [05:21<31:23:00,  3.28it/s]
  0%|          | 1108/371472 [05:22<29:51:52,  3.44it/s]
  0%|          | 1109/371472 [05:22<29:12:09,  3.52it/s]
  0%|          | 1110/371472 [05:22<28:23:31,  3.62it/s]
  0%|          | 1111/371472 [05:22<28:52:41,  3.56it/s]
  0%|          | 1112/371472 [05:23<28:19:01,  3.63it/s]
  0%|          | 1113/371472 [05:23<28:20:12,  3.63it/s]
  0%|          | 1114/371472 [05:23<28:43:21,  3.58it/s]
  0%|          | 1115/371472 [05:24<29:12:19,  3.52it/s]
  0%|          | 1116/371472 [05:24<30:19:19,  3.39it/s]
  0%|          | 1117/371472 [05:24<29:36:24,  3.47it/s]
  0%|          | 1118/371472 [05:24<28:42:40,  3.58it/s]
  0%|          | 1119/371472 [05:25<28:08:53,  3.65it/s]
  0%|          | 1120/371472 [05:25<28:34:03,  3.60it/s]
                                                        
{'loss': 6.2892, 'learning_rate': 9.977698291279707e-07, 'epoch': 0.05}

  0%|          | 1120/371472 [05:25<28:34:03,  3.60it/s]
  0%|          | 1121/371472 [05:25<28:38:34,  3.59it/s]
  0%|          | 1122/371472 [05:25<28:32:47,  3.60it/s]
  0%|          | 1123/371472 [05:26<28:43:27,  3.58it/s]
  0%|          | 1124/371472 [05:26<28:12:51,  3.65it/s]
  0%|          | 1125/371472 [05:26<27:59:08,  3.68it/s]
  0%|          | 1126/371472 [05:27<30:28:51,  3.38it/s]
  0%|          | 1127/371472 [05:27<29:19:10,  3.51it/s]
  0%|          | 1128/371472 [05:27<28:57:54,  3.55it/s]
  0%|          | 1129/371472 [05:27<29:30:06,  3.49it/s]
  0%|          | 1130/371472 [05:28<31:05:17,  3.31it/s]
  0%|          | 1131/371472 [05:28<30:18:46,  3.39it/s]
  0%|          | 1132/371472 [05:28<29:18:51,  3.51it/s]
  0%|          | 1133/371472 [05:29<28:06:25,  3.66it/s]
  0%|          | 1134/371472 [05:29<28:18:08,  3.63it/s]
  0%|          | 1135/371472 [05:29<27:41:01,  3.72it/s]
  0%|          | 1136/371472 [05:29<29:50:39,  3.45it/s]
  0%|          | 1137/371472 [05:30<29:27:03,  3.49it/s]
  0%|          | 1138/371472 [05:30<29:12:50,  3.52it/s]
  0%|          | 1139/371472 [05:30<28:39:17,  3.59it/s]
  0%|          | 1140/371472 [05:31<28:10:46,  3.65it/s]
                                                        
{'loss': 6.1592, 'learning_rate': 9.97721347152492e-07, 'epoch': 0.05}

  0%|          | 1140/371472 [05:31<28:10:46,  3.65it/s]
  0%|          | 1141/371472 [05:31<27:26:43,  3.75it/s]
  0%|          | 1142/371472 [05:31<27:56:18,  3.68it/s]
  0%|          | 1143/371472 [05:32<34:20:38,  3.00it/s]
  0%|          | 1144/371472 [05:32<32:39:36,  3.15it/s]
  0%|          | 1145/371472 [05:32<32:00:01,  3.21it/s]
  0%|          | 1146/371472 [05:32<31:22:13,  3.28it/s]
  0%|          | 1147/371472 [05:33<30:58:13,  3.32it/s]
  0%|          | 1148/371472 [05:33<30:07:49,  3.41it/s]
  0%|          | 1149/371472 [05:33<30:03:02,  3.42it/s]
  0%|          | 1150/371472 [05:34<30:27:32,  3.38it/s]
  0%|          | 1151/371472 [05:34<29:33:03,  3.48it/s]
  0%|          | 1152/371472 [05:34<29:06:52,  3.53it/s]
  0%|          | 1153/371472 [05:34<28:48:06,  3.57it/s]
  0%|          | 1154/371472 [05:35<31:33:59,  3.26it/s]
  0%|          | 1155/371472 [05:35<33:13:10,  3.10it/s]
  0%|          | 1156/371472 [05:35<30:45:19,  3.34it/s]
  0%|          | 1157/371472 [05:36<29:17:02,  3.51it/s]
  0%|          | 1158/371472 [05:36<29:21:57,  3.50it/s]
  0%|          | 1159/371472 [05:36<29:00:28,  3.55it/s]
  0%|          | 1160/371472 [05:37<30:10:10,  3.41it/s]
                                                        
{'loss': 6.149, 'learning_rate': 9.976728651770129e-07, 'epoch': 0.05}

  0%|          | 1160/371472 [05:37<30:10:10,  3.41it/s]
  0%|          | 1161/371472 [05:37<29:10:53,  3.52it/s]
  0%|          | 1162/371472 [05:37<30:04:35,  3.42it/s]
  0%|          | 1163/371472 [05:37<29:18:30,  3.51it/s]
  0%|          | 1164/371472 [05:38<28:54:08,  3.56it/s]
  0%|          | 1165/371472 [05:38<29:17:47,  3.51it/s]
  0%|          | 1166/371472 [05:38<28:54:47,  3.56it/s]
  0%|          | 1167/371472 [05:38<28:41:36,  3.58it/s]
  0%|          | 1168/371472 [05:39<28:42:36,  3.58it/s]
  0%|          | 1169/371472 [05:39<29:19:29,  3.51it/s]
  0%|          | 1170/371472 [05:39<29:11:38,  3.52it/s]
  0%|          | 1171/371472 [05:40<29:56:51,  3.43it/s]
  0%|          | 1172/371472 [05:40<29:21:57,  3.50it/s]
  0%|          | 1173/371472 [05:40<29:07:55,  3.53it/s]
  0%|          | 1174/371472 [05:40<29:35:56,  3.48it/s]
  0%|          | 1175/371472 [05:41<29:11:11,  3.52it/s]
  0%|          | 1176/371472 [05:41<28:08:07,  3.66it/s]
  0%|          | 1177/371472 [05:41<28:42:50,  3.58it/s]
  0%|          | 1178/371472 [05:42<28:32:46,  3.60it/s]
  0%|          | 1179/371472 [05:42<28:29:34,  3.61it/s]
  0%|          | 1180/371472 [05:42<31:59:20,  3.22it/s]
                                                        
{'loss': 6.3048, 'learning_rate': 9.976243832015342e-07, 'epoch': 0.05}

  0%|          | 1180/371472 [05:42<31:59:20,  3.22it/s]
  0%|          | 1181/371472 [05:43<31:14:58,  3.29it/s]
  0%|          | 1182/371472 [05:43<30:35:56,  3.36it/s]
  0%|          | 1183/371472 [05:43<31:54:17,  3.22it/s]
  0%|          | 1184/371472 [05:43<31:42:57,  3.24it/s]
  0%|          | 1185/371472 [05:44<30:59:11,  3.32it/s]
  0%|          | 1186/371472 [05:44<30:37:04,  3.36it/s]
  0%|          | 1187/371472 [05:44<30:19:35,  3.39it/s]
  0%|          | 1188/371472 [05:45<31:15:55,  3.29it/s]
  0%|          | 1189/371472 [05:45<29:57:26,  3.43it/s]
  0%|          | 1190/371472 [05:45<30:20:25,  3.39it/s]
  0%|          | 1191/371472 [05:45<29:09:40,  3.53it/s]
  0%|          | 1192/371472 [05:46<29:08:34,  3.53it/s]
  0%|          | 1193/371472 [05:46<29:37:36,  3.47it/s]
  0%|          | 1194/371472 [05:46<28:54:50,  3.56it/s]
  0%|          | 1195/371472 [05:47<29:06:25,  3.53it/s]
  0%|          | 1196/371472 [05:47<29:13:33,  3.52it/s]
  0%|          | 1197/371472 [05:47<28:34:02,  3.60it/s]
  0%|          | 1198/371472 [05:47<30:41:14,  3.35it/s]
  0%|          | 1199/371472 [05:48<30:52:41,  3.33it/s]
  0%|          | 1200/371472 [05:48<30:39:08,  3.36it/s]
                                                        
{'loss': 6.4359, 'learning_rate': 9.975759012260552e-07, 'epoch': 0.05}

  0%|          | 1200/371472 [05:48<30:39:08,  3.36it/s]
  0%|          | 1201/371472 [05:48<30:30:55,  3.37it/s]
  0%|          | 1202/371472 [05:49<29:45:01,  3.46it/s]
  0%|          | 1203/371472 [05:49<31:04:58,  3.31it/s]
  0%|          | 1204/371472 [05:49<30:23:46,  3.38it/s]
  0%|          | 1205/371472 [05:50<31:24:17,  3.28it/s]
  0%|          | 1206/371472 [05:50<30:23:35,  3.38it/s]
  0%|          | 1207/371472 [05:50<30:15:37,  3.40it/s]
  0%|          | 1208/371472 [05:50<29:46:28,  3.45it/s]
  0%|          | 1209/371472 [05:51<30:18:48,  3.39it/s]
  0%|          | 1210/371472 [05:51<29:24:15,  3.50it/s]
  0%|          | 1211/371472 [05:51<29:34:15,  3.48it/s]
  0%|          | 1212/371472 [05:52<31:50:57,  3.23it/s]
  0%|          | 1213/371472 [05:52<30:37:55,  3.36it/s]
  0%|          | 1214/371472 [05:52<29:40:04,  3.47it/s]
  0%|          | 1215/371472 [05:52<28:50:58,  3.57it/s]
  0%|          | 1216/371472 [05:53<29:06:52,  3.53it/s]
  0%|          | 1217/371472 [05:53<28:20:12,  3.63it/s]
  0%|          | 1218/371472 [05:53<29:27:15,  3.49it/s]
  0%|          | 1219/371472 [05:54<28:05:32,  3.66it/s]
  0%|          | 1220/371472 [05:54<27:31:32,  3.74it/s]
                                                        
{'loss': 6.1895, 'learning_rate': 9.975274192505763e-07, 'epoch': 0.05}

  0%|          | 1220/371472 [05:54<27:31:32,  3.74it/s]
  0%|          | 1221/371472 [05:54<27:54:24,  3.69it/s]
  0%|          | 1222/371472 [05:54<29:50:33,  3.45it/s]
  0%|          | 1223/371472 [05:55<29:22:07,  3.50it/s]
  0%|          | 1224/371472 [05:55<30:04:08,  3.42it/s]
  0%|          | 1225/371472 [05:55<30:11:28,  3.41it/s]
  0%|          | 1226/371472 [05:56<29:19:12,  3.51it/s]
  0%|          | 1227/371472 [05:56<28:52:25,  3.56it/s]
  0%|          | 1228/371472 [05:56<29:44:06,  3.46it/s]
  0%|          | 1229/371472 [05:56<29:32:02,  3.48it/s]
  0%|          | 1230/371472 [05:57<29:58:00,  3.43it/s]
  0%|          | 1231/371472 [05:57<29:15:13,  3.52it/s]
  0%|          | 1232/371472 [05:57<28:30:29,  3.61it/s]
  0%|          | 1233/371472 [05:58<29:13:08,  3.52it/s]
  0%|          | 1234/371472 [05:58<30:36:00,  3.36it/s]
  0%|          | 1235/371472 [05:58<29:51:06,  3.45it/s]
  0%|          | 1236/371472 [05:59<33:06:31,  3.11it/s]
  0%|          | 1237/371472 [05:59<31:41:04,  3.25it/s]
  0%|          | 1238/371472 [05:59<32:43:13,  3.14it/s]
  0%|          | 1239/371472 [05:59<30:57:44,  3.32it/s]
  0%|          | 1240/371472 [06:00<29:41:58,  3.46it/s]
                                                        
{'loss': 6.0717, 'learning_rate': 9.974789372750976e-07, 'epoch': 0.05}

  0%|          | 1240/371472 [06:00<29:41:58,  3.46it/s]
  0%|          | 1241/371472 [06:00<31:09:09,  3.30it/s]
  0%|          | 1242/371472 [06:00<32:52:38,  3.13it/s]
  0%|          | 1243/371472 [06:01<31:18:33,  3.28it/s]
  0%|          | 1244/371472 [06:01<31:43:48,  3.24it/s]
  0%|          | 1245/371472 [06:01<29:57:33,  3.43it/s]
  0%|          | 1246/371472 [06:02<31:07:15,  3.30it/s]
  0%|          | 1247/371472 [06:02<29:29:54,  3.49it/s]
  0%|          | 1248/371472 [06:02<29:02:45,  3.54it/s]
  0%|          | 1249/371472 [06:02<29:33:07,  3.48it/s]
  0%|          | 1250/371472 [06:03<29:40:20,  3.47it/s]
  0%|          | 1251/371472 [06:03<29:48:20,  3.45it/s]
  0%|          | 1252/371472 [06:03<28:53:11,  3.56it/s]
  0%|          | 1253/371472 [06:03<28:14:52,  3.64it/s]
  0%|          | 1254/371472 [06:04<28:20:00,  3.63it/s]
  0%|          | 1255/371472 [06:04<30:44:42,  3.34it/s]
  0%|          | 1256/371472 [06:04<29:16:34,  3.51it/s]
  0%|          | 1257/371472 [06:05<31:41:49,  3.24it/s]
  0%|          | 1258/371472 [06:05<30:32:31,  3.37it/s]
  0%|          | 1259/371472 [06:05<29:41:58,  3.46it/s]
  0%|          | 1260/371472 [06:06<29:15:26,  3.51it/s]
                                                        
{'loss': 6.4554, 'learning_rate': 9.974304552996186e-07, 'epoch': 0.05}

  0%|          | 1260/371472 [06:06<29:15:26,  3.51it/s]
  0%|          | 1261/371472 [06:06<28:52:23,  3.56it/s]
  0%|          | 1262/371472 [06:06<28:51:38,  3.56it/s]
  0%|          | 1263/371472 [06:06<30:57:40,  3.32it/s]
  0%|          | 1264/371472 [06:07<29:08:10,  3.53it/s]
  0%|          | 1265/371472 [06:07<29:25:56,  3.49it/s]
  0%|          | 1266/371472 [06:07<29:00:05,  3.55it/s]
  0%|          | 1267/371472 [06:08<30:29:50,  3.37it/s]
  0%|          | 1268/371472 [06:08<29:29:13,  3.49it/s]
  0%|          | 1269/371472 [06:08<29:21:48,  3.50it/s]
  0%|          | 1270/371472 [06:08<28:24:50,  3.62it/s]
  0%|          | 1271/371472 [06:09<29:47:22,  3.45it/s]
  0%|          | 1272/371472 [06:09<32:27:10,  3.17it/s]
  0%|          | 1273/371472 [06:09<31:16:54,  3.29it/s]
  0%|          | 1274/371472 [06:10<29:39:51,  3.47it/s]
  0%|          | 1275/371472 [06:10<29:00:20,  3.55it/s]
  0%|          | 1276/371472 [06:10<29:54:06,  3.44it/s]
  0%|          | 1277/371472 [06:10<28:56:43,  3.55it/s]
  0%|          | 1278/371472 [06:11<28:47:33,  3.57it/s]
  0%|          | 1279/371472 [06:11<30:42:10,  3.35it/s]
  0%|          | 1280/371472 [06:11<29:15:32,  3.51it/s]
                                                        
{'loss': 6.3709, 'learning_rate': 9.973819733241397e-07, 'epoch': 0.06}

  0%|          | 1280/371472 [06:11<29:15:32,  3.51it/s]
  0%|          | 1281/371472 [06:12<28:40:19,  3.59it/s]
  0%|          | 1282/371472 [06:12<28:14:04,  3.64it/s]
  0%|          | 1283/371472 [06:12<28:31:12,  3.61it/s]
  0%|          | 1284/371472 [06:12<28:01:54,  3.67it/s]
  0%|          | 1285/371472 [06:13<28:02:17,  3.67it/s]
  0%|          | 1286/371472 [06:13<27:33:14,  3.73it/s]
  0%|          | 1287/371472 [06:13<30:08:45,  3.41it/s]
  0%|          | 1288/371472 [06:14<29:50:14,  3.45it/s]
  0%|          | 1289/371472 [06:14<29:22:00,  3.50it/s]
  0%|          | 1290/371472 [06:14<29:30:01,  3.49it/s]
  0%|          | 1291/371472 [06:14<29:24:04,  3.50it/s]
  0%|          | 1292/371472 [06:15<29:52:34,  3.44it/s]
  0%|          | 1293/371472 [06:15<28:55:46,  3.55it/s]
  0%|          | 1294/371472 [06:15<29:25:32,  3.49it/s]
  0%|          | 1295/371472 [06:16<31:59:32,  3.21it/s]
  0%|          | 1296/371472 [06:16<31:05:12,  3.31it/s]
  0%|          | 1297/371472 [06:16<30:05:00,  3.42it/s]
  0%|          | 1298/371472 [06:17<30:41:08,  3.35it/s]
  0%|          | 1299/371472 [06:17<30:53:37,  3.33it/s]
  0%|          | 1300/371472 [06:17<30:39:58,  3.35it/s]
                                                        
{'loss': 6.3882, 'learning_rate': 9.973334913486606e-07, 'epoch': 0.06}

  0%|          | 1300/371472 [06:17<30:39:58,  3.35it/s]
  0%|          | 1301/371472 [06:17<30:28:42,  3.37it/s]
  0%|          | 1302/371472 [06:18<30:11:56,  3.40it/s]
  0%|          | 1303/371472 [06:18<29:40:52,  3.46it/s]
  0%|          | 1304/371472 [06:18<28:19:03,  3.63it/s]
  0%|          | 1305/371472 [06:18<28:14:22,  3.64it/s]
  0%|          | 1306/371472 [06:19<28:28:57,  3.61it/s]
  0%|          | 1307/371472 [06:19<28:50:23,  3.57it/s]
  0%|          | 1308/371472 [06:19<29:04:17,  3.54it/s]
  0%|          | 1309/371472 [06:20<34:03:30,  3.02it/s]
  0%|          | 1310/371472 [06:20<31:55:45,  3.22it/s]
  0%|          | 1311/371472 [06:20<33:19:20,  3.09it/s]
  0%|          | 1312/371472 [06:21<31:04:04,  3.31it/s]
  0%|          | 1313/371472 [06:21<31:43:47,  3.24it/s]
  0%|          | 1314/371472 [06:21<31:06:27,  3.31it/s]
  0%|          | 1315/371472 [06:22<30:30:49,  3.37it/s]
  0%|          | 1316/371472 [06:22<31:34:31,  3.26it/s]
  0%|          | 1317/371472 [06:22<29:53:57,  3.44it/s]
  0%|          | 1318/371472 [06:22<29:00:24,  3.54it/s]
  0%|          | 1319/371472 [06:23<29:27:07,  3.49it/s]
  0%|          | 1320/371472 [06:23<30:54:53,  3.33it/s]
                                                        
{'loss': 6.272, 'learning_rate': 9.972850093731819e-07, 'epoch': 0.06}

  0%|          | 1320/371472 [06:23<30:54:53,  3.33it/s]
  0%|          | 1321/371472 [06:23<30:23:55,  3.38it/s]
  0%|          | 1322/371472 [06:24<29:49:20,  3.45it/s]
  0%|          | 1323/371472 [06:24<28:40:57,  3.58it/s]
  0%|          | 1324/371472 [06:24<28:34:59,  3.60it/s]
  0%|          | 1325/371472 [06:24<27:49:31,  3.70it/s]
  0%|          | 1326/371472 [06:25<31:39:31,  3.25it/s]
  0%|          | 1327/371472 [06:25<30:25:17,  3.38it/s]
  0%|          | 1328/371472 [06:25<30:01:53,  3.42it/s]
  0%|          | 1329/371472 [06:26<31:10:41,  3.30it/s]
  0%|          | 1330/371472 [06:26<30:58:06,  3.32it/s]
  0%|          | 1331/371472 [06:26<32:49:24,  3.13it/s]
  0%|          | 1332/371472 [06:27<32:25:20,  3.17it/s]
  0%|          | 1333/371472 [06:27<32:01:35,  3.21it/s]
  0%|          | 1334/371472 [06:27<32:02:05,  3.21it/s]
  0%|          | 1335/371472 [06:28<31:10:17,  3.30it/s]
  0%|          | 1336/371472 [06:28<31:38:48,  3.25it/s]
  0%|          | 1337/371472 [06:28<31:22:58,  3.28it/s]
  0%|          | 1338/371472 [06:28<29:47:22,  3.45it/s]
  0%|          | 1339/371472 [06:29<30:30:45,  3.37it/s]
  0%|          | 1340/371472 [06:29<30:24:21,  3.38it/s]
                                                        
{'loss': 6.0779, 'learning_rate': 9.97236527397703e-07, 'epoch': 0.06}

  0%|          | 1340/371472 [06:29<30:24:21,  3.38it/s]
  0%|          | 1341/371472 [06:29<29:56:24,  3.43it/s]
  0%|          | 1342/371472 [06:30<29:33:20,  3.48it/s]
  0%|          | 1343/371472 [06:30<29:17:50,  3.51it/s]
  0%|          | 1344/371472 [06:30<29:18:27,  3.51it/s]
  0%|          | 1345/371472 [06:30<29:54:55,  3.44it/s]
  0%|          | 1346/371472 [06:31<28:22:41,  3.62it/s]
  0%|          | 1347/371472 [06:31<28:01:09,  3.67it/s]
  0%|          | 1348/371472 [06:31<28:34:18,  3.60it/s]
  0%|          | 1349/371472 [06:32<30:34:04,  3.36it/s]
  0%|          | 1350/371472 [06:32<30:01:01,  3.43it/s]
  0%|          | 1351/371472 [06:32<31:02:33,  3.31it/s]
  0%|          | 1352/371472 [06:32<29:14:33,  3.52it/s]
  0%|          | 1353/371472 [06:33<28:20:38,  3.63it/s]
  0%|          | 1354/371472 [06:33<27:57:11,  3.68it/s]
  0%|          | 1355/371472 [06:33<28:57:17,  3.55it/s]
  0%|          | 1356/371472 [06:34<29:13:02,  3.52it/s]
  0%|          | 1357/371472 [06:34<30:06:14,  3.42it/s]
  0%|          | 1358/371472 [06:34<31:07:55,  3.30it/s]
  0%|          | 1359/371472 [06:34<30:56:17,  3.32it/s]
  0%|          | 1360/371472 [06:35<30:22:49,  3.38it/s]
                                                        
{'loss': 6.3757, 'learning_rate': 9.97188045422224e-07, 'epoch': 0.06}

  0%|          | 1360/371472 [06:35<30:22:49,  3.38it/s]
  0%|          | 1361/371472 [06:35<31:39:16,  3.25it/s]
  0%|          | 1362/371472 [06:35<30:43:55,  3.35it/s]
  0%|          | 1363/371472 [06:36<30:58:47,  3.32it/s]
  0%|          | 1364/371472 [06:36<31:24:17,  3.27it/s]
  0%|          | 1365/371472 [06:36<32:08:37,  3.20it/s]
  0%|          | 1366/371472 [06:37<31:17:20,  3.29it/s]
  0%|          | 1367/371472 [06:37<30:10:12,  3.41it/s]
  0%|          | 1368/371472 [06:37<30:37:56,  3.36it/s]
  0%|          | 1369/371472 [06:37<29:12:08,  3.52it/s]
  0%|          | 1370/371472 [06:38<28:00:53,  3.67it/s]
  0%|          | 1371/371472 [06:38<28:30:41,  3.61it/s]
  0%|          | 1372/371472 [06:38<30:23:07,  3.38it/s]
  0%|          | 1373/371472 [06:39<29:54:50,  3.44it/s]
  0%|          | 1374/371472 [06:39<30:44:02,  3.34it/s]
  0%|          | 1375/371472 [06:39<30:36:39,  3.36it/s]
  0%|          | 1376/371472 [06:39<29:19:45,  3.51it/s]
  0%|          | 1377/371472 [06:40<31:17:09,  3.29it/s]
  0%|          | 1378/371472 [06:40<31:26:18,  3.27it/s]
  0%|          | 1379/371472 [06:40<30:26:59,  3.38it/s]
  0%|          | 1380/371472 [06:41<30:01:06,  3.42it/s]
                                                        
{'loss': 5.9969, 'learning_rate': 9.971395634467453e-07, 'epoch': 0.06}

  0%|          | 1380/371472 [06:41<30:01:06,  3.42it/s]
  0%|          | 1381/371472 [06:41<29:44:28,  3.46it/s]
  0%|          | 1382/371472 [06:41<29:38:35,  3.47it/s]
  0%|          | 1383/371472 [06:42<30:48:13,  3.34it/s]
  0%|          | 1384/371472 [06:42<31:09:55,  3.30it/s]
  0%|          | 1385/371472 [06:42<29:47:29,  3.45it/s]
  0%|          | 1386/371472 [06:42<30:10:45,  3.41it/s]
  0%|          | 1387/371472 [06:43<30:36:13,  3.36it/s]
  0%|          | 1388/371472 [06:43<30:24:21,  3.38it/s]
  0%|          | 1389/371472 [06:43<30:08:35,  3.41it/s]
  0%|          | 1390/371472 [06:44<29:38:52,  3.47it/s]
  0%|          | 1391/371472 [06:44<29:16:37,  3.51it/s]
  0%|          | 1392/371472 [06:44<29:42:07,  3.46it/s]
  0%|          | 1393/371472 [06:44<31:04:20,  3.31it/s]
  0%|          | 1394/371472 [06:45<29:41:38,  3.46it/s]
  0%|          | 1395/371472 [06:45<29:01:18,  3.54it/s]
  0%|          | 1396/371472 [06:45<29:41:40,  3.46it/s]
  0%|          | 1397/371472 [06:46<28:23:05,  3.62it/s]
  0%|          | 1398/371472 [06:46<28:36:33,  3.59it/s]
  0%|          | 1399/371472 [06:46<28:21:15,  3.63it/s]
  0%|          | 1400/371472 [06:46<28:28:36,  3.61it/s]
                                                        
{'loss': 6.288, 'learning_rate': 9.970910814712664e-07, 'epoch': 0.06}

  0%|          | 1400/371472 [06:46<28:28:36,  3.61it/s]
  0%|          | 1401/371472 [06:47<29:03:18,  3.54it/s]
  0%|          | 1402/371472 [06:47<27:53:01,  3.69it/s]
  0%|          | 1403/371472 [06:47<28:21:32,  3.62it/s]
  0%|          | 1404/371472 [06:48<33:13:00,  3.09it/s]
  0%|          | 1405/371472 [06:48<31:27:52,  3.27it/s]
  0%|          | 1406/371472 [06:48<31:52:59,  3.22it/s]
  0%|          | 1407/371472 [06:49<31:44:43,  3.24it/s]
  0%|          | 1408/371472 [06:49<30:40:22,  3.35it/s]
  0%|          | 1409/371472 [06:49<32:07:23,  3.20it/s]
  0%|          | 1410/371472 [06:50<33:47:36,  3.04it/s]
  0%|          | 1411/371472 [06:50<32:38:14,  3.15it/s]
  0%|          | 1412/371472 [06:50<35:40:20,  2.88it/s]
  0%|          | 1413/371472 [06:50<32:55:26,  3.12it/s]
  0%|          | 1414/371472 [06:51<37:11:41,  2.76it/s]
  0%|          | 1415/371472 [06:51<35:43:22,  2.88it/s]
  0%|          | 1416/371472 [06:52<33:11:50,  3.10it/s]
  0%|          | 1417/371472 [06:52<31:28:53,  3.27it/s]
  0%|          | 1418/371472 [06:52<31:52:03,  3.23it/s]
  0%|          | 1419/371472 [06:52<31:33:38,  3.26it/s]
  0%|          | 1420/371472 [06:53<31:07:23,  3.30it/s]
                                                        
{'loss': 6.3014, 'learning_rate': 9.970425994957874e-07, 'epoch': 0.06}

  0%|          | 1420/371472 [06:53<31:07:23,  3.30it/s]
  0%|          | 1421/371472 [06:53<29:23:53,  3.50it/s]
  0%|          | 1422/371472 [06:53<29:51:11,  3.44it/s]
  0%|          | 1423/371472 [06:54<29:27:42,  3.49it/s]
  0%|          | 1424/371472 [06:54<31:15:02,  3.29it/s]
  0%|          | 1425/371472 [06:54<30:41:33,  3.35it/s]
  0%|          | 1426/371472 [06:54<30:32:03,  3.37it/s]
  0%|          | 1427/371472 [06:55<29:43:48,  3.46it/s]
  0%|          | 1428/371472 [06:55<28:42:14,  3.58it/s]
  0%|          | 1429/371472 [06:55<27:42:41,  3.71it/s]
  0%|          | 1430/371472 [06:56<28:00:42,  3.67it/s]
  0%|          | 1431/371472 [06:56<28:04:06,  3.66it/s]
  0%|          | 1432/371472 [06:56<27:38:50,  3.72it/s]
  0%|          | 1433/371472 [06:56<30:37:09,  3.36it/s]
  0%|          | 1434/371472 [06:57<29:27:20,  3.49it/s]
  0%|          | 1435/371472 [06:57<28:46:09,  3.57it/s]
  0%|          | 1436/371472 [06:57<28:11:06,  3.65it/s]
  0%|          | 1437/371472 [06:57<28:08:39,  3.65it/s]
  0%|          | 1438/371472 [06:58<30:58:49,  3.32it/s]
  0%|          | 1439/371472 [06:58<33:40:28,  3.05it/s]
  0%|          | 1440/371472 [06:59<32:45:18,  3.14it/s]
                                                        
{'loss': 6.0141, 'learning_rate': 9.969941175203085e-07, 'epoch': 0.06}

  0%|          | 1440/371472 [06:59<32:45:18,  3.14it/s]
  0%|          | 1441/371472 [06:59<34:01:19,  3.02it/s]
  0%|          | 1442/371472 [06:59<33:28:37,  3.07it/s]
  0%|          | 1443/371472 [06:59<32:11:37,  3.19it/s]
  0%|          | 1444/371472 [07:00<30:40:16,  3.35it/s]
  0%|          | 1445/371472 [07:00<30:34:41,  3.36it/s]
  0%|          | 1446/371472 [07:00<30:20:48,  3.39it/s]
  0%|          | 1447/371472 [07:01<30:18:35,  3.39it/s]
  0%|          | 1448/371472 [07:01<32:03:08,  3.21it/s]
  0%|          | 1449/371472 [07:01<31:55:09,  3.22it/s]
  0%|          | 1450/371472 [07:02<30:36:04,  3.36it/s]
  0%|          | 1451/371472 [07:02<30:04:22,  3.42it/s]
  0%|          | 1452/371472 [07:02<31:26:58,  3.27it/s]
  0%|          | 1453/371472 [07:02<30:48:54,  3.34it/s]
  0%|          | 1454/371472 [07:03<30:30:22,  3.37it/s]
  0%|          | 1455/371472 [07:03<30:57:07,  3.32it/s]
  0%|          | 1456/371472 [07:03<31:05:34,  3.31it/s]
  0%|          | 1457/371472 [07:04<31:15:00,  3.29it/s]
  0%|          | 1458/371472 [07:04<31:27:53,  3.27it/s]
  0%|          | 1459/371472 [07:04<30:39:00,  3.35it/s]
  0%|          | 1460/371472 [07:05<29:36:44,  3.47it/s]
                                                        
{'loss': 6.2296, 'learning_rate': 9.969456355448296e-07, 'epoch': 0.06}

  0%|          | 1460/371472 [07:05<29:36:44,  3.47it/s]
  0%|          | 1461/371472 [07:05<29:36:36,  3.47it/s]
  0%|          | 1462/371472 [07:05<28:42:09,  3.58it/s]
  0%|          | 1463/371472 [07:05<28:54:06,  3.56it/s]
  0%|          | 1464/371472 [07:06<28:09:25,  3.65it/s]
  0%|          | 1465/371472 [07:06<29:16:03,  3.51it/s]
  0%|          | 1466/371472 [07:06<29:01:13,  3.54it/s]
  0%|          | 1467/371472 [07:06<28:48:33,  3.57it/s]
  0%|          | 1468/371472 [07:07<30:19:20,  3.39it/s]
  0%|          | 1469/371472 [07:07<29:19:42,  3.50it/s]
  0%|          | 1470/371472 [07:07<28:44:51,  3.58it/s]
  0%|          | 1471/371472 [07:08<30:00:10,  3.43it/s]
  0%|          | 1472/371472 [07:08<29:47:26,  3.45it/s]
  0%|          | 1473/371472 [07:08<29:42:28,  3.46it/s]
  0%|          | 1474/371472 [07:08<28:30:00,  3.61it/s]
  0%|          | 1475/371472 [07:09<27:51:24,  3.69it/s]
  0%|          | 1476/371472 [07:09<27:40:40,  3.71it/s]
  0%|          | 1477/371472 [07:09<28:01:58,  3.67it/s]
  0%|          | 1478/371472 [07:10<29:43:03,  3.46it/s]
  0%|          | 1479/371472 [07:10<30:25:09,  3.38it/s]
  0%|          | 1480/371472 [07:10<30:11:44,  3.40it/s]
                                                        
{'loss': 6.2257, 'learning_rate': 9.968971535693509e-07, 'epoch': 0.06}

  0%|          | 1480/371472 [07:10<30:11:44,  3.40it/s]
  0%|          | 1481/371472 [07:11<31:45:25,  3.24it/s]
  0%|          | 1482/371472 [07:11<29:59:13,  3.43it/s]
  0%|          | 1483/371472 [07:11<29:10:40,  3.52it/s]
  0%|          | 1484/371472 [07:11<28:58:10,  3.55it/s]
  0%|          | 1485/371472 [07:12<27:46:29,  3.70it/s]
  0%|          | 1486/371472 [07:12<28:22:28,  3.62it/s]
  0%|          | 1487/371472 [07:12<28:26:02,  3.61it/s]
  0%|          | 1488/371472 [07:13<31:06:21,  3.30it/s]
  0%|          | 1489/371472 [07:13<30:15:36,  3.40it/s]
  0%|          | 1490/371472 [07:13<29:39:48,  3.46it/s]
  0%|          | 1491/371472 [07:13<29:33:44,  3.48it/s]
  0%|          | 1492/371472 [07:14<28:35:25,  3.59it/s]
  0%|          | 1493/371472 [07:14<29:23:31,  3.50it/s]
  0%|          | 1494/371472 [07:14<28:35:01,  3.60it/s]
  0%|          | 1495/371472 [07:14<28:34:39,  3.60it/s]
  0%|          | 1496/371472 [07:15<28:34:07,  3.60it/s]
  0%|          | 1497/371472 [07:15<28:12:17,  3.64it/s]
  0%|          | 1498/371472 [07:15<28:54:16,  3.56it/s]
  0%|          | 1499/371472 [07:16<28:33:00,  3.60it/s]
  0%|          | 1500/371472 [07:16<27:59:41,  3.67it/s]
                                                        
{'loss': 6.2917, 'learning_rate': 9.968486715938717e-07, 'epoch': 0.06}

  0%|          | 1500/371472 [07:16<27:59:41,  3.67it/s]
  0%|          | 1501/371472 [07:16<28:11:46,  3.64it/s]
  0%|          | 1502/371472 [07:16<29:05:06,  3.53it/s]
  0%|          | 1503/371472 [07:17<28:53:27,  3.56it/s]
  0%|          | 1504/371472 [07:17<30:21:40,  3.38it/s]
  0%|          | 1505/371472 [07:17<30:48:32,  3.34it/s]
  0%|          | 1506/371472 [07:18<29:30:25,  3.48it/s]
  0%|          | 1507/371472 [07:18<28:43:59,  3.58it/s]
  0%|          | 1508/371472 [07:18<30:06:12,  3.41it/s]
  0%|          | 1509/371472 [07:18<29:42:47,  3.46it/s]
  0%|          | 1510/371472 [07:19<30:14:28,  3.40it/s]
  0%|          | 1511/371472 [07:19<31:18:07,  3.28it/s]
  0%|          | 1512/371472 [07:19<31:35:20,  3.25it/s]
  0%|          | 1513/371472 [07:20<30:28:27,  3.37it/s]
  0%|          | 1514/371472 [07:20<32:30:03,  3.16it/s]
  0%|          | 1515/371472 [07:20<31:42:47,  3.24it/s]
  0%|          | 1516/371472 [07:21<30:42:01,  3.35it/s]
  0%|          | 1517/371472 [07:21<32:23:23,  3.17it/s]
  0%|          | 1518/371472 [07:21<30:53:15,  3.33it/s]
  0%|          | 1519/371472 [07:21<29:23:34,  3.50it/s]
  0%|          | 1520/371472 [07:22<28:32:56,  3.60it/s]
                                                        
{'loss': 6.0469, 'learning_rate': 9.96800189618393e-07, 'epoch': 0.07}

  0%|          | 1520/371472 [07:22<28:32:56,  3.60it/s]
  0%|          | 1521/371472 [07:22<29:08:51,  3.53it/s]
  0%|          | 1522/371472 [07:22<28:00:39,  3.67it/s]
  0%|          | 1523/371472 [07:23<28:22:36,  3.62it/s]
  0%|          | 1524/371472 [07:23<28:54:13,  3.56it/s]
  0%|          | 1525/371472 [07:23<29:54:43,  3.44it/s]
  0%|          | 1526/371472 [07:23<30:46:02,  3.34it/s]
  0%|          | 1527/371472 [07:24<30:09:03,  3.41it/s]
  0%|          | 1528/371472 [07:24<30:27:14,  3.37it/s]
  0%|          | 1529/371472 [07:24<29:26:40,  3.49it/s]
  0%|          | 1530/371472 [07:25<32:00:44,  3.21it/s]
  0%|          | 1531/371472 [07:25<32:30:21,  3.16it/s]
  0%|          | 1532/371472 [07:25<34:02:26,  3.02it/s]
  0%|          | 1533/371472 [07:26<32:08:10,  3.20it/s]
  0%|          | 1534/371472 [07:26<31:21:39,  3.28it/s]
  0%|          | 1535/371472 [07:26<31:55:12,  3.22it/s]
  0%|          | 1536/371472 [07:27<33:30:56,  3.07it/s]
  0%|          | 1537/371472 [07:27<33:51:15,  3.04it/s]
  0%|          | 1538/371472 [07:27<32:55:16,  3.12it/s]
  0%|          | 1539/371472 [07:28<32:36:47,  3.15it/s]
  0%|          | 1540/371472 [07:28<31:15:55,  3.29it/s]
                                                        
{'loss': 6.1077, 'learning_rate': 9.967517076429139e-07, 'epoch': 0.07}

  0%|          | 1540/371472 [07:28<31:15:55,  3.29it/s]
  0%|          | 1541/371472 [07:28<35:40:12,  2.88it/s]
  0%|          | 1542/371472 [07:29<33:27:15,  3.07it/s]
  0%|          | 1543/371472 [07:29<31:30:17,  3.26it/s]
  0%|          | 1544/371472 [07:29<32:09:23,  3.20it/s]
  0%|          | 1545/371472 [07:29<30:07:37,  3.41it/s]
  0%|          | 1546/371472 [07:30<33:00:13,  3.11it/s]
  0%|          | 1547/371472 [07:30<32:07:51,  3.20it/s]
  0%|          | 1548/371472 [07:30<30:16:21,  3.39it/s]
  0%|          | 1549/371472 [07:31<29:09:10,  3.52it/s]
  0%|          | 1550/371472 [07:31<29:26:24,  3.49it/s]
  0%|          | 1551/371472 [07:31<28:36:05,  3.59it/s]
  0%|          | 1552/371472 [07:31<29:43:23,  3.46it/s]
  0%|          | 1553/371472 [07:32<29:23:57,  3.50it/s]
  0%|          | 1554/371472 [07:32<30:26:24,  3.38it/s]
  0%|          | 1555/371472 [07:32<30:04:16,  3.42it/s]
  0%|          | 1556/371472 [07:33<28:42:53,  3.58it/s]
  0%|          | 1557/371472 [07:33<28:55:25,  3.55it/s]
  0%|          | 1558/371472 [07:33<28:45:40,  3.57it/s]
  0%|          | 1559/371472 [07:33<30:06:32,  3.41it/s]
  0%|          | 1560/371472 [07:34<29:25:46,  3.49it/s]
                                                        
{'loss': 6.2491, 'learning_rate': 9.967032256674351e-07, 'epoch': 0.07}

  0%|          | 1560/371472 [07:34<29:25:46,  3.49it/s]
  0%|          | 1561/371472 [07:34<30:00:03,  3.42it/s]
  0%|          | 1562/371472 [07:34<31:53:53,  3.22it/s]
  0%|          | 1563/371472 [07:35<34:24:47,  2.99it/s]
  0%|          | 1564/371472 [07:35<33:22:45,  3.08it/s]
  0%|          | 1565/371472 [07:35<31:30:01,  3.26it/s]
  0%|          | 1566/371472 [07:36<30:21:49,  3.38it/s]
  0%|          | 1567/371472 [07:36<29:12:09,  3.52it/s]
  0%|          | 1568/371472 [07:36<28:46:19,  3.57it/s]
  0%|          | 1569/371472 [07:37<31:08:48,  3.30it/s]
  0%|          | 1570/371472 [07:37<30:38:35,  3.35it/s]
  0%|          | 1571/371472 [07:37<29:12:43,  3.52it/s]
  0%|          | 1572/371472 [07:37<29:38:40,  3.47it/s]
  0%|          | 1573/371472 [07:38<28:31:59,  3.60it/s]
  0%|          | 1574/371472 [07:38<30:15:17,  3.40it/s]
  0%|          | 1575/371472 [07:38<29:04:41,  3.53it/s]
  0%|          | 1576/371472 [07:38<28:25:26,  3.61it/s]
  0%|          | 1577/371472 [07:39<29:45:06,  3.45it/s]
  0%|          | 1578/371472 [07:39<31:41:04,  3.24it/s]
  0%|          | 1579/371472 [07:39<30:41:12,  3.35it/s]
  0%|          | 1580/371472 [07:40<29:38:50,  3.47it/s]
                                                        
{'loss': 5.8996, 'learning_rate': 9.966547436919562e-07, 'epoch': 0.07}

  0%|          | 1580/371472 [07:40<29:38:50,  3.47it/s]
  0%|          | 1581/371472 [07:40<29:10:22,  3.52it/s]
  0%|          | 1582/371472 [07:40<28:43:01,  3.58it/s]
  0%|          | 1583/371472 [07:40<28:01:18,  3.67it/s]
  0%|          | 1584/371472 [07:41<30:07:16,  3.41it/s]
  0%|          | 1585/371472 [07:41<29:52:19,  3.44it/s]
  0%|          | 1586/371472 [07:41<29:30:10,  3.48it/s]
  0%|          | 1587/371472 [07:42<31:05:31,  3.30it/s]
  0%|          | 1588/371472 [07:42<30:10:27,  3.41it/s]
  0%|          | 1589/371472 [07:42<29:40:20,  3.46it/s]
  0%|          | 1590/371472 [07:43<31:27:15,  3.27it/s]
  0%|          | 1591/371472 [07:43<30:21:09,  3.39it/s]
  0%|          | 1592/371472 [07:43<29:31:05,  3.48it/s]
  0%|          | 1593/371472 [07:43<28:59:37,  3.54it/s]
  0%|          | 1594/371472 [07:44<30:13:59,  3.40it/s]
  0%|          | 1595/371472 [07:44<29:06:37,  3.53it/s]
  0%|          | 1596/371472 [07:44<28:15:04,  3.64it/s]
  0%|          | 1597/371472 [07:45<30:09:02,  3.41it/s]
  0%|          | 1598/371472 [07:45<31:19:07,  3.28it/s]
  0%|          | 1599/371472 [07:45<30:03:15,  3.42it/s]
  0%|          | 1600/371472 [07:45<29:18:44,  3.51it/s]
                                                        
{'loss': 6.3099, 'learning_rate': 9.966062617164773e-07, 'epoch': 0.07}

  0%|          | 1600/371472 [07:45<29:18:44,  3.51it/s]
  0%|          | 1601/371472 [07:46<29:35:31,  3.47it/s]
  0%|          | 1602/371472 [07:46<28:40:36,  3.58it/s]
  0%|          | 1603/371472 [07:46<27:49:49,  3.69it/s]
  0%|          | 1604/371472 [07:47<29:06:35,  3.53it/s]
  0%|          | 1605/371472 [07:47<30:03:15,  3.42it/s]
  0%|          | 1606/371472 [07:47<28:41:50,  3.58it/s]
  0%|          | 1607/371472 [07:47<29:06:19,  3.53it/s]
  0%|          | 1608/371472 [07:48<28:58:47,  3.55it/s]
  0%|          | 1609/371472 [07:48<29:36:54,  3.47it/s]
  0%|          | 1610/371472 [07:48<28:30:35,  3.60it/s]
  0%|          | 1611/371472 [07:49<28:15:24,  3.64it/s]
  0%|          | 1612/371472 [07:49<28:08:50,  3.65it/s]
  0%|          | 1613/371472 [07:49<28:30:34,  3.60it/s]
  0%|          | 1614/371472 [07:49<29:05:50,  3.53it/s]
  0%|          | 1615/371472 [07:50<29:00:11,  3.54it/s]
  0%|          | 1616/371472 [07:50<28:55:35,  3.55it/s]
  0%|          | 1617/371472 [07:50<29:47:48,  3.45it/s]
  0%|          | 1618/371472 [07:51<29:08:50,  3.52it/s]
  0%|          | 1619/371472 [07:51<28:36:15,  3.59it/s]
  0%|          | 1620/371472 [07:51<29:23:49,  3.49it/s]
                                                        
{'loss': 6.2458, 'learning_rate': 9.965577797409986e-07, 'epoch': 0.07}

  0%|          | 1620/371472 [07:51<29:23:49,  3.49it/s]
  0%|          | 1621/371472 [07:51<31:24:22,  3.27it/s]
  0%|          | 1622/371472 [07:52<31:38:38,  3.25it/s]
  0%|          | 1623/371472 [07:52<30:51:17,  3.33it/s]
  0%|          | 1624/371472 [07:52<29:32:32,  3.48it/s]
  0%|          | 1625/371472 [07:53<29:37:17,  3.47it/s]
  0%|          | 1626/371472 [07:53<28:45:27,  3.57it/s]
  0%|          | 1627/371472 [07:53<28:40:03,  3.58it/s]
  0%|          | 1628/371472 [07:53<28:30:35,  3.60it/s]
  0%|          | 1629/371472 [07:54<28:02:09,  3.66it/s]
  0%|          | 1630/371472 [07:54<29:42:22,  3.46it/s]
  0%|          | 1631/371472 [07:54<29:06:41,  3.53it/s]
  0%|          | 1632/371472 [07:55<29:34:18,  3.47it/s]
  0%|          | 1633/371472 [07:55<28:21:04,  3.62it/s]
  0%|          | 1634/371472 [07:55<28:56:54,  3.55it/s]
  0%|          | 1635/371472 [07:55<28:57:07,  3.55it/s]
  0%|          | 1636/371472 [07:56<28:47:48,  3.57it/s]
  0%|          | 1637/371472 [07:56<27:59:48,  3.67it/s]
  0%|          | 1638/371472 [07:56<28:40:09,  3.58it/s]
  0%|          | 1639/371472 [07:56<27:57:56,  3.67it/s]
  0%|          | 1640/371472 [07:57<27:55:39,  3.68it/s]
                                                        
{'loss': 6.2759, 'learning_rate': 9.965092977655196e-07, 'epoch': 0.07}

  0%|          | 1640/371472 [07:57<27:55:39,  3.68it/s]
  0%|          | 1641/371472 [07:57<27:56:00,  3.68it/s]
  0%|          | 1642/371472 [07:57<29:12:44,  3.52it/s]
  0%|          | 1643/371472 [07:58<28:49:56,  3.56it/s]
  0%|          | 1644/371472 [07:58<28:59:50,  3.54it/s]
  0%|          | 1645/371472 [07:58<28:34:33,  3.59it/s]
  0%|          | 1646/371472 [07:58<28:04:41,  3.66it/s]
  0%|          | 1647/371472 [07:59<27:44:22,  3.70it/s]
  0%|          | 1648/371472 [07:59<27:33:14,  3.73it/s]
  0%|          | 1649/371472 [07:59<28:00:36,  3.67it/s]
  0%|          | 1650/371472 [07:59<27:35:18,  3.72it/s]
  0%|          | 1651/371472 [08:00<28:13:34,  3.64it/s]
  0%|          | 1652/371472 [08:00<27:36:01,  3.72it/s]
  0%|          | 1653/371472 [08:00<27:38:01,  3.72it/s]
  0%|          | 1654/371472 [08:01<29:28:23,  3.49it/s]
  0%|          | 1655/371472 [08:01<28:37:43,  3.59it/s]
  0%|          | 1656/371472 [08:01<28:31:22,  3.60it/s]
  0%|          | 1657/371472 [08:01<27:51:24,  3.69it/s]
  0%|          | 1658/371472 [08:02<28:20:03,  3.63it/s]
  0%|          | 1659/371472 [08:02<28:36:42,  3.59it/s]
  0%|          | 1660/371472 [08:02<28:51:35,  3.56it/s]
                                                        
{'loss': 6.2417, 'learning_rate': 9.964608157900407e-07, 'epoch': 0.07}

  0%|          | 1660/371472 [08:02<28:51:35,  3.56it/s]
  0%|          | 1661/371472 [08:03<29:09:11,  3.52it/s]
  0%|          | 1662/371472 [08:03<30:25:10,  3.38it/s]
  0%|          | 1663/371472 [08:03<30:30:02,  3.37it/s]
  0%|          | 1664/371472 [08:03<29:58:37,  3.43it/s]
  0%|          | 1665/371472 [08:04<31:29:26,  3.26it/s]
  0%|          | 1666/371472 [08:04<31:30:57,  3.26it/s]
  0%|          | 1667/371472 [08:04<30:37:58,  3.35it/s]
  0%|          | 1668/371472 [08:05<30:42:09,  3.35it/s]
  0%|          | 1669/371472 [08:05<30:21:01,  3.38it/s]
  0%|          | 1670/371472 [08:05<29:41:45,  3.46it/s]
  0%|          | 1671/371472 [08:06<28:48:08,  3.57it/s]
  0%|          | 1672/371472 [08:06<28:33:26,  3.60it/s]
  0%|          | 1673/371472 [08:06<29:11:10,  3.52it/s]
  0%|          | 1674/371472 [08:06<29:30:10,  3.48it/s]
  0%|          | 1675/371472 [08:07<28:37:49,  3.59it/s]
  0%|          | 1676/371472 [08:07<29:15:46,  3.51it/s]
  0%|          | 1677/371472 [08:07<28:39:30,  3.58it/s]
  0%|          | 1678/371472 [08:08<29:59:31,  3.42it/s]
  0%|          | 1679/371472 [08:08<30:55:34,  3.32it/s]
  0%|          | 1680/371472 [08:08<30:11:32,  3.40it/s]
                                                        
{'loss': 6.0339, 'learning_rate': 9.964123338145618e-07, 'epoch': 0.07}

  0%|          | 1680/371472 [08:08<30:11:32,  3.40it/s]
  0%|          | 1681/371472 [08:08<29:30:32,  3.48it/s]
  0%|          | 1682/371472 [08:09<28:38:14,  3.59it/s]
  0%|          | 1683/371472 [08:09<28:28:47,  3.61it/s]
  0%|          | 1684/371472 [08:09<27:41:39,  3.71it/s]
  0%|          | 1685/371472 [08:09<27:52:06,  3.69it/s]
  0%|          | 1686/371472 [08:10<27:34:56,  3.72it/s]
  0%|          | 1687/371472 [08:10<30:47:02,  3.34it/s]
  0%|          | 1688/371472 [08:10<29:49:54,  3.44it/s]
  0%|          | 1689/371472 [08:11<32:26:33,  3.17it/s]
  0%|          | 1690/371472 [08:11<32:09:22,  3.19it/s]
  0%|          | 1691/371472 [08:11<31:07:52,  3.30it/s]
  0%|          | 1692/371472 [08:12<30:34:34,  3.36it/s]
  0%|          | 1693/371472 [08:12<29:43:11,  3.46it/s]
  0%|          | 1694/371472 [08:12<30:08:22,  3.41it/s]
  0%|          | 1695/371472 [08:12<29:11:30,  3.52it/s]
  0%|          | 1696/371472 [08:13<28:22:37,  3.62it/s]
  0%|          | 1697/371472 [08:13<28:45:18,  3.57it/s]
  0%|          | 1698/371472 [08:13<28:55:43,  3.55it/s]
  0%|          | 1699/371472 [08:14<31:43:44,  3.24it/s]
  0%|          | 1700/371472 [08:14<31:34:26,  3.25it/s]
                                                        
{'loss': 6.1054, 'learning_rate': 9.963638518390829e-07, 'epoch': 0.07}

  0%|          | 1700/371472 [08:14<31:34:26,  3.25it/s]
  0%|          | 1701/371472 [08:14<29:57:41,  3.43it/s]
  0%|          | 1702/371472 [08:14<28:46:00,  3.57it/s]
  0%|          | 1703/371472 [08:15<30:06:25,  3.41it/s]
  0%|          | 1704/371472 [08:15<29:25:02,  3.49it/s]
  0%|          | 1705/371472 [08:15<28:46:22,  3.57it/s]
  0%|          | 1706/371472 [08:16<27:49:33,  3.69it/s]
  0%|          | 1707/371472 [08:16<27:31:02,  3.73it/s]
  0%|          | 1708/371472 [08:16<27:52:27,  3.68it/s]
  0%|          | 1709/371472 [08:16<28:19:40,  3.63it/s]
  0%|          | 1710/371472 [08:17<27:50:43,  3.69it/s]
  0%|          | 1711/371472 [08:17<27:34:25,  3.72it/s]
  0%|          | 1712/371472 [08:17<27:14:13,  3.77it/s]
  0%|          | 1713/371472 [08:17<28:54:05,  3.55it/s]
  0%|          | 1714/371472 [08:18<28:33:58,  3.60it/s]
  0%|          | 1715/371472 [08:18<28:27:04,  3.61it/s]
  0%|          | 1716/371472 [08:18<27:44:24,  3.70it/s]
  0%|          | 1717/371472 [08:19<26:57:19,  3.81it/s]
  0%|          | 1718/371472 [08:19<27:23:39,  3.75it/s]
  0%|          | 1719/371472 [08:19<27:36:25,  3.72it/s]
  0%|          | 1720/371472 [08:19<27:05:38,  3.79it/s]
                                                        
{'loss': 6.2843, 'learning_rate': 9.963153698636041e-07, 'epoch': 0.07}

  0%|          | 1720/371472 [08:19<27:05:38,  3.79it/s]
  0%|          | 1721/371472 [08:20<28:04:42,  3.66it/s]
  0%|          | 1722/371472 [08:20<27:51:14,  3.69it/s]
  0%|          | 1723/371472 [08:20<28:22:25,  3.62it/s]
  0%|          | 1724/371472 [08:20<28:37:54,  3.59it/s]
  0%|          | 1725/371472 [08:21<30:57:32,  3.32it/s]
  0%|          | 1726/371472 [08:21<32:03:53,  3.20it/s]
  0%|          | 1727/371472 [08:21<30:58:24,  3.32it/s]
  0%|          | 1728/371472 [08:22<31:03:18,  3.31it/s]
  0%|          | 1729/371472 [08:22<30:47:38,  3.34it/s]
  0%|          | 1730/371472 [08:22<32:12:20,  3.19it/s]
  0%|          | 1731/371472 [08:23<34:29:42,  2.98it/s]
  0%|          | 1732/371472 [08:23<32:59:21,  3.11it/s]
  0%|          | 1733/371472 [08:23<31:36:33,  3.25it/s]
  0%|          | 1734/371472 [08:24<30:52:48,  3.33it/s]
  0%|          | 1735/371472 [08:24<30:34:28,  3.36it/s]
  0%|          | 1736/371472 [08:24<30:25:31,  3.38it/s]
  0%|          | 1737/371472 [08:24<28:55:59,  3.55it/s]
  0%|          | 1738/371472 [08:25<28:45:07,  3.57it/s]
  0%|          | 1739/371472 [08:25<30:11:18,  3.40it/s]
  0%|          | 1740/371472 [08:25<31:21:18,  3.28it/s]
                                                        
{'loss': 6.0034, 'learning_rate': 9.96266887888125e-07, 'epoch': 0.07}

  0%|          | 1740/371472 [08:25<31:21:18,  3.28it/s]
  0%|          | 1741/371472 [08:26<30:38:57,  3.35it/s]
  0%|          | 1742/371472 [08:26<30:44:41,  3.34it/s]
  0%|          | 1743/371472 [08:26<29:29:52,  3.48it/s]
  0%|          | 1744/371472 [08:27<31:29:21,  3.26it/s]
  0%|          | 1745/371472 [08:27<30:58:08,  3.32it/s]
  0%|          | 1746/371472 [08:27<30:40:26,  3.35it/s]
  0%|          | 1747/371472 [08:27<30:34:39,  3.36it/s]
  0%|          | 1748/371472 [08:28<30:51:34,  3.33it/s]
  0%|          | 1749/371472 [08:28<30:13:13,  3.40it/s]
  0%|          | 1750/371472 [08:28<30:14:31,  3.40it/s]
  0%|          | 1751/371472 [08:29<29:01:26,  3.54it/s]
  0%|          | 1752/371472 [08:29<30:46:12,  3.34it/s]
  0%|          | 1753/371472 [08:29<30:53:13,  3.33it/s]
  0%|          | 1754/371472 [08:30<32:58:44,  3.11it/s]
  0%|          | 1755/371472 [08:30<32:25:00,  3.17it/s]
  0%|          | 1756/371472 [08:30<33:48:45,  3.04it/s]
  0%|          | 1757/371472 [08:31<31:47:40,  3.23it/s]
  0%|          | 1758/371472 [08:31<31:17:21,  3.28it/s]
  0%|          | 1759/371472 [08:31<32:29:39,  3.16it/s]
  0%|          | 1760/371472 [08:31<30:44:58,  3.34it/s]
                                                        
{'loss': 6.2372, 'learning_rate': 9.962184059126463e-07, 'epoch': 0.08}

  0%|          | 1760/371472 [08:31<30:44:58,  3.34it/s]
  0%|          | 1761/371472 [08:32<31:01:27,  3.31it/s]
  0%|          | 1762/371472 [08:32<31:21:29,  3.27it/s]
  0%|          | 1763/371472 [08:32<31:58:05,  3.21it/s]
  0%|          | 1764/371472 [08:33<34:13:02,  3.00it/s]
  0%|          | 1765/371472 [08:33<33:55:09,  3.03it/s]
  0%|          | 1766/371472 [08:33<32:56:15,  3.12it/s]
  0%|          | 1767/371472 [08:34<31:44:29,  3.24it/s]
  0%|          | 1768/371472 [08:34<29:50:45,  3.44it/s]
  0%|          | 1769/371472 [08:34<29:13:47,  3.51it/s]
  0%|          | 1770/371472 [08:34<28:22:22,  3.62it/s]
  0%|          | 1771/371472 [08:35<31:42:22,  3.24it/s]
  0%|          | 1772/371472 [08:35<31:27:08,  3.27it/s]
  0%|          | 1773/371472 [08:35<30:14:44,  3.40it/s]
  0%|          | 1774/371472 [08:36<29:34:54,  3.47it/s]
  0%|          | 1775/371472 [08:36<28:16:25,  3.63it/s]
  0%|          | 1776/371472 [08:36<28:22:00,  3.62it/s]
  0%|          | 1777/371472 [08:36<28:22:05,  3.62it/s]
  0%|          | 1778/371472 [08:37<27:21:31,  3.75it/s]
  0%|          | 1779/371472 [08:37<28:41:38,  3.58it/s]
  0%|          | 1780/371472 [08:37<28:59:21,  3.54it/s]
                                                        
{'loss': 6.2253, 'learning_rate': 9.961699239371674e-07, 'epoch': 0.08}

  0%|          | 1780/371472 [08:37<28:59:21,  3.54it/s]
  0%|          | 1781/371472 [08:38<28:41:30,  3.58it/s]
  0%|          | 1782/371472 [08:38<30:40:20,  3.35it/s]
  0%|          | 1783/371472 [08:38<29:22:38,  3.50it/s]
  0%|          | 1784/371472 [08:38<29:43:12,  3.46it/s]
  0%|          | 1785/371472 [08:39<29:27:20,  3.49it/s]
  0%|          | 1786/371472 [08:39<28:51:27,  3.56it/s]
  0%|          | 1787/371472 [08:39<28:30:20,  3.60it/s]
  0%|          | 1788/371472 [08:40<28:14:27,  3.64it/s]
  0%|          | 1789/371472 [08:40<28:48:57,  3.56it/s]
  0%|          | 1790/371472 [08:40<29:41:38,  3.46it/s]
  0%|          | 1791/371472 [08:40<29:01:25,  3.54it/s]
  0%|          | 1792/371472 [08:41<28:15:40,  3.63it/s]
  0%|          | 1793/371472 [08:41<27:57:19,  3.67it/s]
  0%|          | 1794/371472 [08:41<28:12:37,  3.64it/s]
  0%|          | 1795/371472 [08:42<29:10:21,  3.52it/s]
  0%|          | 1796/371472 [08:42<29:16:35,  3.51it/s]
  0%|          | 1797/371472 [08:42<29:33:31,  3.47it/s]
  0%|          | 1798/371472 [08:42<31:56:26,  3.21it/s]
  0%|          | 1799/371472 [08:43<30:26:35,  3.37it/s]
  0%|          | 1800/371472 [08:43<31:26:35,  3.27it/s]
                                                        
{'loss': 6.1184, 'learning_rate': 9.961214419616884e-07, 'epoch': 0.08}

  0%|          | 1800/371472 [08:43<31:26:35,  3.27it/s]
  0%|          | 1801/371472 [08:43<31:18:54,  3.28it/s]
  0%|          | 1802/371472 [08:44<30:58:36,  3.31it/s]
  0%|          | 1803/371472 [08:44<30:24:14,  3.38it/s]
  0%|          | 1804/371472 [08:44<28:54:41,  3.55it/s]
  0%|          | 1805/371472 [08:45<29:09:38,  3.52it/s]
  0%|          | 1806/371472 [08:45<28:49:42,  3.56it/s]
  0%|          | 1807/371472 [08:45<29:08:35,  3.52it/s]
  0%|          | 1808/371472 [08:45<29:04:17,  3.53it/s]
  0%|          | 1809/371472 [08:46<29:05:15,  3.53it/s]
  0%|          | 1810/371472 [08:46<28:29:42,  3.60it/s]
  0%|          | 1811/371472 [08:46<28:21:42,  3.62it/s]
  0%|          | 1812/371472 [08:47<31:15:40,  3.28it/s]
  0%|          | 1813/371472 [08:47<29:52:01,  3.44it/s]
  0%|          | 1814/371472 [08:47<29:38:33,  3.46it/s]
  0%|          | 1815/371472 [08:47<29:19:01,  3.50it/s]
  0%|          | 1816/371472 [08:48<31:49:30,  3.23it/s]
  0%|          | 1817/371472 [08:48<30:35:51,  3.36it/s]
  0%|          | 1818/371472 [08:48<31:59:48,  3.21it/s]
  0%|          | 1819/371472 [08:49<30:53:00,  3.32it/s]
  0%|          | 1820/371472 [08:49<31:33:28,  3.25it/s]
                                                        
{'loss': 5.952, 'learning_rate': 9.960729599862095e-07, 'epoch': 0.08}

  0%|          | 1820/371472 [08:49<31:33:28,  3.25it/s]
  0%|          | 1821/371472 [08:49<30:46:59,  3.34it/s]
  0%|          | 1822/371472 [08:50<33:17:24,  3.08it/s]
  0%|          | 1823/371472 [08:50<31:51:26,  3.22it/s]
  0%|          | 1824/371472 [08:50<31:19:06,  3.28it/s]
  0%|          | 1825/371472 [08:50<30:21:17,  3.38it/s]
  0%|          | 1826/371472 [08:51<29:39:44,  3.46it/s]
  0%|          | 1827/371472 [08:51<28:48:41,  3.56it/s]
  0%|          | 1828/371472 [08:51<29:41:12,  3.46it/s]
  0%|          | 1829/371472 [08:52<29:55:04,  3.43it/s]
  0%|          | 1830/371472 [08:52<28:58:10,  3.54it/s]
  0%|          | 1831/371472 [08:52<28:31:40,  3.60it/s]
  0%|          | 1832/371472 [08:52<28:34:01,  3.59it/s]
  0%|          | 1833/371472 [08:53<29:01:41,  3.54it/s]
  0%|          | 1834/371472 [08:53<29:00:22,  3.54it/s]
  0%|          | 1835/371472 [08:53<29:18:37,  3.50it/s]
  0%|          | 1836/371472 [08:54<29:37:25,  3.47it/s]
  0%|          | 1837/371472 [08:54<29:16:37,  3.51it/s]
  0%|          | 1838/371472 [08:54<29:57:46,  3.43it/s]
  0%|          | 1839/371472 [08:54<30:10:50,  3.40it/s]
  0%|          | 1840/371472 [08:55<29:53:37,  3.43it/s]
                                                        
{'loss': 6.1059, 'learning_rate': 9.960244780107306e-07, 'epoch': 0.08}

  0%|          | 1840/371472 [08:55<29:53:37,  3.43it/s]
  0%|          | 1841/371472 [08:55<29:16:16,  3.51it/s]
  0%|          | 1842/371472 [08:55<29:05:45,  3.53it/s]
  0%|          | 1843/371472 [08:56<29:06:10,  3.53it/s]
  0%|          | 1844/371472 [08:56<29:19:12,  3.50it/s]
  0%|          | 1845/371472 [08:56<30:39:21,  3.35it/s]
  0%|          | 1846/371472 [08:56<30:53:01,  3.32it/s]
  0%|          | 1847/371472 [08:57<30:09:30,  3.40it/s]
  0%|          | 1848/371472 [08:57<29:35:45,  3.47it/s]
  0%|          | 1849/371472 [08:57<29:44:27,  3.45it/s]
  0%|          | 1850/371472 [08:58<31:25:11,  3.27it/s]
  0%|          | 1851/371472 [08:58<33:37:15,  3.05it/s]
  0%|          | 1852/371472 [08:58<33:08:29,  3.10it/s]
  0%|          | 1853/371472 [08:59<31:50:04,  3.23it/s]
  0%|          | 1854/371472 [08:59<31:23:51,  3.27it/s]
  0%|          | 1855/371472 [08:59<32:27:04,  3.16it/s]
  0%|          | 1856/371472 [09:00<33:20:57,  3.08it/s]
  0%|          | 1857/371472 [09:00<31:36:41,  3.25it/s]
  1%|          | 1858/371472 [09:00<30:45:36,  3.34it/s]
  1%|          | 1859/371472 [09:00<31:20:36,  3.28it/s]
  1%|          | 1860/371472 [09:01<32:11:41,  3.19it/s]
                                                        
{'loss': 6.0038, 'learning_rate': 9.959759960352519e-07, 'epoch': 0.08}

  1%|          | 1860/371472 [09:01<32:11:41,  3.19it/s]
  1%|          | 1861/371472 [09:01<30:49:50,  3.33it/s]
  1%|          | 1862/371472 [09:01<30:49:20,  3.33it/s]
  1%|          | 1863/371472 [09:02<29:49:08,  3.44it/s]
  1%|          | 1864/371472 [09:02<32:14:07,  3.18it/s]
  1%|          | 1865/371472 [09:02<31:04:54,  3.30it/s]
  1%|          | 1866/371472 [09:03<33:03:08,  3.11it/s]
  1%|          | 1867/371472 [09:03<32:09:21,  3.19it/s]
  1%|          | 1868/371472 [09:03<32:22:57,  3.17it/s]
  1%|          | 1869/371472 [09:04<31:38:54,  3.24it/s]
  1%|          | 1870/371472 [09:04<31:25:13,  3.27it/s]
  1%|          | 1871/371472 [09:04<30:18:12,  3.39it/s]
  1%|          | 1872/371472 [09:04<30:28:21,  3.37it/s]
  1%|          | 1873/371472 [09:05<29:35:41,  3.47it/s]
  1%|          | 1874/371472 [09:05<28:46:35,  3.57it/s]
  1%|          | 1875/371472 [09:05<31:03:46,  3.31it/s]
  1%|          | 1876/371472 [09:06<29:36:42,  3.47it/s]
  1%|          | 1877/371472 [09:06<28:24:35,  3.61it/s]
  1%|          | 1878/371472 [09:06<27:46:37,  3.70it/s]
  1%|          | 1879/371472 [09:06<27:52:33,  3.68it/s]
  1%|          | 1880/371472 [09:07<28:17:41,  3.63it/s]
                                                        
{'loss': 6.197, 'learning_rate': 9.959275140597727e-07, 'epoch': 0.08}

  1%|          | 1880/371472 [09:07<28:17:41,  3.63it/s]
  1%|          | 1881/371472 [09:07<28:18:49,  3.63it/s]
  1%|          | 1882/371472 [09:07<27:59:18,  3.67it/s]
  1%|          | 1883/371472 [09:07<28:28:07,  3.61it/s]
  1%|          | 1884/371472 [09:08<28:35:24,  3.59it/s]
  1%|          | 1885/371472 [09:08<28:16:38,  3.63it/s]
  1%|          | 1886/371472 [09:08<28:14:16,  3.64it/s]
  1%|          | 1887/371472 [09:09<27:54:03,  3.68it/s]
  1%|          | 1888/371472 [09:09<28:14:38,  3.63it/s]
  1%|          | 1889/371472 [09:09<28:01:56,  3.66it/s]
  1%|          | 1890/371472 [09:09<27:53:25,  3.68it/s]
  1%|          | 1891/371472 [09:10<27:38:48,  3.71it/s]
  1%|          | 1892/371472 [09:10<27:56:32,  3.67it/s]
  1%|          | 1893/371472 [09:10<28:38:05,  3.59it/s]
  1%|          | 1894/371472 [09:11<28:51:09,  3.56it/s]
  1%|          | 1895/371472 [09:11<28:45:46,  3.57it/s]
  1%|          | 1896/371472 [09:11<30:11:06,  3.40it/s]
  1%|          | 1897/371472 [09:11<29:46:36,  3.45it/s]
  1%|          | 1898/371472 [09:12<31:13:19,  3.29it/s]
  1%|          | 1899/371472 [09:12<30:19:54,  3.38it/s]
  1%|          | 1900/371472 [09:12<29:11:46,  3.52it/s]
                                                        
{'loss': 6.0109, 'learning_rate': 9.95879032084294e-07, 'epoch': 0.08}

  1%|          | 1900/371472 [09:12<29:11:46,  3.52it/s]
  1%|          | 1901/371472 [09:13<29:54:28,  3.43it/s]
  1%|          | 1902/371472 [09:13<29:14:08,  3.51it/s]
  1%|          | 1903/371472 [09:13<35:55:00,  2.86it/s]
  1%|          | 1904/371472 [09:14<33:52:32,  3.03it/s]
  1%|          | 1905/371472 [09:14<33:36:28,  3.05it/s]
  1%|          | 1906/371472 [09:14<31:36:01,  3.25it/s]
  1%|          | 1907/371472 [09:14<29:58:47,  3.42it/s]
  1%|          | 1908/371472 [09:15<29:25:36,  3.49it/s]
  1%|          | 1909/371472 [09:15<28:44:35,  3.57it/s]
  1%|          | 1910/371472 [09:15<28:42:39,  3.58it/s]
  1%|          | 1911/371472 [09:16<28:21:34,  3.62it/s]
  1%|          | 1912/371472 [09:16<28:27:45,  3.61it/s]
  1%|          | 1913/371472 [09:16<29:01:33,  3.54it/s]
  1%|          | 1914/371472 [09:16<28:31:46,  3.60it/s]
  1%|          | 1915/371472 [09:17<28:03:34,  3.66it/s]
  1%|          | 1916/371472 [09:17<27:32:47,  3.73it/s]
  1%|          | 1917/371472 [09:17<28:02:22,  3.66it/s]
  1%|          | 1918/371472 [09:17<27:45:23,  3.70it/s]
  1%|          | 1919/371472 [09:18<27:31:29,  3.73it/s]
  1%|          | 1920/371472 [09:18<27:50:56,  3.69it/s]
                                                        
{'loss': 6.081, 'learning_rate': 9.95830550108815e-07, 'epoch': 0.08}

  1%|          | 1920/371472 [09:18<27:50:56,  3.69it/s]
  1%|          | 1921/371472 [09:18<28:39:44,  3.58it/s]
  1%|          | 1922/371472 [09:19<35:49:14,  2.87it/s]
  1%|          | 1923/371472 [09:19<33:01:01,  3.11it/s]
  1%|          | 1924/371472 [09:19<31:57:40,  3.21it/s]
  1%|          | 1925/371472 [09:20<31:38:19,  3.24it/s]
  1%|          | 1926/371472 [09:20<30:32:58,  3.36it/s]
  1%|          | 1927/371472 [09:20<30:22:10,  3.38it/s]
  1%|          | 1928/371472 [09:21<29:28:53,  3.48it/s]
  1%|          | 1929/371472 [09:21<29:40:11,  3.46it/s]
  1%|          | 1930/371472 [09:21<28:50:57,  3.56it/s]
  1%|          | 1931/371472 [09:21<30:59:53,  3.31it/s]
  1%|          | 1932/371472 [09:22<30:12:19,  3.40it/s]
  1%|          | 1933/371472 [09:22<29:46:12,  3.45it/s]
  1%|          | 1934/371472 [09:22<28:45:19,  3.57it/s]
  1%|          | 1935/371472 [09:22<27:41:57,  3.71it/s]
  1%|          | 1936/371472 [09:23<29:53:39,  3.43it/s]
  1%|          | 1937/371472 [09:23<32:15:15,  3.18it/s]
  1%|          | 1938/371472 [09:23<31:40:28,  3.24it/s]
  1%|          | 1939/371472 [09:24<34:00:43,  3.02it/s]
  1%|          | 1940/371472 [09:24<32:44:00,  3.14it/s]
                                                        
{'loss': 5.8241, 'learning_rate': 9.957820681333361e-07, 'epoch': 0.08}

  1%|          | 1940/371472 [09:24<32:44:00,  3.14it/s]
  1%|          | 1941/371472 [09:24<30:51:38,  3.33it/s]
  1%|          | 1942/371472 [09:25<29:20:16,  3.50it/s]
  1%|          | 1943/371472 [09:25<29:03:05,  3.53it/s]
  1%|          | 1944/371472 [09:25<28:44:28,  3.57it/s]
  1%|          | 1945/371472 [09:26<30:31:40,  3.36it/s]
  1%|          | 1946/371472 [09:26<30:09:36,  3.40it/s]
  1%|          | 1947/371472 [09:26<29:13:11,  3.51it/s]
  1%|          | 1948/371472 [09:26<28:40:53,  3.58it/s]
  1%|          | 1949/371472 [09:27<28:55:02,  3.55it/s]
  1%|          | 1950/371472 [09:27<28:27:57,  3.61it/s]
  1%|          | 1951/371472 [09:27<29:32:31,  3.47it/s]
  1%|          | 1952/371472 [09:27<29:05:35,  3.53it/s]
  1%|          | 1953/371472 [09:28<29:04:06,  3.53it/s]
  1%|          | 1954/371472 [09:28<29:08:28,  3.52it/s]
  1%|          | 1955/371472 [09:28<28:44:46,  3.57it/s]
  1%|          | 1956/371472 [09:29<29:15:04,  3.51it/s]
  1%|          | 1957/371472 [09:29<28:22:11,  3.62it/s]
  1%|          | 1958/371472 [09:29<27:59:08,  3.67it/s]
  1%|          | 1959/371472 [09:29<27:34:17,  3.72it/s]
  1%|          | 1960/371472 [09:30<27:33:05,  3.73it/s]
                                                        
{'loss': 6.2336, 'learning_rate': 9.957335861578572e-07, 'epoch': 0.08}

  1%|          | 1960/371472 [09:30<27:33:05,  3.73it/s]
  1%|          | 1961/371472 [09:30<27:34:46,  3.72it/s]
  1%|          | 1962/371472 [09:30<28:59:57,  3.54it/s]
  1%|          | 1963/371472 [09:31<30:08:26,  3.41it/s]
  1%|          | 1964/371472 [09:31<29:49:45,  3.44it/s]
  1%|          | 1965/371472 [09:31<32:31:20,  3.16it/s]
  1%|          | 1966/371472 [09:32<30:51:47,  3.33it/s]
  1%|          | 1967/371472 [09:32<29:58:56,  3.42it/s]
  1%|          | 1968/371472 [09:32<30:30:08,  3.36it/s]
  1%|          | 1969/371472 [09:32<29:33:58,  3.47it/s]
  1%|          | 1970/371472 [09:33<29:03:44,  3.53it/s]
  1%|          | 1971/371472 [09:33<28:23:13,  3.62it/s]
  1%|          | 1972/371472 [09:33<28:52:11,  3.56it/s]
  1%|          | 1973/371472 [09:34<30:09:33,  3.40it/s]
  1%|          | 1974/371472 [09:34<29:41:49,  3.46it/s]
  1%|          | 1975/371472 [09:34<29:56:38,  3.43it/s]
  1%|          | 1976/371472 [09:34<32:01:40,  3.20it/s]
  1%|          | 1977/371472 [09:35<31:29:36,  3.26it/s]
  1%|          | 1978/371472 [09:35<30:12:48,  3.40it/s]
  1%|          | 1979/371472 [09:35<29:16:27,  3.51it/s]
  1%|          | 1980/371472 [09:36<30:00:05,  3.42it/s]
                                                        
{'loss': 5.9938, 'learning_rate': 9.956851041823783e-07, 'epoch': 0.09}

  1%|          | 1980/371472 [09:36<30:00:05,  3.42it/s]
  1%|          | 1981/371472 [09:36<29:12:28,  3.51it/s]
  1%|          | 1982/371472 [09:36<31:11:03,  3.29it/s]
  1%|          | 1983/371472 [09:36<30:23:56,  3.38it/s]
  1%|          | 1984/371472 [09:37<29:34:47,  3.47it/s]
  1%|          | 1985/371472 [09:37<30:14:41,  3.39it/s]
  1%|          | 1986/371472 [09:37<29:23:06,  3.49it/s]
  1%|          | 1987/371472 [09:38<29:10:56,  3.52it/s]
  1%|          | 1988/371472 [09:38<27:58:24,  3.67it/s]
  1%|          | 1989/371472 [09:38<28:42:47,  3.57it/s]
  1%|          | 1990/371472 [09:38<28:01:45,  3.66it/s]
  1%|          | 1991/371472 [09:39<28:03:14,  3.66it/s]
  1%|          | 1992/371472 [09:39<31:25:15,  3.27it/s]
  1%|          | 1993/371472 [09:40<36:20:40,  2.82it/s]
  1%|          | 1994/371472 [09:40<34:24:28,  2.98it/s]
  1%|          | 1995/371472 [09:40<31:52:43,  3.22it/s]
  1%|          | 1996/371472 [09:40<30:21:06,  3.38it/s]
  1%|          | 1997/371472 [09:41<29:50:34,  3.44it/s]
  1%|          | 1998/371472 [09:41<29:01:11,  3.54it/s]
  1%|          | 1999/371472 [09:41<28:40:09,  3.58it/s]
  1%|          | 2000/371472 [09:41<28:28:05,  3.61it/s]
                                                        
{'loss': 6.1137, 'learning_rate': 9.956366222068996e-07, 'epoch': 0.09}

  1%|          | 2000/371472 [09:41<28:28:05,  3.61it/s]
  1%|          | 2001/371472 [09:42<28:31:12,  3.60it/s]
  1%|          | 2002/371472 [09:42<30:07:42,  3.41it/s]
  1%|          | 2003/371472 [09:42<29:09:24,  3.52it/s]
  1%|          | 2004/371472 [09:43<28:57:35,  3.54it/s]
  1%|          | 2005/371472 [09:43<28:28:17,  3.60it/s]
  1%|          | 2006/371472 [09:43<28:05:26,  3.65it/s]
  1%|          | 2007/371472 [09:43<28:36:18,  3.59it/s]
  1%|          | 2008/371472 [09:44<28:04:17,  3.66it/s]
  1%|          | 2009/371472 [09:44<28:40:14,  3.58it/s]
  1%|          | 2010/371472 [09:44<28:12:45,  3.64it/s]
  1%|          | 2011/371472 [09:45<29:12:20,  3.51it/s]
  1%|          | 2012/371472 [09:45<30:35:52,  3.35it/s]
  1%|          | 2013/371472 [09:45<30:23:46,  3.38it/s]
  1%|          | 2014/371472 [09:45<29:25:15,  3.49it/s]
  1%|          | 2015/371472 [09:46<33:30:13,  3.06it/s]
  1%|          | 2016/371472 [09:46<31:45:59,  3.23it/s]
  1%|          | 2017/371472 [09:46<31:05:57,  3.30it/s]
  1%|          | 2018/371472 [09:47<30:21:19,  3.38it/s]
  1%|          | 2019/371472 [09:47<30:05:30,  3.41it/s]
  1%|          | 2020/371472 [09:47<29:18:24,  3.50it/s]
                                                        
{'loss': 5.8231, 'learning_rate': 9.955881402314206e-07, 'epoch': 0.09}

  1%|          | 2020/371472 [09:47<29:18:24,  3.50it/s]
  1%|          | 2021/371472 [09:47<28:16:41,  3.63it/s]
  1%|          | 2022/371472 [09:48<28:49:01,  3.56it/s]
  1%|          | 2023/371472 [09:48<28:03:03,  3.66it/s]
  1%|          | 2024/371472 [09:48<27:56:25,  3.67it/s]
  1%|          | 2025/371472 [09:49<27:30:54,  3.73it/s]
  1%|          | 2026/371472 [09:49<27:57:45,  3.67it/s]
  1%|          | 2027/371472 [09:49<28:20:09,  3.62it/s]
  1%|          | 2028/371472 [09:49<28:31:07,  3.60it/s]
  1%|          | 2029/371472 [09:50<28:44:15,  3.57it/s]
  1%|          | 2030/371472 [09:50<30:42:16,  3.34it/s]
  1%|          | 2031/371472 [09:50<30:06:55,  3.41it/s]
  1%|          | 2032/371472 [09:51<28:54:59,  3.55it/s]
  1%|          | 2033/371472 [09:51<28:38:10,  3.58it/s]
  1%|          | 2034/371472 [09:51<28:22:17,  3.62it/s]
  1%|          | 2035/371472 [09:51<28:50:32,  3.56it/s]
  1%|          | 2036/371472 [09:52<28:08:31,  3.65it/s]
  1%|          | 2037/371472 [09:52<27:36:01,  3.72it/s]
  1%|          | 2038/371472 [09:52<27:51:06,  3.68it/s]
  1%|          | 2039/371472 [09:52<28:31:27,  3.60it/s]
  1%|          | 2040/371472 [09:53<28:13:15,  3.64it/s]
                                                        
{'loss': 5.919, 'learning_rate': 9.955396582559417e-07, 'epoch': 0.09}

  1%|          | 2040/371472 [09:53<28:13:15,  3.64it/s]
  1%|          | 2041/371472 [09:53<29:04:56,  3.53it/s]
  1%|          | 2042/371472 [09:53<32:28:00,  3.16it/s]
  1%|          | 2043/371472 [09:54<30:26:47,  3.37it/s]
  1%|          | 2044/371472 [09:54<30:19:11,  3.38it/s]
  1%|          | 2045/371472 [09:54<31:13:03,  3.29it/s]
  1%|          | 2046/371472 [09:55<31:56:27,  3.21it/s]
  1%|          | 2047/371472 [09:55<30:56:58,  3.32it/s]
  1%|          | 2048/371472 [09:55<29:44:10,  3.45it/s]
  1%|          | 2049/371472 [09:55<28:45:00,  3.57it/s]
  1%|          | 2050/371472 [09:56<27:53:20,  3.68it/s]
  1%|          | 2051/371472 [09:56<28:07:47,  3.65it/s]
  1%|          | 2052/371472 [09:56<29:10:26,  3.52it/s]
  1%|          | 2053/371472 [09:57<32:58:10,  3.11it/s]
  1%|          | 2054/371472 [09:57<32:52:17,  3.12it/s]
  1%|          | 2055/371472 [09:57<31:55:38,  3.21it/s]
  1%|          | 2056/371472 [09:58<31:32:41,  3.25it/s]
  1%|          | 2057/371472 [09:58<30:01:32,  3.42it/s]
  1%|          | 2058/371472 [09:58<29:45:17,  3.45it/s]
  1%|          | 2059/371472 [09:58<30:45:07,  3.34it/s]
  1%|          | 2060/371472 [09:59<29:44:57,  3.45it/s]
                                                        
{'loss': 5.9266, 'learning_rate': 9.954911762804628e-07, 'epoch': 0.09}

  1%|          | 2060/371472 [09:59<29:44:57,  3.45it/s]
  1%|          | 2061/371472 [09:59<29:43:07,  3.45it/s]
  1%|          | 2062/371472 [09:59<29:43:53,  3.45it/s]
  1%|          | 2063/371472 [10:00<29:02:44,  3.53it/s]
  1%|          | 2064/371472 [10:00<29:03:13,  3.53it/s]
  1%|          | 2065/371472 [10:00<28:33:15,  3.59it/s]
  1%|          | 2066/371472 [10:00<30:46:38,  3.33it/s]
  1%|          | 2067/371472 [10:01<30:22:40,  3.38it/s]
  1%|          | 2068/371472 [10:01<29:08:07,  3.52it/s]
  1%|          | 2069/371472 [10:01<29:11:36,  3.51it/s]
  1%|          | 2070/371472 [10:02<29:28:46,  3.48it/s]
  1%|          | 2071/371472 [10:02<29:03:50,  3.53it/s]
  1%|          | 2072/371472 [10:02<28:39:04,  3.58it/s]
  1%|          | 2073/371472 [10:02<28:00:16,  3.66it/s]
  1%|          | 2074/371472 [10:03<27:35:32,  3.72it/s]
  1%|          | 2075/371472 [10:03<27:24:52,  3.74it/s]
  1%|          | 2076/371472 [10:03<27:50:17,  3.69it/s]
  1%|          | 2077/371472 [10:03<28:47:13,  3.56it/s]
  1%|          | 2078/371472 [10:04<28:37:03,  3.59it/s]
  1%|          | 2079/371472 [10:04<28:03:13,  3.66it/s]
  1%|          | 2080/371472 [10:04<27:20:36,  3.75it/s]
                                                        
{'loss': 6.0525, 'learning_rate': 9.954426943049839e-07, 'epoch': 0.09}

  1%|          | 2080/371472 [10:04<27:20:36,  3.75it/s]
  1%|          | 2081/371472 [10:05<28:26:01,  3.61it/s]
  1%|          | 2082/371472 [10:05<30:00:38,  3.42it/s]
  1%|          | 2083/371472 [10:05<30:22:30,  3.38it/s]
  1%|          | 2084/371472 [10:05<29:18:25,  3.50it/s]
  1%|          | 2085/371472 [10:06<30:34:54,  3.36it/s]
  1%|          | 2086/371472 [10:06<30:06:08,  3.41it/s]
  1%|          | 2087/371472 [10:06<28:51:00,  3.56it/s]
  1%|          | 2088/371472 [10:07<27:45:36,  3.70it/s]
  1%|          | 2089/371472 [10:07<28:41:57,  3.58it/s]
  1%|          | 2090/371472 [10:07<28:51:48,  3.55it/s]
  1%|          | 2091/371472 [10:07<28:29:29,  3.60it/s]
  1%|          | 2092/371472 [10:08<30:30:11,  3.36it/s]
  1%|          | 2093/371472 [10:08<29:44:21,  3.45it/s]
  1%|          | 2094/371472 [10:08<28:48:58,  3.56it/s]
  1%|          | 2095/371472 [10:09<27:43:21,  3.70it/s]
  1%|          | 2096/371472 [10:09<28:32:25,  3.60it/s]
  1%|          | 2097/371472 [10:09<29:11:37,  3.51it/s]
  1%|          | 2098/371472 [10:09<29:11:41,  3.51it/s]
  1%|          | 2099/371472 [10:10<31:59:41,  3.21it/s]
  1%|          | 2100/371472 [10:10<31:25:27,  3.27it/s]
                                                        
{'loss': 5.8037, 'learning_rate': 9.953942123295051e-07, 'epoch': 0.09}

  1%|          | 2100/371472 [10:10<31:25:27,  3.27it/s]
  1%|          | 2101/371472 [10:10<31:54:10,  3.22it/s]
  1%|          | 2102/371472 [10:11<32:33:14,  3.15it/s]
  1%|          | 2103/371472 [10:11<33:58:46,  3.02it/s]
  1%|          | 2104/371472 [10:11<32:53:16,  3.12it/s]
  1%|          | 2105/371472 [10:12<31:07:43,  3.30it/s]
  1%|          | 2106/371472 [10:12<34:16:06,  2.99it/s]
  1%|          | 2107/371472 [10:12<32:25:47,  3.16it/s]
  1%|          | 2108/371472 [10:13<31:35:06,  3.25it/s]
  1%|          | 2109/371472 [10:13<30:17:20,  3.39it/s]
  1%|          | 2110/371472 [10:13<29:49:27,  3.44it/s]
  1%|          | 2111/371472 [10:13<28:57:31,  3.54it/s]
  1%|          | 2112/371472 [10:14<30:46:44,  3.33it/s]
  1%|          | 2113/371472 [10:14<30:28:00,  3.37it/s]
  1%|          | 2114/371472 [10:14<32:12:01,  3.19it/s]
  1%|          | 2115/371472 [10:15<31:22:28,  3.27it/s]
  1%|          | 2116/371472 [10:15<29:58:41,  3.42it/s]
  1%|          | 2117/371472 [10:15<30:54:12,  3.32it/s]
  1%|          | 2118/371472 [10:16<33:17:21,  3.08it/s]
  1%|          | 2119/371472 [10:16<31:14:52,  3.28it/s]
  1%|          | 2120/371472 [10:16<30:51:10,  3.33it/s]
                                                        
{'loss': 5.8224, 'learning_rate': 9.95345730354026e-07, 'epoch': 0.09}

  1%|          | 2120/371472 [10:16<30:51:10,  3.33it/s]
  1%|          | 2121/371472 [10:16<29:38:46,  3.46it/s]
  1%|          | 2122/371472 [10:17<29:48:22,  3.44it/s]
  1%|          | 2123/371472 [10:17<30:17:05,  3.39it/s]
  1%|          | 2124/371472 [10:17<29:00:48,  3.54it/s]
  1%|          | 2125/371472 [10:18<29:01:44,  3.53it/s]
  1%|          | 2126/371472 [10:18<28:54:04,  3.55it/s]
  1%|          | 2127/371472 [10:18<31:15:53,  3.28it/s]
  1%|          | 2128/371472 [10:19<31:12:27,  3.29it/s]
  1%|          | 2129/371472 [10:19<30:03:08,  3.41it/s]
  1%|          | 2130/371472 [10:19<33:58:41,  3.02it/s]
  1%|          | 2131/371472 [10:20<32:13:48,  3.18it/s]
  1%|          | 2132/371472 [10:20<30:42:44,  3.34it/s]
  1%|          | 2133/371472 [10:20<29:44:44,  3.45it/s]
  1%|          | 2134/371472 [10:20<29:01:40,  3.53it/s]
  1%|          | 2135/371472 [10:21<28:27:46,  3.60it/s]
  1%|          | 2136/371472 [10:21<28:13:17,  3.64it/s]
  1%|          | 2137/371472 [10:21<28:14:40,  3.63it/s]
  1%|          | 2138/371472 [10:21<27:51:58,  3.68it/s]
  1%|          | 2139/371472 [10:22<27:47:31,  3.69it/s]
  1%|          | 2140/371472 [10:22<27:47:35,  3.69it/s]
                                                        
{'loss': 5.9992, 'learning_rate': 9.952972483785473e-07, 'epoch': 0.09}

  1%|          | 2140/371472 [10:22<27:47:35,  3.69it/s]
  1%|          | 2141/371472 [10:22<27:56:56,  3.67it/s]
  1%|          | 2142/371472 [10:22<27:27:27,  3.74it/s]
  1%|          | 2143/371472 [10:23<26:48:55,  3.83it/s]
  1%|          | 2144/371472 [10:23<28:11:09,  3.64it/s]
  1%|          | 2145/371472 [10:23<29:11:03,  3.52it/s]
  1%|          | 2146/371472 [10:24<28:50:15,  3.56it/s]
  1%|          | 2147/371472 [10:24<29:17:24,  3.50it/s]
  1%|          | 2148/371472 [10:24<28:23:00,  3.61it/s]
  1%|          | 2149/371472 [10:24<28:01:09,  3.66it/s]
  1%|          | 2150/371472 [10:25<27:29:58,  3.73it/s]
  1%|          | 2151/371472 [10:25<27:41:21,  3.71it/s]
  1%|          | 2152/371472 [10:25<29:21:10,  3.50it/s]
  1%|          | 2153/371472 [10:26<29:12:03,  3.51it/s]
  1%|          | 2154/371472 [10:26<29:17:18,  3.50it/s]
  1%|          | 2155/371472 [10:26<29:45:40,  3.45it/s]
  1%|          | 2156/371472 [10:26<29:03:44,  3.53it/s]
  1%|          | 2157/371472 [10:27<28:04:27,  3.65it/s]
  1%|          | 2158/371472 [10:27<28:18:28,  3.62it/s]
  1%|          | 2159/371472 [10:27<28:53:14,  3.55it/s]
  1%|          | 2160/371472 [10:28<28:32:35,  3.59it/s]
                                                        
{'loss': 6.222, 'learning_rate': 9.952487664030683e-07, 'epoch': 0.09}

  1%|          | 2160/371472 [10:28<28:32:35,  3.59it/s]
  1%|          | 2161/371472 [10:28<27:58:10,  3.67it/s]
  1%|          | 2162/371472 [10:28<28:29:58,  3.60it/s]
  1%|          | 2163/371472 [10:28<28:40:12,  3.58it/s]
  1%|          | 2164/371472 [10:29<29:54:10,  3.43it/s]
  1%|          | 2165/371472 [10:29<34:07:21,  3.01it/s]
  1%|          | 2166/371472 [10:29<33:06:07,  3.10it/s]
  1%|          | 2167/371472 [10:30<31:39:10,  3.24it/s]
  1%|          | 2168/371472 [10:30<30:22:44,  3.38it/s]
  1%|          | 2169/371472 [10:30<29:12:46,  3.51it/s]
  1%|          | 2170/371472 [10:30<29:23:29,  3.49it/s]
  1%|          | 2171/371472 [10:31<30:32:34,  3.36it/s]
  1%|          | 2172/371472 [10:31<30:38:44,  3.35it/s]
  1%|          | 2173/371472 [10:31<30:46:58,  3.33it/s]
  1%|          | 2174/371472 [10:32<29:42:27,  3.45it/s]
  1%|          | 2175/371472 [10:32<31:50:39,  3.22it/s]
  1%|          | 2176/371472 [10:32<31:06:25,  3.30it/s]
  1%|          | 2177/371472 [10:33<31:06:14,  3.30it/s]
  1%|          | 2178/371472 [10:33<29:41:38,  3.45it/s]
  1%|          | 2179/371472 [10:33<29:59:58,  3.42it/s]
  1%|          | 2180/371472 [10:33<29:27:40,  3.48it/s]
                                                        
{'loss': 6.221, 'learning_rate': 9.952002844275894e-07, 'epoch': 0.09}

  1%|          | 2180/371472 [10:33<29:27:40,  3.48it/s]
  1%|          | 2181/371472 [10:34<29:21:24,  3.49it/s]
  1%|          | 2182/371472 [10:34<29:12:13,  3.51it/s]
  1%|          | 2183/371472 [10:34<29:17:15,  3.50it/s]
  1%|          | 2184/371472 [10:35<28:19:17,  3.62it/s]
  1%|          | 2185/371472 [10:35<28:01:48,  3.66it/s]
  1%|          | 2186/371472 [10:35<27:37:58,  3.71it/s]
  1%|          | 2187/371472 [10:35<28:43:42,  3.57it/s]
  1%|          | 2188/371472 [10:36<30:44:53,  3.34it/s]
  1%|          | 2189/371472 [10:36<31:36:45,  3.24it/s]
  1%|          | 2190/371472 [10:36<30:31:32,  3.36it/s]
  1%|          | 2191/371472 [10:37<30:12:30,  3.40it/s]
  1%|          | 2192/371472 [10:37<29:36:19,  3.46it/s]
  1%|          | 2193/371472 [10:37<29:43:56,  3.45it/s]
  1%|          | 2194/371472 [10:37<28:52:03,  3.55it/s]
  1%|          | 2195/371472 [10:38<29:02:17,  3.53it/s]
  1%|          | 2196/371472 [10:38<28:33:35,  3.59it/s]
  1%|          | 2197/371472 [10:38<30:47:13,  3.33it/s]
  1%|          | 2198/371472 [10:39<30:18:42,  3.38it/s]
  1%|          | 2199/371472 [10:39<29:19:56,  3.50it/s]
  1%|          | 2200/371472 [10:39<28:24:57,  3.61it/s]
                                                        
{'loss': 5.9652, 'learning_rate': 9.951518024521105e-07, 'epoch': 0.09}

  1%|          | 2200/371472 [10:39<28:24:57,  3.61it/s]
  1%|          | 2201/371472 [10:39<27:58:46,  3.67it/s]
  1%|          | 2202/371472 [10:40<28:00:45,  3.66it/s]
  1%|          | 2203/371472 [10:40<27:49:54,  3.69it/s]
  1%|          | 2204/371472 [10:40<28:42:12,  3.57it/s]
  1%|          | 2205/371472 [10:41<28:06:05,  3.65it/s]
  1%|          | 2206/371472 [10:41<28:53:30,  3.55it/s]
  1%|          | 2207/371472 [10:41<27:45:32,  3.70it/s]
  1%|          | 2208/371472 [10:41<27:29:50,  3.73it/s]
  1%|          | 2209/371472 [10:42<27:59:45,  3.66it/s]
  1%|          | 2210/371472 [10:42<27:31:18,  3.73it/s]
  1%|          | 2211/371472 [10:42<27:55:46,  3.67it/s]
  1%|          | 2212/371472 [10:42<27:50:25,  3.68it/s]
  1%|          | 2213/371472 [10:43<27:32:07,  3.73it/s]
  1%|          | 2214/371472 [10:43<27:49:40,  3.69it/s]
  1%|          | 2215/371472 [10:43<27:44:50,  3.70it/s]
  1%|          | 2216/371472 [10:44<27:07:46,  3.78it/s]
  1%|          | 2217/371472 [10:44<26:40:21,  3.85it/s]
  1%|          | 2218/371472 [10:44<27:10:48,  3.77it/s]
  1%|          | 2219/371472 [10:44<27:14:01,  3.77it/s]
  1%|          | 2220/371472 [10:45<29:29:25,  3.48it/s]
                                                        
{'loss': 6.1783, 'learning_rate': 9.951033204766316e-07, 'epoch': 0.1}

  1%|          | 2220/371472 [10:45<29:29:25,  3.48it/s]
  1%|          | 2221/371472 [10:45<28:47:51,  3.56it/s]
  1%|          | 2222/371472 [10:45<28:19:40,  3.62it/s]
  1%|          | 2223/371472 [10:45<27:42:38,  3.70it/s]
  1%|          | 2224/371472 [10:46<27:48:19,  3.69it/s]
  1%|          | 2225/371472 [10:46<27:14:40,  3.76it/s]
  1%|          | 2226/371472 [10:46<28:02:47,  3.66it/s]
  1%|          | 2227/371472 [10:47<27:50:57,  3.68it/s]
  1%|          | 2228/371472 [10:47<28:53:27,  3.55it/s]
  1%|          | 2229/371472 [10:47<28:08:51,  3.64it/s]
  1%|          | 2230/371472 [10:47<30:49:13,  3.33it/s]
  1%|          | 2231/371472 [10:48<29:39:42,  3.46it/s]
  1%|          | 2232/371472 [10:48<29:18:56,  3.50it/s]
  1%|          | 2233/371472 [10:48<30:48:12,  3.33it/s]
  1%|          | 2234/371472 [10:49<32:00:15,  3.20it/s]
  1%|          | 2235/371472 [10:49<34:11:42,  3.00it/s]
  1%|          | 2236/371472 [10:49<32:54:14,  3.12it/s]
  1%|          | 2237/371472 [10:50<30:52:34,  3.32it/s]
  1%|          | 2238/371472 [10:50<30:43:14,  3.34it/s]
  1%|          | 2239/371472 [10:50<29:37:44,  3.46it/s]
  1%|          | 2240/371472 [10:50<29:36:12,  3.46it/s]
                                                        
{'loss': 5.9059, 'learning_rate': 9.950548385011528e-07, 'epoch': 0.1}

  1%|          | 2240/371472 [10:50<29:36:12,  3.46it/s]
  1%|          | 2241/371472 [10:51<29:42:49,  3.45it/s]
  1%|          | 2242/371472 [10:51<31:05:50,  3.30it/s]
  1%|          | 2243/371472 [10:51<30:34:34,  3.35it/s]
  1%|          | 2244/371472 [10:52<28:56:21,  3.54it/s]
  1%|          | 2245/371472 [10:52<28:12:33,  3.64it/s]
  1%|          | 2246/371472 [10:52<28:25:51,  3.61it/s]
  1%|          | 2247/371472 [10:52<28:22:22,  3.61it/s]
  1%|          | 2248/371472 [10:53<29:42:28,  3.45it/s]
  1%|          | 2249/371472 [10:53<30:08:42,  3.40it/s]
  1%|          | 2250/371472 [10:53<30:23:02,  3.38it/s]
  1%|          | 2251/371472 [10:54<29:04:05,  3.53it/s]
  1%|          | 2252/371472 [10:54<28:31:14,  3.60it/s]
  1%|          | 2253/371472 [10:54<28:33:16,  3.59it/s]
  1%|          | 2254/371472 [10:54<28:34:58,  3.59it/s]
  1%|          | 2255/371472 [10:55<29:31:34,  3.47it/s]
  1%|          | 2256/371472 [10:55<29:04:24,  3.53it/s]
  1%|          | 2257/371472 [10:55<28:23:01,  3.61it/s]
  1%|          | 2258/371472 [10:56<28:02:56,  3.66it/s]
  1%|          | 2259/371472 [10:56<28:03:25,  3.66it/s]
  1%|          | 2260/371472 [10:56<27:59:20,  3.66it/s]
                                                        
{'loss': 6.1, 'learning_rate': 9.95006356525674e-07, 'epoch': 0.1}

  1%|          | 2260/371472 [10:56<27:59:20,  3.66it/s]
  1%|          | 2261/371472 [10:56<28:09:53,  3.64it/s]
  1%|          | 2262/371472 [10:57<27:23:51,  3.74it/s]
  1%|          | 2263/371472 [10:57<27:44:48,  3.70it/s]
  1%|          | 2264/371472 [10:57<27:53:17,  3.68it/s]
  1%|          | 2265/371472 [10:57<29:34:30,  3.47it/s]
  1%|          | 2266/371472 [10:58<30:17:22,  3.39it/s]
  1%|          | 2267/371472 [10:58<30:04:32,  3.41it/s]
  1%|          | 2268/371472 [10:58<31:14:10,  3.28it/s]
  1%|          | 2269/371472 [10:59<31:23:25,  3.27it/s]
  1%|          | 2270/371472 [10:59<30:26:57,  3.37it/s]
  1%|          | 2271/371472 [10:59<30:40:41,  3.34it/s]
  1%|          | 2272/371472 [11:00<31:39:08,  3.24it/s]
  1%|          | 2273/371472 [11:00<30:58:31,  3.31it/s]
  1%|          | 2274/371472 [11:00<32:10:09,  3.19it/s]
  1%|          | 2275/371472 [11:01<31:49:25,  3.22it/s]
  1%|          | 2276/371472 [11:01<31:30:44,  3.25it/s]
  1%|          | 2277/371472 [11:01<32:05:37,  3.20it/s]
  1%|          | 2278/371472 [11:01<31:22:53,  3.27it/s]
  1%|          | 2279/371472 [11:02<29:35:38,  3.47it/s]
  1%|          | 2280/371472 [11:02<29:45:04,  3.45it/s]
                                                        
{'loss': 5.9231, 'learning_rate': 9.94957874550195e-07, 'epoch': 0.1}

  1%|          | 2280/371472 [11:02<29:45:04,  3.45it/s]
  1%|          | 2281/371472 [11:02<29:29:51,  3.48it/s]
  1%|          | 2282/371472 [11:03<28:57:37,  3.54it/s]
  1%|          | 2283/371472 [11:03<28:13:34,  3.63it/s]
  1%|          | 2284/371472 [11:03<30:25:27,  3.37it/s]
  1%|          | 2285/371472 [11:04<33:44:51,  3.04it/s]
  1%|          | 2286/371472 [11:04<31:30:43,  3.25it/s]
  1%|          | 2287/371472 [11:04<34:30:44,  2.97it/s]
  1%|          | 2288/371472 [11:04<31:56:11,  3.21it/s]
  1%|          | 2289/371472 [11:05<30:49:42,  3.33it/s]
  1%|          | 2290/371472 [11:05<30:04:08,  3.41it/s]
  1%|          | 2291/371472 [11:05<30:13:02,  3.39it/s]
  1%|          | 2292/371472 [11:06<29:57:59,  3.42it/s]
  1%|          | 2293/371472 [11:06<29:56:57,  3.42it/s]
  1%|          | 2294/371472 [11:06<28:41:52,  3.57it/s]
  1%|          | 2295/371472 [11:06<28:07:35,  3.65it/s]
  1%|          | 2296/371472 [11:07<28:36:47,  3.58it/s]
  1%|          | 2297/371472 [11:07<29:49:04,  3.44it/s]
  1%|          | 2298/371472 [11:07<29:05:35,  3.52it/s]
  1%|          | 2299/371472 [11:08<28:08:44,  3.64it/s]
  1%|          | 2300/371472 [11:08<27:19:01,  3.75it/s]
                                                        
{'loss': 6.0686, 'learning_rate': 9.94909392574716e-07, 'epoch': 0.1}

  1%|          | 2300/371472 [11:08<27:19:01,  3.75it/s]
  1%|          | 2301/371472 [11:08<28:57:06,  3.54it/s]
  1%|          | 2302/371472 [11:08<29:27:26,  3.48it/s]
  1%|          | 2303/371472 [11:09<29:53:57,  3.43it/s]
  1%|          | 2304/371472 [11:09<31:04:02,  3.30it/s]
  1%|          | 2305/371472 [11:09<29:23:48,  3.49it/s]
  1%|          | 2306/371472 [11:10<29:18:46,  3.50it/s]
  1%|          | 2307/371472 [11:10<29:05:48,  3.52it/s]
  1%|          | 2308/371472 [11:10<29:04:08,  3.53it/s]
  1%|          | 2309/371472 [11:10<30:44:02,  3.34it/s]
  1%|          | 2310/371472 [11:11<29:55:54,  3.43it/s]
  1%|          | 2311/371472 [11:11<28:46:16,  3.56it/s]
  1%|          | 2312/371472 [11:11<29:53:55,  3.43it/s]
  1%|          | 2313/371472 [11:12<31:11:51,  3.29it/s]
  1%|          | 2314/371472 [11:12<30:22:45,  3.38it/s]
  1%|          | 2315/371472 [11:12<30:15:17,  3.39it/s]
  1%|          | 2316/371472 [11:13<29:48:39,  3.44it/s]
  1%|          | 2317/371472 [11:13<29:35:22,  3.47it/s]
  1%|          | 2318/371472 [11:13<29:12:03,  3.51it/s]
  1%|          | 2319/371472 [11:13<29:02:30,  3.53it/s]
  1%|          | 2320/371472 [11:14<28:52:06,  3.55it/s]
                                                        
{'loss': 5.8488, 'learning_rate': 9.948609105992371e-07, 'epoch': 0.1}

  1%|          | 2320/371472 [11:14<28:52:06,  3.55it/s]
  1%|          | 2321/371472 [11:14<29:25:19,  3.49it/s]
  1%|          | 2322/371472 [11:14<28:49:41,  3.56it/s]
  1%|          | 2323/371472 [11:15<31:44:09,  3.23it/s]
  1%|          | 2324/371472 [11:15<30:05:14,  3.41it/s]
  1%|          | 2325/371472 [11:15<28:29:07,  3.60it/s]
  1%|          | 2326/371472 [11:15<28:21:43,  3.62it/s]
  1%|          | 2327/371472 [11:16<28:43:38,  3.57it/s]
  1%|          | 2328/371472 [11:16<28:27:22,  3.60it/s]
  1%|          | 2329/371472 [11:16<29:09:02,  3.52it/s]
  1%|          | 2330/371472 [11:17<30:38:16,  3.35it/s]
  1%|          | 2331/371472 [11:17<29:44:05,  3.45it/s]
  1%|          | 2332/371472 [11:17<30:09:17,  3.40it/s]
  1%|          | 2333/371472 [11:17<31:57:51,  3.21it/s]
  1%|          | 2334/371472 [11:18<30:35:34,  3.35it/s]
  1%|          | 2335/371472 [11:18<29:41:22,  3.45it/s]
  1%|          | 2336/371472 [11:18<28:41:19,  3.57it/s]
  1%|          | 2337/371472 [11:19<29:28:31,  3.48it/s]
  1%|          | 2338/371472 [11:19<30:13:49,  3.39it/s]
  1%|          | 2339/371472 [11:19<31:03:37,  3.30it/s]
  1%|          | 2340/371472 [11:19<30:23:34,  3.37it/s]
                                                        
{'loss': 5.7428, 'learning_rate': 9.948124286237584e-07, 'epoch': 0.1}

  1%|          | 2340/371472 [11:19<30:23:34,  3.37it/s]
  1%|          | 2341/371472 [11:20<30:34:36,  3.35it/s]
  1%|          | 2342/371472 [11:20<30:08:58,  3.40it/s]
  1%|          | 2343/371472 [11:20<31:16:48,  3.28it/s]
  1%|          | 2344/371472 [11:21<30:36:24,  3.35it/s]
  1%|          | 2345/371472 [11:21<30:41:34,  3.34it/s]
  1%|          | 2346/371472 [11:21<30:29:38,  3.36it/s]
  1%|          | 2347/371472 [11:22<29:46:05,  3.44it/s]
  1%|          | 2348/371472 [11:22<32:38:32,  3.14it/s]
  1%|          | 2349/371472 [11:22<32:23:10,  3.17it/s]
  1%|          | 2350/371472 [11:23<32:04:25,  3.20it/s]
  1%|          | 2351/371472 [11:23<33:31:45,  3.06it/s]
  1%|          | 2352/371472 [11:23<32:06:15,  3.19it/s]
  1%|          | 2353/371472 [11:23<31:05:09,  3.30it/s]
  1%|          | 2354/371472 [11:24<33:22:58,  3.07it/s]
  1%|          | 2355/371472 [11:24<32:07:40,  3.19it/s]
  1%|          | 2356/371472 [11:24<31:09:09,  3.29it/s]
  1%|          | 2357/371472 [11:25<29:36:05,  3.46it/s]
  1%|          | 2358/371472 [11:25<29:24:15,  3.49it/s]
  1%|          | 2359/371472 [11:25<28:58:57,  3.54it/s]
  1%|          | 2360/371472 [11:26<30:18:32,  3.38it/s]
                                                        
{'loss': 5.8092, 'learning_rate': 9.947639466482793e-07, 'epoch': 0.1}

  1%|          | 2360/371472 [11:26<30:18:32,  3.38it/s]
  1%|          | 2361/371472 [11:26<29:42:40,  3.45it/s]
  1%|          | 2362/371472 [11:26<28:32:13,  3.59it/s]
  1%|          | 2363/371472 [11:26<27:52:30,  3.68it/s]
  1%|          | 2364/371472 [11:27<27:34:19,  3.72it/s]
  1%|          | 2365/371472 [11:27<28:17:38,  3.62it/s]
  1%|          | 2366/371472 [11:27<29:50:03,  3.44it/s]
  1%|          | 2367/371472 [11:27<29:49:47,  3.44it/s]
  1%|          | 2368/371472 [11:28<31:23:17,  3.27it/s]
  1%|          | 2369/371472 [11:28<31:47:29,  3.23it/s]
  1%|          | 2370/371472 [11:28<31:07:58,  3.29it/s]
  1%|          | 2371/371472 [11:29<32:09:44,  3.19it/s]
  1%|          | 2372/371472 [11:29<31:15:20,  3.28it/s]
  1%|          | 2373/371472 [11:29<30:10:25,  3.40it/s]
  1%|          | 2374/371472 [11:30<29:05:58,  3.52it/s]
  1%|          | 2375/371472 [11:30<29:21:24,  3.49it/s]
  1%|          | 2376/371472 [11:30<29:54:03,  3.43it/s]
  1%|          | 2377/371472 [11:30<29:47:37,  3.44it/s]
  1%|          | 2378/371472 [11:31<29:20:08,  3.49it/s]
  1%|          | 2379/371472 [11:31<29:12:39,  3.51it/s]
  1%|          | 2380/371472 [11:31<30:10:38,  3.40it/s]
                                                        
{'loss': 6.0985, 'learning_rate': 9.947154646728006e-07, 'epoch': 0.1}

  1%|          | 2380/371472 [11:31<30:10:38,  3.40it/s]
  1%|          | 2381/371472 [11:32<29:36:13,  3.46it/s]
  1%|          | 2382/371472 [11:32<30:10:44,  3.40it/s]
  1%|          | 2383/371472 [11:32<29:25:41,  3.48it/s]
  1%|          | 2384/371472 [11:32<28:54:52,  3.55it/s]
  1%|          | 2385/371472 [11:33<28:03:05,  3.65it/s]
  1%|          | 2386/371472 [11:33<28:41:54,  3.57it/s]
  1%|          | 2387/371472 [11:33<30:17:10,  3.39it/s]
  1%|          | 2388/371472 [11:34<29:31:39,  3.47it/s]
  1%|          | 2389/371472 [11:34<29:55:06,  3.43it/s]
  1%|          | 2390/371472 [11:34<31:01:13,  3.31it/s]
  1%|          | 2391/371472 [11:35<29:53:13,  3.43it/s]
  1%|          | 2392/371472 [11:35<31:01:27,  3.30it/s]
  1%|          | 2393/371472 [11:35<31:03:12,  3.30it/s]
  1%|          | 2394/371472 [11:35<31:13:31,  3.28it/s]
  1%|          | 2395/371472 [11:36<29:54:27,  3.43it/s]
  1%|          | 2396/371472 [11:36<29:48:35,  3.44it/s]
  1%|          | 2397/371472 [11:36<29:02:34,  3.53it/s]
  1%|          | 2398/371472 [11:37<31:25:49,  3.26it/s]
  1%|          | 2399/371472 [11:37<30:27:09,  3.37it/s]
  1%|          | 2400/371472 [11:37<30:09:25,  3.40it/s]
                                                        
{'loss': 6.14, 'learning_rate': 9.946669826973216e-07, 'epoch': 0.1}

  1%|          | 2400/371472 [11:37<30:09:25,  3.40it/s]
  1%|          | 2401/371472 [11:38<30:29:33,  3.36it/s]
  1%|          | 2402/371472 [11:38<33:01:30,  3.10it/s]
  1%|          | 2403/371472 [11:38<31:25:04,  3.26it/s]
  1%|          | 2404/371472 [11:38<30:16:05,  3.39it/s]
  1%|          | 2405/371472 [11:39<29:08:49,  3.52it/s]
  1%|          | 2406/371472 [11:39<28:51:55,  3.55it/s]
  1%|          | 2407/371472 [11:39<31:37:28,  3.24it/s]
  1%|          | 2408/371472 [11:40<32:47:39,  3.13it/s]
  1%|          | 2409/371472 [11:40<31:35:37,  3.24it/s]
  1%|          | 2410/371472 [11:40<36:44:49,  2.79it/s]
  1%|          | 2411/371472 [11:41<35:14:14,  2.91it/s]
  1%|          | 2412/371472 [11:41<32:44:15,  3.13it/s]
  1%|          | 2413/371472 [11:41<31:13:41,  3.28it/s]
  1%|          | 2414/371472 [11:42<29:30:26,  3.47it/s]
  1%|          | 2415/371472 [11:42<30:08:19,  3.40it/s]
  1%|          | 2416/371472 [11:42<30:55:27,  3.32it/s]
  1%|          | 2417/371472 [11:42<29:43:59,  3.45it/s]
  1%|          | 2418/371472 [11:43<32:08:18,  3.19it/s]
  1%|          | 2419/371472 [11:43<31:06:38,  3.30it/s]
  1%|          | 2420/371472 [11:43<30:31:43,  3.36it/s]
                                                        
{'loss': 5.6721, 'learning_rate': 9.946185007218427e-07, 'epoch': 0.1}

  1%|          | 2420/371472 [11:43<30:31:43,  3.36it/s]
  1%|          | 2421/371472 [11:44<29:21:33,  3.49it/s]
  1%|          | 2422/371472 [11:44<30:48:25,  3.33it/s]
  1%|          | 2423/371472 [11:44<31:41:02,  3.24it/s]
  1%|          | 2424/371472 [11:45<32:49:53,  3.12it/s]
  1%|          | 2425/371472 [11:45<32:03:45,  3.20it/s]
  1%|          | 2426/371472 [11:45<31:23:51,  3.26it/s]
  1%|          | 2427/371472 [11:45<30:21:48,  3.38it/s]
  1%|          | 2428/371472 [11:46<30:04:25,  3.41it/s]
  1%|          | 2429/371472 [11:46<29:01:33,  3.53it/s]
  1%|          | 2430/371472 [11:46<28:51:51,  3.55it/s]
  1%|          | 2431/371472 [11:47<27:47:59,  3.69it/s]
  1%|          | 2432/371472 [11:47<29:42:28,  3.45it/s]
  1%|          | 2433/371472 [11:47<29:10:59,  3.51it/s]
  1%|          | 2434/371472 [11:47<28:21:12,  3.62it/s]
  1%|          | 2435/371472 [11:48<28:10:53,  3.64it/s]
  1%|          | 2436/371472 [11:48<28:14:02,  3.63it/s]
  1%|          | 2437/371472 [11:48<32:04:09,  3.20it/s]
  1%|          | 2438/371472 [11:49<30:43:43,  3.34it/s]
  1%|          | 2439/371472 [11:49<31:49:32,  3.22it/s]
  1%|          | 2440/371472 [11:49<30:05:10,  3.41it/s]
                                                        
{'loss': 5.6273, 'learning_rate': 9.945700187463638e-07, 'epoch': 0.11}

  1%|          | 2440/371472 [11:49<30:05:10,  3.41it/s]
  1%|          | 2441/371472 [11:49<29:01:57,  3.53it/s]
  1%|          | 2442/371472 [11:50<28:22:25,  3.61it/s]
  1%|          | 2443/371472 [11:50<31:03:11,  3.30it/s]
  1%|          | 2444/371472 [11:50<30:13:04,  3.39it/s]
  1%|          | 2445/371472 [11:51<29:22:15,  3.49it/s]
  1%|          | 2446/371472 [11:51<28:56:36,  3.54it/s]
  1%|          | 2447/371472 [11:51<28:03:38,  3.65it/s]
  1%|          | 2448/371472 [11:51<27:35:21,  3.72it/s]
  1%|          | 2449/371472 [11:52<27:26:47,  3.73it/s]
  1%|          | 2450/371472 [11:52<33:20:03,  3.08it/s]
  1%|          | 2451/371472 [11:52<32:02:12,  3.20it/s]
  1%|          | 2452/371472 [11:53<30:43:54,  3.34it/s]
  1%|          | 2453/371472 [11:53<30:02:17,  3.41it/s]
  1%|          | 2454/371472 [11:53<31:57:58,  3.21it/s]
  1%|          | 2455/371472 [11:54<31:06:50,  3.29it/s]
  1%|          | 2456/371472 [11:54<30:18:38,  3.38it/s]
  1%|          | 2457/371472 [11:54<33:48:03,  3.03it/s]
  1%|          | 2458/371472 [11:55<31:43:11,  3.23it/s]
  1%|          | 2459/371472 [11:55<29:29:19,  3.48it/s]
  1%|          | 2460/371472 [11:55<29:01:08,  3.53it/s]
                                                        
{'loss': 6.1214, 'learning_rate': 9.945215367708848e-07, 'epoch': 0.11}

  1%|          | 2460/371472 [11:55<29:01:08,  3.53it/s]
  1%|          | 2461/371472 [11:55<29:46:45,  3.44it/s]
  1%|          | 2462/371472 [11:56<39:31:21,  2.59it/s]
  1%|          | 2463/371472 [11:56<35:34:48,  2.88it/s]
  1%|          | 2464/371472 [11:57<34:12:26,  3.00it/s]
  1%|          | 2465/371472 [11:57<32:48:45,  3.12it/s]
  1%|          | 2466/371472 [11:57<32:42:02,  3.13it/s]
  1%|          | 2467/371472 [11:57<31:52:01,  3.22it/s]
  1%|          | 2468/371472 [11:58<31:28:02,  3.26it/s]
  1%|          | 2469/371472 [11:58<31:35:32,  3.24it/s]
  1%|          | 2470/371472 [11:58<30:30:49,  3.36it/s]
  1%|          | 2471/371472 [11:59<32:14:38,  3.18it/s]
  1%|          | 2472/371472 [11:59<30:49:39,  3.32it/s]
  1%|          | 2473/371472 [11:59<29:41:36,  3.45it/s]
  1%|          | 2474/371472 [11:59<28:25:53,  3.61it/s]
  1%|          | 2475/371472 [12:00<28:24:14,  3.61it/s]
  1%|          | 2476/371472 [12:00<27:57:52,  3.67it/s]
  1%|          | 2477/371472 [12:00<27:53:06,  3.68it/s]
  1%|          | 2478/371472 [12:01<28:09:27,  3.64it/s]
  1%|          | 2479/371472 [12:01<27:53:45,  3.67it/s]
  1%|          | 2480/371472 [12:01<28:00:15,  3.66it/s]
                                                        
{'loss': 5.9658, 'learning_rate': 9.944730547954061e-07, 'epoch': 0.11}

  1%|          | 2480/371472 [12:01<28:00:15,  3.66it/s]
  1%|          | 2481/371472 [12:01<28:46:37,  3.56it/s]
  1%|          | 2482/371472 [12:02<29:30:15,  3.47it/s]
  1%|          | 2483/371472 [12:02<36:07:40,  2.84it/s]
  1%|          | 2484/371472 [12:02<33:54:37,  3.02it/s]
  1%|          | 2485/371472 [12:03<33:16:37,  3.08it/s]
  1%|          | 2486/371472 [12:03<32:11:03,  3.18it/s]
  1%|          | 2487/371472 [12:03<34:07:57,  3.00it/s]
  1%|          | 2488/371472 [12:04<32:57:32,  3.11it/s]
  1%|          | 2489/371472 [12:04<31:46:42,  3.23it/s]
  1%|          | 2490/371472 [12:04<30:40:08,  3.34it/s]
  1%|          | 2491/371472 [12:05<31:19:29,  3.27it/s]
  1%|          | 2492/371472 [12:05<30:37:48,  3.35it/s]
  1%|          | 2493/371472 [12:05<31:20:41,  3.27it/s]
  1%|          | 2494/371472 [12:05<29:45:10,  3.44it/s]
  1%|          | 2495/371472 [12:06<31:52:34,  3.22it/s]
  1%|          | 2496/371472 [12:06<31:57:25,  3.21it/s]
  1%|          | 2497/371472 [12:06<30:30:55,  3.36it/s]
  1%|          | 2498/371472 [12:07<30:01:33,  3.41it/s]
  1%|          | 2499/371472 [12:07<29:10:59,  3.51it/s]
  1%|          | 2500/371472 [12:07<29:07:03,  3.52it/s]
                                                        
{'loss': 5.7439, 'learning_rate': 9.94424572819927e-07, 'epoch': 0.11}

  1%|          | 2500/371472 [12:07<29:07:03,  3.52it/s]
  1%|          | 2501/371472 [12:08<28:44:11,  3.57it/s]
  1%|          | 2502/371472 [12:08<27:44:55,  3.69it/s]
  1%|          | 2503/371472 [12:08<29:01:41,  3.53it/s]
  1%|          | 2504/371472 [12:08<28:24:22,  3.61it/s]
  1%|          | 2505/371472 [12:09<31:33:37,  3.25it/s]
  1%|          | 2506/371472 [12:09<30:57:46,  3.31it/s]
  1%|          | 2507/371472 [12:09<32:39:21,  3.14it/s]
  1%|          | 2508/371472 [12:10<32:55:54,  3.11it/s]
  1%|          | 2509/371472 [12:10<32:55:48,  3.11it/s]
  1%|          | 2510/371472 [12:10<33:36:47,  3.05it/s]
  1%|          | 2511/371472 [12:11<34:18:53,  2.99it/s]
  1%|          | 2512/371472 [12:11<32:20:42,  3.17it/s]
  1%|          | 2513/371472 [12:11<30:10:42,  3.40it/s]
  1%|          | 2514/371472 [12:12<29:39:51,  3.45it/s]
  1%|          | 2515/371472 [12:12<30:42:26,  3.34it/s]
  1%|          | 2516/371472 [12:12<30:06:19,  3.40it/s]
  1%|          | 2517/371472 [12:12<30:14:25,  3.39it/s]
  1%|          | 2518/371472 [12:13<30:43:49,  3.34it/s]
  1%|          | 2519/371472 [12:13<29:57:42,  3.42it/s]
  1%|          | 2520/371472 [12:13<31:10:19,  3.29it/s]
                                                        
{'loss': 5.7759, 'learning_rate': 9.943760908444483e-07, 'epoch': 0.11}

  1%|          | 2520/371472 [12:13<31:10:19,  3.29it/s]
  1%|          | 2521/371472 [12:14<30:04:08,  3.41it/s]
  1%|          | 2522/371472 [12:14<29:53:28,  3.43it/s]
  1%|          | 2523/371472 [12:14<29:59:32,  3.42it/s]
  1%|          | 2524/371472 [12:14<29:47:53,  3.44it/s]
  1%|          | 2525/371472 [12:15<29:41:22,  3.45it/s]
  1%|          | 2526/371472 [12:15<29:00:11,  3.53it/s]
  1%|          | 2527/371472 [12:15<28:52:20,  3.55it/s]
  1%|          | 2528/371472 [12:16<28:53:56,  3.55it/s]
  1%|          | 2529/371472 [12:16<28:43:55,  3.57it/s]
  1%|          | 2530/371472 [12:16<27:46:17,  3.69it/s]
  1%|          | 2531/371472 [12:16<27:59:38,  3.66it/s]
  1%|          | 2532/371472 [12:17<28:51:06,  3.55it/s]
  1%|          | 2533/371472 [12:17<28:08:38,  3.64it/s]
  1%|          | 2534/371472 [12:17<28:05:12,  3.65it/s]
  1%|          | 2535/371472 [12:18<31:07:21,  3.29it/s]
  1%|          | 2536/371472 [12:18<30:07:08,  3.40it/s]
  1%|          | 2537/371472 [12:18<31:51:31,  3.22it/s]
  1%|          | 2538/371472 [12:19<32:41:28,  3.13it/s]
  1%|          | 2539/371472 [12:19<33:29:19,  3.06it/s]
  1%|          | 2540/371472 [12:19<31:36:19,  3.24it/s]
                                                        
{'loss': 5.9705, 'learning_rate': 9.943276088689693e-07, 'epoch': 0.11}

  1%|          | 2540/371472 [12:19<31:36:19,  3.24it/s]
  1%|          | 2541/371472 [12:19<30:28:04,  3.36it/s]
  1%|          | 2542/371472 [12:20<30:30:00,  3.36it/s]
  1%|          | 2543/371472 [12:20<32:05:10,  3.19it/s]
  1%|          | 2544/371472 [12:20<30:44:34,  3.33it/s]
  1%|          | 2545/371472 [12:21<30:00:20,  3.42it/s]
  1%|          | 2546/371472 [12:21<29:46:08,  3.44it/s]
  1%|          | 2547/371472 [12:21<29:23:59,  3.49it/s]
  1%|          | 2548/371472 [12:22<30:00:56,  3.41it/s]
  1%|          | 2549/371472 [12:22<29:39:15,  3.46it/s]
  1%|          | 2550/371472 [12:22<29:25:42,  3.48it/s]
  1%|          | 2551/371472 [12:22<29:31:51,  3.47it/s]
  1%|          | 2552/371472 [12:23<28:59:26,  3.53it/s]
  1%|          | 2553/371472 [12:23<29:20:01,  3.49it/s]
  1%|          | 2554/371472 [12:23<29:11:50,  3.51it/s]
  1%|          | 2555/371472 [12:24<30:43:54,  3.33it/s]
  1%|          | 2556/371472 [12:24<30:09:12,  3.40it/s]
  1%|          | 2557/371472 [12:24<31:03:48,  3.30it/s]
  1%|          | 2558/371472 [12:24<30:33:22,  3.35it/s]
  1%|          | 2559/371472 [12:25<30:15:24,  3.39it/s]
  1%|          | 2560/371472 [12:25<29:06:02,  3.52it/s]
                                                        
{'loss': 5.5893, 'learning_rate': 9.942791268934904e-07, 'epoch': 0.11}

  1%|          | 2560/371472 [12:25<29:06:02,  3.52it/s]
  1%|          | 2561/371472 [12:25<30:11:21,  3.39it/s]
  1%|          | 2562/371472 [12:26<29:25:55,  3.48it/s]
  1%|          | 2563/371472 [12:26<28:38:04,  3.58it/s]
  1%|          | 2564/371472 [12:26<27:58:40,  3.66it/s]
  1%|          | 2565/371472 [12:26<29:54:21,  3.43it/s]
  1%|          | 2566/371472 [12:27<31:30:22,  3.25it/s]
  1%|          | 2567/371472 [12:27<32:03:03,  3.20it/s]
  1%|          | 2568/371472 [12:27<30:07:39,  3.40it/s]
  1%|          | 2569/371472 [12:28<28:51:48,  3.55it/s]
  1%|          | 2570/371472 [12:28<28:48:15,  3.56it/s]
  1%|          | 2571/371472 [12:28<30:32:56,  3.35it/s]
  1%|          | 2572/371472 [12:28<30:03:53,  3.41it/s]
  1%|          | 2573/371472 [12:29<30:31:23,  3.36it/s]
  1%|          | 2574/371472 [12:29<31:17:37,  3.27it/s]
  1%|          | 2575/371472 [12:29<30:36:44,  3.35it/s]
  1%|          | 2576/371472 [12:30<29:41:56,  3.45it/s]
  1%|          | 2577/371472 [12:30<29:09:45,  3.51it/s]
  1%|          | 2578/371472 [12:30<31:03:42,  3.30it/s]
  1%|          | 2579/371472 [12:31<29:55:44,  3.42it/s]
  1%|          | 2580/371472 [12:31<29:07:04,  3.52it/s]
                                                        
{'loss': 5.7964, 'learning_rate': 9.942306449180115e-07, 'epoch': 0.11}

  1%|          | 2580/371472 [12:31<29:07:04,  3.52it/s]
  1%|          | 2581/371472 [12:31<31:37:17,  3.24it/s]
  1%|          | 2582/371472 [12:31<30:55:57,  3.31it/s]
  1%|          | 2583/371472 [12:32<30:09:49,  3.40it/s]
  1%|          | 2584/371472 [12:32<28:33:52,  3.59it/s]
  1%|          | 2585/371472 [12:32<28:06:33,  3.65it/s]
  1%|          | 2586/371472 [12:33<27:43:38,  3.70it/s]
  1%|          | 2587/371472 [12:33<28:02:30,  3.65it/s]
  1%|          | 2588/371472 [12:33<28:53:46,  3.55it/s]
  1%|          | 2589/371472 [12:33<28:48:45,  3.56it/s]
  1%|          | 2590/371472 [12:34<28:44:15,  3.57it/s]
  1%|          | 2591/371472 [12:34<28:27:16,  3.60it/s]
  1%|          | 2592/371472 [12:34<28:53:53,  3.55it/s]
  1%|          | 2593/371472 [12:35<30:31:33,  3.36it/s]
  1%|          | 2594/371472 [12:35<31:25:38,  3.26it/s]
  1%|          | 2595/371472 [12:35<32:24:53,  3.16it/s]
  1%|          | 2596/371472 [12:36<32:09:15,  3.19it/s]
  1%|          | 2597/371472 [12:36<32:51:01,  3.12it/s]
  1%|          | 2598/371472 [12:36<31:05:12,  3.30it/s]
  1%|          | 2599/371472 [12:36<29:50:17,  3.43it/s]
  1%|          | 2600/371472 [12:37<29:25:16,  3.48it/s]
                                                        
{'loss': 5.8011, 'learning_rate': 9.941821629425326e-07, 'epoch': 0.11}

  1%|          | 2600/371472 [12:37<29:25:16,  3.48it/s]
  1%|          | 2601/371472 [12:37<28:32:15,  3.59it/s]
  1%|          | 2602/371472 [12:37<28:09:45,  3.64it/s]
  1%|          | 2603/371472 [12:37<28:34:53,  3.58it/s]
  1%|          | 2604/371472 [12:38<28:34:58,  3.58it/s]
  1%|          | 2605/371472 [12:38<28:37:16,  3.58it/s]
  1%|          | 2606/371472 [12:38<27:47:31,  3.69it/s]
  1%|          | 2607/371472 [12:39<27:42:27,  3.70it/s]
  1%|          | 2608/371472 [12:39<27:19:04,  3.75it/s]
  1%|          | 2609/371472 [12:39<27:03:59,  3.79it/s]
  1%|          | 2610/371472 [12:39<27:13:36,  3.76it/s]
  1%|          | 2611/371472 [12:40<27:40:38,  3.70it/s]
  1%|          | 2612/371472 [12:40<28:41:12,  3.57it/s]
  1%|          | 2613/371472 [12:40<27:35:05,  3.71it/s]
  1%|          | 2614/371472 [12:40<28:18:01,  3.62it/s]
  1%|          | 2615/371472 [12:41<28:00:54,  3.66it/s]
  1%|          | 2616/371472 [12:41<30:52:00,  3.32it/s]
  1%|          | 2617/371472 [12:41<30:30:59,  3.36it/s]
  1%|          | 2618/371472 [12:42<30:02:47,  3.41it/s]
  1%|          | 2619/371472 [12:42<30:24:49,  3.37it/s]
  1%|          | 2620/371472 [12:42<29:30:15,  3.47it/s]
                                                        
{'loss': 5.7291, 'learning_rate': 9.941336809670538e-07, 'epoch': 0.11}

  1%|          | 2620/371472 [12:42<29:30:15,  3.47it/s]
  1%|          | 2621/371472 [12:43<30:09:13,  3.40it/s]
  1%|          | 2622/371472 [12:43<29:46:50,  3.44it/s]
  1%|          | 2623/371472 [12:43<29:28:01,  3.48it/s]
  1%|          | 2624/371472 [12:43<29:23:20,  3.49it/s]
  1%|          | 2625/371472 [12:44<28:49:49,  3.55it/s]
  1%|          | 2626/371472 [12:44<28:33:15,  3.59it/s]
  1%|          | 2627/371472 [12:44<28:42:45,  3.57it/s]
  1%|          | 2628/371472 [12:45<28:15:39,  3.63it/s]
  1%|          | 2629/371472 [12:45<28:03:44,  3.65it/s]
  1%|          | 2630/371472 [12:45<27:37:53,  3.71it/s]
  1%|          | 2631/371472 [12:45<27:58:57,  3.66it/s]
  1%|          | 2632/371472 [12:46<27:17:58,  3.75it/s]
  1%|          | 2633/371472 [12:46<26:31:23,  3.86it/s]
  1%|          | 2634/371472 [12:46<27:22:06,  3.74it/s]
  1%|          | 2635/371472 [12:46<28:19:17,  3.62it/s]
  1%|          | 2636/371472 [12:47<27:52:01,  3.68it/s]
  1%|          | 2637/371472 [12:47<29:20:59,  3.49it/s]
  1%|          | 2638/371472 [12:47<28:24:16,  3.61it/s]
  1%|          | 2639/371472 [12:47<27:32:04,  3.72it/s]
  1%|          | 2640/371472 [12:48<27:27:05,  3.73it/s]
                                                        
{'loss': 5.7857, 'learning_rate': 9.94085198991575e-07, 'epoch': 0.11}

  1%|          | 2640/371472 [12:48<27:27:05,  3.73it/s]
  1%|          | 2641/371472 [12:48<27:47:27,  3.69it/s]
  1%|          | 2642/371472 [12:48<28:11:33,  3.63it/s]
  1%|          | 2643/371472 [12:49<28:13:12,  3.63it/s]
  1%|          | 2644/371472 [12:49<27:51:30,  3.68it/s]
  1%|          | 2645/371472 [12:49<28:00:01,  3.66it/s]
  1%|          | 2646/371472 [12:49<27:25:57,  3.73it/s]
  1%|          | 2647/371472 [12:50<27:48:30,  3.68it/s]
  1%|          | 2648/371472 [12:50<29:17:30,  3.50it/s]
  1%|          | 2649/371472 [12:50<28:44:22,  3.56it/s]
  1%|          | 2650/371472 [12:51<29:30:28,  3.47it/s]
  1%|          | 2651/371472 [12:51<30:54:34,  3.31it/s]
  1%|          | 2652/371472 [12:51<30:19:05,  3.38it/s]
  1%|          | 2653/371472 [12:51<29:24:44,  3.48it/s]
  1%|          | 2654/371472 [12:52<31:35:08,  3.24it/s]
  1%|          | 2655/371472 [12:52<30:56:06,  3.31it/s]
  1%|          | 2656/371472 [12:52<29:52:30,  3.43it/s]
  1%|          | 2657/371472 [12:53<30:09:06,  3.40it/s]
  1%|          | 2658/371472 [12:53<29:04:20,  3.52it/s]
  1%|          | 2659/371472 [12:53<29:51:06,  3.43it/s]
  1%|          | 2660/371472 [12:54<30:44:57,  3.33it/s]
                                                        
{'loss': 5.8249, 'learning_rate': 9.94036717016096e-07, 'epoch': 0.11}

  1%|          | 2660/371472 [12:54<30:44:57,  3.33it/s]
  1%|          | 2661/371472 [12:54<33:42:30,  3.04it/s]
  1%|          | 2662/371472 [12:54<31:40:16,  3.23it/s]
  1%|          | 2663/371472 [12:54<30:31:38,  3.36it/s]
  1%|          | 2664/371472 [12:55<29:43:13,  3.45it/s]
  1%|          | 2665/371472 [12:55<30:19:38,  3.38it/s]
  1%|          | 2666/371472 [12:55<29:58:11,  3.42it/s]
  1%|          | 2667/371472 [12:56<28:38:34,  3.58it/s]
  1%|          | 2668/371472 [12:56<29:27:25,  3.48it/s]
  1%|          | 2669/371472 [12:56<29:45:17,  3.44it/s]
  1%|          | 2670/371472 [12:57<31:04:54,  3.30it/s]
  1%|          | 2671/371472 [12:57<29:59:24,  3.42it/s]
  1%|          | 2672/371472 [12:57<28:59:04,  3.53it/s]
  1%|          | 2673/371472 [12:57<30:41:29,  3.34it/s]
  1%|          | 2674/371472 [12:58<30:18:40,  3.38it/s]
  1%|          | 2675/371472 [12:58<31:58:34,  3.20it/s]
  1%|          | 2676/371472 [12:58<30:23:40,  3.37it/s]
  1%|          | 2677/371472 [12:59<29:42:44,  3.45it/s]
  1%|          | 2678/371472 [12:59<29:31:06,  3.47it/s]
  1%|          | 2679/371472 [12:59<29:23:28,  3.49it/s]
  1%|          | 2680/371472 [12:59<29:15:17,  3.50it/s]
                                                        
{'loss': 5.6865, 'learning_rate': 9.93988235040617e-07, 'epoch': 0.12}

  1%|          | 2680/371472 [12:59<29:15:17,  3.50it/s]
  1%|          | 2681/371472 [13:00<29:35:04,  3.46it/s]
  1%|          | 2682/371472 [13:00<30:02:23,  3.41it/s]
  1%|          | 2683/371472 [13:00<28:58:00,  3.54it/s]
  1%|          | 2684/371472 [13:01<29:38:06,  3.46it/s]
  1%|          | 2685/371472 [13:01<31:02:57,  3.30it/s]
  1%|          | 2686/371472 [13:01<30:14:05,  3.39it/s]
  1%|          | 2687/371472 [13:02<31:24:01,  3.26it/s]
  1%|          | 2688/371472 [13:02<30:49:12,  3.32it/s]
  1%|          | 2689/371472 [13:02<30:47:10,  3.33it/s]
  1%|          | 2690/371472 [13:02<30:27:10,  3.36it/s]
  1%|          | 2691/371472 [13:03<30:19:28,  3.38it/s]
  1%|          | 2692/371472 [13:03<30:39:10,  3.34it/s]
  1%|          | 2693/371472 [13:03<29:23:11,  3.49it/s]
  1%|          | 2694/371472 [13:04<28:57:23,  3.54it/s]
  1%|          | 2695/371472 [13:04<29:34:44,  3.46it/s]
  1%|          | 2696/371472 [13:04<28:49:34,  3.55it/s]
  1%|          | 2697/371472 [13:04<27:34:50,  3.71it/s]
  1%|          | 2698/371472 [13:05<28:23:44,  3.61it/s]
  1%|          | 2699/371472 [13:05<27:43:33,  3.69it/s]
  1%|          | 2700/371472 [13:05<27:26:23,  3.73it/s]
                                                        
{'loss': 5.8647, 'learning_rate': 9.939397530651381e-07, 'epoch': 0.12}

  1%|          | 2700/371472 [13:05<27:26:23,  3.73it/s]
  1%|          | 2701/371472 [13:05<27:24:29,  3.74it/s]
  1%|          | 2702/371472 [13:06<27:47:21,  3.69it/s]
  1%|          | 2703/371472 [13:06<29:37:32,  3.46it/s]
  1%|          | 2704/371472 [13:06<29:53:21,  3.43it/s]
  1%|          | 2705/371472 [13:07<30:03:26,  3.41it/s]
  1%|          | 2706/371472 [13:07<30:55:02,  3.31it/s]
  1%|          | 2707/371472 [13:07<29:46:58,  3.44it/s]
  1%|          | 2708/371472 [13:07<29:55:27,  3.42it/s]
  1%|          | 2709/371472 [13:08<29:46:09,  3.44it/s]
  1%|          | 2710/371472 [13:08<29:08:33,  3.51it/s]
  1%|          | 2711/371472 [13:08<31:46:38,  3.22it/s]
  1%|          | 2712/371472 [13:09<30:34:42,  3.35it/s]
  1%|          | 2713/371472 [13:09<29:23:41,  3.48it/s]
  1%|          | 2714/371472 [13:09<31:18:23,  3.27it/s]
  1%|          | 2715/371472 [13:10<31:27:31,  3.26it/s]
  1%|          | 2716/371472 [13:10<30:14:05,  3.39it/s]
  1%|          | 2717/371472 [13:10<30:42:05,  3.34it/s]
  1%|          | 2718/371472 [13:10<29:24:23,  3.48it/s]
  1%|          | 2719/371472 [13:11<29:51:02,  3.43it/s]
  1%|          | 2720/371472 [13:11<30:10:35,  3.39it/s]
                                                        
{'loss': 5.558, 'learning_rate': 9.938912710896594e-07, 'epoch': 0.12}

  1%|          | 2720/371472 [13:11<30:10:35,  3.39it/s]
  1%|          | 2721/371472 [13:11<29:57:07,  3.42it/s]
  1%|          | 2722/371472 [13:12<29:04:13,  3.52it/s]
  1%|          | 2723/371472 [13:12<29:10:21,  3.51it/s]
  1%|          | 2724/371472 [13:12<28:31:04,  3.59it/s]
  1%|          | 2725/371472 [13:12<28:56:59,  3.54it/s]
  1%|          | 2726/371472 [13:13<27:44:47,  3.69it/s]
  1%|          | 2727/371472 [13:13<28:29:07,  3.60it/s]
  1%|          | 2728/371472 [13:13<28:36:16,  3.58it/s]
  1%|          | 2729/371472 [13:14<28:54:44,  3.54it/s]
  1%|          | 2730/371472 [13:14<29:47:46,  3.44it/s]
  1%|          | 2731/371472 [13:14<28:29:43,  3.59it/s]
  1%|          | 2732/371472 [13:14<27:57:22,  3.66it/s]
  1%|          | 2733/371472 [13:15<28:38:27,  3.58it/s]
  1%|          | 2734/371472 [13:15<28:21:28,  3.61it/s]
  1%|          | 2735/371472 [13:15<27:57:03,  3.66it/s]
  1%|          | 2736/371472 [13:16<29:48:13,  3.44it/s]
  1%|          | 2737/371472 [13:16<28:36:54,  3.58it/s]
  1%|          | 2738/371472 [13:16<28:40:57,  3.57it/s]
  1%|          | 2739/371472 [13:16<28:13:54,  3.63it/s]
  1%|          | 2740/371472 [13:17<30:24:18,  3.37it/s]
                                                        
{'loss': 6.0017, 'learning_rate': 9.938427891141803e-07, 'epoch': 0.12}

  1%|          | 2740/371472 [13:17<30:24:18,  3.37it/s]
  1%|          | 2741/371472 [13:17<30:20:08,  3.38it/s]
  1%|          | 2742/371472 [13:17<29:33:37,  3.46it/s]
  1%|          | 2743/371472 [13:18<30:49:36,  3.32it/s]
  1%|          | 2744/371472 [13:18<29:29:39,  3.47it/s]
  1%|          | 2745/371472 [13:18<29:16:23,  3.50it/s]
  1%|          | 2746/371472 [13:18<28:50:18,  3.55it/s]
  1%|          | 2747/371472 [13:19<28:41:43,  3.57it/s]
  1%|          | 2748/371472 [13:19<28:13:07,  3.63it/s]
  1%|          | 2749/371472 [13:19<28:16:20,  3.62it/s]
  1%|          | 2750/371472 [13:19<27:44:25,  3.69it/s]
  1%|          | 2751/371472 [13:20<27:13:32,  3.76it/s]
  1%|          | 2752/371472 [13:20<28:09:03,  3.64it/s]
  1%|          | 2753/371472 [13:20<28:21:35,  3.61it/s]
  1%|          | 2754/371472 [13:21<28:35:43,  3.58it/s]
  1%|          | 2755/371472 [13:21<28:24:07,  3.61it/s]
  1%|          | 2756/371472 [13:21<28:17:22,  3.62it/s]
  1%|          | 2757/371472 [13:21<29:10:52,  3.51it/s]
  1%|          | 2758/371472 [13:22<31:04:07,  3.30it/s]
  1%|          | 2759/371472 [13:22<30:54:40,  3.31it/s]
  1%|          | 2760/371472 [13:22<29:14:42,  3.50it/s]
                                                        
{'loss': 5.7348, 'learning_rate': 9.937943071387016e-07, 'epoch': 0.12}

  1%|          | 2760/371472 [13:22<29:14:42,  3.50it/s]
  1%|          | 2761/371472 [13:23<31:48:05,  3.22it/s]
  1%|          | 2762/371472 [13:23<31:15:19,  3.28it/s]
  1%|          | 2763/371472 [13:23<31:13:00,  3.28it/s]
  1%|          | 2764/371472 [13:24<31:09:23,  3.29it/s]
  1%|          | 2765/371472 [13:24<30:10:22,  3.39it/s]
  1%|          | 2766/371472 [13:24<30:30:56,  3.36it/s]
  1%|          | 2767/371472 [13:24<29:34:16,  3.46it/s]
  1%|          | 2768/371472 [13:25<28:23:00,  3.61it/s]
  1%|          | 2769/371472 [13:25<28:05:16,  3.65it/s]
  1%|          | 2770/371472 [13:25<27:55:10,  3.67it/s]
  1%|          | 2771/371472 [13:26<28:23:12,  3.61it/s]
  1%|          | 2772/371472 [13:26<28:16:01,  3.62it/s]
  1%|          | 2773/371472 [13:26<29:01:48,  3.53it/s]
  1%|          | 2774/371472 [13:26<29:29:47,  3.47it/s]
  1%|          | 2775/371472 [13:27<29:43:21,  3.45it/s]
  1%|          | 2776/371472 [13:27<29:19:05,  3.49it/s]
  1%|          | 2777/371472 [13:27<29:18:34,  3.49it/s]
  1%|          | 2778/371472 [13:28<30:00:41,  3.41it/s]
  1%|          | 2779/371472 [13:28<29:00:51,  3.53it/s]
  1%|          | 2780/371472 [13:28<29:32:03,  3.47it/s]
                                                        
{'loss': 5.5196, 'learning_rate': 9.937458251632226e-07, 'epoch': 0.12}

  1%|          | 2780/371472 [13:28<29:32:03,  3.47it/s]
  1%|          | 2781/371472 [13:28<29:05:02,  3.52it/s]
  1%|          | 2782/371472 [13:29<27:43:59,  3.69it/s]
  1%|          | 2783/371472 [13:29<27:26:09,  3.73it/s]
  1%|          | 2784/371472 [13:29<27:00:55,  3.79it/s]
  1%|          | 2785/371472 [13:29<28:17:30,  3.62it/s]
  1%|          | 2786/371472 [13:30<29:20:16,  3.49it/s]
  1%|          | 2787/371472 [13:30<28:51:17,  3.55it/s]
  1%|          | 2788/371472 [13:30<29:24:38,  3.48it/s]
  1%|          | 2789/371472 [13:31<31:52:17,  3.21it/s]
  1%|          | 2790/371472 [13:31<31:41:44,  3.23it/s]
  1%|          | 2791/371472 [13:31<32:35:03,  3.14it/s]
  1%|          | 2792/371472 [13:32<30:53:27,  3.32it/s]
  1%|          | 2793/371472 [13:32<29:39:27,  3.45it/s]
  1%|          | 2794/371472 [13:32<28:42:07,  3.57it/s]
  1%|          | 2795/371472 [13:32<27:41:45,  3.70it/s]
  1%|          | 2796/371472 [13:33<29:12:49,  3.51it/s]
  1%|          | 2797/371472 [13:33<31:10:22,  3.29it/s]
  1%|          | 2798/371472 [13:33<31:20:31,  3.27it/s]
  1%|          | 2799/371472 [13:34<31:26:55,  3.26it/s]
  1%|          | 2800/371472 [13:34<30:59:22,  3.30it/s]
                                                        
{'loss': 5.6164, 'learning_rate': 9.936973431877437e-07, 'epoch': 0.12}

  1%|          | 2800/371472 [13:34<30:59:22,  3.30it/s]
  1%|          | 2801/371472 [13:34<31:30:11,  3.25it/s]
  1%|          | 2802/371472 [13:35<30:36:40,  3.35it/s]
  1%|          | 2803/371472 [13:35<30:56:38,  3.31it/s]
  1%|          | 2804/371472 [13:35<30:38:07,  3.34it/s]
  1%|          | 2805/371472 [13:35<29:33:06,  3.47it/s]
  1%|          | 2806/371472 [13:36<31:15:32,  3.28it/s]
  1%|          | 2807/371472 [13:36<31:21:22,  3.27it/s]
  1%|          | 2808/371472 [13:36<30:09:51,  3.39it/s]
  1%|          | 2809/371472 [13:37<30:45:11,  3.33it/s]
  1%|          | 2810/371472 [13:37<30:34:01,  3.35it/s]
  1%|          | 2811/371472 [13:37<30:19:20,  3.38it/s]
  1%|          | 2812/371472 [13:38<31:01:49,  3.30it/s]
  1%|          | 2813/371472 [13:38<30:46:30,  3.33it/s]
  1%|          | 2814/371472 [13:38<29:52:49,  3.43it/s]
  1%|          | 2815/371472 [13:38<30:58:01,  3.31it/s]
  1%|          | 2816/371472 [13:39<29:55:00,  3.42it/s]
  1%|          | 2817/371472 [13:39<29:23:38,  3.48it/s]
  1%|          | 2818/371472 [13:39<28:24:00,  3.61it/s]
  1%|          | 2819/371472 [13:40<27:59:13,  3.66it/s]
  1%|          | 2820/371472 [13:40<27:20:01,  3.75it/s]
                                                        
{'loss': 5.8701, 'learning_rate': 9.936488612122648e-07, 'epoch': 0.12}

  1%|          | 2820/371472 [13:40<27:20:01,  3.75it/s]
  1%|          | 2821/371472 [13:40<26:38:17,  3.84it/s]
  1%|          | 2822/371472 [13:40<26:26:54,  3.87it/s]
  1%|          | 2823/371472 [13:41<26:55:49,  3.80it/s]
  1%|          | 2824/371472 [13:41<27:32:01,  3.72it/s]
  1%|          | 2825/371472 [13:41<27:28:16,  3.73it/s]
  1%|          | 2826/371472 [13:41<27:31:27,  3.72it/s]
  1%|          | 2827/371472 [13:42<27:29:47,  3.72it/s]
  1%|          | 2828/371472 [13:42<31:00:30,  3.30it/s]
  1%|          | 2829/371472 [13:42<33:08:43,  3.09it/s]
  1%|          | 2830/371472 [13:43<31:27:30,  3.26it/s]
  1%|          | 2831/371472 [13:43<30:50:41,  3.32it/s]
  1%|          | 2832/371472 [13:43<30:05:09,  3.40it/s]
  1%|          | 2833/371472 [13:44<30:10:26,  3.39it/s]
  1%|          | 2834/371472 [13:44<28:44:35,  3.56it/s]
  1%|          | 2835/371472 [13:44<29:21:19,  3.49it/s]
  1%|          | 2836/371472 [13:44<29:04:45,  3.52it/s]
  1%|          | 2837/371472 [13:45<28:22:43,  3.61it/s]
  1%|          | 2838/371472 [13:45<28:11:51,  3.63it/s]
  1%|          | 2839/371472 [13:45<30:39:48,  3.34it/s]
  1%|          | 2840/371472 [13:46<30:29:18,  3.36it/s]
                                                        
{'loss': 5.9252, 'learning_rate': 9.936003792367858e-07, 'epoch': 0.12}

  1%|          | 2840/371472 [13:46<30:29:18,  3.36it/s]
  1%|          | 2841/371472 [13:46<30:06:24,  3.40it/s]
  1%|          | 2842/371472 [13:46<30:20:58,  3.37it/s]
  1%|          | 2843/371472 [13:46<31:15:44,  3.28it/s]
  1%|          | 2844/371472 [13:47<29:57:49,  3.42it/s]
  1%|          | 2845/371472 [13:47<29:04:59,  3.52it/s]
  1%|          | 2846/371472 [13:47<29:56:51,  3.42it/s]
  1%|          | 2847/371472 [13:48<29:52:16,  3.43it/s]
  1%|          | 2848/371472 [13:48<29:19:54,  3.49it/s]
  1%|          | 2849/371472 [13:48<29:26:25,  3.48it/s]
  1%|          | 2850/371472 [13:48<29:16:49,  3.50it/s]
  1%|          | 2851/371472 [13:49<29:59:15,  3.41it/s]
  1%|          | 2852/371472 [13:49<31:56:14,  3.21it/s]
  1%|          | 2853/371472 [13:49<30:25:02,  3.37it/s]
  1%|          | 2854/371472 [13:50<29:13:16,  3.50it/s]
  1%|          | 2855/371472 [13:50<28:26:48,  3.60it/s]
  1%|          | 2856/371472 [13:50<28:28:50,  3.60it/s]
  1%|          | 2857/371472 [13:50<28:27:08,  3.60it/s]
  1%|          | 2858/371472 [13:51<28:07:56,  3.64it/s]
  1%|          | 2859/371472 [13:51<27:49:55,  3.68it/s]
  1%|          | 2860/371472 [13:51<28:31:55,  3.59it/s]
                                                        
{'loss': 5.502, 'learning_rate': 9.935518972613071e-07, 'epoch': 0.12}

  1%|          | 2860/371472 [13:51<28:31:55,  3.59it/s]
  1%|          | 2861/371472 [13:52<28:33:39,  3.59it/s]
  1%|          | 2862/371472 [13:52<29:51:17,  3.43it/s]
  1%|          | 2863/371472 [13:52<28:50:37,  3.55it/s]
  1%|          | 2864/371472 [13:52<28:00:49,  3.66it/s]
  1%|          | 2865/371472 [13:53<28:03:55,  3.65it/s]
  1%|          | 2866/371472 [13:53<29:30:06,  3.47it/s]
  1%|          | 2867/371472 [13:53<29:18:14,  3.49it/s]
  1%|          | 2868/371472 [13:54<28:59:10,  3.53it/s]
  1%|          | 2869/371472 [13:54<28:39:09,  3.57it/s]
  1%|          | 2870/371472 [13:54<30:01:44,  3.41it/s]
  1%|          | 2871/371472 [13:54<30:39:18,  3.34it/s]
  1%|          | 2872/371472 [13:55<29:44:41,  3.44it/s]
  1%|          | 2873/371472 [13:55<28:48:00,  3.56it/s]
  1%|          | 2874/371472 [13:55<30:44:38,  3.33it/s]
  1%|          | 2875/371472 [13:56<33:28:14,  3.06it/s]
  1%|          | 2876/371472 [13:56<32:25:16,  3.16it/s]
  1%|          | 2877/371472 [13:56<33:05:56,  3.09it/s]
  1%|          | 2878/371472 [13:57<32:14:00,  3.18it/s]
  1%|          | 2879/371472 [13:57<30:57:43,  3.31it/s]
  1%|          | 2880/371472 [13:57<30:02:15,  3.41it/s]
                                                        
{'loss': 5.8715, 'learning_rate': 9.935034152858282e-07, 'epoch': 0.12}

  1%|          | 2880/371472 [13:57<30:02:15,  3.41it/s]
  1%|          | 2881/371472 [13:57<31:21:14,  3.27it/s]
  1%|          | 2882/371472 [13:58<31:45:00,  3.22it/s]
  1%|          | 2883/371472 [13:58<31:01:47,  3.30it/s]
  1%|          | 2884/371472 [13:58<30:06:06,  3.40it/s]
  1%|          | 2885/371472 [13:59<29:05:56,  3.52it/s]
  1%|          | 2886/371472 [13:59<28:36:11,  3.58it/s]
  1%|          | 2887/371472 [13:59<29:55:17,  3.42it/s]
  1%|          | 2888/371472 [14:00<31:04:43,  3.29it/s]
  1%|          | 2889/371472 [14:00<30:40:29,  3.34it/s]
  1%|          | 2890/371472 [14:00<30:36:09,  3.35it/s]
  1%|          | 2891/371472 [14:00<30:53:07,  3.31it/s]
  1%|          | 2892/371472 [14:01<30:05:26,  3.40it/s]
  1%|          | 2893/371472 [14:01<29:22:49,  3.48it/s]
  1%|          | 2894/371472 [14:01<28:38:08,  3.58it/s]
  1%|          | 2895/371472 [14:02<29:45:47,  3.44it/s]
  1%|          | 2896/371472 [14:02<29:10:41,  3.51it/s]
  1%|          | 2897/371472 [14:02<29:16:01,  3.50it/s]
  1%|          | 2898/371472 [14:02<28:20:56,  3.61it/s]
  1%|          | 2899/371472 [14:03<29:31:38,  3.47it/s]
  1%|          | 2900/371472 [14:03<32:04:15,  3.19it/s]
                                                        
{'loss': 5.5986, 'learning_rate': 9.934549333103493e-07, 'epoch': 0.12}

  1%|          | 2900/371472 [14:03<32:04:15,  3.19it/s]
  1%|          | 2901/371472 [14:03<31:22:17,  3.26it/s]
  1%|          | 2902/371472 [14:04<30:24:28,  3.37it/s]
  1%|          | 2903/371472 [14:04<30:00:43,  3.41it/s]
  1%|          | 2904/371472 [14:04<29:40:11,  3.45it/s]
  1%|          | 2905/371472 [14:05<30:27:21,  3.36it/s]
  1%|          | 2906/371472 [14:05<29:31:04,  3.47it/s]
  1%|          | 2907/371472 [14:05<29:00:29,  3.53it/s]
  1%|          | 2908/371472 [14:05<28:47:53,  3.56it/s]
  1%|          | 2909/371472 [14:06<28:04:00,  3.65it/s]
  1%|          | 2910/371472 [14:06<29:15:34,  3.50it/s]
  1%|          | 2911/371472 [14:06<30:10:26,  3.39it/s]
  1%|          | 2912/371472 [14:06<29:13:16,  3.50it/s]
  1%|          | 2913/371472 [14:07<28:46:24,  3.56it/s]
  1%|          | 2914/371472 [14:07<28:40:51,  3.57it/s]
  1%|          | 2915/371472 [14:07<30:42:21,  3.33it/s]
  1%|          | 2916/371472 [14:08<29:23:26,  3.48it/s]
  1%|          | 2917/371472 [14:08<29:57:34,  3.42it/s]
  1%|          | 2918/371472 [14:08<31:11:33,  3.28it/s]
  1%|          | 2919/371472 [14:09<29:55:51,  3.42it/s]
  1%|          | 2920/371472 [14:09<28:56:50,  3.54it/s]
                                                        
{'loss': 5.7461, 'learning_rate': 9.934064513348703e-07, 'epoch': 0.13}

  1%|          | 2920/371472 [14:09<28:56:50,  3.54it/s]
  1%|          | 2921/371472 [14:09<30:56:38,  3.31it/s]
  1%|          | 2922/371472 [14:09<30:34:48,  3.35it/s]
  1%|          | 2923/371472 [14:10<29:09:46,  3.51it/s]
  1%|          | 2924/371472 [14:10<31:17:12,  3.27it/s]
  1%|          | 2925/371472 [14:11<36:23:02,  2.81it/s]
  1%|          | 2926/371472 [14:11<34:19:35,  2.98it/s]
  1%|          | 2927/371472 [14:11<34:17:15,  2.99it/s]
  1%|          | 2928/371472 [14:11<32:13:05,  3.18it/s]
  1%|          | 2929/371472 [14:12<33:07:06,  3.09it/s]
  1%|          | 2930/371472 [14:12<31:24:37,  3.26it/s]
  1%|          | 2931/371472 [14:12<30:26:48,  3.36it/s]
  1%|          | 2932/371472 [14:13<30:23:36,  3.37it/s]
  1%|          | 2933/371472 [14:13<29:11:29,  3.51it/s]
  1%|          | 2934/371472 [14:13<32:21:04,  3.16it/s]
  1%|          | 2935/371472 [14:14<31:13:22,  3.28it/s]
  1%|          | 2936/371472 [14:14<30:20:26,  3.37it/s]
  1%|          | 2937/371472 [14:14<29:25:29,  3.48it/s]
  1%|          | 2938/371472 [14:14<28:27:25,  3.60it/s]
  1%|          | 2939/371472 [14:15<28:36:32,  3.58it/s]
  1%|          | 2940/371472 [14:15<28:30:05,  3.59it/s]
                                                        
{'loss': 5.921, 'learning_rate': 9.933579693593914e-07, 'epoch': 0.13}

  1%|          | 2940/371472 [14:15<28:30:05,  3.59it/s]
  1%|          | 2941/371472 [14:15<28:01:34,  3.65it/s]
  1%|          | 2942/371472 [14:15<27:56:12,  3.66it/s]
  1%|          | 2943/371472 [14:16<29:56:59,  3.42it/s]
  1%|          | 2944/371472 [14:16<28:38:52,  3.57it/s]
  1%|          | 2945/371472 [14:16<28:09:31,  3.64it/s]
  1%|          | 2946/371472 [14:17<29:22:39,  3.48it/s]
  1%|          | 2947/371472 [14:17<28:29:31,  3.59it/s]
  1%|          | 2948/371472 [14:17<28:21:08,  3.61it/s]
  1%|          | 2949/371472 [14:17<28:35:43,  3.58it/s]
  1%|          | 2950/371472 [14:18<29:44:35,  3.44it/s]
  1%|          | 2951/371472 [14:18<29:10:46,  3.51it/s]
  1%|          | 2952/371472 [14:18<29:00:06,  3.53it/s]
  1%|          | 2953/371472 [14:19<29:14:51,  3.50it/s]
  1%|          | 2954/371472 [14:19<28:36:40,  3.58it/s]
  1%|          | 2955/371472 [14:19<27:42:04,  3.70it/s]
  1%|          | 2956/371472 [14:19<27:21:41,  3.74it/s]
  1%|          | 2957/371472 [14:20<29:34:55,  3.46it/s]
  1%|          | 2958/371472 [14:20<32:52:41,  3.11it/s]
  1%|          | 2959/371472 [14:20<32:35:16,  3.14it/s]
  1%|          | 2960/371472 [14:21<31:28:11,  3.25it/s]
                                                        
{'loss': 5.8295, 'learning_rate': 9.933094873839125e-07, 'epoch': 0.13}

  1%|          | 2960/371472 [14:21<31:28:11,  3.25it/s]
  1%|          | 2961/371472 [14:21<30:12:34,  3.39it/s]
  1%|          | 2962/371472 [14:21<30:22:51,  3.37it/s]
  1%|          | 2963/371472 [14:21<29:20:35,  3.49it/s]
  1%|          | 2964/371472 [14:22<31:02:38,  3.30it/s]
  1%|          | 2965/371472 [14:22<32:29:40,  3.15it/s]
  1%|          | 2966/371472 [14:22<31:32:22,  3.25it/s]
  1%|          | 2967/371472 [14:23<32:39:34,  3.13it/s]
  1%|          | 2968/371472 [14:23<32:50:10,  3.12it/s]
  1%|          | 2969/371472 [14:23<33:46:44,  3.03it/s]
  1%|          | 2970/371472 [14:24<31:32:48,  3.24it/s]
  1%|          | 2971/371472 [14:24<29:42:24,  3.45it/s]
  1%|          | 2972/371472 [14:24<30:13:30,  3.39it/s]
  1%|          | 2973/371472 [14:25<30:30:00,  3.36it/s]
  1%|          | 2974/371472 [14:25<30:21:08,  3.37it/s]
  1%|          | 2975/371472 [14:25<29:32:10,  3.47it/s]
  1%|          | 2976/371472 [14:25<28:43:03,  3.56it/s]
  1%|          | 2977/371472 [14:26<27:56:12,  3.66it/s]
  1%|          | 2978/371472 [14:26<28:10:45,  3.63it/s]
  1%|          | 2979/371472 [14:26<29:52:36,  3.43it/s]
  1%|          | 2980/371472 [14:27<30:46:00,  3.33it/s]
                                                        
{'loss': 5.6581, 'learning_rate': 9.932610054084336e-07, 'epoch': 0.13}

  1%|          | 2980/371472 [14:27<30:46:00,  3.33it/s]
  1%|          | 2981/371472 [14:27<29:32:27,  3.46it/s]
  1%|          | 2982/371472 [14:27<29:27:31,  3.47it/s]
  1%|          | 2983/371472 [14:27<28:00:23,  3.65it/s]
  1%|          | 2984/371472 [14:28<27:30:31,  3.72it/s]
  1%|          | 2985/371472 [14:28<28:28:46,  3.59it/s]
  1%|          | 2986/371472 [14:28<28:27:45,  3.60it/s]
  1%|          | 2987/371472 [14:28<27:46:15,  3.69it/s]
  1%|          | 2988/371472 [14:29<28:41:22,  3.57it/s]
  1%|          | 2989/371472 [14:29<29:11:55,  3.51it/s]
  1%|          | 2990/371472 [14:29<28:42:03,  3.57it/s]
  1%|          | 2991/371472 [14:30<28:36:57,  3.58it/s]
  1%|          | 2992/371472 [14:30<28:59:19,  3.53it/s]
  1%|          | 2993/371472 [14:30<28:44:38,  3.56it/s]
  1%|          | 2994/371472 [14:30<29:19:03,  3.49it/s]
  1%|          | 2995/371472 [14:31<28:03:16,  3.65it/s]
  1%|          | 2996/371472 [14:31<31:52:56,  3.21it/s]
  1%|          | 2997/371472 [14:31<31:55:20,  3.21it/s]
  1%|          | 2998/371472 [14:32<29:48:34,  3.43it/s]
  1%|          | 2999/371472 [14:32<28:52:27,  3.54it/s]
  1%|          | 3000/371472 [14:32<28:35:32,  3.58it/s]
                                                        
{'loss': 5.7304, 'learning_rate': 9.932125234329548e-07, 'epoch': 0.13}

  1%|          | 3000/371472 [14:32<28:35:32,  3.58it/s]
  1%|          | 3001/371472 [14:32<27:57:24,  3.66it/s]
  1%|          | 3002/371472 [14:33<28:43:33,  3.56it/s]
  1%|          | 3003/371472 [14:33<30:03:00,  3.41it/s]
  1%|          | 3004/371472 [14:33<29:39:40,  3.45it/s]
  1%|          | 3005/371472 [14:34<29:51:09,  3.43it/s]
  1%|          | 3006/371472 [14:34<29:50:49,  3.43it/s]
  1%|          | 3007/371472 [14:34<30:18:31,  3.38it/s]
  1%|          | 3008/371472 [14:35<30:34:47,  3.35it/s]
  1%|          | 3009/371472 [14:35<30:30:58,  3.35it/s]
  1%|          | 3010/371472 [14:35<31:03:58,  3.29it/s]
  1%|          | 3011/371472 [14:35<30:44:34,  3.33it/s]
  1%|          | 3012/371472 [14:36<29:36:50,  3.46it/s]
  1%|          | 3013/371472 [14:36<29:15:25,  3.50it/s]
  1%|          | 3014/371472 [14:36<28:29:56,  3.59it/s]
  1%|          | 3015/371472 [14:37<27:50:44,  3.68it/s]
  1%|          | 3016/371472 [14:37<29:55:27,  3.42it/s]
  1%|          | 3017/371472 [14:37<29:53:23,  3.42it/s]
  1%|          | 3018/371472 [14:37<28:45:52,  3.56it/s]
  1%|          | 3019/371472 [14:38<27:51:33,  3.67it/s]
  1%|          | 3020/371472 [14:38<27:45:18,  3.69it/s]
                                                        
{'loss': 5.9998, 'learning_rate': 9.93164041457476e-07, 'epoch': 0.13}

  1%|          | 3020/371472 [14:38<27:45:18,  3.69it/s]
  1%|          | 3021/371472 [14:38<28:13:41,  3.63it/s]
  1%|          | 3022/371472 [14:39<28:51:14,  3.55it/s]
  1%|          | 3023/371472 [14:39<29:16:09,  3.50it/s]
  1%|          | 3024/371472 [14:39<30:30:35,  3.35it/s]
  1%|          | 3025/371472 [14:39<29:31:02,  3.47it/s]
  1%|          | 3026/371472 [14:40<30:27:55,  3.36it/s]
  1%|          | 3027/371472 [14:40<33:44:56,  3.03it/s]
  1%|          | 3028/371472 [14:40<32:32:56,  3.14it/s]
  1%|          | 3029/371472 [14:41<31:56:17,  3.20it/s]
  1%|          | 3030/371472 [14:41<31:47:15,  3.22it/s]
  1%|          | 3031/371472 [14:41<31:02:04,  3.30it/s]
  1%|          | 3032/371472 [14:42<33:46:40,  3.03it/s]
  1%|          | 3033/371472 [14:42<32:04:11,  3.19it/s]
  1%|          | 3034/371472 [14:42<30:42:55,  3.33it/s]
  1%|          | 3035/371472 [14:43<30:46:52,  3.32it/s]
  1%|          | 3036/371472 [14:43<30:58:45,  3.30it/s]
  1%|          | 3037/371472 [14:43<29:55:48,  3.42it/s]
  1%|          | 3038/371472 [14:43<29:32:00,  3.47it/s]
  1%|          | 3039/371472 [14:44<29:45:28,  3.44it/s]
  1%|          | 3040/371472 [14:44<30:36:18,  3.34it/s]
                                                        
{'loss': 6.0369, 'learning_rate': 9.93115559481997e-07, 'epoch': 0.13}

  1%|          | 3040/371472 [14:44<30:36:18,  3.34it/s]
  1%|          | 3041/371472 [14:44<29:16:39,  3.50it/s]
  1%|          | 3042/371472 [14:45<28:54:35,  3.54it/s]
  1%|          | 3043/371472 [14:45<27:47:08,  3.68it/s]
  1%|          | 3044/371472 [14:45<28:52:50,  3.54it/s]
  1%|          | 3045/371472 [14:45<29:29:49,  3.47it/s]
  1%|          | 3046/371472 [14:46<29:46:19,  3.44it/s]
  1%|          | 3047/371472 [14:46<30:03:06,  3.41it/s]
  1%|          | 3048/371472 [14:46<29:30:40,  3.47it/s]
  1%|          | 3049/371472 [14:47<29:30:17,  3.47it/s]
  1%|          | 3050/371472 [14:47<28:26:43,  3.60it/s]
  1%|          | 3051/371472 [14:47<29:18:56,  3.49it/s]
  1%|          | 3052/371472 [14:47<30:35:42,  3.34it/s]
  1%|          | 3053/371472 [14:48<30:24:24,  3.37it/s]
  1%|          | 3054/371472 [14:48<29:28:54,  3.47it/s]
  1%|          | 3055/371472 [14:48<29:02:29,  3.52it/s]
  1%|          | 3056/371472 [14:49<29:44:40,  3.44it/s]
  1%|          | 3057/371472 [14:49<29:48:27,  3.43it/s]
  1%|          | 3058/371472 [14:49<29:58:33,  3.41it/s]
  1%|          | 3059/371472 [14:50<30:29:38,  3.36it/s]
  1%|          | 3060/371472 [14:50<30:36:44,  3.34it/s]
                                                        
{'loss': 5.9676, 'learning_rate': 9.930670775065183e-07, 'epoch': 0.13}

  1%|          | 3060/371472 [14:50<30:36:44,  3.34it/s]
  1%|          | 3061/371472 [14:50<32:11:46,  3.18it/s]
  1%|          | 3062/371472 [14:50<31:36:44,  3.24it/s]
  1%|          | 3063/371472 [14:51<31:27:11,  3.25it/s]
  1%|          | 3064/371472 [14:51<31:35:07,  3.24it/s]
  1%|          | 3065/371472 [14:51<30:16:48,  3.38it/s]
  1%|          | 3066/371472 [14:52<29:38:11,  3.45it/s]
  1%|          | 3067/371472 [14:52<28:39:55,  3.57it/s]
  1%|          | 3068/371472 [14:52<28:39:23,  3.57it/s]
  1%|          | 3069/371472 [14:52<29:00:17,  3.53it/s]
  1%|          | 3070/371472 [14:53<29:04:10,  3.52it/s]
  1%|          | 3071/371472 [14:53<28:31:49,  3.59it/s]
  1%|          | 3072/371472 [14:53<29:31:46,  3.47it/s]
  1%|          | 3073/371472 [14:54<30:52:03,  3.32it/s]
  1%|          | 3074/371472 [14:54<32:01:34,  3.20it/s]
  1%|          | 3075/371472 [14:54<33:13:33,  3.08it/s]
  1%|          | 3076/371472 [14:55<34:16:55,  2.99it/s]
  1%|          | 3077/371472 [14:55<31:50:56,  3.21it/s]
  1%|          | 3078/371472 [14:55<31:53:56,  3.21it/s]
  1%|          | 3079/371472 [14:56<31:52:06,  3.21it/s]
  1%|          | 3080/371472 [14:56<31:18:07,  3.27it/s]
                                                        
{'loss': 5.2663, 'learning_rate': 9.930185955310391e-07, 'epoch': 0.13}

  1%|          | 3080/371472 [14:56<31:18:07,  3.27it/s]
  1%|          | 3081/371472 [14:56<31:04:16,  3.29it/s]
  1%|          | 3082/371472 [14:56<31:18:45,  3.27it/s]
  1%|          | 3083/371472 [14:57<31:33:58,  3.24it/s]
  1%|          | 3084/371472 [14:57<30:03:47,  3.40it/s]
  1%|          | 3085/371472 [14:57<29:31:51,  3.47it/s]
  1%|          | 3086/371472 [14:58<29:43:17,  3.44it/s]
  1%|          | 3087/371472 [14:58<29:12:40,  3.50it/s]
  1%|          | 3088/371472 [14:58<28:31:12,  3.59it/s]
  1%|          | 3089/371472 [14:58<29:15:35,  3.50it/s]
  1%|          | 3090/371472 [14:59<31:44:43,  3.22it/s]
  1%|          | 3091/371472 [14:59<30:25:44,  3.36it/s]
  1%|          | 3092/371472 [14:59<30:06:48,  3.40it/s]
  1%|          | 3093/371472 [15:00<30:47:54,  3.32it/s]
  1%|          | 3094/371472 [15:00<30:50:05,  3.32it/s]
  1%|          | 3095/371472 [15:00<30:30:50,  3.35it/s]
  1%|          | 3096/371472 [15:01<30:10:57,  3.39it/s]
  1%|          | 3097/371472 [15:01<30:32:37,  3.35it/s]
  1%|          | 3098/371472 [15:01<31:58:34,  3.20it/s]
  1%|          | 3099/371472 [15:02<30:36:45,  3.34it/s]
  1%|          | 3100/371472 [15:02<29:10:33,  3.51it/s]
                                                        
{'loss': 5.8159, 'learning_rate': 9.929701135555604e-07, 'epoch': 0.13}

  1%|          | 3100/371472 [15:02<29:10:33,  3.51it/s]
  1%|          | 3101/371472 [15:02<32:02:50,  3.19it/s]
  1%|          | 3102/371472 [15:02<30:45:06,  3.33it/s]
  1%|          | 3103/371472 [15:03<31:16:20,  3.27it/s]
  1%|          | 3104/371472 [15:03<31:10:03,  3.28it/s]
  1%|          | 3105/371472 [15:03<30:26:37,  3.36it/s]
  1%|          | 3106/371472 [15:04<31:53:22,  3.21it/s]
  1%|          | 3107/371472 [15:04<29:58:16,  3.41it/s]
  1%|          | 3108/371472 [15:04<29:31:34,  3.47it/s]
  1%|          | 3109/371472 [15:04<28:34:52,  3.58it/s]
  1%|          | 3110/371472 [15:05<28:32:36,  3.58it/s]
  1%|          | 3111/371472 [15:05<28:22:40,  3.61it/s]
  1%|          | 3112/371472 [15:05<27:37:57,  3.70it/s]
  1%|          | 3113/371472 [15:05<27:12:30,  3.76it/s]
  1%|          | 3114/371472 [15:06<28:54:48,  3.54it/s]
  1%|          | 3115/371472 [15:06<29:28:51,  3.47it/s]
  1%|          | 3116/371472 [15:06<29:00:30,  3.53it/s]
  1%|          | 3117/371472 [15:07<29:27:11,  3.47it/s]
  1%|          | 3118/371472 [15:07<28:25:02,  3.60it/s]
  1%|          | 3119/371472 [15:07<29:24:03,  3.48it/s]
  1%|          | 3120/371472 [15:08<29:47:26,  3.43it/s]
                                                        
{'loss': 5.5133, 'learning_rate': 9.929216315800813e-07, 'epoch': 0.13}

  1%|          | 3120/371472 [15:08<29:47:26,  3.43it/s]
  1%|          | 3121/371472 [15:08<30:07:06,  3.40it/s]
  1%|          | 3122/371472 [15:08<29:36:33,  3.46it/s]
  1%|          | 3123/371472 [15:08<28:49:35,  3.55it/s]
  1%|          | 3124/371472 [15:09<29:01:37,  3.52it/s]
  1%|          | 3125/371472 [15:09<27:54:22,  3.67it/s]
  1%|          | 3126/371472 [15:09<29:04:55,  3.52it/s]
  1%|          | 3127/371472 [15:10<29:46:36,  3.44it/s]
  1%|          | 3128/371472 [15:10<28:38:52,  3.57it/s]
  1%|          | 3129/371472 [15:10<28:41:18,  3.57it/s]
  1%|          | 3130/371472 [15:10<28:24:16,  3.60it/s]
  1%|          | 3131/371472 [15:11<27:58:20,  3.66it/s]
  1%|          | 3132/371472 [15:11<28:52:02,  3.54it/s]
  1%|          | 3133/371472 [15:11<30:33:11,  3.35it/s]
  1%|          | 3134/371472 [15:12<31:54:10,  3.21it/s]
  1%|          | 3135/371472 [15:12<31:26:26,  3.25it/s]
  1%|          | 3136/371472 [15:12<30:49:13,  3.32it/s]
  1%|          | 3137/371472 [15:12<30:36:13,  3.34it/s]
  1%|          | 3138/371472 [15:13<32:57:16,  3.10it/s]
  1%|          | 3139/371472 [15:13<36:27:37,  2.81it/s]
  1%|          | 3140/371472 [15:14<34:09:38,  3.00it/s]
                                                        
{'loss': 5.7083, 'learning_rate': 9.928731496046025e-07, 'epoch': 0.14}

  1%|          | 3140/371472 [15:14<34:09:38,  3.00it/s]
  1%|          | 3141/371472 [15:14<32:37:10,  3.14it/s]
  1%|          | 3142/371472 [15:14<31:07:34,  3.29it/s]
  1%|          | 3143/371472 [15:14<30:22:28,  3.37it/s]
  1%|          | 3144/371472 [15:15<29:25:07,  3.48it/s]
  1%|          | 3145/371472 [15:15<32:00:54,  3.20it/s]
  1%|          | 3146/371472 [15:15<30:33:11,  3.35it/s]
  1%|          | 3147/371472 [15:16<29:28:50,  3.47it/s]
  1%|          | 3148/371472 [15:16<29:15:23,  3.50it/s]
  1%|          | 3149/371472 [15:16<29:25:28,  3.48it/s]
  1%|          | 3150/371472 [15:16<28:50:30,  3.55it/s]
  1%|          | 3151/371472 [15:17<29:14:26,  3.50it/s]
  1%|          | 3152/371472 [15:17<29:38:30,  3.45it/s]
  1%|          | 3153/371472 [15:17<29:57:18,  3.42it/s]
  1%|          | 3154/371472 [15:18<28:41:15,  3.57it/s]
  1%|          | 3155/371472 [15:18<28:19:47,  3.61it/s]
  1%|          | 3156/371472 [15:18<29:15:08,  3.50it/s]
  1%|          | 3157/371472 [15:18<29:28:48,  3.47it/s]
  1%|          | 3158/371472 [15:19<29:11:49,  3.50it/s]
  1%|          | 3159/371472 [15:19<29:05:10,  3.52it/s]
  1%|          | 3160/371472 [15:19<28:31:46,  3.59it/s]
                                                        
{'loss': 5.7072, 'learning_rate': 9.928246676291236e-07, 'epoch': 0.14}

  1%|          | 3160/371472 [15:19<28:31:46,  3.59it/s]
  1%|          | 3161/371472 [15:20<29:28:41,  3.47it/s]
  1%|          | 3162/371472 [15:20<32:00:33,  3.20it/s]
  1%|          | 3163/371472 [15:20<31:58:00,  3.20it/s]
  1%|          | 3164/371472 [15:21<30:08:08,  3.39it/s]
  1%|          | 3165/371472 [15:21<33:22:16,  3.07it/s]
  1%|          | 3166/371472 [15:21<31:39:30,  3.23it/s]
  1%|          | 3167/371472 [15:21<30:21:05,  3.37it/s]
  1%|          | 3168/371472 [15:22<29:42:16,  3.44it/s]
  1%|          | 3169/371472 [15:22<30:20:06,  3.37it/s]
  1%|          | 3170/371472 [15:22<29:33:32,  3.46it/s]
  1%|          | 3171/371472 [15:23<30:51:21,  3.32it/s]
  1%|          | 3172/371472 [15:23<31:04:16,  3.29it/s]
  1%|          | 3173/371472 [15:23<30:11:32,  3.39it/s]
  1%|          | 3174/371472 [15:23<29:14:21,  3.50it/s]
  1%|          | 3175/371472 [15:24<29:27:50,  3.47it/s]
  1%|          | 3176/371472 [15:24<29:02:39,  3.52it/s]
  1%|          | 3177/371472 [15:24<29:47:00,  3.43it/s]
  1%|          | 3178/371472 [15:25<30:53:16,  3.31it/s]
  1%|          | 3179/371472 [15:25<33:45:56,  3.03it/s]
  1%|          | 3180/371472 [15:25<31:49:11,  3.22it/s]
                                                        
{'loss': 5.8228, 'learning_rate': 9.927761856536447e-07, 'epoch': 0.14}

  1%|          | 3180/371472 [15:25<31:49:11,  3.22it/s]
  1%|          | 3181/371472 [15:26<30:47:06,  3.32it/s]
  1%|          | 3182/371472 [15:26<29:48:22,  3.43it/s]
  1%|          | 3183/371472 [15:26<30:19:30,  3.37it/s]
  1%|          | 3184/371472 [15:26<29:03:28,  3.52it/s]
  1%|          | 3185/371472 [15:27<28:25:24,  3.60it/s]
  1%|          | 3186/371472 [15:27<28:15:38,  3.62it/s]
  1%|          | 3187/371472 [15:27<30:32:26,  3.35it/s]
  1%|          | 3188/371472 [15:28<30:39:34,  3.34it/s]
  1%|          | 3189/371472 [15:28<30:20:43,  3.37it/s]
  1%|          | 3190/371472 [15:28<29:01:25,  3.52it/s]
  1%|          | 3191/371472 [15:28<28:38:25,  3.57it/s]
  1%|          | 3192/371472 [15:29<28:46:03,  3.56it/s]
  1%|          | 3193/371472 [15:29<28:42:50,  3.56it/s]
  1%|          | 3194/371472 [15:29<27:50:48,  3.67it/s]
  1%|          | 3195/371472 [15:30<28:06:25,  3.64it/s]
  1%|          | 3196/371472 [15:30<29:03:00,  3.52it/s]
  1%|          | 3197/371472 [15:30<29:58:57,  3.41it/s]
  1%|          | 3198/371472 [15:30<29:05:41,  3.52it/s]
  1%|          | 3199/371472 [15:31<28:46:27,  3.56it/s]
  1%|          | 3200/371472 [15:31<30:28:26,  3.36it/s]
                                                        
{'loss': 5.9269, 'learning_rate': 9.927277036781658e-07, 'epoch': 0.14}

  1%|          | 3200/371472 [15:31<30:28:26,  3.36it/s]
  1%|          | 3201/371472 [15:31<29:50:17,  3.43it/s]
  1%|          | 3202/371472 [15:32<31:19:48,  3.27it/s]
  1%|          | 3203/371472 [15:32<31:27:03,  3.25it/s]
  1%|          | 3204/371472 [15:32<30:47:53,  3.32it/s]
  1%|          | 3205/371472 [15:33<31:27:34,  3.25it/s]
  1%|          | 3206/371472 [15:33<29:59:31,  3.41it/s]
  1%|          | 3207/371472 [15:33<29:56:50,  3.42it/s]
  1%|          | 3208/371472 [15:33<29:46:49,  3.43it/s]
  1%|          | 3209/371472 [15:34<28:57:28,  3.53it/s]
  1%|          | 3210/371472 [15:34<28:30:59,  3.59it/s]
  1%|          | 3211/371472 [15:34<30:03:30,  3.40it/s]
  1%|          | 3212/371472 [15:35<29:36:02,  3.46it/s]
  1%|          | 3213/371472 [15:35<29:12:08,  3.50it/s]
  1%|          | 3214/371472 [15:35<30:06:01,  3.40it/s]
  1%|          | 3215/371472 [15:35<29:00:07,  3.53it/s]
  1%|          | 3216/371472 [15:36<28:45:28,  3.56it/s]
  1%|          | 3217/371472 [15:36<29:04:54,  3.52it/s]
  1%|          | 3218/371472 [15:36<28:19:22,  3.61it/s]
  1%|          | 3219/371472 [15:37<29:06:19,  3.51it/s]
  1%|          | 3220/371472 [15:37<28:51:48,  3.54it/s]
                                                        
{'loss': 5.7547, 'learning_rate': 9.926792217026868e-07, 'epoch': 0.14}

  1%|          | 3220/371472 [15:37<28:51:48,  3.54it/s]
  1%|          | 3221/371472 [15:37<28:01:50,  3.65it/s]
  1%|          | 3222/371472 [15:37<29:52:54,  3.42it/s]
  1%|          | 3223/371472 [15:38<29:12:03,  3.50it/s]
  1%|          | 3224/371472 [15:38<29:14:17,  3.50it/s]
  1%|          | 3225/371472 [15:38<30:30:17,  3.35it/s]
  1%|          | 3226/371472 [15:39<29:17:04,  3.49it/s]
  1%|          | 3227/371472 [15:39<28:53:19,  3.54it/s]
  1%|          | 3228/371472 [15:39<29:53:45,  3.42it/s]
  1%|          | 3229/371472 [15:39<28:44:27,  3.56it/s]
  1%|          | 3230/371472 [15:40<29:33:58,  3.46it/s]
  1%|          | 3231/371472 [15:40<30:47:14,  3.32it/s]
  1%|          | 3232/371472 [15:40<29:14:57,  3.50it/s]
  1%|          | 3233/371472 [15:41<29:13:57,  3.50it/s]
  1%|          | 3234/371472 [15:41<28:37:08,  3.57it/s]
  1%|          | 3235/371472 [15:41<29:18:26,  3.49it/s]
  1%|          | 3236/371472 [15:41<30:16:56,  3.38it/s]
  1%|          | 3237/371472 [15:42<29:14:43,  3.50it/s]
  1%|          | 3238/371472 [15:42<28:41:39,  3.56it/s]
  1%|          | 3239/371472 [15:42<28:25:56,  3.60it/s]
  1%|          | 3240/371472 [15:43<27:48:28,  3.68it/s]
                                                        
{'loss': 5.7518, 'learning_rate': 9.926307397272081e-07, 'epoch': 0.14}

  1%|          | 3240/371472 [15:43<27:48:28,  3.68it/s]
  1%|          | 3241/371472 [15:43<27:50:32,  3.67it/s]
  1%|          | 3242/371472 [15:43<30:02:12,  3.41it/s]
  1%|          | 3243/371472 [15:43<30:02:44,  3.40it/s]
  1%|          | 3244/371472 [15:44<30:13:36,  3.38it/s]
  1%|          | 3245/371472 [15:44<28:46:26,  3.55it/s]
  1%|          | 3246/371472 [15:44<28:56:46,  3.53it/s]
  1%|          | 3247/371472 [15:45<28:41:01,  3.57it/s]
  1%|          | 3248/371472 [15:45<28:14:51,  3.62it/s]
  1%|          | 3249/371472 [15:45<27:29:10,  3.72it/s]
  1%|          | 3250/371472 [15:45<27:25:28,  3.73it/s]
  1%|          | 3251/371472 [15:46<27:07:46,  3.77it/s]
  1%|          | 3252/371472 [15:46<27:04:14,  3.78it/s]
  1%|          | 3253/371472 [15:46<29:22:07,  3.48it/s]
  1%|          | 3254/371472 [15:47<32:27:32,  3.15it/s]
  1%|          | 3255/371472 [15:47<31:59:35,  3.20it/s]
  1%|          | 3256/371472 [15:47<31:29:43,  3.25it/s]
  1%|          | 3257/371472 [15:47<30:15:05,  3.38it/s]
  1%|          | 3258/371472 [15:48<28:54:36,  3.54it/s]
  1%|          | 3259/371472 [15:48<28:15:30,  3.62it/s]
  1%|          | 3260/371472 [15:48<27:56:42,  3.66it/s]
                                                        
{'loss': 5.7172, 'learning_rate': 9.925822577517292e-07, 'epoch': 0.14}

  1%|          | 3260/371472 [15:48<27:56:42,  3.66it/s]
  1%|          | 3261/371472 [15:49<29:29:23,  3.47it/s]
  1%|          | 3262/371472 [15:49<29:50:13,  3.43it/s]
  1%|          | 3263/371472 [15:49<28:37:42,  3.57it/s]
  1%|          | 3264/371472 [15:49<28:15:44,  3.62it/s]
  1%|          | 3265/371472 [15:50<28:31:13,  3.59it/s]
  1%|          | 3266/371472 [15:50<31:09:32,  3.28it/s]
  1%|          | 3267/371472 [15:50<29:57:21,  3.41it/s]
  1%|          | 3268/371472 [15:51<29:28:08,  3.47it/s]
  1%|          | 3269/371472 [15:51<31:42:08,  3.23it/s]
  1%|          | 3270/371472 [15:51<30:08:27,  3.39it/s]
  1%|          | 3271/371472 [15:51<30:02:32,  3.40it/s]
  1%|          | 3272/371472 [15:52<30:35:45,  3.34it/s]
  1%|          | 3273/371472 [15:52<30:07:13,  3.40it/s]
  1%|          | 3274/371472 [15:52<31:08:04,  3.29it/s]
  1%|          | 3275/371472 [15:53<31:35:32,  3.24it/s]
  1%|          | 3276/371472 [15:53<30:20:52,  3.37it/s]
  1%|          | 3277/371472 [15:53<30:50:39,  3.32it/s]
  1%|          | 3278/371472 [15:54<30:26:33,  3.36it/s]
  1%|          | 3279/371472 [15:54<28:48:06,  3.55it/s]
  1%|          | 3280/371472 [15:54<29:04:37,  3.52it/s]
                                                        
{'loss': 5.3164, 'learning_rate': 9.925337757762503e-07, 'epoch': 0.14}

  1%|          | 3280/371472 [15:54<29:04:37,  3.52it/s]
  1%|          | 3281/371472 [15:54<29:03:43,  3.52it/s]
  1%|          | 3282/371472 [15:55<29:23:57,  3.48it/s]
  1%|          | 3283/371472 [15:55<29:11:43,  3.50it/s]
  1%|          | 3284/371472 [15:55<28:13:51,  3.62it/s]
  1%|          | 3285/371472 [15:56<28:27:15,  3.59it/s]
  1%|          | 3286/371472 [15:56<29:22:14,  3.48it/s]
  1%|          | 3287/371472 [15:56<28:13:41,  3.62it/s]
  1%|          | 3288/371472 [15:56<28:01:43,  3.65it/s]
  1%|          | 3289/371472 [15:57<27:35:04,  3.71it/s]
  1%|          | 3290/371472 [15:57<27:40:45,  3.69it/s]
  1%|          | 3291/371472 [15:57<27:47:14,  3.68it/s]
  1%|          | 3292/371472 [15:57<28:40:38,  3.57it/s]
  1%|          | 3293/371472 [15:58<29:11:10,  3.50it/s]
  1%|          | 3294/371472 [15:58<29:06:21,  3.51it/s]
  1%|          | 3295/371472 [15:58<28:38:04,  3.57it/s]
  1%|          | 3296/371472 [15:59<28:23:04,  3.60it/s]
  1%|          | 3297/371472 [15:59<30:31:19,  3.35it/s]
  1%|          | 3298/371472 [15:59<29:07:55,  3.51it/s]
  1%|          | 3299/371472 [15:59<30:16:52,  3.38it/s]
  1%|          | 3300/371472 [16:00<29:34:57,  3.46it/s]
                                                        
{'loss': 5.5814, 'learning_rate': 9.924852938007715e-07, 'epoch': 0.14}

  1%|          | 3300/371472 [16:00<29:34:57,  3.46it/s]
  1%|          | 3301/371472 [16:00<29:44:23,  3.44it/s]
  1%|          | 3302/371472 [16:00<29:19:03,  3.49it/s]
  1%|          | 3303/371472 [16:01<28:53:02,  3.54it/s]
  1%|          | 3304/371472 [16:01<29:05:14,  3.52it/s]
  1%|          | 3305/371472 [16:01<29:17:05,  3.49it/s]
  1%|          | 3306/371472 [16:01<28:32:31,  3.58it/s]
  1%|          | 3307/371472 [16:02<31:31:36,  3.24it/s]
  1%|          | 3308/371472 [16:02<31:45:16,  3.22it/s]
  1%|          | 3309/371472 [16:02<30:25:07,  3.36it/s]
  1%|          | 3310/371472 [16:03<29:19:11,  3.49it/s]
  1%|          | 3311/371472 [16:03<29:02:45,  3.52it/s]
  1%|          | 3312/371472 [16:03<28:36:52,  3.57it/s]
  1%|          | 3313/371472 [16:03<27:46:06,  3.68it/s]
  1%|          | 3314/371472 [16:04<30:40:44,  3.33it/s]
  1%|          | 3315/371472 [16:04<29:29:57,  3.47it/s]
  1%|          | 3316/371472 [16:04<30:07:52,  3.39it/s]
  1%|          | 3317/371472 [16:05<29:45:25,  3.44it/s]
  1%|          | 3318/371472 [16:05<28:57:33,  3.53it/s]
  1%|          | 3319/371472 [16:05<29:35:25,  3.46it/s]
  1%|          | 3320/371472 [16:06<29:01:56,  3.52it/s]
                                                        
{'loss': 5.7014, 'learning_rate': 9.924368118252924e-07, 'epoch': 0.14}

  1%|          | 3320/371472 [16:06<29:01:56,  3.52it/s]
  1%|          | 3321/371472 [16:06<31:09:15,  3.28it/s]
  1%|          | 3322/371472 [16:06<30:18:48,  3.37it/s]
  1%|          | 3323/371472 [16:06<29:03:55,  3.52it/s]
  1%|          | 3324/371472 [16:07<29:59:24,  3.41it/s]
  1%|          | 3325/371472 [16:07<31:04:53,  3.29it/s]
  1%|          | 3326/371472 [16:07<31:12:58,  3.28it/s]
  1%|          | 3327/371472 [16:08<30:51:31,  3.31it/s]
  1%|          | 3328/371472 [16:08<32:42:02,  3.13it/s]
  1%|          | 3329/371472 [16:08<30:26:34,  3.36it/s]
  1%|          | 3330/371472 [16:09<29:24:12,  3.48it/s]
  1%|          | 3331/371472 [16:09<32:08:15,  3.18it/s]
  1%|          | 3332/371472 [16:09<30:25:13,  3.36it/s]
  1%|          | 3333/371472 [16:09<30:26:22,  3.36it/s]
  1%|          | 3334/371472 [16:10<29:55:30,  3.42it/s]
  1%|          | 3335/371472 [16:10<28:48:32,  3.55it/s]
  1%|          | 3336/371472 [16:10<28:11:45,  3.63it/s]
  1%|          | 3337/371472 [16:11<28:21:02,  3.61it/s]
  1%|          | 3338/371472 [16:11<28:04:15,  3.64it/s]
  1%|          | 3339/371472 [16:11<27:55:09,  3.66it/s]
  1%|          | 3340/371472 [16:11<29:21:17,  3.48it/s]
                                                        
{'loss': 5.6091, 'learning_rate': 9.923883298498137e-07, 'epoch': 0.14}

  1%|          | 3340/371472 [16:11<29:21:17,  3.48it/s]
  1%|          | 3341/371472 [16:12<28:03:16,  3.64it/s]
  1%|          | 3342/371472 [16:12<29:08:43,  3.51it/s]
  1%|          | 3343/371472 [16:12<29:29:23,  3.47it/s]
  1%|          | 3344/371472 [16:13<29:01:39,  3.52it/s]
  1%|          | 3345/371472 [16:13<29:09:18,  3.51it/s]
  1%|          | 3346/371472 [16:13<29:12:31,  3.50it/s]
  1%|          | 3347/371472 [16:13<28:59:52,  3.53it/s]
  1%|          | 3348/371472 [16:14<29:38:25,  3.45it/s]
  1%|          | 3349/371472 [16:14<28:21:53,  3.61it/s]
  1%|          | 3350/371472 [16:14<28:17:13,  3.61it/s]
  1%|          | 3351/371472 [16:15<29:57:26,  3.41it/s]
  1%|          | 3352/371472 [16:15<29:28:43,  3.47it/s]
  1%|          | 3353/371472 [16:15<29:19:56,  3.49it/s]
  1%|          | 3354/371472 [16:15<28:56:23,  3.53it/s]
  1%|          | 3355/371472 [16:16<30:08:33,  3.39it/s]
  1%|          | 3356/371472 [16:16<29:36:27,  3.45it/s]
  1%|          | 3357/371472 [16:16<29:06:50,  3.51it/s]
  1%|          | 3358/371472 [16:17<28:55:21,  3.54it/s]
  1%|          | 3359/371472 [16:17<29:25:28,  3.48it/s]
  1%|          | 3360/371472 [16:17<29:51:54,  3.42it/s]
                                                        
{'loss': 5.9346, 'learning_rate': 9.923398478743345e-07, 'epoch': 0.14}

  1%|          | 3360/371472 [16:17<29:51:54,  3.42it/s]
  1%|          | 3361/371472 [16:17<30:53:51,  3.31it/s]
  1%|          | 3362/371472 [16:18<29:39:32,  3.45it/s]
  1%|          | 3363/371472 [16:18<28:56:51,  3.53it/s]
  1%|          | 3364/371472 [16:18<29:36:00,  3.45it/s]
  1%|          | 3365/371472 [16:19<28:36:49,  3.57it/s]
  1%|          | 3366/371472 [16:19<27:54:20,  3.66it/s]
  1%|          | 3367/371472 [16:19<28:22:07,  3.60it/s]
  1%|          | 3368/371472 [16:19<29:09:19,  3.51it/s]
  1%|          | 3369/371472 [16:20<28:02:39,  3.65it/s]
  1%|          | 3370/371472 [16:20<28:07:56,  3.63it/s]
  1%|          | 3371/371472 [16:20<28:49:24,  3.55it/s]
  1%|          | 3372/371472 [16:20<28:31:15,  3.59it/s]
  1%|          | 3373/371472 [16:21<28:41:35,  3.56it/s]
  1%|          | 3374/371472 [16:21<28:53:36,  3.54it/s]
  1%|          | 3375/371472 [16:21<28:54:15,  3.54it/s]
  1%|          | 3376/371472 [16:22<28:00:09,  3.65it/s]
  1%|          | 3377/371472 [16:22<27:13:53,  3.75it/s]
  1%|          | 3378/371472 [16:22<27:04:36,  3.78it/s]
  1%|          | 3379/371472 [16:22<27:08:42,  3.77it/s]
  1%|          | 3380/371472 [16:23<27:55:16,  3.66it/s]
                                                        
{'loss': 5.411, 'learning_rate': 9.922913658988558e-07, 'epoch': 0.15}

  1%|          | 3380/371472 [16:23<27:55:16,  3.66it/s]
  1%|          | 3381/371472 [16:23<28:54:49,  3.54it/s]
  1%|          | 3382/371472 [16:23<28:43:43,  3.56it/s]
  1%|          | 3383/371472 [16:24<28:36:03,  3.57it/s]
  1%|          | 3384/371472 [16:24<31:17:00,  3.27it/s]
  1%|          | 3385/371472 [16:24<32:42:31,  3.13it/s]
  1%|          | 3386/371472 [16:25<32:39:29,  3.13it/s]
  1%|          | 3387/371472 [16:25<30:59:35,  3.30it/s]
  1%|          | 3388/371472 [16:25<29:54:08,  3.42it/s]
  1%|          | 3389/371472 [16:25<31:37:49,  3.23it/s]
  1%|          | 3390/371472 [16:26<31:13:57,  3.27it/s]
  1%|          | 3391/371472 [16:26<30:15:17,  3.38it/s]
  1%|          | 3392/371472 [16:26<29:54:57,  3.42it/s]
  1%|          | 3393/371472 [16:27<29:53:56,  3.42it/s]
  1%|          | 3394/371472 [16:27<29:07:53,  3.51it/s]
  1%|          | 3395/371472 [16:27<29:37:55,  3.45it/s]
  1%|          | 3396/371472 [16:27<29:46:17,  3.43it/s]
  1%|          | 3397/371472 [16:28<29:32:05,  3.46it/s]
  1%|          | 3398/371472 [16:28<30:40:53,  3.33it/s]
  1%|          | 3399/371472 [16:28<30:28:18,  3.36it/s]
  1%|          | 3400/371472 [16:29<29:26:27,  3.47it/s]
                                                        
{'loss': 5.7669, 'learning_rate': 9.92242883923377e-07, 'epoch': 0.15}

  1%|          | 3400/371472 [16:29<29:26:27,  3.47it/s]
  1%|          | 3401/371472 [16:29<28:54:11,  3.54it/s]
  1%|          | 3402/371472 [16:29<28:55:06,  3.54it/s]
  1%|          | 3403/371472 [16:29<30:20:51,  3.37it/s]
  1%|          | 3404/371472 [16:30<29:28:01,  3.47it/s]
  1%|          | 3405/371472 [16:30<29:02:37,  3.52it/s]
  1%|          | 3406/371472 [16:30<29:57:22,  3.41it/s]
  1%|          | 3407/371472 [16:31<30:43:17,  3.33it/s]
  1%|          | 3408/371472 [16:31<29:35:45,  3.45it/s]
  1%|          | 3409/371472 [16:31<28:16:17,  3.62it/s]
  1%|          | 3410/371472 [16:32<30:03:34,  3.40it/s]
  1%|          | 3411/371472 [16:32<29:43:30,  3.44it/s]
  1%|          | 3412/371472 [16:32<28:30:10,  3.59it/s]
  1%|          | 3413/371472 [16:32<28:40:29,  3.57it/s]
  1%|          | 3414/371472 [16:33<29:29:30,  3.47it/s]
  1%|          | 3415/371472 [16:33<28:52:14,  3.54it/s]
  1%|          | 3416/371472 [16:33<30:20:03,  3.37it/s]
  1%|          | 3417/371472 [16:33<28:56:40,  3.53it/s]
  1%|          | 3418/371472 [16:34<28:44:09,  3.56it/s]
  1%|          | 3419/371472 [16:34<28:57:58,  3.53it/s]
  1%|          | 3420/371472 [16:34<30:42:21,  3.33it/s]
                                                        
{'loss': 5.3575, 'learning_rate': 9.92194401947898e-07, 'epoch': 0.15}

  1%|          | 3420/371472 [16:34<30:42:21,  3.33it/s]
  1%|          | 3421/371472 [16:35<29:17:20,  3.49it/s]
  1%|          | 3422/371472 [16:35<29:22:48,  3.48it/s]
  1%|          | 3423/371472 [16:35<28:16:27,  3.62it/s]
  1%|          | 3424/371472 [16:35<27:42:53,  3.69it/s]
  1%|          | 3425/371472 [16:36<27:25:11,  3.73it/s]
  1%|          | 3426/371472 [16:36<27:57:21,  3.66it/s]
  1%|          | 3427/371472 [16:36<27:32:12,  3.71it/s]
  1%|          | 3428/371472 [16:37<27:18:18,  3.74it/s]
  1%|          | 3429/371472 [16:37<26:43:09,  3.83it/s]
  1%|          | 3430/371472 [16:37<27:57:53,  3.66it/s]
  1%|          | 3431/371472 [16:37<27:45:05,  3.68it/s]
  1%|          | 3432/371472 [16:38<30:02:14,  3.40it/s]
  1%|          | 3433/371472 [16:38<29:17:01,  3.49it/s]
  1%|          | 3434/371472 [16:38<28:39:23,  3.57it/s]
  1%|          | 3435/371472 [16:38<28:17:45,  3.61it/s]
  1%|          | 3436/371472 [16:39<27:54:29,  3.66it/s]
  1%|          | 3437/371472 [16:39<27:51:39,  3.67it/s]
  1%|          | 3438/371472 [16:39<27:41:53,  3.69it/s]
  1%|          | 3439/371472 [16:40<28:40:38,  3.56it/s]
  1%|          | 3440/371472 [16:40<29:11:24,  3.50it/s]
                                                        
{'loss': 5.8575, 'learning_rate': 9.921459199724193e-07, 'epoch': 0.15}

  1%|          | 3440/371472 [16:40<29:11:24,  3.50it/s]
  1%|          | 3441/371472 [16:40<28:39:14,  3.57it/s]
  1%|          | 3442/371472 [16:40<28:13:29,  3.62it/s]
  1%|          | 3443/371472 [16:41<27:44:39,  3.68it/s]
  1%|          | 3444/371472 [16:41<28:06:16,  3.64it/s]
  1%|          | 3445/371472 [16:41<29:10:38,  3.50it/s]
  1%|          | 3446/371472 [16:42<29:21:03,  3.48it/s]
  1%|          | 3447/371472 [16:42<29:11:22,  3.50it/s]
  1%|          | 3448/371472 [16:42<28:41:50,  3.56it/s]
  1%|          | 3449/371472 [16:42<28:33:23,  3.58it/s]
  1%|          | 3450/371472 [16:43<29:31:55,  3.46it/s]
  1%|          | 3451/371472 [16:43<28:39:49,  3.57it/s]
  1%|          | 3452/371472 [16:43<28:40:03,  3.57it/s]
  1%|          | 3453/371472 [16:44<28:44:04,  3.56it/s]
  1%|          | 3454/371472 [16:44<28:53:55,  3.54it/s]
  1%|          | 3455/371472 [16:44<29:01:51,  3.52it/s]
  1%|          | 3456/371472 [16:44<29:04:55,  3.52it/s]
  1%|          | 3457/371472 [16:45<29:30:19,  3.46it/s]
  1%|          | 3458/371472 [16:45<29:04:31,  3.52it/s]
  1%|          | 3459/371472 [16:45<28:38:45,  3.57it/s]
  1%|          | 3460/371472 [16:45<28:21:09,  3.61it/s]
                                                        
{'loss': 5.5618, 'learning_rate': 9.920974379969401e-07, 'epoch': 0.15}

  1%|          | 3460/371472 [16:46<28:21:09,  3.61it/s]
  1%|          | 3461/371472 [16:46<28:33:43,  3.58it/s]
  1%|          | 3462/371472 [16:46<29:04:45,  3.52it/s]
  1%|          | 3463/371472 [16:46<29:29:53,  3.47it/s]
  1%|          | 3464/371472 [16:47<29:36:50,  3.45it/s]
  1%|          | 3465/371472 [16:47<29:51:12,  3.42it/s]
  1%|          | 3466/371472 [16:47<29:17:14,  3.49it/s]
  1%|          | 3467/371472 [16:48<29:09:09,  3.51it/s]
  1%|          | 3468/371472 [16:48<28:53:54,  3.54it/s]
  1%|          | 3469/371472 [16:48<28:59:23,  3.53it/s]
  1%|          | 3470/371472 [16:48<28:57:54,  3.53it/s]
  1%|          | 3471/371472 [16:49<27:59:33,  3.65it/s]
  1%|          | 3472/371472 [16:49<28:27:55,  3.59it/s]
  1%|          | 3473/371472 [16:49<30:56:00,  3.30it/s]
  1%|          | 3474/371472 [16:50<30:15:45,  3.38it/s]
  1%|          | 3475/371472 [16:50<30:13:57,  3.38it/s]
  1%|          | 3476/371472 [16:50<29:29:24,  3.47it/s]
  1%|          | 3477/371472 [16:50<28:59:41,  3.53it/s]
  1%|          | 3478/371472 [16:51<29:07:58,  3.51it/s]
  1%|          | 3479/371472 [16:51<28:38:37,  3.57it/s]
  1%|          | 3480/371472 [16:51<29:35:23,  3.45it/s]
                                                        
{'loss': 5.7241, 'learning_rate': 9.920489560214614e-07, 'epoch': 0.15}

  1%|          | 3480/371472 [16:51<29:35:23,  3.45it/s]
  1%|          | 3481/371472 [16:52<29:05:38,  3.51it/s]
  1%|          | 3482/371472 [16:52<28:15:00,  3.62it/s]
  1%|          | 3483/371472 [16:52<28:32:25,  3.58it/s]
  1%|          | 3484/371472 [16:52<27:44:10,  3.69it/s]
  1%|          | 3485/371472 [16:53<28:39:34,  3.57it/s]
  1%|          | 3486/371472 [16:53<28:08:08,  3.63it/s]
  1%|          | 3487/371472 [16:53<28:38:34,  3.57it/s]
  1%|          | 3488/371472 [16:53<27:37:04,  3.70it/s]
  1%|          | 3489/371472 [16:54<28:06:42,  3.64it/s]
  1%|          | 3490/371472 [16:54<28:22:42,  3.60it/s]
  1%|          | 3491/371472 [16:54<27:35:28,  3.70it/s]
  1%|          | 3492/371472 [16:55<28:01:51,  3.65it/s]
  1%|          | 3493/371472 [16:55<29:06:24,  3.51it/s]
  1%|          | 3494/371472 [16:55<28:51:23,  3.54it/s]
  1%|          | 3495/371472 [16:55<29:01:28,  3.52it/s]
  1%|          | 3496/371472 [16:56<29:11:14,  3.50it/s]
  1%|          | 3497/371472 [16:56<28:24:10,  3.60it/s]
  1%|          | 3498/371472 [16:56<29:06:32,  3.51it/s]
  1%|          | 3499/371472 [16:57<29:18:08,  3.49it/s]
  1%|          | 3500/371472 [16:57<29:28:49,  3.47it/s]
                                                        
{'loss': 5.6646, 'learning_rate': 9.920004740459823e-07, 'epoch': 0.15}

  1%|          | 3500/371472 [16:57<29:28:49,  3.47it/s]
  1%|          | 3501/371472 [16:57<28:59:45,  3.53it/s]
  1%|          | 3502/371472 [16:57<27:55:20,  3.66it/s]
  1%|          | 3503/371472 [16:58<28:00:57,  3.65it/s]
  1%|          | 3504/371472 [16:58<27:51:23,  3.67it/s]
  1%|          | 3505/371472 [16:58<28:32:27,  3.58it/s]
  1%|          | 3506/371472 [16:58<28:21:04,  3.61it/s]
  1%|          | 3507/371472 [16:59<30:26:24,  3.36it/s]
  1%|          | 3508/371472 [16:59<30:26:43,  3.36it/s]
  1%|          | 3509/371472 [16:59<29:42:25,  3.44it/s]
  1%|          | 3510/371472 [17:00<29:57:14,  3.41it/s]
  1%|          | 3511/371472 [17:00<29:41:05,  3.44it/s]
  1%|          | 3512/371472 [17:00<28:43:33,  3.56it/s]
  1%|          | 3513/371472 [17:01<28:29:56,  3.59it/s]
  1%|          | 3514/371472 [17:01<28:19:04,  3.61it/s]
  1%|          | 3515/371472 [17:01<29:48:58,  3.43it/s]
  1%|          | 3516/371472 [17:01<28:30:23,  3.59it/s]
  1%|          | 3517/371472 [17:02<28:38:20,  3.57it/s]
  1%|          | 3518/371472 [17:02<28:33:23,  3.58it/s]
  1%|          | 3519/371472 [17:02<28:42:35,  3.56it/s]
  1%|          | 3520/371472 [17:02<28:37:55,  3.57it/s]
                                                        
{'loss': 5.7116, 'learning_rate': 9.919519920705035e-07, 'epoch': 0.15}

  1%|          | 3520/371472 [17:02<28:37:55,  3.57it/s]
  1%|          | 3521/371472 [17:03<30:29:56,  3.35it/s]
  1%|          | 3522/371472 [17:03<29:27:28,  3.47it/s]
  1%|          | 3523/371472 [17:03<29:13:59,  3.50it/s]
  1%|          | 3524/371472 [17:04<28:25:51,  3.59it/s]
  1%|          | 3525/371472 [17:04<29:37:57,  3.45it/s]
  1%|          | 3526/371472 [17:04<30:00:33,  3.41it/s]
  1%|          | 3527/371472 [17:05<30:06:25,  3.39it/s]
  1%|          | 3528/371472 [17:05<30:32:21,  3.35it/s]
  1%|          | 3529/371472 [17:05<30:01:07,  3.40it/s]
  1%|          | 3530/371472 [17:05<30:19:06,  3.37it/s]
  1%|          | 3531/371472 [17:06<30:38:41,  3.34it/s]
  1%|          | 3532/371472 [17:06<30:10:43,  3.39it/s]
  1%|          | 3533/371472 [17:06<29:06:44,  3.51it/s]
  1%|          | 3534/371472 [17:07<28:38:05,  3.57it/s]
  1%|          | 3535/371472 [17:07<28:13:42,  3.62it/s]
  1%|          | 3536/371472 [17:07<30:48:39,  3.32it/s]
  1%|          | 3537/371472 [17:07<30:43:21,  3.33it/s]
  1%|          | 3538/371472 [17:08<34:12:21,  2.99it/s]
  1%|          | 3539/371472 [17:08<32:27:26,  3.15it/s]
  1%|          | 3540/371472 [17:08<32:14:45,  3.17it/s]
                                                        
{'loss': 5.4578, 'learning_rate': 9.919035100950246e-07, 'epoch': 0.15}

  1%|          | 3540/371472 [17:08<32:14:45,  3.17it/s]
  1%|          | 3541/371472 [17:09<31:00:55,  3.30it/s]
  1%|          | 3542/371472 [17:09<30:13:13,  3.38it/s]
  1%|          | 3543/371472 [17:09<29:45:14,  3.43it/s]
  1%|          | 3544/371472 [17:10<29:06:18,  3.51it/s]
  1%|          | 3545/371472 [17:10<28:22:45,  3.60it/s]
  1%|          | 3546/371472 [17:10<29:06:08,  3.51it/s]
  1%|          | 3547/371472 [17:10<28:15:26,  3.62it/s]
  1%|          | 3548/371472 [17:11<32:30:57,  3.14it/s]
  1%|          | 3549/371472 [17:11<30:48:31,  3.32it/s]
  1%|          | 3550/371472 [17:11<30:14:47,  3.38it/s]
  1%|          | 3551/371472 [17:12<29:28:26,  3.47it/s]
  1%|          | 3552/371472 [17:12<28:43:29,  3.56it/s]
  1%|          | 3553/371472 [17:12<29:59:27,  3.41it/s]
  1%|          | 3554/371472 [17:13<29:49:45,  3.43it/s]
  1%|          | 3555/371472 [17:13<29:09:41,  3.50it/s]
  1%|          | 3556/371472 [17:13<28:41:51,  3.56it/s]
  1%|          | 3557/371472 [17:13<29:35:48,  3.45it/s]
  1%|          | 3558/371472 [17:14<28:27:21,  3.59it/s]
  1%|          | 3559/371472 [17:14<27:46:09,  3.68it/s]
  1%|          | 3560/371472 [17:14<28:15:21,  3.62it/s]
                                                        
{'loss': 5.4505, 'learning_rate': 9.918550281195457e-07, 'epoch': 0.15}

  1%|          | 3560/371472 [17:14<28:15:21,  3.62it/s]
  1%|          | 3561/371472 [17:14<28:36:43,  3.57it/s]
  1%|          | 3562/371472 [17:15<30:27:26,  3.36it/s]
  1%|          | 3563/371472 [17:15<29:53:56,  3.42it/s]
  1%|          | 3564/371472 [17:15<30:28:48,  3.35it/s]
  1%|          | 3565/371472 [17:16<30:42:58,  3.33it/s]
  1%|          | 3566/371472 [17:16<33:33:49,  3.04it/s]
  1%|          | 3567/371472 [17:16<31:40:31,  3.23it/s]
  1%|          | 3568/371472 [17:17<31:07:41,  3.28it/s]
  1%|          | 3569/371472 [17:17<29:52:53,  3.42it/s]
  1%|          | 3570/371472 [17:17<29:58:23,  3.41it/s]
  1%|          | 3571/371472 [17:17<29:27:20,  3.47it/s]
  1%|          | 3572/371472 [17:18<29:48:20,  3.43it/s]
  1%|          | 3573/371472 [17:18<29:41:08,  3.44it/s]
  1%|          | 3574/371472 [17:18<29:21:39,  3.48it/s]
  1%|          | 3575/371472 [17:19<29:07:34,  3.51it/s]
  1%|          | 3576/371472 [17:19<28:02:10,  3.65it/s]
  1%|          | 3577/371472 [17:19<27:40:59,  3.69it/s]
  1%|          | 3578/371472 [17:19<29:10:57,  3.50it/s]
  1%|          | 3579/371472 [17:20<28:36:48,  3.57it/s]
  1%|          | 3580/371472 [17:20<28:29:12,  3.59it/s]
                                                        
{'loss': 5.6805, 'learning_rate': 9.918065461440668e-07, 'epoch': 0.15}

  1%|          | 3580/371472 [17:20<28:29:12,  3.59it/s]
  1%|          | 3581/371472 [17:20<30:32:03,  3.35it/s]
  1%|          | 3582/371472 [17:21<29:11:17,  3.50it/s]
  1%|          | 3583/371472 [17:21<28:43:55,  3.56it/s]
  1%|          | 3584/371472 [17:21<30:10:05,  3.39it/s]
  1%|          | 3585/371472 [17:21<29:40:53,  3.44it/s]
  1%|          | 3586/371472 [17:22<32:17:27,  3.16it/s]
  1%|          | 3587/371472 [17:22<30:42:47,  3.33it/s]
  1%|          | 3588/371472 [17:22<30:32:08,  3.35it/s]
  1%|          | 3589/371472 [17:23<30:57:26,  3.30it/s]
  1%|          | 3590/371472 [17:23<33:55:48,  3.01it/s]
  1%|          | 3591/371472 [17:23<34:29:44,  2.96it/s]
  1%|          | 3592/371472 [17:24<32:33:05,  3.14it/s]
  1%|          | 3593/371472 [17:24<30:44:51,  3.32it/s]
  1%|          | 3594/371472 [17:24<29:49:08,  3.43it/s]
  1%|          | 3595/371472 [17:25<36:57:26,  2.77it/s]
  1%|          | 3596/371472 [17:25<34:17:44,  2.98it/s]
  1%|          | 3597/371472 [17:25<31:52:04,  3.21it/s]
  1%|          | 3598/371472 [17:26<32:37:03,  3.13it/s]
  1%|          | 3599/371472 [17:26<31:15:19,  3.27it/s]
  1%|          | 3600/371472 [17:26<30:21:41,  3.37it/s]
                                                        
{'loss': 5.3575, 'learning_rate': 9.917580641685878e-07, 'epoch': 0.16}

  1%|          | 3600/371472 [17:26<30:21:41,  3.37it/s]
  1%|          | 3601/371472 [17:27<31:00:22,  3.30it/s]
  1%|          | 3602/371472 [17:27<30:25:50,  3.36it/s]
  1%|          | 3603/371472 [17:27<31:22:39,  3.26it/s]
  1%|          | 3604/371472 [17:27<30:22:16,  3.36it/s]
  1%|          | 3605/371472 [17:28<30:25:36,  3.36it/s]
  1%|          | 3606/371472 [17:28<29:06:51,  3.51it/s]
  1%|          | 3607/371472 [17:28<29:11:51,  3.50it/s]
  1%|          | 3608/371472 [17:29<28:22:35,  3.60it/s]
  1%|          | 3609/371472 [17:29<27:33:19,  3.71it/s]
  1%|          | 3610/371472 [17:29<27:24:12,  3.73it/s]
  1%|          | 3611/371472 [17:29<28:53:45,  3.54it/s]
  1%|          | 3612/371472 [17:30<28:16:32,  3.61it/s]
  1%|          | 3613/371472 [17:30<28:37:01,  3.57it/s]
  1%|          | 3614/371472 [17:30<29:45:45,  3.43it/s]
  1%|          | 3615/371472 [17:31<29:24:41,  3.47it/s]
  1%|          | 3616/371472 [17:31<29:55:26,  3.41it/s]
  1%|          | 3617/371472 [17:31<29:02:14,  3.52it/s]
  1%|          | 3618/371472 [17:31<28:14:34,  3.62it/s]
  1%|          | 3619/371472 [17:32<29:07:33,  3.51it/s]
  1%|          | 3620/371472 [17:32<29:11:16,  3.50it/s]
                                                        
{'loss': 5.7853, 'learning_rate': 9.917095821931091e-07, 'epoch': 0.16}

  1%|          | 3620/371472 [17:32<29:11:16,  3.50it/s]
  1%|          | 3621/371472 [17:32<28:53:51,  3.54it/s]
  1%|          | 3622/371472 [17:32<28:52:21,  3.54it/s]
  1%|          | 3623/371472 [17:33<28:16:55,  3.61it/s]
  1%|          | 3624/371472 [17:33<27:55:49,  3.66it/s]
  1%|          | 3625/371472 [17:33<28:33:42,  3.58it/s]
  1%|          | 3626/371472 [17:34<28:04:56,  3.64it/s]
  1%|          | 3627/371472 [17:34<27:27:43,  3.72it/s]
  1%|          | 3628/371472 [17:34<29:15:47,  3.49it/s]
  1%|          | 3629/371472 [17:34<29:03:23,  3.52it/s]
  1%|          | 3630/371472 [17:35<28:36:43,  3.57it/s]
  1%|          | 3631/371472 [17:35<27:56:02,  3.66it/s]
  1%|          | 3632/371472 [17:35<29:02:59,  3.52it/s]
  1%|          | 3633/371472 [17:36<27:44:48,  3.68it/s]
  1%|          | 3634/371472 [17:36<28:55:51,  3.53it/s]
  1%|          | 3635/371472 [17:36<28:39:24,  3.57it/s]
  1%|          | 3636/371472 [17:36<29:24:48,  3.47it/s]
  1%|          | 3637/371472 [17:37<28:29:07,  3.59it/s]
  1%|          | 3638/371472 [17:37<28:13:45,  3.62it/s]
  1%|          | 3639/371472 [17:37<28:33:04,  3.58it/s]
  1%|          | 3640/371472 [17:37<27:31:39,  3.71it/s]
                                                        
{'loss': 5.8258, 'learning_rate': 9.916611002176302e-07, 'epoch': 0.16}

  1%|          | 3640/371472 [17:37<27:31:39,  3.71it/s]
  1%|          | 3641/371472 [17:38<29:14:17,  3.49it/s]
  1%|          | 3642/371472 [17:38<29:14:58,  3.49it/s]
  1%|          | 3643/371472 [17:38<28:52:27,  3.54it/s]
  1%|          | 3644/371472 [17:39<28:32:34,  3.58it/s]
  1%|          | 3645/371472 [17:39<29:17:00,  3.49it/s]
  1%|          | 3646/371472 [17:39<28:51:27,  3.54it/s]
  1%|          | 3647/371472 [17:40<30:18:06,  3.37it/s]
  1%|          | 3648/371472 [17:40<29:31:32,  3.46it/s]
  1%|          | 3649/371472 [17:40<29:35:13,  3.45it/s]
  1%|          | 3650/371472 [17:40<29:22:47,  3.48it/s]
  1%|          | 3651/371472 [17:41<28:41:16,  3.56it/s]
  1%|          | 3652/371472 [17:41<30:00:00,  3.41it/s]
  1%|          | 3653/371472 [17:41<28:52:52,  3.54it/s]
  1%|          | 3654/371472 [17:41<28:32:34,  3.58it/s]
  1%|          | 3655/371472 [17:42<29:23:00,  3.48it/s]
  1%|          | 3656/371472 [17:42<30:26:48,  3.36it/s]
  1%|          | 3657/371472 [17:42<31:58:03,  3.20it/s]
  1%|          | 3658/371472 [17:43<31:02:46,  3.29it/s]
  1%|          | 3659/371472 [17:43<30:23:55,  3.36it/s]
  1%|          | 3660/371472 [17:43<31:30:27,  3.24it/s]
                                                        
{'loss': 5.6299, 'learning_rate': 9.916126182421513e-07, 'epoch': 0.16}

  1%|          | 3660/371472 [17:43<31:30:27,  3.24it/s]
  1%|          | 3661/371472 [17:44<29:58:52,  3.41it/s]
  1%|          | 3662/371472 [17:44<30:04:09,  3.40it/s]
  1%|          | 3663/371472 [17:44<28:56:20,  3.53it/s]
  1%|          | 3664/371472 [17:45<31:19:33,  3.26it/s]
  1%|          | 3665/371472 [17:45<29:54:16,  3.42it/s]
  1%|          | 3666/371472 [17:45<29:18:12,  3.49it/s]
  1%|          | 3667/371472 [17:45<28:46:42,  3.55it/s]
  1%|          | 3668/371472 [17:46<28:24:23,  3.60it/s]
  1%|          | 3669/371472 [17:46<28:23:40,  3.60it/s]
  1%|          | 3670/371472 [17:46<30:48:29,  3.32it/s]
  1%|          | 3671/371472 [17:47<30:20:50,  3.37it/s]
  1%|          | 3672/371472 [17:47<30:29:12,  3.35it/s]
  1%|          | 3673/371472 [17:47<29:37:28,  3.45it/s]
  1%|          | 3674/371472 [17:47<28:42:26,  3.56it/s]
  1%|          | 3675/371472 [17:48<27:45:38,  3.68it/s]
  1%|          | 3676/371472 [17:48<27:13:12,  3.75it/s]
  1%|          | 3677/371472 [17:48<26:49:29,  3.81it/s]
  1%|          | 3678/371472 [17:48<26:57:27,  3.79it/s]
  1%|          | 3679/371472 [17:49<26:48:45,  3.81it/s]
  1%|          | 3680/371472 [17:49<29:03:40,  3.52it/s]
                                                        
{'loss': 5.7533, 'learning_rate': 9.915641362666725e-07, 'epoch': 0.16}

  1%|          | 3680/371472 [17:49<29:03:40,  3.52it/s]
  1%|          | 3681/371472 [17:49<30:40:20,  3.33it/s]
  1%|          | 3682/371472 [17:50<31:08:44,  3.28it/s]
  1%|          | 3683/371472 [17:50<31:17:44,  3.26it/s]
  1%|          | 3684/371472 [17:50<30:25:29,  3.36it/s]
  1%|          | 3685/371472 [17:50<29:29:14,  3.46it/s]
  1%|          | 3686/371472 [17:51<29:15:00,  3.49it/s]
  1%|          | 3687/371472 [17:51<30:30:39,  3.35it/s]
  1%|          | 3688/371472 [17:51<29:58:39,  3.41it/s]
  1%|          | 3689/371472 [17:52<29:10:57,  3.50it/s]
  1%|          | 3690/371472 [17:52<29:16:11,  3.49it/s]
  1%|          | 3691/371472 [17:52<29:47:46,  3.43it/s]
  1%|          | 3692/371472 [17:53<29:27:54,  3.47it/s]
  1%|          | 3693/371472 [17:53<29:09:09,  3.50it/s]
  1%|          | 3694/371472 [17:53<33:02:23,  3.09it/s]
  1%|          | 3695/371472 [17:54<33:01:50,  3.09it/s]
  1%|          | 3696/371472 [17:54<32:15:30,  3.17it/s]
  1%|          | 3697/371472 [17:54<30:47:25,  3.32it/s]
  1%|          | 3698/371472 [17:54<29:48:21,  3.43it/s]
  1%|          | 3699/371472 [17:55<28:31:42,  3.58it/s]
  1%|          | 3700/371472 [17:55<27:57:22,  3.65it/s]
                                                        
{'loss': 5.6216, 'learning_rate': 9.915156542911934e-07, 'epoch': 0.16}

  1%|          | 3700/371472 [17:55<27:57:22,  3.65it/s]
  1%|          | 3701/371472 [17:55<27:49:46,  3.67it/s]
  1%|          | 3702/371472 [17:55<28:54:57,  3.53it/s]
  1%|          | 3703/371472 [17:56<28:28:56,  3.59it/s]
  1%|          | 3704/371472 [17:56<28:29:51,  3.58it/s]
  1%|          | 3705/371472 [17:56<28:03:32,  3.64it/s]
  1%|          | 3706/371472 [17:57<27:39:38,  3.69it/s]
  1%|          | 3707/371472 [17:57<27:42:03,  3.69it/s]
  1%|          | 3708/371472 [17:57<28:00:58,  3.65it/s]
  1%|          | 3709/371472 [17:57<28:51:41,  3.54it/s]
  1%|          | 3710/371472 [17:58<28:39:32,  3.56it/s]
  1%|          | 3711/371472 [17:58<28:57:51,  3.53it/s]
  1%|          | 3712/371472 [17:58<28:18:35,  3.61it/s]
  1%|          | 3713/371472 [17:59<29:16:39,  3.49it/s]
  1%|          | 3714/371472 [17:59<29:47:23,  3.43it/s]
  1%|          | 3715/371472 [17:59<29:25:17,  3.47it/s]
  1%|          | 3716/371472 [17:59<28:48:24,  3.55it/s]
  1%|          | 3717/371472 [18:00<28:31:27,  3.58it/s]
  1%|          | 3718/371472 [18:00<27:45:38,  3.68it/s]
  1%|          | 3719/371472 [18:00<27:51:52,  3.67it/s]
  1%|          | 3720/371472 [18:00<27:06:39,  3.77it/s]
                                                        
{'loss': 5.9745, 'learning_rate': 9.914671723157147e-07, 'epoch': 0.16}

  1%|          | 3720/371472 [18:00<27:06:39,  3.77it/s]
  1%|          | 3721/371472 [18:01<28:25:53,  3.59it/s]
  1%|          | 3722/371472 [18:01<27:45:22,  3.68it/s]
  1%|          | 3723/371472 [18:01<27:34:45,  3.70it/s]
  1%|          | 3724/371472 [18:02<29:07:03,  3.51it/s]
  1%|          | 3725/371472 [18:02<31:00:08,  3.29it/s]
  1%|          | 3726/371472 [18:02<30:30:09,  3.35it/s]
  1%|          | 3727/371472 [18:02<29:26:35,  3.47it/s]
  1%|          | 3728/371472 [18:03<30:12:30,  3.38it/s]
  1%|          | 3729/371472 [18:03<29:35:54,  3.45it/s]
  1%|          | 3730/371472 [18:03<29:12:03,  3.50it/s]
  1%|          | 3731/371472 [18:04<29:21:08,  3.48it/s]
  1%|          | 3732/371472 [18:04<28:55:07,  3.53it/s]
  1%|          | 3733/371472 [18:04<28:34:42,  3.57it/s]
  1%|          | 3734/371472 [18:04<27:52:00,  3.67it/s]
  1%|          | 3735/371472 [18:05<28:25:06,  3.59it/s]
  1%|          | 3736/371472 [18:05<28:12:12,  3.62it/s]
  1%|          | 3737/371472 [18:05<29:48:18,  3.43it/s]
  1%|          | 3738/371472 [18:06<28:45:18,  3.55it/s]
  1%|          | 3739/371472 [18:06<30:21:07,  3.37it/s]
  1%|          | 3740/371472 [18:06<29:35:53,  3.45it/s]
                                                        
{'loss': 5.6028, 'learning_rate': 9.914186903402355e-07, 'epoch': 0.16}

  1%|          | 3740/371472 [18:06<29:35:53,  3.45it/s]
  1%|          | 3741/371472 [18:06<28:40:30,  3.56it/s]
  1%|          | 3742/371472 [18:07<28:57:06,  3.53it/s]
  1%|          | 3743/371472 [18:07<28:34:43,  3.57it/s]
  1%|          | 3744/371472 [18:07<27:49:48,  3.67it/s]
  1%|          | 3745/371472 [18:08<27:44:18,  3.68it/s]
  1%|          | 3746/371472 [18:08<30:01:53,  3.40it/s]
  1%|          | 3747/371472 [18:08<30:16:39,  3.37it/s]
  1%|          | 3748/371472 [18:08<30:12:00,  3.38it/s]
  1%|          | 3749/371472 [18:09<29:10:05,  3.50it/s]
  1%|          | 3750/371472 [18:09<29:36:10,  3.45it/s]
  1%|          | 3751/371472 [18:09<29:36:34,  3.45it/s]
  1%|          | 3752/371472 [18:10<29:31:53,  3.46it/s]
  1%|          | 3753/371472 [18:10<28:56:42,  3.53it/s]
  1%|          | 3754/371472 [18:10<31:07:06,  3.28it/s]
  1%|          | 3755/371472 [18:11<31:29:14,  3.24it/s]
  1%|          | 3756/371472 [18:11<29:56:08,  3.41it/s]
  1%|          | 3757/371472 [18:11<32:36:33,  3.13it/s]
  1%|          | 3758/371472 [18:11<31:08:26,  3.28it/s]
  1%|          | 3759/371472 [18:12<30:31:19,  3.35it/s]
  1%|          | 3760/371472 [18:12<29:17:58,  3.49it/s]
                                                        
{'loss': 5.658, 'learning_rate': 9.913702083647568e-07, 'epoch': 0.16}

  1%|          | 3760/371472 [18:12<29:17:58,  3.49it/s]
  1%|          | 3761/371472 [18:12<29:59:31,  3.41it/s]
  1%|          | 3762/371472 [18:13<30:57:15,  3.30it/s]
  1%|          | 3763/371472 [18:13<31:01:31,  3.29it/s]
  1%|          | 3764/371472 [18:13<30:46:19,  3.32it/s]
  1%|          | 3765/371472 [18:14<29:46:46,  3.43it/s]
  1%|          | 3766/371472 [18:14<29:19:37,  3.48it/s]
  1%|          | 3767/371472 [18:14<29:01:19,  3.52it/s]
  1%|          | 3768/371472 [18:14<28:42:57,  3.56it/s]
  1%|          | 3769/371472 [18:15<28:54:15,  3.53it/s]
  1%|          | 3770/371472 [18:15<30:17:47,  3.37it/s]
  1%|          | 3771/371472 [18:15<32:35:49,  3.13it/s]
  1%|          | 3772/371472 [18:16<30:59:25,  3.30it/s]
  1%|          | 3773/371472 [18:16<29:58:13,  3.41it/s]
  1%|          | 3774/371472 [18:16<28:39:33,  3.56it/s]
  1%|          | 3775/371472 [18:16<30:18:20,  3.37it/s]
  1%|          | 3776/371472 [18:17<30:25:56,  3.36it/s]
  1%|          | 3777/371472 [18:17<29:17:15,  3.49it/s]
  1%|          | 3778/371472 [18:17<28:46:09,  3.55it/s]
  1%|          | 3779/371472 [18:18<28:30:24,  3.58it/s]
  1%|          | 3780/371472 [18:18<28:23:51,  3.60it/s]
                                                        
{'loss': 5.4876, 'learning_rate': 9.913217263892779e-07, 'epoch': 0.16}

  1%|          | 3780/371472 [18:18<28:23:51,  3.60it/s]
  1%|          | 3781/371472 [18:18<28:37:05,  3.57it/s]
  1%|          | 3782/371472 [18:18<29:10:11,  3.50it/s]
  1%|          | 3783/371472 [18:19<28:35:27,  3.57it/s]
  1%|          | 3784/371472 [18:19<29:00:28,  3.52it/s]
  1%|          | 3785/371472 [18:19<28:01:54,  3.64it/s]
  1%|          | 3786/371472 [18:19<27:28:28,  3.72it/s]
  1%|          | 3787/371472 [18:20<27:32:16,  3.71it/s]
  1%|          | 3788/371472 [18:20<28:14:01,  3.62it/s]
  1%|          | 3789/371472 [18:20<28:42:00,  3.56it/s]
  1%|          | 3790/371472 [18:21<28:47:10,  3.55it/s]
  1%|          | 3791/371472 [18:21<29:43:10,  3.44it/s]
  1%|          | 3792/371472 [18:21<29:56:54,  3.41it/s]
  1%|          | 3793/371472 [18:22<29:56:19,  3.41it/s]
  1%|          | 3794/371472 [18:22<29:10:24,  3.50it/s]
  1%|          | 3795/371472 [18:22<28:29:34,  3.58it/s]
  1%|          | 3796/371472 [18:22<28:26:43,  3.59it/s]
  1%|          | 3797/371472 [18:23<28:31:42,  3.58it/s]
  1%|          | 3798/371472 [18:23<27:18:14,  3.74it/s]
  1%|          | 3799/371472 [18:23<27:31:08,  3.71it/s]
  1%|          | 3800/371472 [18:23<29:32:39,  3.46it/s]
                                                        
{'loss': 5.5794, 'learning_rate': 9.91273244413799e-07, 'epoch': 0.16}

  1%|          | 3800/371472 [18:23<29:32:39,  3.46it/s]
  1%|          | 3801/371472 [18:24<29:32:37,  3.46it/s]
  1%|          | 3802/371472 [18:24<29:52:07,  3.42it/s]
  1%|          | 3803/371472 [18:24<31:11:07,  3.27it/s]
  1%|          | 3804/371472 [18:25<29:42:20,  3.44it/s]
  1%|          | 3805/371472 [18:25<29:17:07,  3.49it/s]
  1%|          | 3806/371472 [18:25<28:36:17,  3.57it/s]
  1%|          | 3807/371472 [18:25<27:49:32,  3.67it/s]
  1%|          | 3808/371472 [18:26<29:24:51,  3.47it/s]
  1%|          | 3809/371472 [18:26<30:16:11,  3.37it/s]
  1%|          | 3810/371472 [18:26<28:54:08,  3.53it/s]
  1%|          | 3811/371472 [18:27<28:16:26,  3.61it/s]
  1%|          | 3812/371472 [18:27<31:54:23,  3.20it/s]
  1%|          | 3813/371472 [18:27<32:07:26,  3.18it/s]
  1%|          | 3814/371472 [18:28<30:37:31,  3.33it/s]
  1%|          | 3815/371472 [18:28<29:40:21,  3.44it/s]
  1%|          | 3816/371472 [18:28<30:38:48,  3.33it/s]
  1%|          | 3817/371472 [18:28<31:06:51,  3.28it/s]
  1%|          | 3818/371472 [18:29<29:19:37,  3.48it/s]
  1%|          | 3819/371472 [18:29<28:12:52,  3.62it/s]
  1%|          | 3820/371472 [18:29<27:44:15,  3.68it/s]
                                                        
{'loss': 5.6442, 'learning_rate': 9.912247624383202e-07, 'epoch': 0.16}

  1%|          | 3820/371472 [18:29<27:44:15,  3.68it/s]
  1%|          | 3821/371472 [18:30<31:00:39,  3.29it/s]
  1%|          | 3822/371472 [18:30<33:02:07,  3.09it/s]
  1%|          | 3823/371472 [18:30<30:44:56,  3.32it/s]
  1%|          | 3824/371472 [18:31<29:37:45,  3.45it/s]
  1%|          | 3825/371472 [18:31<28:32:11,  3.58it/s]
  1%|          | 3826/371472 [18:31<28:53:52,  3.53it/s]
  1%|          | 3827/371472 [18:31<31:20:30,  3.26it/s]
  1%|          | 3828/371472 [18:32<30:34:31,  3.34it/s]
  1%|          | 3829/371472 [18:32<29:40:18,  3.44it/s]
  1%|          | 3830/371472 [18:32<29:54:34,  3.41it/s]
  1%|          | 3831/371472 [18:33<28:55:22,  3.53it/s]
  1%|          | 3832/371472 [18:33<28:40:20,  3.56it/s]
  1%|          | 3833/371472 [18:33<28:05:06,  3.64it/s]
  1%|          | 3834/371472 [18:33<28:39:35,  3.56it/s]
  1%|          | 3835/371472 [18:34<28:32:34,  3.58it/s]
  1%|          | 3836/371472 [18:34<28:37:43,  3.57it/s]
  1%|          | 3837/371472 [18:34<29:23:25,  3.47it/s]
  1%|          | 3838/371472 [18:34<28:49:28,  3.54it/s]
  1%|          | 3839/371472 [18:35<29:23:15,  3.47it/s]
  1%|          | 3840/371472 [18:35<29:59:12,  3.41it/s]
                                                        
{'loss': 5.5536, 'learning_rate': 9.911762804628411e-07, 'epoch': 0.17}

  1%|          | 3840/371472 [18:35<29:59:12,  3.41it/s]
  1%|          | 3841/371472 [18:35<29:47:16,  3.43it/s]
  1%|          | 3842/371472 [18:36<28:43:21,  3.56it/s]
  1%|          | 3843/371472 [18:36<29:13:50,  3.49it/s]
  1%|          | 3844/371472 [18:36<28:08:10,  3.63it/s]
  1%|          | 3845/371472 [18:37<30:06:14,  3.39it/s]
  1%|          | 3846/371472 [18:37<29:51:22,  3.42it/s]
  1%|          | 3847/371472 [18:37<30:45:07,  3.32it/s]
  1%|          | 3848/371472 [18:37<30:38:13,  3.33it/s]
  1%|          | 3849/371472 [18:38<29:58:14,  3.41it/s]
  1%|          | 3850/371472 [18:38<31:36:37,  3.23it/s]
  1%|          | 3851/371472 [18:38<30:40:04,  3.33it/s]
  1%|          | 3852/371472 [18:39<32:50:32,  3.11it/s]
  1%|          | 3853/371472 [18:39<32:59:02,  3.10it/s]
  1%|          | 3854/371472 [18:39<32:29:56,  3.14it/s]
  1%|          | 3855/371472 [18:40<30:29:01,  3.35it/s]
  1%|          | 3856/371472 [18:40<30:04:36,  3.40it/s]
  1%|          | 3857/371472 [18:40<28:54:34,  3.53it/s]
  1%|          | 3858/371472 [18:41<31:47:04,  3.21it/s]
  1%|          | 3859/371472 [18:41<30:58:33,  3.30it/s]
  1%|          | 3860/371472 [18:41<29:59:33,  3.40it/s]
                                                        
{'loss': 5.5444, 'learning_rate': 9.911277984873624e-07, 'epoch': 0.17}

  1%|          | 3860/371472 [18:41<29:59:33,  3.40it/s]
  1%|          | 3861/371472 [18:41<29:09:25,  3.50it/s]
  1%|          | 3862/371472 [18:42<28:40:42,  3.56it/s]
  1%|          | 3863/371472 [18:42<29:09:05,  3.50it/s]
  1%|          | 3864/371472 [18:42<29:44:10,  3.43it/s]
  1%|          | 3865/371472 [18:43<31:38:45,  3.23it/s]
  1%|          | 3866/371472 [18:43<30:15:34,  3.37it/s]
  1%|          | 3867/371472 [18:43<31:14:54,  3.27it/s]
  1%|          | 3868/371472 [18:43<29:53:38,  3.42it/s]
  1%|          | 3869/371472 [18:44<29:57:43,  3.41it/s]
  1%|          | 3870/371472 [18:44<30:45:03,  3.32it/s]
  1%|          | 3871/371472 [18:44<30:03:57,  3.40it/s]
  1%|          | 3872/371472 [18:45<28:47:41,  3.55it/s]
  1%|          | 3873/371472 [18:45<32:50:34,  3.11it/s]
  1%|          | 3874/371472 [18:45<32:53:09,  3.10it/s]
  1%|          | 3875/371472 [18:46<33:05:33,  3.09it/s]
  1%|          | 3876/371472 [18:46<32:26:52,  3.15it/s]
  1%|          | 3877/371472 [18:46<31:36:51,  3.23it/s]
  1%|          | 3878/371472 [18:47<32:20:50,  3.16it/s]
  1%|          | 3879/371472 [18:47<30:03:31,  3.40it/s]
  1%|          | 3880/371472 [18:47<30:03:05,  3.40it/s]
                                                        
{'loss': 5.7136, 'learning_rate': 9.910793165118835e-07, 'epoch': 0.17}

  1%|          | 3880/371472 [18:47<30:03:05,  3.40it/s]
  1%|          | 3881/371472 [18:47<29:00:10,  3.52it/s]
  1%|          | 3882/371472 [18:48<29:18:59,  3.48it/s]
  1%|          | 3883/371472 [18:48<28:55:35,  3.53it/s]
  1%|          | 3884/371472 [18:48<30:17:22,  3.37it/s]
  1%|          | 3885/371472 [18:49<31:38:47,  3.23it/s]
  1%|          | 3886/371472 [18:49<31:00:45,  3.29it/s]
  1%|          | 3887/371472 [18:49<30:18:50,  3.37it/s]
  1%|          | 3888/371472 [18:49<29:02:26,  3.52it/s]
  1%|          | 3889/371472 [18:50<31:02:49,  3.29it/s]
  1%|          | 3890/371472 [18:50<29:56:15,  3.41it/s]
  1%|          | 3891/371472 [18:50<30:56:53,  3.30it/s]
  1%|          | 3892/371472 [18:51<31:23:28,  3.25it/s]
  1%|          | 3893/371472 [18:51<30:45:40,  3.32it/s]
  1%|          | 3894/371472 [18:51<29:51:43,  3.42it/s]
  1%|          | 3895/371472 [18:51<28:46:56,  3.55it/s]
  1%|          | 3896/371472 [18:52<28:24:27,  3.59it/s]
  1%|          | 3897/371472 [18:52<28:13:22,  3.62it/s]
  1%|          | 3898/371472 [18:52<29:00:24,  3.52it/s]
  1%|          | 3899/371472 [18:53<28:58:32,  3.52it/s]
  1%|          | 3900/371472 [18:53<29:26:44,  3.47it/s]
                                                        
{'loss': 5.2753, 'learning_rate': 9.910308345364045e-07, 'epoch': 0.17}

  1%|          | 3900/371472 [18:53<29:26:44,  3.47it/s]
  1%|          | 3901/371472 [18:53<29:39:54,  3.44it/s]
  1%|          | 3902/371472 [18:54<29:37:59,  3.45it/s]
  1%|          | 3903/371472 [18:54<32:18:32,  3.16it/s]
  1%|          | 3904/371472 [18:54<30:40:37,  3.33it/s]
  1%|          | 3905/371472 [18:54<30:55:49,  3.30it/s]
  1%|          | 3906/371472 [18:55<30:33:40,  3.34it/s]
  1%|          | 3907/371472 [18:55<29:39:05,  3.44it/s]
  1%|          | 3908/371472 [18:55<30:51:38,  3.31it/s]
  1%|          | 3909/371472 [18:56<29:08:30,  3.50it/s]
  1%|          | 3910/371472 [18:56<29:28:21,  3.46it/s]
  1%|          | 3911/371472 [18:56<29:43:24,  3.44it/s]
  1%|          | 3912/371472 [18:56<29:42:52,  3.44it/s]
  1%|          | 3913/371472 [18:57<28:36:03,  3.57it/s]
  1%|          | 3914/371472 [18:57<29:31:06,  3.46it/s]
  1%|          | 3915/371472 [18:57<29:23:04,  3.47it/s]
  1%|          | 3916/371472 [18:58<28:27:22,  3.59it/s]
  1%|          | 3917/371472 [18:58<28:31:14,  3.58it/s]
  1%|          | 3918/371472 [18:58<29:04:03,  3.51it/s]
  1%|          | 3919/371472 [18:58<29:44:37,  3.43it/s]
  1%|          | 3920/371472 [18:59<30:10:46,  3.38it/s]
                                                        
{'loss': 5.4269, 'learning_rate': 9.909823525609258e-07, 'epoch': 0.17}

  1%|          | 3920/371472 [18:59<30:10:46,  3.38it/s]
  1%|          | 3921/371472 [18:59<29:39:14,  3.44it/s]
  1%|          | 3922/371472 [18:59<28:25:16,  3.59it/s]
  1%|          | 3923/371472 [19:00<28:52:47,  3.54it/s]
  1%|          | 3924/371472 [19:00<30:03:38,  3.40it/s]
  1%|          | 3925/371472 [19:00<29:07:42,  3.51it/s]
  1%|          | 3926/371472 [19:00<28:57:15,  3.53it/s]
  1%|          | 3927/371472 [19:01<31:16:42,  3.26it/s]
  1%|          | 3928/371472 [19:01<31:57:46,  3.19it/s]
  1%|          | 3929/371472 [19:01<30:50:30,  3.31it/s]
  1%|          | 3930/371472 [19:02<30:19:40,  3.37it/s]
  1%|          | 3931/371472 [19:02<29:24:36,  3.47it/s]
  1%|          | 3932/371472 [19:02<28:04:08,  3.64it/s]
  1%|          | 3933/371472 [19:03<28:34:36,  3.57it/s]
  1%|          | 3934/371472 [19:03<27:37:40,  3.70it/s]
  1%|          | 3935/371472 [19:03<28:09:57,  3.62it/s]
  1%|          | 3936/371472 [19:03<28:40:43,  3.56it/s]
  1%|          | 3937/371472 [19:04<28:16:59,  3.61it/s]
  1%|          | 3938/371472 [19:04<29:08:53,  3.50it/s]
  1%|          | 3939/371472 [19:04<28:28:11,  3.59it/s]
  1%|          | 3940/371472 [19:04<28:05:54,  3.63it/s]
                                                        
{'loss': 5.4923, 'learning_rate': 9.909338705854467e-07, 'epoch': 0.17}

  1%|          | 3940/371472 [19:04<28:05:54,  3.63it/s]
  1%|          | 3941/371472 [19:05<28:47:06,  3.55it/s]
  1%|          | 3942/371472 [19:05<28:57:38,  3.53it/s]
  1%|          | 3943/371472 [19:05<28:35:51,  3.57it/s]
  1%|          | 3944/371472 [19:06<29:51:10,  3.42it/s]
  1%|          | 3945/371472 [19:06<30:31:30,  3.34it/s]
  1%|          | 3946/371472 [19:06<30:39:26,  3.33it/s]
  1%|          | 3947/371472 [19:07<30:48:50,  3.31it/s]
  1%|          | 3948/371472 [19:07<29:58:59,  3.40it/s]
  1%|          | 3949/371472 [19:07<28:52:10,  3.54it/s]
  1%|          | 3950/371472 [19:07<28:15:47,  3.61it/s]
  1%|          | 3951/371472 [19:08<28:34:24,  3.57it/s]
  1%|          | 3952/371472 [19:08<28:26:11,  3.59it/s]
  1%|          | 3953/371472 [19:08<28:15:32,  3.61it/s]
  1%|          | 3954/371472 [19:08<29:00:49,  3.52it/s]
  1%|          | 3955/371472 [19:09<29:19:36,  3.48it/s]
  1%|          | 3956/371472 [19:09<28:46:05,  3.55it/s]
  1%|          | 3957/371472 [19:09<27:46:35,  3.68it/s]
  1%|          | 3958/371472 [19:10<27:53:31,  3.66it/s]
  1%|          | 3959/371472 [19:10<28:01:41,  3.64it/s]
  1%|          | 3960/371472 [19:10<28:12:01,  3.62it/s]
                                                        
{'loss': 5.5202, 'learning_rate': 9.90885388609968e-07, 'epoch': 0.17}

  1%|          | 3960/371472 [19:10<28:12:01,  3.62it/s]
  1%|          | 3961/371472 [19:10<28:38:06,  3.57it/s]
  1%|          | 3962/371472 [19:11<28:04:36,  3.64it/s]
  1%|          | 3963/371472 [19:11<29:29:14,  3.46it/s]
  1%|          | 3964/371472 [19:11<28:12:53,  3.62it/s]
  1%|          | 3965/371472 [19:12<28:47:09,  3.55it/s]
  1%|          | 3966/371472 [19:12<28:44:57,  3.55it/s]
  1%|          | 3967/371472 [19:12<29:13:22,  3.49it/s]
  1%|          | 3968/371472 [19:12<28:39:48,  3.56it/s]
  1%|          | 3969/371472 [19:13<28:04:13,  3.64it/s]
  1%|          | 3970/371472 [19:13<28:16:28,  3.61it/s]
  1%|          | 3971/371472 [19:13<28:11:39,  3.62it/s]
  1%|          | 3972/371472 [19:13<28:08:24,  3.63it/s]
  1%|          | 3973/371472 [19:14<28:00:35,  3.64it/s]
  1%|          | 3974/371472 [19:14<28:19:05,  3.60it/s]
  1%|          | 3975/371472 [19:14<30:15:01,  3.37it/s]
  1%|          | 3976/371472 [19:15<30:24:18,  3.36it/s]
  1%|          | 3977/371472 [19:15<30:59:00,  3.29it/s]
  1%|          | 3978/371472 [19:15<30:03:48,  3.40it/s]
  1%|          | 3979/371472 [19:16<28:42:35,  3.56it/s]
  1%|          | 3980/371472 [19:16<27:58:51,  3.65it/s]
                                                        
{'loss': 5.5258, 'learning_rate': 9.908369066344888e-07, 'epoch': 0.17}

  1%|          | 3980/371472 [19:16<27:58:51,  3.65it/s]
  1%|          | 3981/371472 [19:16<27:49:41,  3.67it/s]
  1%|          | 3982/371472 [19:16<28:41:40,  3.56it/s]
  1%|          | 3983/371472 [19:17<27:49:45,  3.67it/s]
  1%|          | 3984/371472 [19:17<29:19:59,  3.48it/s]
  1%|          | 3985/371472 [19:17<29:42:24,  3.44it/s]
  1%|          | 3986/371472 [19:17<28:46:58,  3.55it/s]
  1%|          | 3987/371472 [19:18<29:28:35,  3.46it/s]
  1%|          | 3988/371472 [19:18<28:59:48,  3.52it/s]
  1%|          | 3989/371472 [19:18<31:01:06,  3.29it/s]
  1%|          | 3990/371472 [19:19<30:12:07,  3.38it/s]
  1%|          | 3991/371472 [19:19<32:58:27,  3.10it/s]
  1%|          | 3992/371472 [19:19<31:02:16,  3.29it/s]
  1%|          | 3993/371472 [19:20<31:21:03,  3.26it/s]
  1%|          | 3994/371472 [19:20<29:59:12,  3.40it/s]
  1%|          | 3995/371472 [19:20<29:06:35,  3.51it/s]
  1%|          | 3996/371472 [19:20<29:26:07,  3.47it/s]
  1%|          | 3997/371472 [19:21<30:23:57,  3.36it/s]
  1%|          | 3998/371472 [19:21<29:06:56,  3.51it/s]
  1%|          | 3999/371472 [19:21<28:51:03,  3.54it/s]
  1%|          | 4000/371472 [19:22<28:13:09,  3.62it/s]
                                                        
{'loss': 5.5544, 'learning_rate': 9.9078842465901e-07, 'epoch': 0.17}

  1%|          | 4000/371472 [19:22<28:13:09,  3.62it/s]
  1%|          | 4001/371472 [19:22<30:35:17,  3.34it/s]
  1%|          | 4002/371472 [19:22<29:36:49,  3.45it/s]
  1%|          | 4003/371472 [19:23<30:57:30,  3.30it/s]
  1%|          | 4004/371472 [19:23<30:25:49,  3.35it/s]
  1%|          | 4005/371472 [19:23<29:03:55,  3.51it/s]
  1%|          | 4006/371472 [19:23<28:58:14,  3.52it/s]
  1%|          | 4007/371472 [19:24<28:23:11,  3.60it/s]
  1%|          | 4008/371472 [19:24<28:49:11,  3.54it/s]
  1%|          | 4009/371472 [19:24<29:45:41,  3.43it/s]
  1%|          | 4010/371472 [19:25<31:29:48,  3.24it/s]
  1%|          | 4011/371472 [19:25<30:26:37,  3.35it/s]
  1%|          | 4012/371472 [19:25<29:29:12,  3.46it/s]
  1%|          | 4013/371472 [19:25<28:52:40,  3.53it/s]
  1%|          | 4014/371472 [19:26<28:58:29,  3.52it/s]
  1%|          | 4015/371472 [19:26<29:15:32,  3.49it/s]
  1%|          | 4016/371472 [19:26<28:27:40,  3.59it/s]
  1%|          | 4017/371472 [19:26<27:50:36,  3.67it/s]
  1%|          | 4018/371472 [19:27<27:55:58,  3.65it/s]
  1%|          | 4019/371472 [19:27<28:58:19,  3.52it/s]
  1%|          | 4020/371472 [19:27<29:29:31,  3.46it/s]
                                                        
{'loss': 5.5478, 'learning_rate': 9.907399426835312e-07, 'epoch': 0.17}

  1%|          | 4020/371472 [19:27<29:29:31,  3.46it/s]
  1%|          | 4021/371472 [19:28<29:15:20,  3.49it/s]
  1%|          | 4022/371472 [19:28<29:12:41,  3.49it/s]
  1%|          | 4023/371472 [19:28<30:41:38,  3.33it/s]
  1%|          | 4024/371472 [19:29<29:56:52,  3.41it/s]
  1%|          | 4025/371472 [19:29<29:11:23,  3.50it/s]
  1%|          | 4026/371472 [19:29<28:58:38,  3.52it/s]
  1%|          | 4027/371472 [19:29<30:57:43,  3.30it/s]
  1%|          | 4028/371472 [19:30<29:56:23,  3.41it/s]
  1%|          | 4029/371472 [19:30<29:40:48,  3.44it/s]
  1%|          | 4030/371472 [19:30<30:03:53,  3.39it/s]
  1%|          | 4031/371472 [19:31<32:35:55,  3.13it/s]
  1%|          | 4032/371472 [19:31<31:16:19,  3.26it/s]
  1%|          | 4033/371472 [19:31<29:59:59,  3.40it/s]
  1%|          | 4034/371472 [19:32<30:32:57,  3.34it/s]
  1%|          | 4035/371472 [19:32<29:05:20,  3.51it/s]
  1%|          | 4036/371472 [19:32<30:19:29,  3.37it/s]
  1%|          | 4037/371472 [19:32<31:08:19,  3.28it/s]
  1%|          | 4038/371472 [19:33<30:06:18,  3.39it/s]
  1%|          | 4039/371472 [19:33<31:53:36,  3.20it/s]
  1%|          | 4040/371472 [19:33<31:45:32,  3.21it/s]
                                                        
{'loss': 5.5041, 'learning_rate': 9.906914607080522e-07, 'epoch': 0.17}

  1%|          | 4040/371472 [19:33<31:45:32,  3.21it/s]
  1%|          | 4041/371472 [19:34<31:18:09,  3.26it/s]
  1%|          | 4042/371472 [19:34<30:56:13,  3.30it/s]
  1%|          | 4043/371472 [19:34<30:27:41,  3.35it/s]
  1%|          | 4044/371472 [19:35<29:42:48,  3.43it/s]
  1%|          | 4045/371472 [19:35<30:53:48,  3.30it/s]
  1%|          | 4046/371472 [19:35<31:25:44,  3.25it/s]
  1%|          | 4047/371472 [19:35<29:59:06,  3.40it/s]
  1%|          | 4048/371472 [19:36<30:59:56,  3.29it/s]
  1%|          | 4049/371472 [19:36<29:53:46,  3.41it/s]
  1%|          | 4050/371472 [19:36<29:42:55,  3.43it/s]
  1%|          | 4051/371472 [19:37<29:22:25,  3.47it/s]
  1%|          | 4052/371472 [19:37<28:01:05,  3.64it/s]
  1%|          | 4053/371472 [19:37<28:05:42,  3.63it/s]
  1%|          | 4054/371472 [19:37<28:53:35,  3.53it/s]
  1%|          | 4055/371472 [19:38<30:03:02,  3.40it/s]
  1%|          | 4056/371472 [19:38<28:34:31,  3.57it/s]
  1%|          | 4057/371472 [19:38<28:09:05,  3.63it/s]
  1%|          | 4058/371472 [19:39<28:35:28,  3.57it/s]
  1%|          | 4059/371472 [19:39<29:15:10,  3.49it/s]
  1%|          | 4060/371472 [19:39<28:14:23,  3.61it/s]
                                                        
{'loss': 5.4906, 'learning_rate': 9.906429787325735e-07, 'epoch': 0.17}

  1%|          | 4060/371472 [19:39<28:14:23,  3.61it/s]
  1%|          | 4061/371472 [19:39<27:59:10,  3.65it/s]
  1%|          | 4062/371472 [19:40<27:43:35,  3.68it/s]
  1%|          | 4063/371472 [19:40<27:27:06,  3.72it/s]
  1%|          | 4064/371472 [19:40<28:08:31,  3.63it/s]
  1%|          | 4065/371472 [19:40<27:58:14,  3.65it/s]
  1%|          | 4066/371472 [19:41<28:37:15,  3.57it/s]
  1%|          | 4067/371472 [19:41<28:30:34,  3.58it/s]
  1%|          | 4068/371472 [19:41<28:16:00,  3.61it/s]
  1%|          | 4069/371472 [19:42<29:01:15,  3.52it/s]
  1%|          | 4070/371472 [19:42<28:39:05,  3.56it/s]
  1%|          | 4071/371472 [19:42<27:35:29,  3.70it/s]
  1%|          | 4072/371472 [19:42<28:25:36,  3.59it/s]
  1%|          | 4073/371472 [19:43<28:13:40,  3.62it/s]
  1%|          | 4074/371472 [19:43<28:45:39,  3.55it/s]
  1%|          | 4075/371472 [19:43<29:26:58,  3.47it/s]
  1%|          | 4076/371472 [19:44<28:58:12,  3.52it/s]
  1%|          | 4077/371472 [19:44<28:37:22,  3.57it/s]
  1%|          | 4078/371472 [19:44<28:09:31,  3.62it/s]
  1%|          | 4079/371472 [19:44<28:02:14,  3.64it/s]
  1%|          | 4080/371472 [19:45<28:05:48,  3.63it/s]
                                                        
{'loss': 5.4225, 'learning_rate': 9.905944967570944e-07, 'epoch': 0.18}

  1%|          | 4080/371472 [19:45<28:05:48,  3.63it/s]
  1%|          | 4081/371472 [19:45<28:16:12,  3.61it/s]
  1%|          | 4082/371472 [19:45<27:31:47,  3.71it/s]
  1%|          | 4083/371472 [19:45<27:23:15,  3.73it/s]
  1%|          | 4084/371472 [19:46<28:45:51,  3.55it/s]
  1%|          | 4085/371472 [19:46<28:57:34,  3.52it/s]
  1%|          | 4086/371472 [19:46<29:00:57,  3.52it/s]
  1%|          | 4087/371472 [19:47<29:13:17,  3.49it/s]
  1%|          | 4088/371472 [19:47<29:26:39,  3.47it/s]
  1%|          | 4089/371472 [19:47<29:26:23,  3.47it/s]
  1%|          | 4090/371472 [19:47<28:59:06,  3.52it/s]
  1%|          | 4091/371472 [19:48<29:17:17,  3.48it/s]
  1%|          | 4092/371472 [19:48<28:42:13,  3.56it/s]
  1%|          | 4093/371472 [19:48<30:39:53,  3.33it/s]
  1%|          | 4094/371472 [19:49<30:40:24,  3.33it/s]
  1%|          | 4095/371472 [19:49<29:19:19,  3.48it/s]
  1%|          | 4096/371472 [19:49<28:49:09,  3.54it/s]
  1%|          | 4097/371472 [19:50<29:22:31,  3.47it/s]
  1%|          | 4098/371472 [19:50<29:21:41,  3.48it/s]
  1%|          | 4099/371472 [19:50<28:32:52,  3.57it/s]
  1%|          | 4100/371472 [19:50<28:27:43,  3.59it/s]
                                                        
{'loss': 5.6207, 'learning_rate': 9.905460147816157e-07, 'epoch': 0.18}

  1%|          | 4100/371472 [19:50<28:27:43,  3.59it/s]
  1%|          | 4101/371472 [19:51<28:02:28,  3.64it/s]
  1%|          | 4102/371472 [19:51<27:43:45,  3.68it/s]
  1%|          | 4103/371472 [19:51<29:28:33,  3.46it/s]
  1%|          | 4104/371472 [19:51<29:14:13,  3.49it/s]
  1%|          | 4105/371472 [19:52<28:46:48,  3.55it/s]
  1%|          | 4106/371472 [19:52<29:50:10,  3.42it/s]
  1%|          | 4107/371472 [19:52<29:39:19,  3.44it/s]
  1%|          | 4108/371472 [19:53<31:26:37,  3.25it/s]
  1%|          | 4109/371472 [19:53<30:08:22,  3.39it/s]
  1%|          | 4110/371472 [19:53<29:43:07,  3.43it/s]
  1%|          | 4111/371472 [19:54<29:18:35,  3.48it/s]
  1%|          | 4112/371472 [19:54<28:10:43,  3.62it/s]
  1%|          | 4113/371472 [19:54<29:29:22,  3.46it/s]
  1%|          | 4114/371472 [19:54<28:30:32,  3.58it/s]
  1%|          | 4115/371472 [19:55<28:25:47,  3.59it/s]
  1%|          | 4116/371472 [19:55<28:41:16,  3.56it/s]
  1%|          | 4117/371472 [19:55<29:14:56,  3.49it/s]
  1%|          | 4118/371472 [19:56<29:31:56,  3.46it/s]
  1%|          | 4119/371472 [19:56<30:15:05,  3.37it/s]
  1%|          | 4120/371472 [19:56<31:46:49,  3.21it/s]
                                                        
{'loss': 5.5054, 'learning_rate': 9.904975328061365e-07, 'epoch': 0.18}

  1%|          | 4120/371472 [19:56<31:46:49,  3.21it/s]
  1%|          | 4121/371472 [19:56<30:56:27,  3.30it/s]
  1%|          | 4122/371472 [19:57<30:05:24,  3.39it/s]
  1%|          | 4123/371472 [19:57<29:08:00,  3.50it/s]
  1%|          | 4124/371472 [19:57<28:50:35,  3.54it/s]
  1%|          | 4125/371472 [19:58<28:43:23,  3.55it/s]
  1%|          | 4126/371472 [19:58<28:09:14,  3.62it/s]
  1%|          | 4127/371472 [19:58<29:01:35,  3.52it/s]
  1%|          | 4128/371472 [19:58<29:15:33,  3.49it/s]
  1%|          | 4129/371472 [19:59<28:18:54,  3.60it/s]
  1%|          | 4130/371472 [19:59<28:39:05,  3.56it/s]
  1%|          | 4131/371472 [19:59<28:33:10,  3.57it/s]
  1%|          | 4132/371472 [20:00<29:55:23,  3.41it/s]
  1%|          | 4133/371472 [20:00<28:36:40,  3.57it/s]
  1%|          | 4134/371472 [20:00<27:47:43,  3.67it/s]
  1%|          | 4135/371472 [20:00<27:02:20,  3.77it/s]
  1%|          | 4136/371472 [20:01<28:01:35,  3.64it/s]
  1%|          | 4137/371472 [20:01<27:29:24,  3.71it/s]
  1%|          | 4138/371472 [20:01<27:06:26,  3.76it/s]
  1%|          | 4139/371472 [20:01<29:13:40,  3.49it/s]
  1%|          | 4140/371472 [20:02<30:03:17,  3.40it/s]
                                                        
{'loss': 5.4273, 'learning_rate': 9.904490508306578e-07, 'epoch': 0.18}

  1%|          | 4140/371472 [20:02<30:03:17,  3.40it/s]
  1%|          | 4141/371472 [20:02<29:10:56,  3.50it/s]
  1%|          | 4142/371472 [20:02<29:05:15,  3.51it/s]
  1%|          | 4143/371472 [20:03<29:03:25,  3.51it/s]
  1%|          | 4144/371472 [20:03<28:20:07,  3.60it/s]
  1%|          | 4145/371472 [20:03<32:11:31,  3.17it/s]
  1%|          | 4146/371472 [20:04<30:14:45,  3.37it/s]
  1%|          | 4147/371472 [20:04<30:33:40,  3.34it/s]
  1%|          | 4148/371472 [20:04<33:30:53,  3.04it/s]
  1%|          | 4149/371472 [20:05<32:47:37,  3.11it/s]
  1%|          | 4150/371472 [20:05<30:32:56,  3.34it/s]
  1%|          | 4151/371472 [20:05<30:10:49,  3.38it/s]
  1%|          | 4152/371472 [20:05<28:42:29,  3.55it/s]
  1%|          | 4153/371472 [20:06<27:51:44,  3.66it/s]
  1%|          | 4154/371472 [20:06<27:13:51,  3.75it/s]
  1%|          | 4155/371472 [20:06<27:27:56,  3.71it/s]
  1%|          | 4156/371472 [20:06<29:05:16,  3.51it/s]
  1%|          | 4157/371472 [20:07<28:55:03,  3.53it/s]
  1%|          | 4158/371472 [20:07<28:28:43,  3.58it/s]
  1%|          | 4159/371472 [20:07<28:20:34,  3.60it/s]
  1%|          | 4160/371472 [20:07<28:03:13,  3.64it/s]
                                                        
{'loss': 5.6312, 'learning_rate': 9.904005688551789e-07, 'epoch': 0.18}

  1%|          | 4160/371472 [20:08<28:03:13,  3.64it/s]
  1%|          | 4161/371472 [20:08<28:18:55,  3.60it/s]
  1%|          | 4162/371472 [20:08<28:13:58,  3.61it/s]
  1%|          | 4163/371472 [20:08<27:51:29,  3.66it/s]
  1%|          | 4164/371472 [20:09<27:44:43,  3.68it/s]
  1%|          | 4165/371472 [20:09<27:50:02,  3.67it/s]
  1%|          | 4166/371472 [20:09<27:29:35,  3.71it/s]
  1%|          | 4167/371472 [20:09<28:03:38,  3.64it/s]
  1%|          | 4168/371472 [20:10<27:31:45,  3.71it/s]
  1%|          | 4169/371472 [20:10<27:17:47,  3.74it/s]
  1%|          | 4170/371472 [20:10<28:28:14,  3.58it/s]
  1%|          | 4171/371472 [20:11<28:12:46,  3.62it/s]
  1%|          | 4172/371472 [20:11<30:07:29,  3.39it/s]
  1%|          | 4173/371472 [20:11<31:06:30,  3.28it/s]
  1%|          | 4174/371472 [20:11<29:37:56,  3.44it/s]
  1%|          | 4175/371472 [20:12<28:29:46,  3.58it/s]
  1%|          | 4176/371472 [20:12<28:00:10,  3.64it/s]
  1%|          | 4177/371472 [20:12<27:57:10,  3.65it/s]
  1%|          | 4178/371472 [20:12<27:52:27,  3.66it/s]
  1%|          | 4179/371472 [20:13<27:12:26,  3.75it/s]
  1%|          | 4180/371472 [20:13<27:20:42,  3.73it/s]
                                                        
{'loss': 5.5304, 'learning_rate': 9.903520868797e-07, 'epoch': 0.18}

  1%|          | 4180/371472 [20:13<27:20:42,  3.73it/s]
  1%|          | 4181/371472 [20:13<28:33:46,  3.57it/s]
  1%|          | 4182/371472 [20:14<27:50:10,  3.67it/s]
  1%|          | 4183/371472 [20:14<27:49:50,  3.67it/s]
  1%|          | 4184/371472 [20:14<28:54:25,  3.53it/s]
  1%|          | 4185/371472 [20:14<28:38:23,  3.56it/s]
  1%|          | 4186/371472 [20:15<28:50:02,  3.54it/s]
  1%|          | 4187/371472 [20:15<28:12:50,  3.62it/s]
  1%|          | 4188/371472 [20:15<27:59:58,  3.64it/s]
  1%|          | 4189/371472 [20:16<27:30:54,  3.71it/s]
  1%|          | 4190/371472 [20:16<27:37:56,  3.69it/s]
  1%|          | 4191/371472 [20:16<28:20:43,  3.60it/s]
  1%|          | 4192/371472 [20:16<27:59:47,  3.64it/s]
  1%|          | 4193/371472 [20:17<28:21:34,  3.60it/s]
  1%|          | 4194/371472 [20:17<27:41:51,  3.68it/s]
  1%|          | 4195/371472 [20:17<28:22:03,  3.60it/s]
  1%|          | 4196/371472 [20:17<27:42:06,  3.68it/s]
  1%|          | 4197/371472 [20:18<28:12:58,  3.62it/s]
  1%|          | 4198/371472 [20:18<27:44:34,  3.68it/s]
  1%|          | 4199/371472 [20:18<27:01:29,  3.78it/s]
  1%|          | 4200/371472 [20:19<27:49:28,  3.67it/s]
                                                        
{'loss': 5.8041, 'learning_rate': 9.903036049042212e-07, 'epoch': 0.18}

  1%|          | 4200/371472 [20:19<27:49:28,  3.67it/s]
  1%|          | 4201/371472 [20:19<28:08:55,  3.62it/s]
  1%|          | 4202/371472 [20:19<28:24:30,  3.59it/s]
  1%|          | 4203/371472 [20:19<29:25:21,  3.47it/s]
  1%|          | 4204/371472 [20:20<28:09:03,  3.62it/s]
  1%|          | 4205/371472 [20:20<29:23:52,  3.47it/s]
  1%|          | 4206/371472 [20:20<29:16:58,  3.48it/s]
  1%|          | 4207/371472 [20:21<29:16:42,  3.48it/s]
  1%|          | 4208/371472 [20:21<31:25:13,  3.25it/s]
  1%|          | 4209/371472 [20:21<30:22:10,  3.36it/s]
  1%|          | 4210/371472 [20:21<29:00:51,  3.52it/s]
  1%|          | 4211/371472 [20:22<28:47:20,  3.54it/s]
  1%|          | 4212/371472 [20:22<30:27:24,  3.35it/s]
  1%|          | 4213/371472 [20:22<30:25:16,  3.35it/s]
  1%|          | 4214/371472 [20:23<31:29:42,  3.24it/s]
  1%|          | 4215/371472 [20:23<30:02:53,  3.40it/s]
  1%|          | 4216/371472 [20:23<30:35:40,  3.33it/s]
  1%|          | 4217/371472 [20:24<33:27:08,  3.05it/s]
  1%|          | 4218/371472 [20:24<32:00:04,  3.19it/s]
  1%|          | 4219/371472 [20:24<30:14:26,  3.37it/s]
  1%|          | 4220/371472 [20:24<29:03:50,  3.51it/s]
                                                        
{'loss': 5.6389, 'learning_rate': 9.90255122928742e-07, 'epoch': 0.18}

  1%|          | 4220/371472 [20:24<29:03:50,  3.51it/s]
  1%|          | 4221/371472 [20:25<32:42:11,  3.12it/s]
  1%|          | 4222/371472 [20:25<31:54:55,  3.20it/s]
  1%|          | 4223/371472 [20:25<30:00:49,  3.40it/s]
  1%|          | 4224/371472 [20:26<28:56:58,  3.52it/s]
  1%|          | 4225/371472 [20:26<28:32:43,  3.57it/s]
  1%|          | 4226/371472 [20:26<28:55:28,  3.53it/s]
  1%|          | 4227/371472 [20:26<27:57:41,  3.65it/s]
  1%|          | 4228/371472 [20:27<28:53:07,  3.53it/s]
  1%|          | 4229/371472 [20:27<29:52:54,  3.41it/s]
  1%|          | 4230/371472 [20:27<31:16:52,  3.26it/s]
  1%|          | 4231/371472 [20:28<30:46:44,  3.31it/s]
  1%|          | 4232/371472 [20:28<29:49:15,  3.42it/s]
  1%|          | 4233/371472 [20:28<31:15:52,  3.26it/s]
  1%|          | 4234/371472 [20:29<31:06:49,  3.28it/s]
  1%|          | 4235/371472 [20:29<30:54:27,  3.30it/s]
  1%|          | 4236/371472 [20:29<30:51:33,  3.31it/s]
  1%|          | 4237/371472 [20:29<29:29:10,  3.46it/s]
  1%|          | 4238/371472 [20:30<29:01:01,  3.52it/s]
  1%|          | 4239/371472 [20:30<29:50:12,  3.42it/s]
  1%|          | 4240/371472 [20:30<29:55:04,  3.41it/s]
                                                        
{'loss': 5.4039, 'learning_rate': 9.902066409532634e-07, 'epoch': 0.18}

  1%|          | 4240/371472 [20:30<29:55:04,  3.41it/s]
  1%|          | 4241/371472 [20:31<29:26:56,  3.46it/s]
  1%|          | 4242/371472 [20:31<28:30:43,  3.58it/s]
  1%|          | 4243/371472 [20:31<28:04:42,  3.63it/s]
  1%|          | 4244/371472 [20:31<28:26:02,  3.59it/s]
  1%|          | 4245/371472 [20:32<27:44:10,  3.68it/s]
  1%|          | 4246/371472 [20:32<28:29:49,  3.58it/s]
  1%|          | 4247/371472 [20:32<28:55:27,  3.53it/s]
  1%|          | 4248/371472 [20:33<27:50:00,  3.66it/s]
  1%|          | 4249/371472 [20:33<27:58:18,  3.65it/s]
  1%|          | 4250/371472 [20:33<27:39:23,  3.69it/s]
  1%|          | 4251/371472 [20:33<28:14:52,  3.61it/s]
  1%|          | 4252/371472 [20:34<30:52:00,  3.30it/s]
  1%|          | 4253/371472 [20:34<29:21:39,  3.47it/s]
  1%|          | 4254/371472 [20:34<28:17:46,  3.60it/s]
  1%|          | 4255/371472 [20:35<28:32:30,  3.57it/s]
  1%|          | 4256/371472 [20:35<28:46:46,  3.54it/s]
  1%|          | 4257/371472 [20:35<28:35:22,  3.57it/s]
  1%|          | 4258/371472 [20:35<28:59:42,  3.52it/s]
  1%|          | 4259/371472 [20:36<28:28:43,  3.58it/s]
  1%|          | 4260/371472 [20:36<27:56:44,  3.65it/s]
                                                        
{'loss': 5.3949, 'learning_rate': 9.901581589777845e-07, 'epoch': 0.18}

  1%|          | 4260/371472 [20:36<27:56:44,  3.65it/s]
  1%|          | 4261/371472 [20:36<28:24:39,  3.59it/s]
  1%|          | 4262/371472 [20:36<27:38:43,  3.69it/s]
  1%|          | 4263/371472 [20:37<27:38:16,  3.69it/s]
  1%|          | 4264/371472 [20:37<28:34:29,  3.57it/s]
  1%|          | 4265/371472 [20:37<27:43:59,  3.68it/s]
  1%|          | 4266/371472 [20:38<27:59:22,  3.64it/s]
  1%|          | 4267/371472 [20:38<27:40:12,  3.69it/s]
  1%|          | 4268/371472 [20:38<28:19:58,  3.60it/s]
  1%|          | 4269/371472 [20:38<30:04:38,  3.39it/s]
  1%|          | 4270/371472 [20:39<29:30:55,  3.46it/s]
  1%|          | 4271/371472 [20:39<29:11:56,  3.49it/s]
  1%|          | 4272/371472 [20:39<29:16:43,  3.48it/s]
  1%|          | 4273/371472 [20:40<29:05:15,  3.51it/s]
  1%|          | 4274/371472 [20:40<28:07:14,  3.63it/s]
  1%|          | 4275/371472 [20:40<28:43:45,  3.55it/s]
  1%|          | 4276/371472 [20:40<28:14:27,  3.61it/s]
  1%|          | 4277/371472 [20:41<28:08:34,  3.62it/s]
  1%|          | 4278/371472 [20:41<28:21:54,  3.60it/s]
  1%|          | 4279/371472 [20:41<30:02:51,  3.39it/s]
  1%|          | 4280/371472 [20:42<29:51:13,  3.42it/s]
                                                        
{'loss': 5.462, 'learning_rate': 9.901096770023055e-07, 'epoch': 0.18}

  1%|          | 4280/371472 [20:42<29:51:13,  3.42it/s]
  1%|          | 4281/371472 [20:42<29:52:05,  3.41it/s]
  1%|          | 4282/371472 [20:42<29:15:57,  3.49it/s]
  1%|          | 4283/371472 [20:42<28:21:01,  3.60it/s]
  1%|          | 4284/371472 [20:43<27:51:06,  3.66it/s]
  1%|          | 4285/371472 [20:43<28:46:08,  3.55it/s]
  1%|          | 4286/371472 [20:43<30:43:22,  3.32it/s]
  1%|          | 4287/371472 [20:44<29:09:29,  3.50it/s]
  1%|          | 4288/371472 [20:44<33:07:01,  3.08it/s]
  1%|          | 4289/371472 [20:44<31:26:27,  3.24it/s]
  1%|          | 4290/371472 [20:44<29:43:23,  3.43it/s]
  1%|          | 4291/371472 [20:45<28:44:19,  3.55it/s]
  1%|          | 4292/371472 [20:45<28:41:28,  3.55it/s]
  1%|          | 4293/371472 [20:45<28:19:45,  3.60it/s]
  1%|          | 4294/371472 [20:46<28:26:03,  3.59it/s]
  1%|          | 4295/371472 [20:46<29:52:17,  3.41it/s]
  1%|          | 4296/371472 [20:46<31:34:44,  3.23it/s]
  1%|          | 4297/371472 [20:47<29:47:15,  3.42it/s]
  1%|          | 4298/371472 [20:47<29:17:27,  3.48it/s]
  1%|          | 4299/371472 [20:47<29:11:18,  3.49it/s]
  1%|          | 4300/371472 [20:47<28:21:08,  3.60it/s]
                                                        
{'loss': 5.6406, 'learning_rate': 9.900611950268268e-07, 'epoch': 0.19}

  1%|          | 4300/371472 [20:47<28:21:08,  3.60it/s]
  1%|          | 4301/371472 [20:48<28:05:30,  3.63it/s]
  1%|          | 4302/371472 [20:48<30:18:14,  3.37it/s]
  1%|          | 4303/371472 [20:48<29:23:35,  3.47it/s]
  1%|          | 4304/371472 [20:48<29:24:10,  3.47it/s]
  1%|          | 4305/371472 [20:49<29:08:52,  3.50it/s]
  1%|          | 4306/371472 [20:49<28:51:08,  3.53it/s]
  1%|          | 4307/371472 [20:49<29:28:51,  3.46it/s]
  1%|          | 4308/371472 [20:50<31:07:15,  3.28it/s]
  1%|          | 4309/371472 [20:50<32:37:07,  3.13it/s]
  1%|          | 4310/371472 [20:50<33:32:06,  3.04it/s]
  1%|          | 4311/371472 [20:51<32:34:05,  3.13it/s]
  1%|          | 4312/371472 [20:51<31:36:06,  3.23it/s]
  1%|          | 4313/371472 [20:51<30:50:33,  3.31it/s]
  1%|          | 4314/371472 [20:52<29:54:43,  3.41it/s]
  1%|          | 4315/371472 [20:52<29:02:20,  3.51it/s]
  1%|          | 4316/371472 [20:52<30:07:41,  3.39it/s]
  1%|          | 4317/371472 [20:52<29:25:40,  3.47it/s]
  1%|          | 4318/371472 [20:53<28:40:37,  3.56it/s]
  1%|          | 4319/371472 [20:53<28:27:59,  3.58it/s]
  1%|          | 4320/371472 [20:53<28:26:32,  3.59it/s]
                                                        
{'loss': 5.4098, 'learning_rate': 9.900127130513477e-07, 'epoch': 0.19}

  1%|          | 4320/371472 [20:53<28:26:32,  3.59it/s]
  1%|          | 4321/371472 [20:54<28:38:45,  3.56it/s]
  1%|          | 4322/371472 [20:54<28:20:48,  3.60it/s]
  1%|          | 4323/371472 [20:54<28:21:15,  3.60it/s]
  1%|          | 4324/371472 [20:54<28:55:32,  3.53it/s]
  1%|          | 4325/371472 [20:55<28:44:13,  3.55it/s]
  1%|          | 4326/371472 [20:55<28:36:30,  3.56it/s]
  1%|          | 4327/371472 [20:55<28:05:25,  3.63it/s]
  1%|          | 4328/371472 [20:55<28:39:19,  3.56it/s]
  1%|          | 4329/371472 [20:56<28:55:37,  3.53it/s]
  1%|          | 4330/371472 [20:56<28:48:48,  3.54it/s]
  1%|          | 4331/371472 [20:56<29:35:49,  3.45it/s]
  1%|          | 4332/371472 [20:57<28:58:56,  3.52it/s]
  1%|          | 4333/371472 [20:57<31:00:07,  3.29it/s]
  1%|          | 4334/371472 [20:57<30:16:05,  3.37it/s]
  1%|          | 4335/371472 [20:58<29:48:34,  3.42it/s]
  1%|          | 4336/371472 [20:58<29:01:37,  3.51it/s]
  1%|          | 4337/371472 [20:58<29:17:35,  3.48it/s]
  1%|          | 4338/371472 [20:58<29:51:20,  3.42it/s]
  1%|          | 4339/371472 [20:59<29:20:08,  3.48it/s]
  1%|          | 4340/371472 [20:59<28:10:52,  3.62it/s]
                                                        
{'loss': 5.5045, 'learning_rate': 9.89964231075869e-07, 'epoch': 0.19}

  1%|          | 4340/371472 [20:59<28:10:52,  3.62it/s]
  1%|          | 4341/371472 [20:59<29:38:44,  3.44it/s]
  1%|          | 4342/371472 [21:00<29:01:01,  3.51it/s]
  1%|          | 4343/371472 [21:00<28:29:37,  3.58it/s]
  1%|          | 4344/371472 [21:00<27:44:50,  3.68it/s]
  1%|          | 4345/371472 [21:00<30:20:02,  3.36it/s]
  1%|          | 4346/371472 [21:01<32:09:30,  3.17it/s]
  1%|          | 4347/371472 [21:01<31:57:45,  3.19it/s]
  1%|          | 4348/371472 [21:01<29:55:08,  3.41it/s]
  1%|          | 4349/371472 [21:02<29:21:58,  3.47it/s]
  1%|          | 4350/371472 [21:02<28:39:11,  3.56it/s]
  1%|          | 4351/371472 [21:02<28:08:30,  3.62it/s]
  1%|          | 4352/371472 [21:02<27:29:21,  3.71it/s]
  1%|          | 4353/371472 [21:03<28:32:10,  3.57it/s]
  1%|          | 4354/371472 [21:03<28:54:46,  3.53it/s]
  1%|          | 4355/371472 [21:03<28:14:23,  3.61it/s]
  1%|          | 4356/371472 [21:03<28:05:43,  3.63it/s]
  1%|          | 4357/371472 [21:04<30:56:22,  3.30it/s]
  1%|          | 4358/371472 [21:04<30:05:44,  3.39it/s]
  1%|          | 4359/371472 [21:04<29:17:50,  3.48it/s]
  1%|          | 4360/371472 [21:05<28:50:59,  3.53it/s]
                                                        
{'loss': 5.4192, 'learning_rate': 9.899157491003898e-07, 'epoch': 0.19}

  1%|          | 4360/371472 [21:05<28:50:59,  3.53it/s]
  1%|          | 4361/371472 [21:05<29:45:50,  3.43it/s]
  1%|          | 4362/371472 [21:05<31:52:33,  3.20it/s]
  1%|          | 4363/371472 [21:06<30:39:19,  3.33it/s]
  1%|          | 4364/371472 [21:06<29:40:56,  3.44it/s]
  1%|          | 4365/371472 [21:06<30:33:39,  3.34it/s]
  1%|          | 4366/371472 [21:07<33:23:59,  3.05it/s]
  1%|          | 4367/371472 [21:07<30:59:14,  3.29it/s]
  1%|          | 4368/371472 [21:07<31:17:17,  3.26it/s]
  1%|          | 4369/371472 [21:07<29:56:06,  3.41it/s]
  1%|          | 4370/371472 [21:08<28:23:28,  3.59it/s]
  1%|          | 4371/371472 [21:08<31:49:26,  3.20it/s]
  1%|          | 4372/371472 [21:08<30:05:17,  3.39it/s]
  1%|          | 4373/371472 [21:09<30:53:51,  3.30it/s]
  1%|          | 4374/371472 [21:09<30:04:50,  3.39it/s]
  1%|          | 4375/371472 [21:09<30:39:23,  3.33it/s]
  1%|          | 4376/371472 [21:10<31:32:42,  3.23it/s]
  1%|          | 4377/371472 [21:10<32:29:30,  3.14it/s]
  1%|          | 4378/371472 [21:10<32:19:22,  3.15it/s]
  1%|          | 4379/371472 [21:11<33:26:07,  3.05it/s]
  1%|          | 4380/371472 [21:11<31:36:26,  3.23it/s]
                                                        
{'loss': 5.3939, 'learning_rate': 9.89867267124911e-07, 'epoch': 0.19}

  1%|          | 4380/371472 [21:11<31:36:26,  3.23it/s]
  1%|          | 4381/371472 [21:11<30:37:46,  3.33it/s]
  1%|          | 4382/371472 [21:11<30:02:27,  3.39it/s]
  1%|          | 4383/371472 [21:12<28:51:21,  3.53it/s]
  1%|          | 4384/371472 [21:12<29:29:53,  3.46it/s]
  1%|          | 4385/371472 [21:12<30:34:09,  3.34it/s]
  1%|          | 4386/371472 [21:13<31:16:54,  3.26it/s]
  1%|          | 4387/371472 [21:13<31:06:46,  3.28it/s]
  1%|          | 4388/371472 [21:13<30:50:07,  3.31it/s]
  1%|          | 4389/371472 [21:13<30:14:16,  3.37it/s]
  1%|          | 4390/371472 [21:14<29:34:50,  3.45it/s]
  1%|          | 4391/371472 [21:14<28:58:42,  3.52it/s]
  1%|          | 4392/371472 [21:14<30:15:10,  3.37it/s]
  1%|          | 4393/371472 [21:15<28:50:42,  3.53it/s]
  1%|          | 4394/371472 [21:15<28:27:20,  3.58it/s]
  1%|          | 4395/371472 [21:15<29:33:08,  3.45it/s]
  1%|          | 4396/371472 [21:15<28:42:51,  3.55it/s]
  1%|          | 4397/371472 [21:16<27:51:33,  3.66it/s]
  1%|          | 4398/371472 [21:16<29:33:05,  3.45it/s]
  1%|          | 4399/371472 [21:16<28:34:30,  3.57it/s]
  1%|          | 4400/371472 [21:17<27:57:56,  3.65it/s]
                                                        
{'loss': 5.6309, 'learning_rate': 9.898187851494322e-07, 'epoch': 0.19}

  1%|          | 4400/371472 [21:17<27:57:56,  3.65it/s]
  1%|          | 4401/371472 [21:17<29:37:40,  3.44it/s]
  1%|          | 4402/371472 [21:17<29:36:40,  3.44it/s]
  1%|          | 4403/371472 [21:17<29:18:49,  3.48it/s]
  1%|          | 4404/371472 [21:18<28:59:25,  3.52it/s]
  1%|          | 4405/371472 [21:18<29:43:20,  3.43it/s]
  1%|          | 4406/371472 [21:18<29:56:34,  3.41it/s]
  1%|          | 4407/371472 [21:19<29:31:03,  3.45it/s]
  1%|          | 4408/371472 [21:19<28:27:16,  3.58it/s]
  1%|          | 4409/371472 [21:19<28:19:05,  3.60it/s]
  1%|          | 4410/371472 [21:19<27:29:58,  3.71it/s]
  1%|          | 4411/371472 [21:20<26:51:16,  3.80it/s]
  1%|          | 4412/371472 [21:20<27:05:49,  3.76it/s]
  1%|          | 4413/371472 [21:20<28:12:03,  3.62it/s]
  1%|          | 4414/371472 [21:20<28:16:26,  3.61it/s]
  1%|          | 4415/371472 [21:21<27:42:34,  3.68it/s]
  1%|          | 4416/371472 [21:21<27:54:57,  3.65it/s]
  1%|          | 4417/371472 [21:21<27:03:25,  3.77it/s]
  1%|          | 4418/371472 [21:22<29:49:02,  3.42it/s]
  1%|          | 4419/371472 [21:22<28:49:50,  3.54it/s]
  1%|          | 4420/371472 [21:22<28:44:53,  3.55it/s]
                                                        
{'loss': 5.3819, 'learning_rate': 9.897703031739532e-07, 'epoch': 0.19}

  1%|          | 4420/371472 [21:22<28:44:53,  3.55it/s]
  1%|          | 4421/371472 [21:23<33:19:03,  3.06it/s]
  1%|          | 4422/371472 [21:23<32:02:39,  3.18it/s]
  1%|          | 4423/371472 [21:23<32:23:23,  3.15it/s]
  1%|          | 4424/371472 [21:23<30:27:51,  3.35it/s]
  1%|          | 4425/371472 [21:24<29:52:59,  3.41it/s]
  1%|          | 4426/371472 [21:24<32:11:11,  3.17it/s]
  1%|          | 4427/371472 [21:24<31:10:53,  3.27it/s]
  1%|          | 4428/371472 [21:25<30:22:18,  3.36it/s]
  1%|          | 4429/371472 [21:25<29:13:53,  3.49it/s]
  1%|          | 4430/371472 [21:25<29:27:23,  3.46it/s]
  1%|          | 4431/371472 [21:26<29:01:02,  3.51it/s]
  1%|          | 4432/371472 [21:26<28:26:36,  3.58it/s]
  1%|          | 4433/371472 [21:26<27:55:37,  3.65it/s]
  1%|          | 4434/371472 [21:26<27:46:25,  3.67it/s]
  1%|          | 4435/371472 [21:27<27:53:10,  3.66it/s]
  1%|          | 4436/371472 [21:27<27:54:32,  3.65it/s]
  1%|          | 4437/371472 [21:27<28:06:52,  3.63it/s]
  1%|          | 4438/371472 [21:27<28:38:02,  3.56it/s]
  1%|          | 4439/371472 [21:28<28:47:45,  3.54it/s]
  1%|          | 4440/371472 [21:28<28:22:38,  3.59it/s]
                                                        
{'loss': 5.3316, 'learning_rate': 9.897218211984745e-07, 'epoch': 0.19}

  1%|          | 4440/371472 [21:28<28:22:38,  3.59it/s]
  1%|          | 4441/371472 [21:28<28:46:59,  3.54it/s]
  1%|          | 4442/371472 [21:29<29:51:08,  3.42it/s]
  1%|          | 4443/371472 [21:29<31:35:42,  3.23it/s]
  1%|          | 4444/371472 [21:29<30:23:19,  3.35it/s]
  1%|          | 4445/371472 [21:29<29:49:02,  3.42it/s]
  1%|          | 4446/371472 [21:30<29:52:08,  3.41it/s]
  1%|          | 4447/371472 [21:30<31:39:24,  3.22it/s]
  1%|          | 4448/371472 [21:30<30:42:42,  3.32it/s]
  1%|          | 4449/371472 [21:31<31:01:52,  3.29it/s]
  1%|          | 4450/371472 [21:31<30:15:01,  3.37it/s]
  1%|          | 4451/371472 [21:31<29:46:56,  3.42it/s]
  1%|          | 4452/371472 [21:32<28:43:14,  3.55it/s]
  1%|          | 4453/371472 [21:32<27:55:39,  3.65it/s]
  1%|          | 4454/371472 [21:32<27:14:36,  3.74it/s]
  1%|          | 4455/371472 [21:32<28:03:22,  3.63it/s]
  1%|          | 4456/371472 [21:33<28:34:18,  3.57it/s]
  1%|          | 4457/371472 [21:33<29:18:16,  3.48it/s]
  1%|          | 4458/371472 [21:33<29:45:25,  3.43it/s]
  1%|          | 4459/371472 [21:34<29:15:06,  3.49it/s]
  1%|          | 4460/371472 [21:34<31:18:43,  3.26it/s]
                                                        
{'loss': 5.3271, 'learning_rate': 9.896733392229954e-07, 'epoch': 0.19}

  1%|          | 4460/371472 [21:34<31:18:43,  3.26it/s]
  1%|          | 4461/371472 [21:34<29:37:06,  3.44it/s]
  1%|          | 4462/371472 [21:34<29:55:58,  3.41it/s]
  1%|          | 4463/371472 [21:35<30:29:20,  3.34it/s]
  1%|          | 4464/371472 [21:35<29:40:06,  3.44it/s]
  1%|          | 4465/371472 [21:35<31:24:59,  3.24it/s]
  1%|          | 4466/371472 [21:36<38:09:56,  2.67it/s]
  1%|          | 4467/371472 [21:36<35:15:17,  2.89it/s]
  1%|          | 4468/371472 [21:36<33:37:26,  3.03it/s]
  1%|          | 4469/371472 [21:37<31:45:24,  3.21it/s]
  1%|          | 4470/371472 [21:37<31:01:46,  3.29it/s]
  1%|          | 4471/371472 [21:37<32:06:30,  3.18it/s]
  1%|          | 4472/371472 [21:38<30:51:20,  3.30it/s]
  1%|          | 4473/371472 [21:38<30:40:52,  3.32it/s]
  1%|          | 4474/371472 [21:38<31:23:44,  3.25it/s]
  1%|          | 4475/371472 [21:39<29:45:00,  3.43it/s]
  1%|          | 4476/371472 [21:39<28:44:53,  3.55it/s]
  1%|          | 4477/371472 [21:39<29:50:59,  3.42it/s]
  1%|          | 4478/371472 [21:39<31:03:48,  3.28it/s]
  1%|          | 4479/371472 [21:40<31:35:03,  3.23it/s]
  1%|          | 4480/371472 [21:40<32:25:02,  3.14it/s]
                                                        
{'loss': 5.5944, 'learning_rate': 9.896248572475167e-07, 'epoch': 0.19}

  1%|          | 4480/371472 [21:40<32:25:02,  3.14it/s]
  1%|          | 4481/371472 [21:40<34:15:10,  2.98it/s]
  1%|          | 4482/371472 [21:41<31:35:22,  3.23it/s]
  1%|          | 4483/371472 [21:41<30:21:37,  3.36it/s]
  1%|          | 4484/371472 [21:41<32:01:48,  3.18it/s]
  1%|          | 4485/371472 [21:42<30:19:44,  3.36it/s]
  1%|          | 4486/371472 [21:42<30:51:19,  3.30it/s]
  1%|          | 4487/371472 [21:42<30:17:41,  3.36it/s]
  1%|          | 4488/371472 [21:42<29:39:10,  3.44it/s]
  1%|          | 4489/371472 [21:43<31:21:25,  3.25it/s]
  1%|          | 4490/371472 [21:43<30:05:34,  3.39it/s]
  1%|          | 4491/371472 [21:43<32:33:18,  3.13it/s]
  1%|          | 4492/371472 [21:44<31:43:56,  3.21it/s]
  1%|          | 4493/371472 [21:44<31:08:04,  3.27it/s]
  1%|          | 4494/371472 [21:44<29:56:52,  3.40it/s]
  1%|          | 4495/371472 [21:45<30:48:51,  3.31it/s]
  1%|          | 4496/371472 [21:45<30:06:36,  3.39it/s]
  1%|          | 4497/371472 [21:45<29:23:54,  3.47it/s]
  1%|          | 4498/371472 [21:45<29:42:31,  3.43it/s]
  1%|          | 4499/371472 [21:46<30:03:01,  3.39it/s]
  1%|          | 4500/371472 [21:46<29:15:57,  3.48it/s]
                                                        
{'loss': 5.4956, 'learning_rate': 9.895763752720377e-07, 'epoch': 0.19}

  1%|          | 4500/371472 [21:46<29:15:57,  3.48it/s]
  1%|          | 4501/371472 [21:46<28:33:25,  3.57it/s]
  1%|          | 4502/371472 [21:47<27:15:38,  3.74it/s]
  1%|          | 4503/371472 [21:47<27:37:49,  3.69it/s]
  1%|          | 4504/371472 [21:47<26:55:20,  3.79it/s]
  1%|          | 4505/371472 [21:47<29:27:42,  3.46it/s]
  1%|          | 4506/371472 [21:48<29:42:22,  3.43it/s]
  1%|          | 4507/371472 [21:48<28:27:22,  3.58it/s]
  1%|          | 4508/371472 [21:48<27:26:17,  3.72it/s]
  1%|          | 4509/371472 [21:48<27:44:22,  3.67it/s]
  1%|          | 4510/371472 [21:49<28:18:05,  3.60it/s]
  1%|          | 4511/371472 [21:49<28:58:40,  3.52it/s]
  1%|          | 4512/371472 [21:49<28:24:59,  3.59it/s]
  1%|          | 4513/371472 [21:50<27:49:32,  3.66it/s]
  1%|          | 4514/371472 [21:50<27:40:27,  3.68it/s]
  1%|          | 4515/371472 [21:50<27:14:43,  3.74it/s]
  1%|          | 4516/371472 [21:51<30:46:15,  3.31it/s]
  1%|          | 4517/371472 [21:51<29:15:36,  3.48it/s]
  1%|          | 4518/371472 [21:51<28:39:35,  3.56it/s]
  1%|          | 4519/371472 [21:51<29:31:23,  3.45it/s]
  1%|          | 4520/371472 [21:52<31:00:53,  3.29it/s]
                                                        
{'loss': 5.3326, 'learning_rate': 9.895278932965588e-07, 'epoch': 0.19}

  1%|          | 4520/371472 [21:52<31:00:53,  3.29it/s]
  1%|          | 4521/371472 [21:52<29:43:24,  3.43it/s]
  1%|          | 4522/371472 [21:52<29:03:49,  3.51it/s]
  1%|          | 4523/371472 [21:53<29:38:58,  3.44it/s]
  1%|          | 4524/371472 [21:53<29:26:40,  3.46it/s]
  1%|          | 4525/371472 [21:53<29:06:13,  3.50it/s]
  1%|          | 4526/371472 [21:53<29:40:26,  3.43it/s]
  1%|          | 4527/371472 [21:54<31:51:38,  3.20it/s]
  1%|          | 4528/371472 [21:54<31:11:00,  3.27it/s]
  1%|          | 4529/371472 [21:54<29:48:24,  3.42it/s]
  1%|          | 4530/371472 [21:55<30:58:53,  3.29it/s]
  1%|          | 4531/371472 [21:55<33:11:13,  3.07it/s]
  1%|          | 4532/371472 [21:55<32:53:06,  3.10it/s]
  1%|          | 4533/371472 [21:56<30:46:26,  3.31it/s]
  1%|          | 4534/371472 [21:56<29:39:18,  3.44it/s]
  1%|          | 4535/371472 [21:56<28:42:17,  3.55it/s]
  1%|          | 4536/371472 [21:56<29:00:54,  3.51it/s]
  1%|          | 4537/371472 [21:57<27:56:36,  3.65it/s]
  1%|          | 4538/371472 [21:57<28:37:34,  3.56it/s]
  1%|          | 4539/371472 [21:58<40:04:03,  2.54it/s]
  1%|          | 4540/371472 [21:58<36:19:48,  2.81it/s]
                                                        
{'loss': 5.4429, 'learning_rate': 9.894794113210799e-07, 'epoch': 0.2}

  1%|          | 4540/371472 [21:58<36:19:48,  2.81it/s]
  1%|          | 4541/371472 [21:58<37:42:43,  2.70it/s]
  1%|          | 4542/371472 [21:59<35:11:44,  2.90it/s]
  1%|          | 4543/371472 [21:59<32:04:28,  3.18it/s]
  1%|          | 4544/371472 [21:59<30:01:06,  3.40it/s]
  1%|          | 4545/371472 [21:59<30:28:36,  3.34it/s]
  1%|          | 4546/371472 [22:00<29:23:09,  3.47it/s]
  1%|          | 4547/371472 [22:00<29:17:27,  3.48it/s]
  1%|          | 4548/371472 [22:00<29:34:50,  3.45it/s]
  1%|          | 4549/371472 [22:00<29:07:47,  3.50it/s]
  1%|          | 4550/371472 [22:01<29:31:34,  3.45it/s]
  1%|          | 4551/371472 [22:01<29:17:42,  3.48it/s]
  1%|          | 4552/371472 [22:01<29:12:29,  3.49it/s]
  1%|          | 4553/371472 [22:02<30:34:04,  3.33it/s]
  1%|          | 4554/371472 [22:02<30:55:15,  3.30it/s]
  1%|          | 4555/371472 [22:02<30:10:33,  3.38it/s]
  1%|          | 4556/371472 [22:03<29:15:28,  3.48it/s]
  1%|          | 4557/371472 [22:03<30:32:59,  3.34it/s]
  1%|          | 4558/371472 [22:03<29:18:43,  3.48it/s]
  1%|          | 4559/371472 [22:03<29:39:57,  3.44it/s]
  1%|          | 4560/371472 [22:04<29:12:01,  3.49it/s]
                                                        
{'loss': 5.4955, 'learning_rate': 9.89430929345601e-07, 'epoch': 0.2}

  1%|          | 4560/371472 [22:04<29:12:01,  3.49it/s]
  1%|          | 4561/371472 [22:04<28:23:05,  3.59it/s]
  1%|          | 4562/371472 [22:04<31:13:57,  3.26it/s]
  1%|          | 4563/371472 [22:05<30:01:56,  3.39it/s]
  1%|          | 4564/371472 [22:05<30:44:50,  3.31it/s]
  1%|          | 4565/371472 [22:05<30:58:52,  3.29it/s]
  1%|          | 4566/371472 [22:05<30:07:56,  3.38it/s]
  1%|          | 4567/371472 [22:06<30:04:01,  3.39it/s]
  1%|          | 4568/371472 [22:06<29:25:24,  3.46it/s]
  1%|          | 4569/371472 [22:06<29:17:16,  3.48it/s]
  1%|          | 4570/371472 [22:07<29:48:30,  3.42it/s]
  1%|          | 4571/371472 [22:07<29:04:04,  3.51it/s]
  1%|          | 4572/371472 [22:07<29:06:44,  3.50it/s]
  1%|          | 4573/371472 [22:07<28:27:49,  3.58it/s]
  1%|          | 4574/371472 [22:08<27:24:11,  3.72it/s]
  1%|          | 4575/371472 [22:08<28:15:24,  3.61it/s]
  1%|          | 4576/371472 [22:08<32:50:47,  3.10it/s]
  1%|          | 4577/371472 [22:09<31:58:04,  3.19it/s]
  1%|          | 4578/371472 [22:09<31:03:23,  3.28it/s]
  1%|          | 4579/371472 [22:09<29:57:24,  3.40it/s]
  1%|          | 4580/371472 [22:10<31:40:35,  3.22it/s]
                                                        
{'loss': 5.2479, 'learning_rate': 9.893824473701222e-07, 'epoch': 0.2}

  1%|          | 4580/371472 [22:10<31:40:35,  3.22it/s]
  1%|          | 4581/371472 [22:10<30:45:51,  3.31it/s]
  1%|          | 4582/371472 [22:10<29:20:38,  3.47it/s]
  1%|          | 4583/371472 [22:10<29:33:32,  3.45it/s]
  1%|          | 4584/371472 [22:11<28:46:05,  3.54it/s]
  1%|          | 4585/371472 [22:11<29:00:29,  3.51it/s]
  1%|          | 4586/371472 [22:11<28:53:45,  3.53it/s]
  1%|          | 4587/371472 [22:12<29:09:03,  3.50it/s]
  1%|          | 4588/371472 [22:12<28:46:12,  3.54it/s]
  1%|          | 4589/371472 [22:12<29:29:41,  3.46it/s]
  1%|          | 4590/371472 [22:13<31:23:38,  3.25it/s]
  1%|          | 4591/371472 [22:13<30:01:31,  3.39it/s]
  1%|          | 4592/371472 [22:13<32:16:50,  3.16it/s]
  1%|          | 4593/371472 [22:13<31:10:04,  3.27it/s]
  1%|          | 4594/371472 [22:14<29:23:33,  3.47it/s]
  1%|          | 4595/371472 [22:14<30:40:13,  3.32it/s]
  1%|          | 4596/371472 [22:14<29:08:45,  3.50it/s]
  1%|          | 4597/371472 [22:15<29:02:18,  3.51it/s]
  1%|          | 4598/371472 [22:15<29:55:49,  3.40it/s]
  1%|          | 4599/371472 [22:15<29:58:04,  3.40it/s]
  1%|          | 4600/371472 [22:15<29:59:28,  3.40it/s]
                                                        
{'loss': 5.3128, 'learning_rate': 9.89333965394643e-07, 'epoch': 0.2}

  1%|          | 4600/371472 [22:15<29:59:28,  3.40it/s]
  1%|          | 4601/371472 [22:16<29:09:40,  3.49it/s]
  1%|          | 4602/371472 [22:16<28:18:22,  3.60it/s]
  1%|          | 4603/371472 [22:16<29:54:21,  3.41it/s]
  1%|          | 4604/371472 [22:17<28:52:43,  3.53it/s]
  1%|          | 4605/371472 [22:17<28:40:02,  3.55it/s]
  1%|          | 4606/371472 [22:17<27:48:48,  3.66it/s]
  1%|          | 4607/371472 [22:17<28:13:50,  3.61it/s]
  1%|          | 4608/371472 [22:18<29:11:25,  3.49it/s]
  1%|          | 4609/371472 [22:18<31:41:46,  3.22it/s]
  1%|          | 4610/371472 [22:18<29:52:34,  3.41it/s]
  1%|          | 4611/371472 [22:19<28:49:13,  3.54it/s]
  1%|          | 4612/371472 [22:19<29:14:40,  3.48it/s]
  1%|          | 4613/371472 [22:19<28:30:25,  3.57it/s]
  1%|          | 4614/371472 [22:19<29:09:33,  3.49it/s]
  1%|          | 4615/371472 [22:20<30:15:53,  3.37it/s]
  1%|          | 4616/371472 [22:20<29:39:27,  3.44it/s]
  1%|          | 4617/371472 [22:20<30:02:14,  3.39it/s]
  1%|          | 4618/371472 [22:21<29:40:53,  3.43it/s]
  1%|          | 4619/371472 [22:21<29:26:40,  3.46it/s]
  1%|          | 4620/371472 [22:21<31:22:46,  3.25it/s]
                                                        
{'loss': 5.3392, 'learning_rate': 9.892854834191644e-07, 'epoch': 0.2}

  1%|          | 4620/371472 [22:21<31:22:46,  3.25it/s]
  1%|          | 4621/371472 [22:22<33:42:49,  3.02it/s]
  1%|          | 4622/371472 [22:22<31:12:18,  3.27it/s]
  1%|          | 4623/371472 [22:22<30:21:02,  3.36it/s]
  1%|          | 4624/371472 [22:22<31:06:41,  3.28it/s]
  1%|          | 4625/371472 [22:23<29:35:45,  3.44it/s]
  1%|          | 4626/371472 [22:23<30:12:35,  3.37it/s]
  1%|          | 4627/371472 [22:23<30:20:59,  3.36it/s]
  1%|          | 4628/371472 [22:24<29:34:01,  3.45it/s]
  1%|          | 4629/371472 [22:24<28:18:06,  3.60it/s]
  1%|          | 4630/371472 [22:24<27:28:29,  3.71it/s]
  1%|          | 4631/371472 [22:24<27:30:18,  3.70it/s]
  1%|          | 4632/371472 [22:25<27:53:45,  3.65it/s]
  1%|          | 4633/371472 [22:25<27:23:38,  3.72it/s]
  1%|          | 4634/371472 [22:25<26:57:55,  3.78it/s]
  1%|          | 4635/371472 [22:25<26:44:44,  3.81it/s]
  1%|          | 4636/371472 [22:26<27:19:31,  3.73it/s]
  1%|          | 4637/371472 [22:26<27:29:06,  3.71it/s]
  1%|          | 4638/371472 [22:26<28:42:46,  3.55it/s]
  1%|          | 4639/371472 [22:27<28:53:06,  3.53it/s]
  1%|          | 4640/371472 [22:27<28:21:41,  3.59it/s]
                                                        
{'loss': 5.5973, 'learning_rate': 9.892370014436854e-07, 'epoch': 0.2}

  1%|          | 4640/371472 [22:27<28:21:41,  3.59it/s]
  1%|          | 4641/371472 [22:27<28:08:35,  3.62it/s]
  1%|          | 4642/371472 [22:27<28:54:26,  3.52it/s]
  1%|          | 4643/371472 [22:28<28:04:00,  3.63it/s]
  1%|▏         | 4644/371472 [22:28<27:43:46,  3.67it/s]
  1%|▏         | 4645/371472 [22:28<28:13:20,  3.61it/s]
  1%|▏         | 4646/371472 [22:29<27:44:14,  3.67it/s]
  1%|▏         | 4647/371472 [22:29<28:30:56,  3.57it/s]
  1%|▏         | 4648/371472 [22:29<30:24:06,  3.35it/s]
  1%|▏         | 4649/371472 [22:29<29:29:08,  3.46it/s]
  1%|▏         | 4650/371472 [22:30<30:10:25,  3.38it/s]
  1%|▏         | 4651/371472 [22:30<28:59:20,  3.51it/s]
  1%|▏         | 4652/371472 [22:30<28:32:54,  3.57it/s]
  1%|▏         | 4653/371472 [22:31<28:17:21,  3.60it/s]
  1%|▏         | 4654/371472 [22:31<27:37:04,  3.69it/s]
  1%|▏         | 4655/371472 [22:31<29:07:39,  3.50it/s]
  1%|▏         | 4656/371472 [22:31<28:09:50,  3.62it/s]
  1%|▏         | 4657/371472 [22:32<27:36:07,  3.69it/s]
  1%|▏         | 4658/371472 [22:32<28:14:13,  3.61it/s]
  1%|▏         | 4659/371472 [22:32<27:43:30,  3.68it/s]
  1%|▏         | 4660/371472 [22:33<30:09:45,  3.38it/s]
                                                        
{'loss': 5.4401, 'learning_rate': 9.891885194682065e-07, 'epoch': 0.2}

  1%|▏         | 4660/371472 [22:33<30:09:45,  3.38it/s]
  1%|▏         | 4661/371472 [22:33<30:28:00,  3.34it/s]
  1%|▏         | 4662/371472 [22:33<30:04:34,  3.39it/s]
  1%|▏         | 4663/371472 [22:33<32:25:10,  3.14it/s]
  1%|▏         | 4664/371472 [22:34<31:05:51,  3.28it/s]
  1%|▏         | 4665/371472 [22:34<31:21:08,  3.25it/s]
  1%|▏         | 4666/371472 [22:34<32:36:10,  3.13it/s]
  1%|▏         | 4667/371472 [22:35<30:45:13,  3.31it/s]
  1%|▏         | 4668/371472 [22:35<30:23:29,  3.35it/s]
  1%|▏         | 4669/371472 [22:35<29:21:48,  3.47it/s]
  1%|▏         | 4670/371472 [22:36<28:40:36,  3.55it/s]
  1%|▏         | 4671/371472 [22:36<29:18:53,  3.48it/s]
  1%|▏         | 4672/371472 [22:36<28:34:46,  3.57it/s]
  1%|▏         | 4673/371472 [22:36<28:02:22,  3.63it/s]
  1%|▏         | 4674/371472 [22:37<27:35:14,  3.69it/s]
  1%|▏         | 4675/371472 [22:37<28:47:53,  3.54it/s]
  1%|▏         | 4676/371472 [22:37<28:35:43,  3.56it/s]
  1%|▏         | 4677/371472 [22:37<28:27:47,  3.58it/s]
  1%|▏         | 4678/371472 [22:38<29:06:49,  3.50it/s]
  1%|▏         | 4679/371472 [22:38<30:22:12,  3.35it/s]
  1%|▏         | 4680/371472 [22:38<30:08:17,  3.38it/s]
                                                        
{'loss': 5.3984, 'learning_rate': 9.891400374927278e-07, 'epoch': 0.2}

  1%|▏         | 4680/371472 [22:38<30:08:17,  3.38it/s]
  1%|▏         | 4681/371472 [22:39<29:43:33,  3.43it/s]
  1%|▏         | 4682/371472 [22:39<28:07:10,  3.62it/s]
  1%|▏         | 4683/371472 [22:39<27:44:43,  3.67it/s]
  1%|▏         | 4684/371472 [22:39<28:01:16,  3.64it/s]
  1%|▏         | 4685/371472 [22:40<29:15:00,  3.48it/s]
  1%|▏         | 4686/371472 [22:40<30:30:55,  3.34it/s]
  1%|▏         | 4687/371472 [22:40<29:26:47,  3.46it/s]
  1%|▏         | 4688/371472 [22:41<28:55:54,  3.52it/s]
  1%|▏         | 4689/371472 [22:41<30:50:42,  3.30it/s]
  1%|▏         | 4690/371472 [22:41<29:48:42,  3.42it/s]
  1%|▏         | 4691/371472 [22:42<30:42:07,  3.32it/s]
  1%|▏         | 4692/371472 [22:42<35:21:46,  2.88it/s]
  1%|▏         | 4693/371472 [22:42<33:09:25,  3.07it/s]
  1%|▏         | 4694/371472 [22:43<32:14:25,  3.16it/s]
  1%|▏         | 4695/371472 [22:43<32:09:37,  3.17it/s]
  1%|▏         | 4696/371472 [22:43<31:12:18,  3.26it/s]
  1%|▏         | 4697/371472 [22:43<30:29:16,  3.34it/s]
  1%|▏         | 4698/371472 [22:44<30:36:24,  3.33it/s]
  1%|▏         | 4699/371472 [22:44<31:29:04,  3.24it/s]
  1%|▏         | 4700/371472 [22:44<31:02:41,  3.28it/s]
                                                        
{'loss': 5.2152, 'learning_rate': 9.890915555172487e-07, 'epoch': 0.2}

  1%|▏         | 4700/371472 [22:44<31:02:41,  3.28it/s]
  1%|▏         | 4701/371472 [22:45<32:00:15,  3.18it/s]
  1%|▏         | 4702/371472 [22:45<30:08:30,  3.38it/s]
  1%|▏         | 4703/371472 [22:45<29:13:55,  3.49it/s]
  1%|▏         | 4704/371472 [22:45<27:55:12,  3.65it/s]
  1%|▏         | 4705/371472 [22:46<29:07:41,  3.50it/s]
  1%|▏         | 4706/371472 [22:46<28:22:14,  3.59it/s]
  1%|▏         | 4707/371472 [22:46<28:12:10,  3.61it/s]
  1%|▏         | 4708/371472 [22:47<28:16:56,  3.60it/s]
  1%|▏         | 4709/371472 [22:47<30:17:55,  3.36it/s]
  1%|▏         | 4710/371472 [22:47<30:58:25,  3.29it/s]
  1%|▏         | 4711/371472 [22:48<30:54:10,  3.30it/s]
  1%|▏         | 4712/371472 [22:48<31:06:08,  3.28it/s]
  1%|▏         | 4713/371472 [22:48<30:38:48,  3.32it/s]
  1%|▏         | 4714/371472 [22:49<32:36:03,  3.12it/s]
  1%|▏         | 4715/371472 [22:49<31:52:15,  3.20it/s]
  1%|▏         | 4716/371472 [22:49<31:16:04,  3.26it/s]
  1%|▏         | 4717/371472 [22:49<31:12:59,  3.26it/s]
  1%|▏         | 4718/371472 [22:50<30:14:29,  3.37it/s]
  1%|▏         | 4719/371472 [22:50<29:05:24,  3.50it/s]
  1%|▏         | 4720/371472 [22:50<29:20:05,  3.47it/s]
                                                        
{'loss': 5.5735, 'learning_rate': 9.8904307354177e-07, 'epoch': 0.2}

  1%|▏         | 4720/371472 [22:50<29:20:05,  3.47it/s]
  1%|▏         | 4721/371472 [22:51<28:56:18,  3.52it/s]
  1%|▏         | 4722/371472 [22:51<28:07:38,  3.62it/s]
  1%|▏         | 4723/371472 [22:51<28:14:04,  3.61it/s]
  1%|▏         | 4724/371472 [22:51<31:21:24,  3.25it/s]
  1%|▏         | 4725/371472 [22:52<30:08:18,  3.38it/s]
  1%|▏         | 4726/371472 [22:52<29:16:17,  3.48it/s]
  1%|▏         | 4727/371472 [22:52<29:20:05,  3.47it/s]
  1%|▏         | 4728/371472 [22:53<28:40:20,  3.55it/s]
  1%|▏         | 4729/371472 [22:53<28:08:34,  3.62it/s]
  1%|▏         | 4730/371472 [22:53<29:56:04,  3.40it/s]
  1%|▏         | 4731/371472 [22:53<30:03:12,  3.39it/s]
  1%|▏         | 4732/371472 [22:54<29:04:19,  3.50it/s]
  1%|▏         | 4733/371472 [22:54<28:11:00,  3.61it/s]
  1%|▏         | 4734/371472 [22:54<27:51:37,  3.66it/s]
  1%|▏         | 4735/371472 [22:55<31:33:04,  3.23it/s]
  1%|▏         | 4736/371472 [22:55<31:30:37,  3.23it/s]
  1%|▏         | 4737/371472 [22:55<29:45:07,  3.42it/s]
  1%|▏         | 4738/371472 [22:55<29:40:32,  3.43it/s]
  1%|▏         | 4739/371472 [22:56<29:02:30,  3.51it/s]
  1%|▏         | 4740/371472 [22:56<28:31:16,  3.57it/s]
                                                        
{'loss': 5.4082, 'learning_rate': 9.889945915662908e-07, 'epoch': 0.2}

  1%|▏         | 4740/371472 [22:56<28:31:16,  3.57it/s]
  1%|▏         | 4741/371472 [22:56<28:04:39,  3.63it/s]
  1%|▏         | 4742/371472 [22:57<27:31:54,  3.70it/s]
  1%|▏         | 4743/371472 [22:57<28:41:18,  3.55it/s]
  1%|▏         | 4744/371472 [22:57<29:09:21,  3.49it/s]
  1%|▏         | 4745/371472 [22:57<29:10:01,  3.49it/s]
  1%|▏         | 4746/371472 [22:58<29:19:54,  3.47it/s]
  1%|▏         | 4747/371472 [22:58<28:56:07,  3.52it/s]
  1%|▏         | 4748/371472 [22:58<28:20:07,  3.60it/s]
  1%|▏         | 4749/371472 [22:59<28:33:07,  3.57it/s]
  1%|▏         | 4750/371472 [22:59<28:02:34,  3.63it/s]
  1%|▏         | 4751/371472 [22:59<29:33:31,  3.45it/s]
  1%|▏         | 4752/371472 [22:59<28:46:21,  3.54it/s]
  1%|▏         | 4753/371472 [23:00<28:23:31,  3.59it/s]
  1%|▏         | 4754/371472 [23:00<28:33:24,  3.57it/s]
  1%|▏         | 4755/371472 [23:00<27:51:15,  3.66it/s]
  1%|▏         | 4756/371472 [23:00<27:34:56,  3.69it/s]
  1%|▏         | 4757/371472 [23:01<28:02:37,  3.63it/s]
  1%|▏         | 4758/371472 [23:01<29:12:23,  3.49it/s]
  1%|▏         | 4759/371472 [23:01<29:47:07,  3.42it/s]
  1%|▏         | 4760/371472 [23:02<28:49:25,  3.53it/s]
                                                        
{'loss': 5.2788, 'learning_rate': 9.88946109590812e-07, 'epoch': 0.21}

  1%|▏         | 4760/371472 [23:02<28:49:25,  3.53it/s]
  1%|▏         | 4761/371472 [23:02<29:02:26,  3.51it/s]
  1%|▏         | 4762/371472 [23:02<29:08:05,  3.50it/s]
  1%|▏         | 4763/371472 [23:02<28:37:44,  3.56it/s]
  1%|▏         | 4764/371472 [23:03<27:51:20,  3.66it/s]
  1%|▏         | 4765/371472 [23:03<27:51:52,  3.66it/s]
  1%|▏         | 4766/371472 [23:03<30:08:38,  3.38it/s]
  1%|▏         | 4767/371472 [23:04<28:52:13,  3.53it/s]
  1%|▏         | 4768/371472 [23:04<29:43:03,  3.43it/s]
  1%|▏         | 4769/371472 [23:04<30:27:49,  3.34it/s]
  1%|▏         | 4770/371472 [23:05<30:56:28,  3.29it/s]
  1%|▏         | 4771/371472 [23:05<30:09:23,  3.38it/s]
  1%|▏         | 4772/371472 [23:05<29:58:02,  3.40it/s]
  1%|▏         | 4773/371472 [23:05<28:51:59,  3.53it/s]
  1%|▏         | 4774/371472 [23:06<28:19:22,  3.60it/s]
  1%|▏         | 4775/371472 [23:06<27:19:50,  3.73it/s]
  1%|▏         | 4776/371472 [23:06<26:57:33,  3.78it/s]
  1%|▏         | 4777/371472 [23:06<27:56:18,  3.65it/s]
  1%|▏         | 4778/371472 [23:07<28:05:37,  3.63it/s]
  1%|▏         | 4779/371472 [23:07<27:45:42,  3.67it/s]
  1%|▏         | 4780/371472 [23:07<27:47:46,  3.66it/s]
                                                        
{'loss': 5.384, 'learning_rate': 9.888976276153332e-07, 'epoch': 0.21}

  1%|▏         | 4780/371472 [23:07<27:47:46,  3.66it/s]
  1%|▏         | 4781/371472 [23:08<29:05:38,  3.50it/s]
  1%|▏         | 4782/371472 [23:08<28:20:27,  3.59it/s]
  1%|▏         | 4783/371472 [23:08<27:48:34,  3.66it/s]
  1%|▏         | 4784/371472 [23:08<27:35:53,  3.69it/s]
  1%|▏         | 4785/371472 [23:09<26:55:12,  3.78it/s]
  1%|▏         | 4786/371472 [23:09<26:42:54,  3.81it/s]
  1%|▏         | 4787/371472 [23:09<29:08:44,  3.49it/s]
  1%|▏         | 4788/371472 [23:10<30:02:21,  3.39it/s]
  1%|▏         | 4789/371472 [23:10<28:56:19,  3.52it/s]
  1%|▏         | 4790/371472 [23:10<27:59:06,  3.64it/s]
  1%|▏         | 4791/371472 [23:10<27:33:49,  3.70it/s]
  1%|▏         | 4792/371472 [23:11<29:01:26,  3.51it/s]
  1%|▏         | 4793/371472 [23:11<28:31:51,  3.57it/s]
  1%|▏         | 4794/371472 [23:11<29:06:06,  3.50it/s]
  1%|▏         | 4795/371472 [23:12<30:04:20,  3.39it/s]
  1%|▏         | 4796/371472 [23:12<29:19:49,  3.47it/s]
  1%|▏         | 4797/371472 [23:12<28:15:17,  3.60it/s]
  1%|▏         | 4798/371472 [23:12<28:10:47,  3.61it/s]
  1%|▏         | 4799/371472 [23:13<27:50:02,  3.66it/s]
  1%|▏         | 4800/371472 [23:13<27:20:51,  3.72it/s]
                                                        
{'loss': 5.4814, 'learning_rate': 9.888491456398542e-07, 'epoch': 0.21}

  1%|▏         | 4800/371472 [23:13<27:20:51,  3.72it/s]
  1%|▏         | 4801/371472 [23:13<27:10:15,  3.75it/s]
  1%|▏         | 4802/371472 [23:13<27:35:18,  3.69it/s]
  1%|▏         | 4803/371472 [23:14<27:15:31,  3.74it/s]
  1%|▏         | 4804/371472 [23:14<28:02:12,  3.63it/s]
  1%|▏         | 4805/371472 [23:14<31:06:40,  3.27it/s]
  1%|▏         | 4806/371472 [23:15<30:36:01,  3.33it/s]
  1%|▏         | 4807/371472 [23:15<30:24:47,  3.35it/s]
  1%|▏         | 4808/371472 [23:15<30:32:51,  3.33it/s]
  1%|▏         | 4809/371472 [23:15<30:09:57,  3.38it/s]
  1%|▏         | 4810/371472 [23:16<31:13:30,  3.26it/s]
  1%|▏         | 4811/371472 [23:16<30:44:43,  3.31it/s]
  1%|▏         | 4812/371472 [23:17<33:56:38,  3.00it/s]
  1%|▏         | 4813/371472 [23:17<32:19:17,  3.15it/s]
  1%|▏         | 4814/371472 [23:17<30:20:33,  3.36it/s]
  1%|▏         | 4815/371472 [23:17<29:22:06,  3.47it/s]
  1%|▏         | 4816/371472 [23:18<28:09:24,  3.62it/s]
  1%|▏         | 4817/371472 [23:18<29:38:53,  3.44it/s]
  1%|▏         | 4818/371472 [23:18<29:33:12,  3.45it/s]
  1%|▏         | 4819/371472 [23:18<29:53:57,  3.41it/s]
  1%|▏         | 4820/371472 [23:19<29:16:29,  3.48it/s]
                                                        
{'loss': 5.1962, 'learning_rate': 9.888006636643755e-07, 'epoch': 0.21}

  1%|▏         | 4820/371472 [23:19<29:16:29,  3.48it/s]
  1%|▏         | 4821/371472 [23:19<28:34:38,  3.56it/s]
  1%|▏         | 4822/371472 [23:19<28:42:35,  3.55it/s]
  1%|▏         | 4823/371472 [23:20<31:22:25,  3.25it/s]
  1%|▏         | 4824/371472 [23:20<30:37:05,  3.33it/s]
  1%|▏         | 4825/371472 [23:20<30:58:14,  3.29it/s]
  1%|▏         | 4826/371472 [23:21<30:47:27,  3.31it/s]
  1%|▏         | 4827/371472 [23:21<30:02:13,  3.39it/s]
  1%|▏         | 4828/371472 [23:21<29:34:48,  3.44it/s]
  1%|▏         | 4829/371472 [23:21<28:55:49,  3.52it/s]
  1%|▏         | 4830/371472 [23:22<32:03:17,  3.18it/s]
  1%|▏         | 4831/371472 [23:22<30:43:26,  3.31it/s]
  1%|▏         | 4832/371472 [23:22<29:02:58,  3.51it/s]
  1%|▏         | 4833/371472 [23:23<27:45:02,  3.67it/s]
  1%|▏         | 4834/371472 [23:23<27:26:58,  3.71it/s]
  1%|▏         | 4835/371472 [23:23<27:46:08,  3.67it/s]
  1%|▏         | 4836/371472 [23:23<28:43:48,  3.54it/s]
  1%|▏         | 4837/371472 [23:24<30:14:32,  3.37it/s]
  1%|▏         | 4838/371472 [23:24<30:44:51,  3.31it/s]
  1%|▏         | 4839/371472 [23:24<31:30:15,  3.23it/s]
  1%|▏         | 4840/371472 [23:25<29:38:12,  3.44it/s]
                                                        
{'loss': 5.0913, 'learning_rate': 9.887521816888966e-07, 'epoch': 0.21}

  1%|▏         | 4840/371472 [23:25<29:38:12,  3.44it/s]
  1%|▏         | 4841/371472 [23:25<28:26:05,  3.58it/s]
  1%|▏         | 4842/371472 [23:25<32:24:33,  3.14it/s]
  1%|▏         | 4843/371472 [23:26<32:20:57,  3.15it/s]
  1%|▏         | 4844/371472 [23:26<32:43:00,  3.11it/s]
  1%|▏         | 4845/371472 [23:26<30:48:57,  3.30it/s]
  1%|▏         | 4846/371472 [23:27<33:28:56,  3.04it/s]
  1%|▏         | 4847/371472 [23:27<31:17:25,  3.25it/s]
  1%|▏         | 4848/371472 [23:27<31:15:44,  3.26it/s]
  1%|▏         | 4849/371472 [23:27<30:00:04,  3.39it/s]
  1%|▏         | 4850/371472 [23:28<31:37:39,  3.22it/s]
  1%|▏         | 4851/371472 [23:28<30:24:28,  3.35it/s]
  1%|▏         | 4852/371472 [23:28<32:28:45,  3.14it/s]
  1%|▏         | 4853/371472 [23:29<30:47:04,  3.31it/s]
  1%|▏         | 4854/371472 [23:29<29:29:08,  3.45it/s]
  1%|▏         | 4855/371472 [23:29<28:40:38,  3.55it/s]
  1%|▏         | 4856/371472 [23:29<27:55:47,  3.65it/s]
  1%|▏         | 4857/371472 [23:30<27:50:19,  3.66it/s]
  1%|▏         | 4858/371472 [23:30<28:02:53,  3.63it/s]
  1%|▏         | 4859/371472 [23:30<27:24:48,  3.71it/s]
  1%|▏         | 4860/371472 [23:31<30:36:39,  3.33it/s]
                                                        
{'loss': 5.3056, 'learning_rate': 9.887036997134177e-07, 'epoch': 0.21}

  1%|▏         | 4860/371472 [23:31<30:36:39,  3.33it/s]
  1%|▏         | 4861/371472 [23:31<30:13:44,  3.37it/s]
  1%|▏         | 4862/371472 [23:31<28:44:06,  3.54it/s]
  1%|▏         | 4863/371472 [23:31<28:18:27,  3.60it/s]
  1%|▏         | 4864/371472 [23:32<28:42:15,  3.55it/s]
  1%|▏         | 4865/371472 [23:32<32:02:33,  3.18it/s]
  1%|▏         | 4866/371472 [23:32<30:48:16,  3.31it/s]
  1%|▏         | 4867/371472 [23:33<29:56:16,  3.40it/s]
  1%|▏         | 4868/371472 [23:33<29:23:57,  3.46it/s]
  1%|▏         | 4869/371472 [23:33<30:34:49,  3.33it/s]
  1%|▏         | 4870/371472 [23:33<29:30:04,  3.45it/s]
  1%|▏         | 4871/371472 [23:34<29:27:22,  3.46it/s]
  1%|▏         | 4872/371472 [23:34<29:28:01,  3.46it/s]
  1%|▏         | 4873/371472 [23:34<30:50:19,  3.30it/s]
  1%|▏         | 4874/371472 [23:35<30:45:08,  3.31it/s]
  1%|▏         | 4875/371472 [23:35<29:37:04,  3.44it/s]
  1%|▏         | 4876/371472 [23:35<28:50:15,  3.53it/s]
  1%|▏         | 4877/371472 [23:36<28:55:27,  3.52it/s]
  1%|▏         | 4878/371472 [23:36<29:09:23,  3.49it/s]
  1%|▏         | 4879/371472 [23:36<28:53:08,  3.53it/s]
  1%|▏         | 4880/371472 [23:36<27:58:39,  3.64it/s]
                                                        
{'loss': 5.4644, 'learning_rate': 9.886552177379387e-07, 'epoch': 0.21}

  1%|▏         | 4880/371472 [23:36<27:58:39,  3.64it/s]
  1%|▏         | 4881/371472 [23:37<28:11:59,  3.61it/s]
  1%|▏         | 4882/371472 [23:37<29:50:27,  3.41it/s]
  1%|▏         | 4883/371472 [23:37<30:42:09,  3.32it/s]
  1%|▏         | 4884/371472 [23:38<29:10:15,  3.49it/s]
  1%|▏         | 4885/371472 [23:38<29:29:10,  3.45it/s]
  1%|▏         | 4886/371472 [23:38<32:31:54,  3.13it/s]
  1%|▏         | 4887/371472 [23:39<31:55:37,  3.19it/s]
  1%|▏         | 4888/371472 [23:39<29:45:46,  3.42it/s]
  1%|▏         | 4889/371472 [23:39<29:50:24,  3.41it/s]
  1%|▏         | 4890/371472 [23:39<29:18:58,  3.47it/s]
  1%|▏         | 4891/371472 [23:40<29:04:34,  3.50it/s]
  1%|▏         | 4892/371472 [23:40<32:42:32,  3.11it/s]
  1%|▏         | 4893/371472 [23:40<30:54:16,  3.29it/s]
  1%|▏         | 4894/371472 [23:41<29:53:30,  3.41it/s]
  1%|▏         | 4895/371472 [23:41<28:29:48,  3.57it/s]
  1%|▏         | 4896/371472 [23:41<28:41:24,  3.55it/s]
  1%|▏         | 4897/371472 [23:41<28:55:02,  3.52it/s]
  1%|▏         | 4898/371472 [23:42<28:46:26,  3.54it/s]
  1%|▏         | 4899/371472 [23:42<29:32:56,  3.45it/s]
  1%|▏         | 4900/371472 [23:42<28:33:45,  3.56it/s]
                                                        
{'loss': 5.6686, 'learning_rate': 9.886067357624598e-07, 'epoch': 0.21}

  1%|▏         | 4900/371472 [23:42<28:33:45,  3.56it/s]
  1%|▏         | 4901/371472 [23:42<27:34:44,  3.69it/s]
  1%|▏         | 4902/371472 [23:43<28:18:15,  3.60it/s]
  1%|▏         | 4903/371472 [23:43<27:50:29,  3.66it/s]
  1%|▏         | 4904/371472 [23:43<28:13:54,  3.61it/s]
  1%|▏         | 4905/371472 [23:44<27:47:59,  3.66it/s]
  1%|▏         | 4906/371472 [23:44<29:11:51,  3.49it/s]
  1%|▏         | 4907/371472 [23:44<29:08:19,  3.49it/s]
  1%|▏         | 4908/371472 [23:44<28:48:03,  3.54it/s]
  1%|▏         | 4909/371472 [23:45<27:46:03,  3.67it/s]
  1%|▏         | 4910/371472 [23:45<28:19:14,  3.60it/s]
  1%|▏         | 4911/371472 [23:45<29:14:33,  3.48it/s]
  1%|▏         | 4912/371472 [23:46<29:00:59,  3.51it/s]
  1%|▏         | 4913/371472 [23:46<29:24:19,  3.46it/s]
  1%|▏         | 4914/371472 [23:46<28:25:04,  3.58it/s]
  1%|▏         | 4915/371472 [23:46<28:10:54,  3.61it/s]
  1%|▏         | 4916/371472 [23:47<28:56:18,  3.52it/s]
  1%|▏         | 4917/371472 [23:47<28:31:18,  3.57it/s]
  1%|▏         | 4918/371472 [23:47<30:11:06,  3.37it/s]
  1%|▏         | 4919/371472 [23:48<30:25:26,  3.35it/s]
  1%|▏         | 4920/371472 [23:48<31:24:43,  3.24it/s]
                                                        
{'loss': 5.3201, 'learning_rate': 9.88558253786981e-07, 'epoch': 0.21}

  1%|▏         | 4920/371472 [23:48<31:24:43,  3.24it/s]
  1%|▏         | 4921/371472 [23:48<30:32:40,  3.33it/s]
  1%|▏         | 4922/371472 [23:49<30:46:49,  3.31it/s]
  1%|▏         | 4923/371472 [23:49<30:34:44,  3.33it/s]
  1%|▏         | 4924/371472 [23:49<29:36:24,  3.44it/s]
  1%|▏         | 4925/371472 [23:49<29:20:45,  3.47it/s]
  1%|▏         | 4926/371472 [23:50<28:56:22,  3.52it/s]
  1%|▏         | 4927/371472 [23:50<28:41:44,  3.55it/s]
  1%|▏         | 4928/371472 [23:50<29:20:36,  3.47it/s]
  1%|▏         | 4929/371472 [23:51<28:55:39,  3.52it/s]
  1%|▏         | 4930/371472 [23:51<29:57:30,  3.40it/s]
  1%|▏         | 4931/371472 [23:51<29:15:54,  3.48it/s]
  1%|▏         | 4932/371472 [23:51<28:39:58,  3.55it/s]
  1%|▏         | 4933/371472 [23:52<29:29:08,  3.45it/s]
  1%|▏         | 4934/371472 [23:52<28:37:48,  3.56it/s]
  1%|▏         | 4935/371472 [23:52<30:05:39,  3.38it/s]
  1%|▏         | 4936/371472 [23:53<29:38:11,  3.44it/s]
  1%|▏         | 4937/371472 [23:53<29:32:46,  3.45it/s]
  1%|▏         | 4938/371472 [23:53<28:47:23,  3.54it/s]
  1%|▏         | 4939/371472 [23:53<29:17:07,  3.48it/s]
  1%|▏         | 4940/371472 [23:54<28:49:56,  3.53it/s]
                                                        
{'loss': 5.2799, 'learning_rate': 9.88509771811502e-07, 'epoch': 0.21}

  1%|▏         | 4940/371472 [23:54<28:49:56,  3.53it/s]
  1%|▏         | 4941/371472 [23:54<29:42:16,  3.43it/s]
  1%|▏         | 4942/371472 [23:54<29:21:32,  3.47it/s]
  1%|▏         | 4943/371472 [23:55<28:11:52,  3.61it/s]
  1%|▏         | 4944/371472 [23:55<28:14:47,  3.60it/s]
  1%|▏         | 4945/371472 [23:55<28:39:50,  3.55it/s]
  1%|▏         | 4946/371472 [23:55<28:14:24,  3.61it/s]
  1%|▏         | 4947/371472 [23:56<28:16:14,  3.60it/s]
  1%|▏         | 4948/371472 [23:56<32:59:09,  3.09it/s]
  1%|▏         | 4949/371472 [23:56<30:50:35,  3.30it/s]
  1%|▏         | 4950/371472 [23:57<29:51:34,  3.41it/s]
  1%|▏         | 4951/371472 [23:57<32:59:11,  3.09it/s]
  1%|▏         | 4952/371472 [23:57<31:25:57,  3.24it/s]
  1%|▏         | 4953/371472 [23:58<30:28:26,  3.34it/s]
  1%|▏         | 4954/371472 [23:58<29:21:34,  3.47it/s]
  1%|▏         | 4955/371472 [23:58<28:45:15,  3.54it/s]
  1%|▏         | 4956/371472 [23:58<28:04:56,  3.63it/s]
  1%|▏         | 4957/371472 [23:59<31:31:30,  3.23it/s]
  1%|▏         | 4958/371472 [23:59<31:15:22,  3.26it/s]
  1%|▏         | 4959/371472 [23:59<30:32:06,  3.33it/s]
  1%|▏         | 4960/371472 [24:00<30:09:57,  3.37it/s]
                                                        
{'loss': 5.1967, 'learning_rate': 9.884612898360232e-07, 'epoch': 0.21}

  1%|▏         | 4960/371472 [24:00<30:09:57,  3.37it/s]
  1%|▏         | 4961/371472 [24:00<31:23:39,  3.24it/s]
  1%|▏         | 4962/371472 [24:00<29:46:41,  3.42it/s]
  1%|▏         | 4963/371472 [24:00<29:15:12,  3.48it/s]
  1%|▏         | 4964/371472 [24:01<29:30:27,  3.45it/s]
  1%|▏         | 4965/371472 [24:01<28:37:53,  3.56it/s]
  1%|▏         | 4966/371472 [24:01<28:20:41,  3.59it/s]
  1%|▏         | 4967/371472 [24:02<28:12:39,  3.61it/s]
  1%|▏         | 4968/371472 [24:02<29:15:09,  3.48it/s]
  1%|▏         | 4969/371472 [24:02<28:44:00,  3.54it/s]
  1%|▏         | 4970/371472 [24:02<28:26:15,  3.58it/s]
  1%|▏         | 4971/371472 [24:03<30:51:31,  3.30it/s]
  1%|▏         | 4972/371472 [24:03<30:32:46,  3.33it/s]
  1%|▏         | 4973/371472 [24:03<31:06:03,  3.27it/s]
  1%|▏         | 4974/371472 [24:04<29:58:40,  3.40it/s]
  1%|▏         | 4975/371472 [24:04<29:45:03,  3.42it/s]
  1%|▏         | 4976/371472 [24:04<28:38:22,  3.55it/s]
  1%|▏         | 4977/371472 [24:04<27:56:31,  3.64it/s]
  1%|▏         | 4978/371472 [24:05<28:25:48,  3.58it/s]
  1%|▏         | 4979/371472 [24:05<27:32:13,  3.70it/s]
  1%|▏         | 4980/371472 [24:05<28:29:56,  3.57it/s]
                                                        
{'loss': 5.4358, 'learning_rate': 9.88412807860544e-07, 'epoch': 0.21}

  1%|▏         | 4980/371472 [24:05<28:29:56,  3.57it/s]
  1%|▏         | 4981/371472 [24:06<29:11:38,  3.49it/s]
  1%|▏         | 4982/371472 [24:06<29:22:11,  3.47it/s]
  1%|▏         | 4983/371472 [24:06<28:54:58,  3.52it/s]
  1%|▏         | 4984/371472 [24:06<29:58:29,  3.40it/s]
  1%|▏         | 4985/371472 [24:07<28:45:15,  3.54it/s]
  1%|▏         | 4986/371472 [24:07<29:40:31,  3.43it/s]
  1%|▏         | 4987/371472 [24:07<29:29:36,  3.45it/s]
  1%|▏         | 4988/371472 [24:08<30:09:41,  3.38it/s]
  1%|▏         | 4989/371472 [24:08<28:46:31,  3.54it/s]
  1%|▏         | 4990/371472 [24:08<32:20:47,  3.15it/s]
  1%|▏         | 4991/371472 [24:09<33:48:46,  3.01it/s]
  1%|▏         | 4992/371472 [24:09<31:09:14,  3.27it/s]
  1%|▏         | 4993/371472 [24:09<31:56:28,  3.19it/s]
  1%|▏         | 4994/371472 [24:10<31:10:39,  3.27it/s]
  1%|▏         | 4995/371472 [24:10<33:28:37,  3.04it/s]
  1%|▏         | 4996/371472 [24:10<33:28:55,  3.04it/s]
  1%|▏         | 4997/371472 [24:11<33:24:25,  3.05it/s]
  1%|▏         | 4998/371472 [24:11<33:36:05,  3.03it/s]
  1%|▏         | 4999/371472 [24:11<32:48:43,  3.10it/s]
  1%|▏         | 5000/371472 [24:11<31:42:24,  3.21it/s]
                                                        
{'loss': 5.124, 'learning_rate': 9.883643258850654e-07, 'epoch': 0.22}

  1%|▏         | 5000/371472 [24:11<31:42:24,  3.21it/s]
  1%|▏         | 5001/371472 [24:12<30:40:17,  3.32it/s]
  1%|▏         | 5002/371472 [24:12<31:12:43,  3.26it/s]
  1%|▏         | 5003/371472 [24:12<30:58:37,  3.29it/s]
  1%|▏         | 5004/371472 [24:13<29:36:02,  3.44it/s]
  1%|▏         | 5005/371472 [24:13<31:49:41,  3.20it/s]
  1%|▏         | 5006/371472 [24:13<32:42:55,  3.11it/s]
  1%|▏         | 5007/371472 [24:14<32:14:00,  3.16it/s]
  1%|▏         | 5008/371472 [24:14<31:26:21,  3.24it/s]
  1%|▏         | 5009/371472 [24:14<31:39:16,  3.22it/s]
  1%|▏         | 5010/371472 [24:15<31:56:45,  3.19it/s]
  1%|▏         | 5011/371472 [24:15<34:47:51,  2.93it/s]
  1%|▏         | 5012/371472 [24:15<32:43:36,  3.11it/s]
  1%|▏         | 5013/371472 [24:16<30:55:29,  3.29it/s]
  1%|▏         | 5014/371472 [24:16<29:58:03,  3.40it/s]
  1%|▏         | 5015/371472 [24:16<28:55:40,  3.52it/s]
  1%|▏         | 5016/371472 [24:16<28:29:16,  3.57it/s]
  1%|▏         | 5017/371472 [24:17<29:32:34,  3.45it/s]
  1%|▏         | 5018/371472 [24:17<31:08:55,  3.27it/s]
  1%|▏         | 5019/371472 [24:17<30:43:38,  3.31it/s]
  1%|▏         | 5020/371472 [24:18<29:55:37,  3.40it/s]
                                                        
{'loss': 5.4017, 'learning_rate': 9.883158439095864e-07, 'epoch': 0.22}

  1%|▏         | 5020/371472 [24:18<29:55:37,  3.40it/s]
  1%|▏         | 5021/371472 [24:18<31:37:05,  3.22it/s]
  1%|▏         | 5022/371472 [24:18<30:17:04,  3.36it/s]
  1%|▏         | 5023/371472 [24:18<31:02:59,  3.28it/s]
  1%|▏         | 5024/371472 [24:19<29:56:38,  3.40it/s]
  1%|▏         | 5025/371472 [24:19<28:48:59,  3.53it/s]
  1%|▏         | 5026/371472 [24:19<27:54:55,  3.65it/s]
  1%|▏         | 5027/371472 [24:20<27:27:39,  3.71it/s]
  1%|▏         | 5028/371472 [24:20<26:53:42,  3.78it/s]
  1%|▏         | 5029/371472 [24:20<27:56:35,  3.64it/s]
  1%|▏         | 5030/371472 [24:20<26:57:40,  3.78it/s]
  1%|▏         | 5031/371472 [24:21<27:08:12,  3.75it/s]
  1%|▏         | 5032/371472 [24:21<28:11:16,  3.61it/s]
  1%|▏         | 5033/371472 [24:21<29:10:15,  3.49it/s]
  1%|▏         | 5034/371472 [24:21<28:44:07,  3.54it/s]
  1%|▏         | 5035/371472 [24:22<30:11:41,  3.37it/s]
  1%|▏         | 5036/371472 [24:22<30:31:30,  3.33it/s]
  1%|▏         | 5037/371472 [24:22<31:53:00,  3.19it/s]
  1%|▏         | 5038/371472 [24:23<30:39:36,  3.32it/s]
  1%|▏         | 5039/371472 [24:23<31:25:55,  3.24it/s]
  1%|▏         | 5040/371472 [24:23<33:14:18,  3.06it/s]
                                                        
{'loss': 5.28, 'learning_rate': 9.882673619341075e-07, 'epoch': 0.22}

  1%|▏         | 5040/371472 [24:23<33:14:18,  3.06it/s]
  1%|▏         | 5041/371472 [24:24<31:55:07,  3.19it/s]
  1%|▏         | 5042/371472 [24:24<30:02:13,  3.39it/s]
  1%|▏         | 5043/371472 [24:24<31:42:56,  3.21it/s]
  1%|▏         | 5044/371472 [24:25<30:58:18,  3.29it/s]
  1%|▏         | 5045/371472 [24:25<29:26:09,  3.46it/s]
  1%|▏         | 5046/371472 [24:25<29:18:49,  3.47it/s]
  1%|▏         | 5047/371472 [24:25<29:57:35,  3.40it/s]
  1%|▏         | 5048/371472 [24:26<29:36:52,  3.44it/s]
  1%|▏         | 5049/371472 [24:26<29:18:58,  3.47it/s]
  1%|▏         | 5050/371472 [24:26<29:24:44,  3.46it/s]
  1%|▏         | 5051/371472 [24:27<30:35:20,  3.33it/s]
  1%|▏         | 5052/371472 [24:27<29:12:53,  3.48it/s]
  1%|▏         | 5053/371472 [24:27<27:55:34,  3.64it/s]
  1%|▏         | 5054/371472 [24:27<28:05:01,  3.62it/s]
  1%|▏         | 5055/371472 [24:28<28:24:42,  3.58it/s]
  1%|▏         | 5056/371472 [24:28<28:55:28,  3.52it/s]
  1%|▏         | 5057/371472 [24:28<28:22:35,  3.59it/s]
  1%|▏         | 5058/371472 [24:29<28:14:46,  3.60it/s]
  1%|▏         | 5059/371472 [24:29<29:48:19,  3.41it/s]
  1%|▏         | 5060/371472 [24:29<30:43:59,  3.31it/s]
                                                        
{'loss': 5.427, 'learning_rate': 9.882188799586288e-07, 'epoch': 0.22}

  1%|▏         | 5060/371472 [24:29<30:43:59,  3.31it/s]
  1%|▏         | 5061/371472 [24:29<29:37:11,  3.44it/s]
  1%|▏         | 5062/371472 [24:30<30:34:07,  3.33it/s]
  1%|▏         | 5063/371472 [24:30<29:37:13,  3.44it/s]
  1%|▏         | 5064/371472 [24:30<29:26:13,  3.46it/s]
  1%|▏         | 5065/371472 [24:31<31:19:30,  3.25it/s]
  1%|▏         | 5066/371472 [24:31<29:33:00,  3.44it/s]
  1%|▏         | 5067/371472 [24:31<28:26:07,  3.58it/s]
  1%|▏         | 5068/371472 [24:31<27:54:29,  3.65it/s]
  1%|▏         | 5069/371472 [24:32<30:11:14,  3.37it/s]
  1%|▏         | 5070/371472 [24:32<30:23:16,  3.35it/s]
  1%|▏         | 5071/371472 [24:32<30:06:20,  3.38it/s]
  1%|▏         | 5072/371472 [24:33<28:47:39,  3.53it/s]
  1%|▏         | 5073/371472 [24:33<30:40:24,  3.32it/s]
  1%|▏         | 5074/371472 [24:33<29:29:41,  3.45it/s]
  1%|▏         | 5075/371472 [24:33<28:17:34,  3.60it/s]
  1%|▏         | 5076/371472 [24:34<28:22:19,  3.59it/s]
  1%|▏         | 5077/371472 [24:34<28:28:22,  3.57it/s]
  1%|▏         | 5078/371472 [24:34<27:59:36,  3.64it/s]
  1%|▏         | 5079/371472 [24:35<27:47:26,  3.66it/s]
  1%|▏         | 5080/371472 [24:35<27:06:18,  3.75it/s]
                                                        
{'loss': 5.272, 'learning_rate': 9.881703979831497e-07, 'epoch': 0.22}

  1%|▏         | 5080/371472 [24:35<27:06:18,  3.75it/s]
  1%|▏         | 5081/371472 [24:35<27:48:39,  3.66it/s]
  1%|▏         | 5082/371472 [24:35<27:38:09,  3.68it/s]
  1%|▏         | 5083/371472 [24:36<28:18:42,  3.59it/s]
  1%|▏         | 5084/371472 [24:36<28:53:28,  3.52it/s]
  1%|▏         | 5085/371472 [24:36<28:51:09,  3.53it/s]
  1%|▏         | 5086/371472 [24:37<29:03:35,  3.50it/s]
  1%|▏         | 5087/371472 [24:37<29:22:40,  3.46it/s]
  1%|▏         | 5088/371472 [24:37<29:57:28,  3.40it/s]
  1%|▏         | 5089/371472 [24:37<29:06:53,  3.50it/s]
  1%|▏         | 5090/371472 [24:38<28:42:33,  3.54it/s]
  1%|▏         | 5091/371472 [24:38<27:57:08,  3.64it/s]
  1%|▏         | 5092/371472 [24:38<28:55:24,  3.52it/s]
  1%|▏         | 5093/371472 [24:39<29:41:05,  3.43it/s]
  1%|▏         | 5094/371472 [24:39<29:20:32,  3.47it/s]
  1%|▏         | 5095/371472 [24:39<29:08:31,  3.49it/s]
  1%|▏         | 5096/371472 [24:39<29:04:12,  3.50it/s]
  1%|▏         | 5097/371472 [24:40<29:30:32,  3.45it/s]
  1%|▏         | 5098/371472 [24:40<28:10:11,  3.61it/s]
  1%|▏         | 5099/371472 [24:40<27:45:31,  3.67it/s]
  1%|▏         | 5100/371472 [24:41<28:17:53,  3.60it/s]
                                                        
{'loss': 5.3149, 'learning_rate': 9.88121916007671e-07, 'epoch': 0.22}

  1%|▏         | 5100/371472 [24:41<28:17:53,  3.60it/s]
  1%|▏         | 5101/371472 [24:41<29:17:23,  3.47it/s]
  1%|▏         | 5102/371472 [24:41<28:43:06,  3.54it/s]
  1%|▏         | 5103/371472 [24:42<33:10:50,  3.07it/s]
  1%|▏         | 5104/371472 [24:42<32:00:50,  3.18it/s]
  1%|▏         | 5105/371472 [24:42<31:45:41,  3.20it/s]
  1%|▏         | 5106/371472 [24:42<29:52:41,  3.41it/s]
  1%|▏         | 5107/371472 [24:43<28:50:58,  3.53it/s]
  1%|▏         | 5108/371472 [24:43<29:25:17,  3.46it/s]
  1%|▏         | 5109/371472 [24:43<29:37:29,  3.44it/s]
  1%|▏         | 5110/371472 [24:44<29:42:25,  3.43it/s]
  1%|▏         | 5111/371472 [24:44<28:55:05,  3.52it/s]
  1%|▏         | 5112/371472 [24:44<28:33:43,  3.56it/s]
  1%|▏         | 5113/371472 [24:44<28:37:00,  3.56it/s]
  1%|▏         | 5114/371472 [24:45<28:17:46,  3.60it/s]
  1%|▏         | 5115/371472 [24:45<27:27:51,  3.71it/s]
  1%|▏         | 5116/371472 [24:45<27:03:34,  3.76it/s]
  1%|▏         | 5117/371472 [24:45<27:36:07,  3.69it/s]
  1%|▏         | 5118/371472 [24:46<27:10:26,  3.74it/s]
  1%|▏         | 5119/371472 [24:46<29:21:36,  3.47it/s]
  1%|▏         | 5120/371472 [24:46<29:18:29,  3.47it/s]
                                                        
{'loss': 5.5404, 'learning_rate': 9.880734340321918e-07, 'epoch': 0.22}

  1%|▏         | 5120/371472 [24:46<29:18:29,  3.47it/s]
  1%|▏         | 5121/371472 [24:47<28:29:01,  3.57it/s]
  1%|▏         | 5122/371472 [24:47<29:23:25,  3.46it/s]
  1%|▏         | 5123/371472 [24:47<29:20:05,  3.47it/s]
  1%|▏         | 5124/371472 [24:47<29:30:34,  3.45it/s]
  1%|▏         | 5125/371472 [24:48<29:06:24,  3.50it/s]
  1%|▏         | 5126/371472 [24:48<29:38:46,  3.43it/s]
  1%|▏         | 5127/371472 [24:48<29:12:33,  3.48it/s]
  1%|▏         | 5128/371472 [24:49<28:27:53,  3.57it/s]
  1%|▏         | 5129/371472 [24:49<27:46:01,  3.66it/s]
  1%|▏         | 5130/371472 [24:49<28:34:31,  3.56it/s]
  1%|▏         | 5131/371472 [24:49<27:58:31,  3.64it/s]
  1%|▏         | 5132/371472 [24:50<28:24:17,  3.58it/s]
  1%|▏         | 5133/371472 [24:50<27:53:24,  3.65it/s]
  1%|▏         | 5134/371472 [24:50<29:00:38,  3.51it/s]
  1%|▏         | 5135/371472 [24:51<31:05:31,  3.27it/s]
  1%|▏         | 5136/371472 [24:51<30:55:36,  3.29it/s]
  1%|▏         | 5137/371472 [24:51<29:53:02,  3.41it/s]
  1%|▏         | 5138/371472 [24:51<29:50:05,  3.41it/s]
  1%|▏         | 5139/371472 [24:52<29:21:14,  3.47it/s]
  1%|▏         | 5140/371472 [24:52<29:24:51,  3.46it/s]
                                                        
{'loss': 5.3568, 'learning_rate': 9.88024952056713e-07, 'epoch': 0.22}

  1%|▏         | 5140/371472 [24:52<29:24:51,  3.46it/s]
  1%|▏         | 5141/371472 [24:52<31:24:39,  3.24it/s]
  1%|▏         | 5142/371472 [24:53<29:37:10,  3.44it/s]
  1%|▏         | 5143/371472 [24:53<29:01:20,  3.51it/s]
  1%|▏         | 5144/371472 [24:53<29:17:24,  3.47it/s]
  1%|▏         | 5145/371472 [24:53<28:58:48,  3.51it/s]
  1%|▏         | 5146/371472 [24:54<28:19:43,  3.59it/s]
  1%|▏         | 5147/371472 [24:54<28:37:22,  3.56it/s]
  1%|▏         | 5148/371472 [24:54<30:09:18,  3.37it/s]
  1%|▏         | 5149/371472 [24:55<29:24:38,  3.46it/s]
  1%|▏         | 5150/371472 [24:55<29:13:39,  3.48it/s]
  1%|▏         | 5151/371472 [24:55<29:27:23,  3.45it/s]
  1%|▏         | 5152/371472 [24:56<30:11:27,  3.37it/s]
  1%|▏         | 5153/371472 [24:56<29:52:50,  3.41it/s]
  1%|▏         | 5154/371472 [24:56<29:00:31,  3.51it/s]
  1%|▏         | 5155/371472 [24:56<28:25:19,  3.58it/s]
  1%|▏         | 5156/371472 [24:57<28:53:00,  3.52it/s]
  1%|▏         | 5157/371472 [24:57<29:18:47,  3.47it/s]
  1%|▏         | 5158/371472 [24:57<28:28:35,  3.57it/s]
  1%|▏         | 5159/371472 [24:57<28:13:41,  3.60it/s]
  1%|▏         | 5160/371472 [24:58<29:58:00,  3.40it/s]
                                                        
{'loss': 5.2099, 'learning_rate': 9.879764700812342e-07, 'epoch': 0.22}

  1%|▏         | 5160/371472 [24:58<29:58:00,  3.40it/s]
  1%|▏         | 5161/371472 [24:58<30:30:05,  3.34it/s]
  1%|▏         | 5162/371472 [24:58<30:55:02,  3.29it/s]
  1%|▏         | 5163/371472 [24:59<30:18:25,  3.36it/s]
  1%|▏         | 5164/371472 [24:59<31:07:05,  3.27it/s]
  1%|▏         | 5165/371472 [24:59<30:46:17,  3.31it/s]
  1%|▏         | 5166/371472 [25:00<29:35:44,  3.44it/s]
  1%|▏         | 5167/371472 [25:00<30:13:54,  3.37it/s]
  1%|▏         | 5168/371472 [25:00<29:01:10,  3.51it/s]
  1%|▏         | 5169/371472 [25:00<29:39:10,  3.43it/s]
  1%|▏         | 5170/371472 [25:01<28:56:33,  3.52it/s]
  1%|▏         | 5171/371472 [25:01<29:05:05,  3.50it/s]
  1%|▏         | 5172/371472 [25:01<29:23:02,  3.46it/s]
  1%|▏         | 5173/371472 [25:02<29:12:31,  3.48it/s]
  1%|▏         | 5174/371472 [25:02<28:08:41,  3.62it/s]
  1%|▏         | 5175/371472 [25:02<30:49:36,  3.30it/s]
  1%|▏         | 5176/371472 [25:02<29:31:32,  3.45it/s]
  1%|▏         | 5177/371472 [25:03<29:47:22,  3.42it/s]
  1%|▏         | 5178/371472 [25:03<29:09:29,  3.49it/s]
  1%|▏         | 5179/371472 [25:03<29:53:26,  3.40it/s]
  1%|▏         | 5180/371472 [25:04<28:18:59,  3.59it/s]
                                                        
{'loss': 5.2753, 'learning_rate': 9.879279881057552e-07, 'epoch': 0.22}

  1%|▏         | 5180/371472 [25:04<28:18:59,  3.59it/s]
  1%|▏         | 5181/371472 [25:04<28:06:09,  3.62it/s]
  1%|▏         | 5182/371472 [25:04<27:59:43,  3.63it/s]
  1%|▏         | 5183/371472 [25:04<27:22:38,  3.72it/s]
  1%|▏         | 5184/371472 [25:05<27:01:34,  3.76it/s]
  1%|▏         | 5185/371472 [25:05<26:48:21,  3.80it/s]
  1%|▏         | 5186/371472 [25:05<27:04:47,  3.76it/s]
  1%|▏         | 5187/371472 [25:05<28:00:30,  3.63it/s]
  1%|▏         | 5188/371472 [25:06<30:46:45,  3.31it/s]
  1%|▏         | 5189/371472 [25:06<31:48:55,  3.20it/s]
  1%|▏         | 5190/371472 [25:06<30:46:20,  3.31it/s]
  1%|▏         | 5191/371472 [25:07<31:14:47,  3.26it/s]
  1%|▏         | 5192/371472 [25:07<33:59:12,  2.99it/s]
  1%|▏         | 5193/371472 [25:07<32:45:08,  3.11it/s]
  1%|▏         | 5194/371472 [25:08<31:35:22,  3.22it/s]
  1%|▏         | 5195/371472 [25:08<30:28:19,  3.34it/s]
  1%|▏         | 5196/371472 [25:08<29:13:54,  3.48it/s]
  1%|▏         | 5197/371472 [25:09<29:44:41,  3.42it/s]
  1%|▏         | 5198/371472 [25:09<32:42:58,  3.11it/s]
  1%|▏         | 5199/371472 [25:09<31:28:50,  3.23it/s]
  1%|▏         | 5200/371472 [25:10<29:52:05,  3.41it/s]
                                                        
{'loss': 5.3216, 'learning_rate': 9.878795061302765e-07, 'epoch': 0.22}

  1%|▏         | 5200/371472 [25:10<29:52:05,  3.41it/s]
  1%|▏         | 5201/371472 [25:10<29:03:05,  3.50it/s]
  1%|▏         | 5202/371472 [25:10<29:45:55,  3.42it/s]
  1%|▏         | 5203/371472 [25:10<29:33:18,  3.44it/s]
  1%|▏         | 5204/371472 [25:11<29:05:30,  3.50it/s]
  1%|▏         | 5205/371472 [25:11<29:05:25,  3.50it/s]
  1%|▏         | 5206/371472 [25:11<28:32:59,  3.56it/s]
  1%|▏         | 5207/371472 [25:11<27:56:19,  3.64it/s]
  1%|▏         | 5208/371472 [25:12<30:23:52,  3.35it/s]
  1%|▏         | 5209/371472 [25:12<32:53:45,  3.09it/s]
  1%|▏         | 5210/371472 [25:12<31:22:05,  3.24it/s]
  1%|▏         | 5211/371472 [25:13<30:42:43,  3.31it/s]
  1%|▏         | 5212/371472 [25:13<30:38:30,  3.32it/s]
  1%|▏         | 5213/371472 [25:13<30:29:59,  3.34it/s]
  1%|▏         | 5214/371472 [25:14<29:37:04,  3.44it/s]
  1%|▏         | 5215/371472 [25:14<28:51:49,  3.52it/s]
  1%|▏         | 5216/371472 [25:14<30:27:20,  3.34it/s]
  1%|▏         | 5217/371472 [25:15<30:18:15,  3.36it/s]
  1%|▏         | 5218/371472 [25:15<29:38:11,  3.43it/s]
  1%|▏         | 5219/371472 [25:15<28:48:20,  3.53it/s]
  1%|▏         | 5220/371472 [25:15<28:04:40,  3.62it/s]
                                                        
{'loss': 5.332, 'learning_rate': 9.878310241547976e-07, 'epoch': 0.22}

  1%|▏         | 5220/371472 [25:15<28:04:40,  3.62it/s]
  1%|▏         | 5221/371472 [25:16<28:39:09,  3.55it/s]
  1%|▏         | 5222/371472 [25:16<28:46:58,  3.53it/s]
  1%|▏         | 5223/371472 [25:16<28:25:09,  3.58it/s]
  1%|▏         | 5224/371472 [25:16<29:05:55,  3.50it/s]
  1%|▏         | 5225/371472 [25:17<29:08:12,  3.49it/s]
  1%|▏         | 5226/371472 [25:17<29:22:25,  3.46it/s]
  1%|▏         | 5227/371472 [25:17<30:56:39,  3.29it/s]
  1%|▏         | 5228/371472 [25:18<29:48:18,  3.41it/s]
  1%|▏         | 5229/371472 [25:18<31:01:57,  3.28it/s]
  1%|▏         | 5230/371472 [25:18<30:38:42,  3.32it/s]
  1%|▏         | 5231/371472 [25:19<30:03:43,  3.38it/s]
  1%|▏         | 5232/371472 [25:19<30:21:58,  3.35it/s]
  1%|▏         | 5233/371472 [25:19<30:27:51,  3.34it/s]
  1%|▏         | 5234/371472 [25:19<29:17:00,  3.47it/s]
  1%|▏         | 5235/371472 [25:20<29:09:17,  3.49it/s]
  1%|▏         | 5236/371472 [25:20<28:19:33,  3.59it/s]
  1%|▏         | 5237/371472 [25:20<28:22:48,  3.58it/s]
  1%|▏         | 5238/371472 [25:21<28:34:39,  3.56it/s]
  1%|▏         | 5239/371472 [25:21<27:46:48,  3.66it/s]
  1%|▏         | 5240/371472 [25:21<27:27:54,  3.70it/s]
                                                        
{'loss': 5.1957, 'learning_rate': 9.877825421793187e-07, 'epoch': 0.23}

  1%|▏         | 5240/371472 [25:21<27:27:54,  3.70it/s]
  1%|▏         | 5241/371472 [25:21<29:25:30,  3.46it/s]
  1%|▏         | 5242/371472 [25:22<29:17:23,  3.47it/s]
  1%|▏         | 5243/371472 [25:22<28:07:07,  3.62it/s]
  1%|▏         | 5244/371472 [25:22<28:47:58,  3.53it/s]
  1%|▏         | 5245/371472 [25:23<30:35:58,  3.32it/s]
  1%|▏         | 5246/371472 [25:23<30:03:22,  3.38it/s]
  1%|▏         | 5247/371472 [25:23<31:43:46,  3.21it/s]
  1%|▏         | 5248/371472 [25:24<32:59:38,  3.08it/s]
  1%|▏         | 5249/371472 [25:24<30:42:40,  3.31it/s]
  1%|▏         | 5250/371472 [25:24<34:11:17,  2.98it/s]
  1%|▏         | 5251/371472 [25:25<34:27:46,  2.95it/s]
  1%|▏         | 5252/371472 [25:25<32:14:47,  3.15it/s]
  1%|▏         | 5253/371472 [25:25<31:25:16,  3.24it/s]
  1%|▏         | 5254/371472 [25:25<30:19:41,  3.35it/s]
  1%|▏         | 5255/371472 [25:26<29:04:10,  3.50it/s]
  1%|▏         | 5256/371472 [25:26<29:24:27,  3.46it/s]
  1%|▏         | 5257/371472 [25:26<29:09:54,  3.49it/s]
  1%|▏         | 5258/371472 [25:27<28:21:34,  3.59it/s]
  1%|▏         | 5259/371472 [25:27<28:35:24,  3.56it/s]
  1%|▏         | 5260/371472 [25:27<32:04:59,  3.17it/s]
                                                        
{'loss': 5.493, 'learning_rate': 9.877340602038397e-07, 'epoch': 0.23}

  1%|▏         | 5260/371472 [25:27<32:04:59,  3.17it/s]
  1%|▏         | 5261/371472 [25:27<30:13:30,  3.37it/s]
  1%|▏         | 5262/371472 [25:28<29:18:25,  3.47it/s]
  1%|▏         | 5263/371472 [25:28<28:10:11,  3.61it/s]
  1%|▏         | 5264/371472 [25:28<28:49:24,  3.53it/s]
  1%|▏         | 5265/371472 [25:29<27:36:43,  3.68it/s]
  1%|▏         | 5266/371472 [25:29<27:22:50,  3.72it/s]
  1%|▏         | 5267/371472 [25:29<29:50:46,  3.41it/s]
  1%|▏         | 5268/371472 [25:29<28:40:03,  3.55it/s]
  1%|▏         | 5269/371472 [25:30<29:17:37,  3.47it/s]
  1%|▏         | 5270/371472 [25:30<30:42:49,  3.31it/s]
  1%|▏         | 5271/371472 [25:30<29:36:21,  3.44it/s]
  1%|▏         | 5272/371472 [25:31<28:14:49,  3.60it/s]
  1%|▏         | 5273/371472 [25:31<28:48:50,  3.53it/s]
  1%|▏         | 5274/371472 [25:31<29:04:05,  3.50it/s]
  1%|▏         | 5275/371472 [25:31<28:25:34,  3.58it/s]
  1%|▏         | 5276/371472 [25:32<28:03:26,  3.63it/s]
  1%|▏         | 5277/371472 [25:32<28:18:16,  3.59it/s]
  1%|▏         | 5278/371472 [25:32<28:55:10,  3.52it/s]
  1%|▏         | 5279/371472 [25:33<30:41:10,  3.31it/s]
  1%|▏         | 5280/371472 [25:33<32:20:13,  3.15it/s]
                                                        
{'loss': 5.4048, 'learning_rate': 9.876855782283608e-07, 'epoch': 0.23}

  1%|▏         | 5280/371472 [25:33<32:20:13,  3.15it/s]
  1%|▏         | 5281/371472 [25:33<31:29:49,  3.23it/s]
  1%|▏         | 5282/371472 [25:34<32:55:55,  3.09it/s]
  1%|▏         | 5283/371472 [25:34<30:46:25,  3.31it/s]
  1%|▏         | 5284/371472 [25:34<30:04:10,  3.38it/s]
  1%|▏         | 5285/371472 [25:34<28:53:08,  3.52it/s]
  1%|▏         | 5286/371472 [25:35<28:26:12,  3.58it/s]
  1%|▏         | 5287/371472 [25:35<29:59:25,  3.39it/s]
  1%|▏         | 5288/371472 [25:35<29:45:38,  3.42it/s]
  1%|▏         | 5289/371472 [25:36<29:49:00,  3.41it/s]
  1%|▏         | 5290/371472 [25:36<31:07:59,  3.27it/s]
  1%|▏         | 5291/371472 [25:36<29:59:55,  3.39it/s]
  1%|▏         | 5292/371472 [25:36<30:23:15,  3.35it/s]
  1%|▏         | 5293/371472 [25:37<30:24:00,  3.35it/s]
  1%|▏         | 5294/371472 [25:37<31:25:45,  3.24it/s]
  1%|▏         | 5295/371472 [25:37<31:19:35,  3.25it/s]
  1%|▏         | 5296/371472 [25:38<31:13:53,  3.26it/s]
  1%|▏         | 5297/371472 [25:38<31:42:51,  3.21it/s]
  1%|▏         | 5298/371472 [25:38<29:55:17,  3.40it/s]
  1%|▏         | 5299/371472 [25:39<28:37:26,  3.55it/s]
  1%|▏         | 5300/371472 [25:39<29:03:58,  3.50it/s]
                                                        
{'loss': 5.4582, 'learning_rate': 9.87637096252882e-07, 'epoch': 0.23}

  1%|▏         | 5300/371472 [25:39<29:03:58,  3.50it/s]
  1%|▏         | 5301/371472 [25:39<28:58:35,  3.51it/s]
  1%|▏         | 5302/371472 [25:39<28:18:10,  3.59it/s]
  1%|▏         | 5303/371472 [25:40<27:58:09,  3.64it/s]
  1%|▏         | 5304/371472 [25:40<27:50:04,  3.65it/s]
  1%|▏         | 5305/371472 [25:40<27:27:05,  3.71it/s]
  1%|▏         | 5306/371472 [25:40<29:16:46,  3.47it/s]
  1%|▏         | 5307/371472 [25:41<30:14:11,  3.36it/s]
  1%|▏         | 5308/371472 [25:41<29:12:25,  3.48it/s]
  1%|▏         | 5309/371472 [25:41<29:10:00,  3.49it/s]
  1%|▏         | 5310/371472 [25:42<29:36:13,  3.44it/s]
  1%|▏         | 5311/371472 [25:42<29:25:58,  3.46it/s]
  1%|▏         | 5312/371472 [25:42<29:35:45,  3.44it/s]
  1%|▏         | 5313/371472 [25:43<29:11:42,  3.48it/s]
  1%|▏         | 5314/371472 [25:43<28:39:14,  3.55it/s]
  1%|▏         | 5315/371472 [25:43<29:19:21,  3.47it/s]
  1%|▏         | 5316/371472 [25:43<29:17:40,  3.47it/s]
  1%|▏         | 5317/371472 [25:44<29:04:59,  3.50it/s]
  1%|▏         | 5318/371472 [25:44<29:23:36,  3.46it/s]
  1%|▏         | 5319/371472 [25:44<28:18:05,  3.59it/s]
  1%|▏         | 5320/371472 [25:44<28:04:22,  3.62it/s]
                                                        
{'loss': 5.1358, 'learning_rate': 9.87588614277403e-07, 'epoch': 0.23}

  1%|▏         | 5320/371472 [25:44<28:04:22,  3.62it/s]
  1%|▏         | 5321/371472 [25:45<28:56:33,  3.51it/s]
  1%|▏         | 5322/371472 [25:45<31:32:45,  3.22it/s]
  1%|▏         | 5323/371472 [25:45<31:08:54,  3.27it/s]
  1%|▏         | 5324/371472 [25:46<30:22:07,  3.35it/s]
  1%|▏         | 5325/371472 [25:46<29:39:48,  3.43it/s]
  1%|▏         | 5326/371472 [25:46<30:23:12,  3.35it/s]
  1%|▏         | 5327/371472 [25:47<29:33:38,  3.44it/s]
  1%|▏         | 5328/371472 [25:47<28:48:05,  3.53it/s]
  1%|▏         | 5329/371472 [25:47<27:43:57,  3.67it/s]
  1%|▏         | 5330/371472 [25:47<30:05:39,  3.38it/s]
  1%|▏         | 5331/371472 [25:48<30:17:29,  3.36it/s]
  1%|▏         | 5332/371472 [25:48<28:55:51,  3.52it/s]
  1%|▏         | 5333/371472 [25:48<27:41:41,  3.67it/s]
  1%|▏         | 5334/371472 [25:49<28:17:08,  3.60it/s]
  1%|▏         | 5335/371472 [25:49<29:08:13,  3.49it/s]
  1%|▏         | 5336/371472 [25:49<28:37:30,  3.55it/s]
  1%|▏         | 5337/371472 [25:49<28:02:46,  3.63it/s]
  1%|▏         | 5338/371472 [25:50<27:26:56,  3.71it/s]
  1%|▏         | 5339/371472 [25:50<27:43:31,  3.67it/s]
  1%|▏         | 5340/371472 [25:50<27:41:12,  3.67it/s]
                                                        
{'loss': 5.507, 'learning_rate': 9.875401323019242e-07, 'epoch': 0.23}

  1%|▏         | 5340/371472 [25:50<27:41:12,  3.67it/s]
  1%|▏         | 5341/371472 [25:50<27:28:17,  3.70it/s]
  1%|▏         | 5342/371472 [25:51<28:27:10,  3.57it/s]
  1%|▏         | 5343/371472 [25:51<29:36:14,  3.44it/s]
  1%|▏         | 5344/371472 [25:51<30:01:55,  3.39it/s]
  1%|▏         | 5345/371472 [25:52<28:40:59,  3.55it/s]
  1%|▏         | 5346/371472 [25:52<28:50:28,  3.53it/s]
  1%|▏         | 5347/371472 [25:52<28:05:58,  3.62it/s]
  1%|▏         | 5348/371472 [25:52<28:26:46,  3.58it/s]
  1%|▏         | 5349/371472 [25:53<28:00:06,  3.63it/s]
  1%|▏         | 5350/371472 [25:53<29:37:32,  3.43it/s]
  1%|▏         | 5351/371472 [25:53<30:44:43,  3.31it/s]
  1%|▏         | 5352/371472 [25:54<31:14:53,  3.25it/s]
  1%|▏         | 5353/371472 [25:54<30:00:19,  3.39it/s]
  1%|▏         | 5354/371472 [25:54<30:12:38,  3.37it/s]
  1%|▏         | 5355/371472 [25:55<29:13:31,  3.48it/s]
  1%|▏         | 5356/371472 [25:55<30:47:01,  3.30it/s]
  1%|▏         | 5357/371472 [25:55<29:26:40,  3.45it/s]
  1%|▏         | 5358/371472 [25:55<30:27:58,  3.34it/s]
  1%|▏         | 5359/371472 [25:56<28:44:22,  3.54it/s]
  1%|▏         | 5360/371472 [25:56<29:03:39,  3.50it/s]
                                                        
{'loss': 5.2223, 'learning_rate': 9.87491650326445e-07, 'epoch': 0.23}

  1%|▏         | 5360/371472 [25:56<29:03:39,  3.50it/s]
  1%|▏         | 5361/371472 [25:56<30:06:02,  3.38it/s]
  1%|▏         | 5362/371472 [25:57<30:24:25,  3.34it/s]
  1%|▏         | 5363/371472 [25:57<31:44:40,  3.20it/s]
  1%|▏         | 5364/371472 [25:57<30:24:57,  3.34it/s]
  1%|▏         | 5365/371472 [25:58<30:50:42,  3.30it/s]
  1%|▏         | 5366/371472 [25:58<33:31:30,  3.03it/s]
  1%|▏         | 5367/371472 [25:58<31:19:17,  3.25it/s]
  1%|▏         | 5368/371472 [25:58<30:10:30,  3.37it/s]
  1%|▏         | 5369/371472 [25:59<30:04:01,  3.38it/s]
  1%|▏         | 5370/371472 [25:59<31:40:33,  3.21it/s]
  1%|▏         | 5371/371472 [25:59<30:13:03,  3.37it/s]
  1%|▏         | 5372/371472 [26:00<29:17:16,  3.47it/s]
  1%|▏         | 5373/371472 [26:00<28:45:01,  3.54it/s]
  1%|▏         | 5374/371472 [26:00<28:09:27,  3.61it/s]
  1%|▏         | 5375/371472 [26:00<28:27:26,  3.57it/s]
  1%|▏         | 5376/371472 [26:01<27:38:49,  3.68it/s]
  1%|▏         | 5377/371472 [26:01<27:15:27,  3.73it/s]
  1%|▏         | 5378/371472 [26:01<28:24:48,  3.58it/s]
  1%|▏         | 5379/371472 [26:02<29:01:21,  3.50it/s]
  1%|▏         | 5380/371472 [26:02<29:20:05,  3.47it/s]
                                                        
{'loss': 5.2098, 'learning_rate': 9.874431683509664e-07, 'epoch': 0.23}

  1%|▏         | 5380/371472 [26:02<29:20:05,  3.47it/s]
  1%|▏         | 5381/371472 [26:02<29:46:57,  3.41it/s]
  1%|▏         | 5382/371472 [26:02<29:50:24,  3.41it/s]
  1%|▏         | 5383/371472 [26:03<28:55:52,  3.51it/s]
  1%|▏         | 5384/371472 [26:03<29:02:14,  3.50it/s]
  1%|▏         | 5385/371472 [26:03<30:24:52,  3.34it/s]
  1%|▏         | 5386/371472 [26:04<28:55:27,  3.52it/s]
  1%|▏         | 5387/371472 [26:04<28:37:27,  3.55it/s]
  1%|▏         | 5388/371472 [26:04<28:27:41,  3.57it/s]
  1%|▏         | 5389/371472 [26:05<30:43:50,  3.31it/s]
  1%|▏         | 5390/371472 [26:05<30:43:32,  3.31it/s]
  1%|▏         | 5391/371472 [26:05<30:47:52,  3.30it/s]
  1%|▏         | 5392/371472 [26:05<29:20:25,  3.47it/s]
  1%|▏         | 5393/371472 [26:06<28:35:05,  3.56it/s]
  1%|▏         | 5394/371472 [26:06<28:13:25,  3.60it/s]
  1%|▏         | 5395/371472 [26:06<27:50:53,  3.65it/s]
  1%|▏         | 5396/371472 [26:07<31:13:39,  3.26it/s]
  1%|▏         | 5397/371472 [26:07<29:48:03,  3.41it/s]
  1%|▏         | 5398/371472 [26:07<30:03:09,  3.38it/s]
  1%|▏         | 5399/371472 [26:07<29:13:01,  3.48it/s]
  1%|▏         | 5400/371472 [26:08<28:58:25,  3.51it/s]
                                                        
{'loss': 5.2615, 'learning_rate': 9.873946863754874e-07, 'epoch': 0.23}

  1%|▏         | 5400/371472 [26:08<28:58:25,  3.51it/s]
  1%|▏         | 5401/371472 [26:08<30:05:56,  3.38it/s]
  1%|▏         | 5402/371472 [26:08<30:45:04,  3.31it/s]
  1%|▏         | 5403/371472 [26:09<30:19:34,  3.35it/s]
  1%|▏         | 5404/371472 [26:09<29:26:21,  3.45it/s]
  1%|▏         | 5405/371472 [26:09<29:22:48,  3.46it/s]
  1%|▏         | 5406/371472 [26:09<28:41:48,  3.54it/s]
  1%|▏         | 5407/371472 [26:10<28:42:44,  3.54it/s]
  1%|▏         | 5408/371472 [26:10<28:54:22,  3.52it/s]
  1%|▏         | 5409/371472 [26:10<29:47:39,  3.41it/s]
  1%|▏         | 5410/371472 [26:11<34:12:37,  2.97it/s]
  1%|▏         | 5411/371472 [26:11<31:38:02,  3.21it/s]
  1%|▏         | 5412/371472 [26:11<30:04:17,  3.38it/s]
  1%|▏         | 5413/371472 [26:12<30:34:53,  3.32it/s]
  1%|▏         | 5414/371472 [26:12<30:02:28,  3.38it/s]
  1%|▏         | 5415/371472 [26:12<29:16:11,  3.47it/s]
  1%|▏         | 5416/371472 [26:12<28:46:10,  3.53it/s]
  1%|▏         | 5417/371472 [26:13<28:34:10,  3.56it/s]
  1%|▏         | 5418/371472 [26:13<29:49:34,  3.41it/s]
  1%|▏         | 5419/371472 [26:13<31:10:12,  3.26it/s]
  1%|▏         | 5420/371472 [26:14<29:43:29,  3.42it/s]
                                                        
{'loss': 5.2096, 'learning_rate': 9.873462044000085e-07, 'epoch': 0.23}

  1%|▏         | 5420/371472 [26:14<29:43:29,  3.42it/s]
  1%|▏         | 5421/371472 [26:14<29:32:53,  3.44it/s]
  1%|▏         | 5422/371472 [26:14<29:00:31,  3.51it/s]
  1%|▏         | 5423/371472 [26:14<29:00:08,  3.51it/s]
  1%|▏         | 5424/371472 [26:15<29:41:25,  3.42it/s]
  1%|▏         | 5425/371472 [26:15<31:06:24,  3.27it/s]
  1%|▏         | 5426/371472 [26:15<29:44:49,  3.42it/s]
  1%|▏         | 5427/371472 [26:16<31:35:45,  3.22it/s]
  1%|▏         | 5428/371472 [26:16<30:47:40,  3.30it/s]
  1%|▏         | 5429/371472 [26:16<32:51:35,  3.09it/s]
  1%|▏         | 5430/371472 [26:17<32:50:35,  3.10it/s]
  1%|▏         | 5431/371472 [26:17<31:20:01,  3.25it/s]
  1%|▏         | 5432/371472 [26:17<30:37:26,  3.32it/s]
  1%|▏         | 5433/371472 [26:18<30:26:13,  3.34it/s]
  1%|▏         | 5434/371472 [26:18<32:26:43,  3.13it/s]
  1%|▏         | 5435/371472 [26:18<31:45:36,  3.20it/s]
  1%|▏         | 5436/371472 [26:19<32:41:00,  3.11it/s]
  1%|▏         | 5437/371472 [26:19<30:41:15,  3.31it/s]
  1%|▏         | 5438/371472 [26:19<31:47:55,  3.20it/s]
  1%|▏         | 5439/371472 [26:19<29:45:33,  3.42it/s]
  1%|▏         | 5440/371472 [26:20<29:35:40,  3.44it/s]
                                                        
{'loss': 5.1175, 'learning_rate': 9.872977224245298e-07, 'epoch': 0.23}

  1%|▏         | 5440/371472 [26:20<29:35:40,  3.44it/s]
  1%|▏         | 5441/371472 [26:20<30:02:56,  3.38it/s]
  1%|▏         | 5442/371472 [26:20<32:43:25,  3.11it/s]
  1%|▏         | 5443/371472 [26:21<31:06:09,  3.27it/s]
  1%|▏         | 5444/371472 [26:21<29:43:45,  3.42it/s]
  1%|▏         | 5445/371472 [26:21<28:40:07,  3.55it/s]
  1%|▏         | 5446/371472 [26:21<29:12:57,  3.48it/s]
  1%|▏         | 5447/371472 [26:22<27:56:08,  3.64it/s]
  1%|▏         | 5448/371472 [26:22<27:29:52,  3.70it/s]
  1%|▏         | 5449/371472 [26:22<28:19:18,  3.59it/s]
  1%|▏         | 5450/371472 [26:23<29:06:49,  3.49it/s]
  1%|▏         | 5451/371472 [26:23<29:40:04,  3.43it/s]
  1%|▏         | 5452/371472 [26:23<29:44:32,  3.42it/s]
  1%|▏         | 5453/371472 [26:23<31:12:01,  3.26it/s]
  1%|▏         | 5454/371472 [26:24<32:09:35,  3.16it/s]
  1%|▏         | 5455/371472 [26:24<31:47:09,  3.20it/s]
  1%|▏         | 5456/371472 [26:24<32:17:30,  3.15it/s]
  1%|▏         | 5457/371472 [26:25<30:20:58,  3.35it/s]
  1%|▏         | 5458/371472 [26:25<30:22:10,  3.35it/s]
  1%|▏         | 5459/371472 [26:25<29:38:12,  3.43it/s]
  1%|▏         | 5460/371472 [26:26<29:44:22,  3.42it/s]
                                                        
{'loss': 5.2392, 'learning_rate': 9.872492404490509e-07, 'epoch': 0.24}

  1%|▏         | 5460/371472 [26:26<29:44:22,  3.42it/s]
  1%|▏         | 5461/371472 [26:26<34:50:46,  2.92it/s]
  1%|▏         | 5462/371472 [26:26<32:15:07,  3.15it/s]
  1%|▏         | 5463/371472 [26:27<30:37:58,  3.32it/s]
  1%|▏         | 5464/371472 [26:27<30:01:17,  3.39it/s]
  1%|▏         | 5465/371472 [26:27<30:43:38,  3.31it/s]
  1%|▏         | 5466/371472 [26:27<28:58:47,  3.51it/s]
  1%|▏         | 5467/371472 [26:28<28:15:33,  3.60it/s]
  1%|▏         | 5468/371472 [26:28<29:18:55,  3.47it/s]
  1%|▏         | 5469/371472 [26:28<29:52:07,  3.40it/s]
  1%|▏         | 5470/371472 [26:29<28:52:51,  3.52it/s]
  1%|▏         | 5471/371472 [26:29<29:00:52,  3.50it/s]
  1%|▏         | 5472/371472 [26:29<28:06:35,  3.62it/s]
  1%|▏         | 5473/371472 [26:29<27:36:38,  3.68it/s]
  1%|▏         | 5474/371472 [26:30<27:28:23,  3.70it/s]
  1%|▏         | 5475/371472 [26:30<28:27:13,  3.57it/s]
  1%|▏         | 5476/371472 [26:30<28:13:45,  3.60it/s]
  1%|▏         | 5477/371472 [26:30<27:41:07,  3.67it/s]
  1%|▏         | 5478/371472 [26:31<28:39:35,  3.55it/s]
  1%|▏         | 5479/371472 [26:31<28:24:24,  3.58it/s]
  1%|▏         | 5480/371472 [26:31<28:36:47,  3.55it/s]
                                                        
{'loss': 5.1828, 'learning_rate': 9.87200758473572e-07, 'epoch': 0.24}

  1%|▏         | 5480/371472 [26:31<28:36:47,  3.55it/s]
  1%|▏         | 5481/371472 [26:32<32:00:10,  3.18it/s]
  1%|▏         | 5482/371472 [26:32<30:59:20,  3.28it/s]
  1%|▏         | 5483/371472 [26:32<30:16:08,  3.36it/s]
  1%|▏         | 5484/371472 [26:33<30:37:16,  3.32it/s]
  1%|▏         | 5485/371472 [26:33<29:56:30,  3.40it/s]
  1%|▏         | 5486/371472 [26:33<31:29:27,  3.23it/s]
  1%|▏         | 5487/371472 [26:34<31:39:08,  3.21it/s]
  1%|▏         | 5488/371472 [26:34<30:54:22,  3.29it/s]
  1%|▏         | 5489/371472 [26:34<31:58:01,  3.18it/s]
  1%|▏         | 5490/371472 [26:34<31:08:56,  3.26it/s]
  1%|▏         | 5491/371472 [26:35<30:22:38,  3.35it/s]
  1%|▏         | 5492/371472 [26:35<29:58:21,  3.39it/s]
  1%|▏         | 5493/371472 [26:35<29:47:44,  3.41it/s]
  1%|▏         | 5494/371472 [26:36<30:48:00,  3.30it/s]
  1%|▏         | 5495/371472 [26:36<30:07:06,  3.38it/s]
  1%|▏         | 5496/371472 [26:36<30:00:51,  3.39it/s]
  1%|▏         | 5497/371472 [26:36<28:58:11,  3.51it/s]
  1%|▏         | 5498/371472 [26:37<28:56:28,  3.51it/s]
  1%|▏         | 5499/371472 [26:37<28:29:03,  3.57it/s]
  1%|▏         | 5500/371472 [26:37<28:07:07,  3.62it/s]
                                                        
{'loss': 5.1802, 'learning_rate': 9.87152276498093e-07, 'epoch': 0.24}

  1%|▏         | 5500/371472 [26:37<28:07:07,  3.62it/s]
  1%|▏         | 5501/371472 [26:38<28:53:53,  3.52it/s]
  1%|▏         | 5502/371472 [26:38<28:35:17,  3.56it/s]
  1%|▏         | 5503/371472 [26:38<28:32:03,  3.56it/s]
  1%|▏         | 5504/371472 [26:38<30:58:15,  3.28it/s]
  1%|▏         | 5505/371472 [26:39<29:58:16,  3.39it/s]
  1%|▏         | 5506/371472 [26:39<29:04:30,  3.50it/s]
  1%|▏         | 5507/371472 [26:39<28:22:06,  3.58it/s]
  1%|▏         | 5508/371472 [26:40<29:02:45,  3.50it/s]
  1%|▏         | 5509/371472 [26:40<28:37:21,  3.55it/s]
  1%|▏         | 5510/371472 [26:40<28:53:17,  3.52it/s]
  1%|▏         | 5511/371472 [26:40<28:41:28,  3.54it/s]
  1%|▏         | 5512/371472 [26:41<30:07:25,  3.37it/s]
  1%|▏         | 5513/371472 [26:41<29:04:11,  3.50it/s]
  1%|▏         | 5514/371472 [26:41<34:43:28,  2.93it/s]
  1%|▏         | 5515/371472 [26:42<32:14:48,  3.15it/s]
  1%|▏         | 5516/371472 [26:42<31:04:33,  3.27it/s]
  1%|▏         | 5517/371472 [26:42<31:02:13,  3.28it/s]
  1%|▏         | 5518/371472 [26:43<30:34:53,  3.32it/s]
  1%|▏         | 5519/371472 [26:43<29:50:16,  3.41it/s]
  1%|▏         | 5520/371472 [26:43<29:47:41,  3.41it/s]
                                                        
{'loss': 5.2447, 'learning_rate': 9.87103794522614e-07, 'epoch': 0.24}

  1%|▏         | 5520/371472 [26:43<29:47:41,  3.41it/s]
  1%|▏         | 5521/371472 [26:43<28:46:10,  3.53it/s]
  1%|▏         | 5522/371472 [26:44<28:02:07,  3.63it/s]
  1%|▏         | 5523/371472 [26:44<28:00:03,  3.63it/s]
  1%|▏         | 5524/371472 [26:44<29:39:13,  3.43it/s]
  1%|▏         | 5525/371472 [26:45<29:16:11,  3.47it/s]
  1%|▏         | 5526/371472 [26:45<29:14:04,  3.48it/s]
  1%|▏         | 5527/371472 [26:45<28:08:51,  3.61it/s]
  1%|▏         | 5528/371472 [26:45<28:11:18,  3.61it/s]
  1%|▏         | 5529/371472 [26:46<28:38:34,  3.55it/s]
  1%|▏         | 5530/371472 [26:46<30:30:32,  3.33it/s]
  1%|▏         | 5531/371472 [26:46<30:08:40,  3.37it/s]
  1%|▏         | 5532/371472 [26:47<30:08:23,  3.37it/s]
  1%|▏         | 5533/371472 [26:47<29:11:57,  3.48it/s]
  1%|▏         | 5534/371472 [26:47<28:33:46,  3.56it/s]
  1%|▏         | 5535/371472 [26:47<28:37:48,  3.55it/s]
  1%|▏         | 5536/371472 [26:48<29:05:30,  3.49it/s]
  1%|▏         | 5537/371472 [26:48<28:53:40,  3.52it/s]
  1%|▏         | 5538/371472 [26:48<27:51:14,  3.65it/s]
  1%|▏         | 5539/371472 [26:49<27:55:03,  3.64it/s]
  1%|▏         | 5540/371472 [26:49<27:55:30,  3.64it/s]
                                                        
{'loss': 5.0941, 'learning_rate': 9.870553125471354e-07, 'epoch': 0.24}

  1%|▏         | 5540/371472 [26:49<27:55:30,  3.64it/s]
  1%|▏         | 5541/371472 [26:49<28:07:06,  3.61it/s]
  1%|▏         | 5542/371472 [26:49<29:32:33,  3.44it/s]
  1%|▏         | 5543/371472 [26:50<30:08:36,  3.37it/s]
  1%|▏         | 5544/371472 [26:50<29:51:06,  3.41it/s]
  1%|▏         | 5545/371472 [26:50<28:33:26,  3.56it/s]
  1%|▏         | 5546/371472 [26:51<28:44:11,  3.54it/s]
  1%|▏         | 5547/371472 [26:51<27:37:08,  3.68it/s]
  1%|▏         | 5548/371472 [26:51<27:29:05,  3.70it/s]
  1%|▏         | 5549/371472 [26:51<27:41:40,  3.67it/s]
  1%|▏         | 5550/371472 [26:52<27:42:00,  3.67it/s]
  1%|▏         | 5551/371472 [26:52<27:20:06,  3.72it/s]
  1%|▏         | 5552/371472 [26:52<28:06:44,  3.62it/s]
  1%|▏         | 5553/371472 [26:52<27:31:49,  3.69it/s]
  1%|▏         | 5554/371472 [26:53<28:06:40,  3.62it/s]
  1%|▏         | 5555/371472 [26:53<30:04:06,  3.38it/s]
  1%|▏         | 5556/371472 [26:53<32:07:33,  3.16it/s]
  1%|▏         | 5557/371472 [26:54<30:22:04,  3.35it/s]
  1%|▏         | 5558/371472 [26:54<31:54:04,  3.19it/s]
  1%|▏         | 5559/371472 [26:54<31:35:52,  3.22it/s]
  1%|▏         | 5560/371472 [26:55<30:15:16,  3.36it/s]
                                                        
{'loss': 5.0211, 'learning_rate': 9.870068305716562e-07, 'epoch': 0.24}

  1%|▏         | 5560/371472 [26:55<30:15:16,  3.36it/s]
  1%|▏         | 5561/371472 [26:55<29:06:28,  3.49it/s]
  1%|▏         | 5562/371472 [26:55<28:31:14,  3.56it/s]
  1%|▏         | 5563/371472 [26:55<27:34:59,  3.68it/s]
  1%|▏         | 5564/371472 [26:56<27:48:34,  3.65it/s]
  1%|▏         | 5565/371472 [26:56<27:02:04,  3.76it/s]
  1%|▏         | 5566/371472 [26:56<27:37:03,  3.68it/s]
  1%|▏         | 5567/371472 [26:56<27:07:26,  3.75it/s]
  1%|▏         | 5568/371472 [26:57<27:06:32,  3.75it/s]
  1%|▏         | 5569/371472 [26:57<28:11:33,  3.61it/s]
  1%|▏         | 5570/371472 [26:57<28:49:31,  3.53it/s]
  1%|▏         | 5571/371472 [26:58<27:56:39,  3.64it/s]
  1%|▏         | 5572/371472 [26:58<28:20:11,  3.59it/s]
  2%|▏         | 5573/371472 [26:58<27:18:23,  3.72it/s]
  2%|▏         | 5574/371472 [26:58<27:46:16,  3.66it/s]
  2%|▏         | 5575/371472 [26:59<28:42:36,  3.54it/s]
  2%|▏         | 5576/371472 [26:59<28:15:59,  3.60it/s]
  2%|▏         | 5577/371472 [26:59<28:09:34,  3.61it/s]
  2%|▏         | 5578/371472 [27:00<28:01:49,  3.63it/s]
  2%|▏         | 5579/371472 [27:00<28:14:51,  3.60it/s]
  2%|▏         | 5580/371472 [27:00<27:44:23,  3.66it/s]
                                                        
{'loss': 5.4385, 'learning_rate': 9.869583485961775e-07, 'epoch': 0.24}

  2%|▏         | 5580/371472 [27:00<27:44:23,  3.66it/s]
  2%|▏         | 5581/371472 [27:00<29:13:48,  3.48it/s]
  2%|▏         | 5582/371472 [27:01<28:38:03,  3.55it/s]
  2%|▏         | 5583/371472 [27:01<29:04:28,  3.50it/s]
  2%|▏         | 5584/371472 [27:01<29:21:35,  3.46it/s]
  2%|▏         | 5585/371472 [27:01<28:43:39,  3.54it/s]
  2%|▏         | 5586/371472 [27:02<27:24:11,  3.71it/s]
  2%|▏         | 5587/371472 [27:02<28:36:41,  3.55it/s]
  2%|▏         | 5588/371472 [27:02<27:54:47,  3.64it/s]
  2%|▏         | 5589/371472 [27:03<27:50:08,  3.65it/s]
  2%|▏         | 5590/371472 [27:03<27:43:09,  3.67it/s]
  2%|▏         | 5591/371472 [27:03<27:30:40,  3.69it/s]
  2%|▏         | 5592/371472 [27:03<28:08:59,  3.61it/s]
  2%|▏         | 5593/371472 [27:04<27:36:08,  3.68it/s]
  2%|▏         | 5594/371472 [27:04<29:00:23,  3.50it/s]
  2%|▏         | 5595/371472 [27:04<28:56:32,  3.51it/s]
  2%|▏         | 5596/371472 [27:05<27:54:59,  3.64it/s]
  2%|▏         | 5597/371472 [27:05<27:40:42,  3.67it/s]
  2%|▏         | 5598/371472 [27:05<31:44:59,  3.20it/s]
  2%|▏         | 5599/371472 [27:05<30:15:25,  3.36it/s]
  2%|▏         | 5600/371472 [27:06<29:33:19,  3.44it/s]
                                                        
{'loss': 5.5081, 'learning_rate': 9.869098666206986e-07, 'epoch': 0.24}

  2%|▏         | 5600/371472 [27:06<29:33:19,  3.44it/s]
  2%|▏         | 5601/371472 [27:06<28:42:02,  3.54it/s]
  2%|▏         | 5602/371472 [27:06<28:40:09,  3.54it/s]
  2%|▏         | 5603/371472 [27:07<27:39:18,  3.67it/s]
  2%|▏         | 5604/371472 [27:07<26:48:06,  3.79it/s]
  2%|▏         | 5605/371472 [27:07<27:00:22,  3.76it/s]
  2%|▏         | 5606/371472 [27:07<27:00:45,  3.76it/s]
  2%|▏         | 5607/371472 [27:08<28:08:17,  3.61it/s]
  2%|▏         | 5608/371472 [27:08<27:43:58,  3.66it/s]
  2%|▏         | 5609/371472 [27:08<28:28:49,  3.57it/s]
  2%|▏         | 5610/371472 [27:08<27:53:42,  3.64it/s]
  2%|▏         | 5611/371472 [27:09<27:38:53,  3.68it/s]
  2%|▏         | 5612/371472 [27:09<27:53:33,  3.64it/s]
  2%|▏         | 5613/371472 [27:09<32:34:59,  3.12it/s]
  2%|▏         | 5614/371472 [27:10<30:29:24,  3.33it/s]
  2%|▏         | 5615/371472 [27:10<28:55:12,  3.51it/s]
  2%|▏         | 5616/371472 [27:10<28:24:39,  3.58it/s]
  2%|▏         | 5617/371472 [27:11<30:45:56,  3.30it/s]
  2%|▏         | 5618/371472 [27:11<31:10:27,  3.26it/s]
  2%|▏         | 5619/371472 [27:11<30:05:05,  3.38it/s]
  2%|▏         | 5620/371472 [27:11<30:17:22,  3.36it/s]
                                                        
{'loss': 5.5758, 'learning_rate': 9.868613846452196e-07, 'epoch': 0.24}

  2%|▏         | 5620/371472 [27:11<30:17:22,  3.36it/s]
  2%|▏         | 5621/371472 [27:12<29:01:45,  3.50it/s]
  2%|▏         | 5622/371472 [27:12<28:29:36,  3.57it/s]
  2%|▏         | 5623/371472 [27:12<27:54:17,  3.64it/s]
  2%|▏         | 5624/371472 [27:12<28:25:17,  3.58it/s]
  2%|▏         | 5625/371472 [27:13<28:37:40,  3.55it/s]
  2%|▏         | 5626/371472 [27:13<28:41:03,  3.54it/s]
  2%|▏         | 5627/371472 [27:13<29:47:42,  3.41it/s]
  2%|▏         | 5628/371472 [27:14<29:59:48,  3.39it/s]
  2%|▏         | 5629/371472 [27:14<29:39:46,  3.43it/s]
  2%|▏         | 5630/371472 [27:14<28:54:30,  3.52it/s]
  2%|▏         | 5631/371472 [27:14<27:54:15,  3.64it/s]
  2%|▏         | 5632/371472 [27:15<27:38:27,  3.68it/s]
  2%|▏         | 5633/371472 [27:15<29:16:13,  3.47it/s]
  2%|▏         | 5634/371472 [27:15<28:51:07,  3.52it/s]
  2%|▏         | 5635/371472 [27:16<28:53:22,  3.52it/s]
  2%|▏         | 5636/371472 [27:16<28:41:50,  3.54it/s]
  2%|▏         | 5637/371472 [27:16<28:54:58,  3.51it/s]
  2%|▏         | 5638/371472 [27:16<28:30:25,  3.56it/s]
  2%|▏         | 5639/371472 [27:17<28:37:53,  3.55it/s]
  2%|▏         | 5640/371472 [27:17<28:06:10,  3.62it/s]
                                                        
{'loss': 5.379, 'learning_rate': 9.868129026697407e-07, 'epoch': 0.24}

  2%|▏         | 5640/371472 [27:17<28:06:10,  3.62it/s]
  2%|▏         | 5641/371472 [27:17<27:46:16,  3.66it/s]
  2%|▏         | 5642/371472 [27:18<26:38:46,  3.81it/s]
  2%|▏         | 5643/371472 [27:18<27:20:46,  3.72it/s]
  2%|▏         | 5644/371472 [27:18<27:22:14,  3.71it/s]
  2%|▏         | 5645/371472 [27:18<28:19:53,  3.59it/s]
  2%|▏         | 5646/371472 [27:19<27:56:25,  3.64it/s]
  2%|▏         | 5647/371472 [27:19<27:52:13,  3.65it/s]
  2%|▏         | 5648/371472 [27:19<27:55:16,  3.64it/s]
  2%|▏         | 5649/371472 [27:19<28:14:41,  3.60it/s]
  2%|▏         | 5650/371472 [27:20<28:26:56,  3.57it/s]
  2%|▏         | 5651/371472 [27:20<28:55:56,  3.51it/s]
  2%|▏         | 5652/371472 [27:20<28:22:50,  3.58it/s]
  2%|▏         | 5653/371472 [27:21<28:08:51,  3.61it/s]
  2%|▏         | 5654/371472 [27:21<28:31:53,  3.56it/s]
  2%|▏         | 5655/371472 [27:21<28:27:43,  3.57it/s]
  2%|▏         | 5656/371472 [27:21<27:39:57,  3.67it/s]
  2%|▏         | 5657/371472 [27:22<27:47:27,  3.66it/s]
  2%|▏         | 5658/371472 [27:22<27:12:41,  3.73it/s]
  2%|▏         | 5659/371472 [27:22<28:16:04,  3.59it/s]
  2%|▏         | 5660/371472 [27:23<28:05:03,  3.62it/s]
                                                        
{'loss': 5.5049, 'learning_rate': 9.867644206942618e-07, 'epoch': 0.24}

  2%|▏         | 5660/371472 [27:23<28:05:03,  3.62it/s]
  2%|▏         | 5661/371472 [27:23<28:37:13,  3.55it/s]
  2%|▏         | 5662/371472 [27:23<27:53:22,  3.64it/s]
  2%|▏         | 5663/371472 [27:23<28:18:49,  3.59it/s]
  2%|▏         | 5664/371472 [27:24<28:17:03,  3.59it/s]
  2%|▏         | 5665/371472 [27:24<28:52:27,  3.52it/s]
  2%|▏         | 5666/371472 [27:24<27:39:52,  3.67it/s]
  2%|▏         | 5667/371472 [27:25<29:52:27,  3.40it/s]
  2%|▏         | 5668/371472 [27:25<29:27:26,  3.45it/s]
  2%|▏         | 5669/371472 [27:25<29:12:11,  3.48it/s]
  2%|▏         | 5670/371472 [27:25<29:34:25,  3.44it/s]
  2%|▏         | 5671/371472 [27:26<30:02:11,  3.38it/s]
  2%|▏         | 5672/371472 [27:26<30:30:12,  3.33it/s]
  2%|▏         | 5673/371472 [27:26<31:38:42,  3.21it/s]
  2%|▏         | 5674/371472 [27:27<30:04:01,  3.38it/s]
  2%|▏         | 5675/371472 [27:27<28:51:20,  3.52it/s]
  2%|▏         | 5676/371472 [27:27<30:10:22,  3.37it/s]
  2%|▏         | 5677/371472 [27:27<29:21:06,  3.46it/s]
  2%|▏         | 5678/371472 [27:28<29:46:50,  3.41it/s]
  2%|▏         | 5679/371472 [27:28<28:36:20,  3.55it/s]
  2%|▏         | 5680/371472 [27:28<30:02:51,  3.38it/s]
                                                        
{'loss': 5.2212, 'learning_rate': 9.86715938718783e-07, 'epoch': 0.24}

  2%|▏         | 5680/371472 [27:28<30:02:51,  3.38it/s]
  2%|▏         | 5681/371472 [27:29<28:56:56,  3.51it/s]
  2%|▏         | 5682/371472 [27:29<28:02:39,  3.62it/s]
  2%|▏         | 5683/371472 [27:29<27:23:24,  3.71it/s]
  2%|▏         | 5684/371472 [27:29<27:49:08,  3.65it/s]
  2%|▏         | 5685/371472 [27:30<27:50:07,  3.65it/s]
  2%|▏         | 5686/371472 [27:30<27:25:33,  3.70it/s]
  2%|▏         | 5687/371472 [27:30<30:03:59,  3.38it/s]
  2%|▏         | 5688/371472 [27:31<29:11:29,  3.48it/s]
  2%|▏         | 5689/371472 [27:31<29:54:03,  3.40it/s]
  2%|▏         | 5690/371472 [27:31<29:06:32,  3.49it/s]
  2%|▏         | 5691/371472 [27:31<30:00:33,  3.39it/s]
  2%|▏         | 5692/371472 [27:32<29:01:12,  3.50it/s]
  2%|▏         | 5693/371472 [27:32<28:20:26,  3.59it/s]
  2%|▏         | 5694/371472 [27:32<27:46:35,  3.66it/s]
  2%|▏         | 5695/371472 [27:33<28:36:30,  3.55it/s]
  2%|▏         | 5696/371472 [27:33<31:43:58,  3.20it/s]
  2%|▏         | 5697/371472 [27:33<32:17:36,  3.15it/s]
  2%|▏         | 5698/371472 [27:34<36:00:24,  2.82it/s]
  2%|▏         | 5699/371472 [27:34<34:04:19,  2.98it/s]
  2%|▏         | 5700/371472 [27:34<32:19:04,  3.14it/s]
                                                        
{'loss': 5.1315, 'learning_rate': 9.86667456743304e-07, 'epoch': 0.25}

  2%|▏         | 5700/371472 [27:34<32:19:04,  3.14it/s]
  2%|▏         | 5701/371472 [27:35<31:03:41,  3.27it/s]
  2%|▏         | 5702/371472 [27:35<32:26:37,  3.13it/s]
  2%|▏         | 5703/371472 [27:35<31:46:09,  3.20it/s]
  2%|▏         | 5704/371472 [27:35<30:59:16,  3.28it/s]
  2%|▏         | 5705/371472 [27:36<30:25:00,  3.34it/s]
  2%|▏         | 5706/371472 [27:36<31:11:54,  3.26it/s]
  2%|▏         | 5707/371472 [27:36<29:56:30,  3.39it/s]
  2%|▏         | 5708/371472 [27:37<29:04:13,  3.49it/s]
  2%|▏         | 5709/371472 [27:37<28:25:28,  3.57it/s]
  2%|▏         | 5710/371472 [27:37<28:18:14,  3.59it/s]
  2%|▏         | 5711/371472 [27:38<30:07:03,  3.37it/s]
  2%|▏         | 5712/371472 [27:38<29:04:38,  3.49it/s]
  2%|▏         | 5713/371472 [27:38<33:14:19,  3.06it/s]
  2%|▏         | 5714/371472 [27:39<33:02:48,  3.07it/s]
  2%|▏         | 5715/371472 [27:39<31:28:39,  3.23it/s]
  2%|▏         | 5716/371472 [27:39<31:13:14,  3.25it/s]
  2%|▏         | 5717/371472 [27:39<30:26:03,  3.34it/s]
  2%|▏         | 5718/371472 [27:40<30:13:54,  3.36it/s]
  2%|▏         | 5719/371472 [27:40<31:31:11,  3.22it/s]
  2%|▏         | 5720/371472 [27:40<33:51:40,  3.00it/s]
                                                        
{'loss': 4.9211, 'learning_rate': 9.866189747678252e-07, 'epoch': 0.25}

  2%|▏         | 5720/371472 [27:40<33:51:40,  3.00it/s]
  2%|▏         | 5721/371472 [27:41<31:40:12,  3.21it/s]
  2%|▏         | 5722/371472 [27:41<30:12:22,  3.36it/s]
  2%|▏         | 5723/371472 [27:41<29:01:30,  3.50it/s]
  2%|▏         | 5724/371472 [27:41<30:29:38,  3.33it/s]
  2%|▏         | 5725/371472 [27:42<29:26:12,  3.45it/s]
  2%|▏         | 5726/371472 [27:42<30:05:46,  3.38it/s]
  2%|▏         | 5727/371472 [27:42<28:48:45,  3.53it/s]
  2%|▏         | 5728/371472 [27:43<28:29:19,  3.57it/s]
  2%|▏         | 5729/371472 [27:43<29:01:29,  3.50it/s]
  2%|▏         | 5730/371472 [27:43<28:51:22,  3.52it/s]
  2%|▏         | 5731/371472 [27:43<28:42:55,  3.54it/s]
  2%|▏         | 5732/371472 [27:44<28:34:28,  3.56it/s]
  2%|▏         | 5733/371472 [27:44<27:56:59,  3.63it/s]
  2%|▏         | 5734/371472 [27:44<27:42:31,  3.67it/s]
  2%|▏         | 5735/371472 [27:45<27:50:20,  3.65it/s]
  2%|▏         | 5736/371472 [27:45<28:19:01,  3.59it/s]
  2%|▏         | 5737/371472 [27:45<27:58:34,  3.63it/s]
  2%|▏         | 5738/371472 [27:45<30:59:42,  3.28it/s]
  2%|▏         | 5739/371472 [27:46<29:40:47,  3.42it/s]
  2%|▏         | 5740/371472 [27:46<28:36:31,  3.55it/s]
                                                        
{'loss': 5.2577, 'learning_rate': 9.86570492792346e-07, 'epoch': 0.25}

  2%|▏         | 5740/371472 [27:46<28:36:31,  3.55it/s]
  2%|▏         | 5741/371472 [27:46<29:34:09,  3.44it/s]
  2%|▏         | 5742/371472 [27:47<31:19:32,  3.24it/s]
  2%|▏         | 5743/371472 [27:47<29:45:46,  3.41it/s]
  2%|▏         | 5744/371472 [27:47<29:50:07,  3.41it/s]
  2%|▏         | 5745/371472 [27:48<31:33:02,  3.22it/s]
  2%|▏         | 5746/371472 [27:48<31:03:09,  3.27it/s]
  2%|▏         | 5747/371472 [27:48<29:52:20,  3.40it/s]
  2%|▏         | 5748/371472 [27:48<31:39:56,  3.21it/s]
  2%|▏         | 5749/371472 [27:49<29:55:38,  3.39it/s]
  2%|▏         | 5750/371472 [27:49<29:06:34,  3.49it/s]
  2%|▏         | 5751/371472 [27:49<28:34:11,  3.56it/s]
  2%|▏         | 5752/371472 [27:50<29:06:45,  3.49it/s]
  2%|▏         | 5753/371472 [27:50<28:19:15,  3.59it/s]
  2%|▏         | 5754/371472 [27:50<36:37:59,  2.77it/s]
  2%|▏         | 5755/371472 [27:51<35:37:56,  2.85it/s]
  2%|▏         | 5756/371472 [27:51<34:17:54,  2.96it/s]
  2%|▏         | 5757/371472 [27:51<33:23:51,  3.04it/s]
  2%|▏         | 5758/371472 [27:52<31:27:37,  3.23it/s]
  2%|▏         | 5759/371472 [27:52<31:29:39,  3.23it/s]
  2%|▏         | 5760/371472 [27:52<30:02:56,  3.38it/s]
                                                        
{'loss': 5.1484, 'learning_rate': 9.865220108168674e-07, 'epoch': 0.25}

  2%|▏         | 5760/371472 [27:52<30:02:56,  3.38it/s]
  2%|▏         | 5761/371472 [27:52<28:53:31,  3.52it/s]
  2%|▏         | 5762/371472 [27:53<28:36:58,  3.55it/s]
  2%|▏         | 5763/371472 [27:53<29:56:37,  3.39it/s]
  2%|▏         | 5764/371472 [27:53<31:00:36,  3.28it/s]
  2%|▏         | 5765/371472 [27:54<30:38:37,  3.32it/s]
  2%|▏         | 5766/371472 [27:54<29:41:31,  3.42it/s]
  2%|▏         | 5767/371472 [27:54<29:14:52,  3.47it/s]
  2%|▏         | 5768/371472 [27:54<29:32:40,  3.44it/s]
  2%|▏         | 5769/371472 [27:55<29:28:24,  3.45it/s]
  2%|▏         | 5770/371472 [27:55<28:43:17,  3.54it/s]
  2%|▏         | 5771/371472 [27:55<29:45:44,  3.41it/s]
  2%|▏         | 5772/371472 [27:56<31:06:08,  3.27it/s]
  2%|▏         | 5773/371472 [27:56<31:50:16,  3.19it/s]
  2%|▏         | 5774/371472 [27:56<30:57:57,  3.28it/s]
  2%|▏         | 5775/371472 [27:57<30:10:16,  3.37it/s]
  2%|▏         | 5776/371472 [27:57<29:29:07,  3.45it/s]
  2%|▏         | 5777/371472 [27:57<28:53:30,  3.52it/s]
  2%|▏         | 5778/371472 [27:57<29:57:39,  3.39it/s]
  2%|▏         | 5779/371472 [27:58<29:14:33,  3.47it/s]
  2%|▏         | 5780/371472 [27:58<28:43:44,  3.54it/s]
                                                        
{'loss': 5.2857, 'learning_rate': 9.864735288413884e-07, 'epoch': 0.25}

  2%|▏         | 5780/371472 [27:58<28:43:44,  3.54it/s]
  2%|▏         | 5781/371472 [27:58<28:07:55,  3.61it/s]
  2%|▏         | 5782/371472 [27:59<27:51:39,  3.65it/s]
  2%|▏         | 5783/371472 [27:59<28:48:28,  3.53it/s]
  2%|▏         | 5784/371472 [27:59<29:20:20,  3.46it/s]
  2%|▏         | 5785/371472 [27:59<28:55:32,  3.51it/s]
  2%|▏         | 5786/371472 [28:00<28:23:51,  3.58it/s]
  2%|▏         | 5787/371472 [28:00<28:05:43,  3.62it/s]
  2%|▏         | 5788/371472 [28:00<28:01:42,  3.62it/s]
  2%|▏         | 5789/371472 [28:00<27:43:03,  3.66it/s]
  2%|▏         | 5790/371472 [28:01<27:20:21,  3.72it/s]
  2%|▏         | 5791/371472 [28:01<27:19:45,  3.72it/s]
  2%|▏         | 5792/371472 [28:01<27:26:09,  3.70it/s]
  2%|▏         | 5793/371472 [28:02<27:14:25,  3.73it/s]
  2%|▏         | 5794/371472 [28:02<28:55:32,  3.51it/s]
  2%|▏         | 5795/371472 [28:02<28:09:38,  3.61it/s]
  2%|▏         | 5796/371472 [28:02<28:58:55,  3.50it/s]
  2%|▏         | 5797/371472 [28:03<27:56:34,  3.64it/s]
  2%|▏         | 5798/371472 [28:03<28:10:54,  3.60it/s]
  2%|▏         | 5799/371472 [28:03<27:27:49,  3.70it/s]
  2%|▏         | 5800/371472 [28:04<28:51:10,  3.52it/s]
                                                        
{'loss': 5.1734, 'learning_rate': 9.864250468659095e-07, 'epoch': 0.25}

  2%|▏         | 5800/371472 [28:04<28:51:10,  3.52it/s]
  2%|▏         | 5801/371472 [28:04<29:00:23,  3.50it/s]
  2%|▏         | 5802/371472 [28:04<28:14:48,  3.60it/s]
  2%|▏         | 5803/371472 [28:04<29:30:22,  3.44it/s]
  2%|▏         | 5804/371472 [28:05<28:45:50,  3.53it/s]
  2%|▏         | 5805/371472 [28:05<29:32:43,  3.44it/s]
  2%|▏         | 5806/371472 [28:05<29:35:28,  3.43it/s]
  2%|▏         | 5807/371472 [28:06<28:35:28,  3.55it/s]
  2%|▏         | 5808/371472 [28:06<27:32:30,  3.69it/s]
  2%|▏         | 5809/371472 [28:06<29:46:13,  3.41it/s]
  2%|▏         | 5810/371472 [28:06<29:27:54,  3.45it/s]
  2%|▏         | 5811/371472 [28:07<28:40:42,  3.54it/s]
  2%|▏         | 5812/371472 [28:07<29:07:55,  3.49it/s]
  2%|▏         | 5813/371472 [28:07<29:39:58,  3.42it/s]
  2%|▏         | 5814/371472 [28:08<29:19:54,  3.46it/s]
  2%|▏         | 5815/371472 [28:08<29:37:24,  3.43it/s]
  2%|▏         | 5816/371472 [28:08<30:04:54,  3.38it/s]
  2%|▏         | 5817/371472 [28:08<29:36:13,  3.43it/s]
  2%|▏         | 5818/371472 [28:09<29:11:07,  3.48it/s]
  2%|▏         | 5819/371472 [28:09<29:49:01,  3.41it/s]
  2%|▏         | 5820/371472 [28:09<28:48:15,  3.53it/s]
                                                        
{'loss': 5.3354, 'learning_rate': 9.863765648904308e-07, 'epoch': 0.25}

  2%|▏         | 5820/371472 [28:09<28:48:15,  3.53it/s]
  2%|▏         | 5821/371472 [28:10<28:13:00,  3.60it/s]
  2%|▏         | 5822/371472 [28:10<28:11:42,  3.60it/s]
  2%|▏         | 5823/371472 [28:10<29:41:17,  3.42it/s]
  2%|▏         | 5824/371472 [28:10<29:52:16,  3.40it/s]
  2%|▏         | 5825/371472 [28:11<29:27:18,  3.45it/s]
  2%|▏         | 5826/371472 [28:11<28:56:15,  3.51it/s]
  2%|▏         | 5827/371472 [28:11<28:31:13,  3.56it/s]
  2%|▏         | 5828/371472 [28:12<29:08:45,  3.48it/s]
  2%|▏         | 5829/371472 [28:12<27:37:40,  3.68it/s]
  2%|▏         | 5830/371472 [28:12<29:27:16,  3.45it/s]
  2%|▏         | 5831/371472 [28:12<28:33:11,  3.56it/s]
  2%|▏         | 5832/371472 [28:13<29:39:54,  3.42it/s]
  2%|▏         | 5833/371472 [28:13<28:54:28,  3.51it/s]
  2%|▏         | 5834/371472 [28:13<28:39:19,  3.54it/s]
  2%|▏         | 5835/371472 [28:14<29:46:37,  3.41it/s]
  2%|▏         | 5836/371472 [28:14<29:49:27,  3.41it/s]
  2%|▏         | 5837/371472 [28:14<29:20:01,  3.46it/s]
  2%|▏         | 5838/371472 [28:14<29:09:38,  3.48it/s]
  2%|▏         | 5839/371472 [28:15<29:50:00,  3.40it/s]
  2%|▏         | 5840/371472 [28:15<31:20:51,  3.24it/s]
                                                        
{'loss': 5.2673, 'learning_rate': 9.863280829149519e-07, 'epoch': 0.25}

  2%|▏         | 5840/371472 [28:15<31:20:51,  3.24it/s]
  2%|▏         | 5841/371472 [28:15<30:32:40,  3.33it/s]
  2%|▏         | 5842/371472 [28:16<29:08:49,  3.48it/s]
  2%|▏         | 5843/371472 [28:16<27:56:07,  3.64it/s]
  2%|▏         | 5844/371472 [28:16<27:30:36,  3.69it/s]
  2%|▏         | 5845/371472 [28:16<27:16:10,  3.72it/s]
  2%|▏         | 5846/371472 [28:17<28:57:38,  3.51it/s]
  2%|▏         | 5847/371472 [28:17<28:59:41,  3.50it/s]
  2%|▏         | 5848/371472 [28:17<28:16:03,  3.59it/s]
  2%|▏         | 5849/371472 [28:18<28:09:38,  3.61it/s]
  2%|▏         | 5850/371472 [28:18<28:32:35,  3.56it/s]
  2%|▏         | 5851/371472 [28:18<28:50:34,  3.52it/s]
  2%|▏         | 5852/371472 [28:18<28:56:22,  3.51it/s]
  2%|▏         | 5853/371472 [28:19<28:31:03,  3.56it/s]
  2%|▏         | 5854/371472 [28:19<29:36:52,  3.43it/s]
  2%|▏         | 5855/371472 [28:19<29:32:51,  3.44it/s]
  2%|▏         | 5856/371472 [28:20<30:40:55,  3.31it/s]
  2%|▏         | 5857/371472 [28:20<29:55:56,  3.39it/s]
  2%|▏         | 5858/371472 [28:20<32:07:42,  3.16it/s]
  2%|▏         | 5859/371472 [28:21<30:29:54,  3.33it/s]
  2%|▏         | 5860/371472 [28:21<29:44:53,  3.41it/s]
                                                        
{'loss': 5.1835, 'learning_rate': 9.86279600939473e-07, 'epoch': 0.25}

  2%|▏         | 5860/371472 [28:21<29:44:53,  3.41it/s]
  2%|▏         | 5861/371472 [28:21<28:26:02,  3.57it/s]
  2%|▏         | 5862/371472 [28:21<27:33:28,  3.69it/s]
  2%|▏         | 5863/371472 [28:22<27:38:52,  3.67it/s]
  2%|▏         | 5864/371472 [28:22<27:10:19,  3.74it/s]
  2%|▏         | 5865/371472 [28:22<27:36:41,  3.68it/s]
  2%|▏         | 5866/371472 [28:22<28:38:30,  3.55it/s]
  2%|▏         | 5867/371472 [28:23<28:07:56,  3.61it/s]
  2%|▏         | 5868/371472 [28:23<30:52:39,  3.29it/s]
  2%|▏         | 5869/371472 [28:23<30:27:30,  3.33it/s]
  2%|▏         | 5870/371472 [28:24<29:27:25,  3.45it/s]
  2%|▏         | 5871/371472 [28:24<29:29:46,  3.44it/s]
  2%|▏         | 5872/371472 [28:24<28:07:29,  3.61it/s]
  2%|▏         | 5873/371472 [28:24<28:20:52,  3.58it/s]
  2%|▏         | 5874/371472 [28:25<28:11:07,  3.60it/s]
  2%|▏         | 5875/371472 [28:25<28:03:23,  3.62it/s]
  2%|▏         | 5876/371472 [28:25<28:43:58,  3.53it/s]
  2%|▏         | 5877/371472 [28:26<29:09:37,  3.48it/s]
  2%|▏         | 5878/371472 [28:26<28:52:18,  3.52it/s]
  2%|▏         | 5879/371472 [28:26<28:01:37,  3.62it/s]
  2%|▏         | 5880/371472 [28:26<30:04:41,  3.38it/s]
                                                        
{'loss': 5.1701, 'learning_rate': 9.86231118963994e-07, 'epoch': 0.25}

  2%|▏         | 5880/371472 [28:26<30:04:41,  3.38it/s]
  2%|▏         | 5881/371472 [28:27<29:37:12,  3.43it/s]
  2%|▏         | 5882/371472 [28:27<28:36:39,  3.55it/s]
  2%|▏         | 5883/371472 [28:27<29:06:04,  3.49it/s]
  2%|▏         | 5884/371472 [28:28<29:01:32,  3.50it/s]
  2%|▏         | 5885/371472 [28:28<28:47:00,  3.53it/s]
  2%|▏         | 5886/371472 [28:28<29:03:26,  3.49it/s]
  2%|▏         | 5887/371472 [28:28<28:13:00,  3.60it/s]
  2%|▏         | 5888/371472 [28:29<28:04:00,  3.62it/s]
  2%|▏         | 5889/371472 [28:29<27:42:47,  3.66it/s]
  2%|▏         | 5890/371472 [28:29<27:52:38,  3.64it/s]
  2%|▏         | 5891/371472 [28:30<28:09:01,  3.61it/s]
  2%|▏         | 5892/371472 [28:30<28:09:45,  3.61it/s]
  2%|▏         | 5893/371472 [28:30<27:31:01,  3.69it/s]
  2%|▏         | 5894/371472 [28:30<27:09:51,  3.74it/s]
  2%|▏         | 5895/371472 [28:31<28:18:17,  3.59it/s]
  2%|▏         | 5896/371472 [28:31<29:58:50,  3.39it/s]
  2%|▏         | 5897/371472 [28:31<29:52:55,  3.40it/s]
  2%|▏         | 5898/371472 [28:31<28:53:50,  3.51it/s]
  2%|▏         | 5899/371472 [28:32<29:25:15,  3.45it/s]
  2%|▏         | 5900/371472 [28:32<28:30:29,  3.56it/s]
                                                        
{'loss': 5.2417, 'learning_rate': 9.86182636988515e-07, 'epoch': 0.25}

  2%|▏         | 5900/371472 [28:32<28:30:29,  3.56it/s]
  2%|▏         | 5901/371472 [28:32<28:10:14,  3.60it/s]
  2%|▏         | 5902/371472 [28:33<28:49:56,  3.52it/s]
  2%|▏         | 5903/371472 [28:33<28:38:57,  3.54it/s]
  2%|▏         | 5904/371472 [28:33<28:22:37,  3.58it/s]
  2%|▏         | 5905/371472 [28:33<28:13:08,  3.60it/s]
  2%|▏         | 5906/371472 [28:34<28:04:30,  3.62it/s]
  2%|▏         | 5907/371472 [28:34<28:24:28,  3.57it/s]
  2%|▏         | 5908/371472 [28:34<28:38:41,  3.54it/s]
  2%|▏         | 5909/371472 [28:35<29:19:40,  3.46it/s]
  2%|▏         | 5910/371472 [28:35<28:56:53,  3.51it/s]
  2%|▏         | 5911/371472 [28:35<29:03:38,  3.49it/s]
  2%|▏         | 5912/371472 [28:35<27:53:56,  3.64it/s]
  2%|▏         | 5913/371472 [28:36<27:39:30,  3.67it/s]
  2%|▏         | 5914/371472 [28:36<30:46:03,  3.30it/s]
  2%|▏         | 5915/371472 [28:36<30:40:02,  3.31it/s]
  2%|▏         | 5916/371472 [28:37<33:42:10,  3.01it/s]
  2%|▏         | 5917/371472 [28:37<31:33:53,  3.22it/s]
  2%|▏         | 5918/371472 [28:37<30:14:25,  3.36it/s]
  2%|▏         | 5919/371472 [28:38<29:18:29,  3.46it/s]
  2%|▏         | 5920/371472 [28:38<28:38:43,  3.54it/s]
                                                        
{'loss': 4.9244, 'learning_rate': 9.861341550130364e-07, 'epoch': 0.25}

  2%|▏         | 5920/371472 [28:38<28:38:43,  3.54it/s]
  2%|▏         | 5921/371472 [28:38<28:51:01,  3.52it/s]
  2%|▏         | 5922/371472 [28:38<28:04:23,  3.62it/s]
  2%|▏         | 5923/371472 [28:39<27:58:58,  3.63it/s]
  2%|▏         | 5924/371472 [28:39<29:32:43,  3.44it/s]
  2%|▏         | 5925/371472 [28:39<28:30:16,  3.56it/s]
  2%|▏         | 5926/371472 [28:40<29:22:24,  3.46it/s]
  2%|▏         | 5927/371472 [28:40<28:29:52,  3.56it/s]
  2%|▏         | 5928/371472 [28:40<27:49:24,  3.65it/s]
  2%|▏         | 5929/371472 [28:40<28:14:55,  3.59it/s]
  2%|▏         | 5930/371472 [28:41<28:14:07,  3.60it/s]
  2%|▏         | 5931/371472 [28:41<27:59:56,  3.63it/s]
  2%|▏         | 5932/371472 [28:41<27:01:52,  3.76it/s]
  2%|▏         | 5933/371472 [28:41<27:19:59,  3.71it/s]
  2%|▏         | 5934/371472 [28:42<26:41:25,  3.80it/s]
  2%|▏         | 5935/371472 [28:42<28:38:14,  3.55it/s]
  2%|▏         | 5936/371472 [28:42<29:36:07,  3.43it/s]
  2%|▏         | 5937/371472 [28:43<29:52:27,  3.40it/s]
  2%|▏         | 5938/371472 [28:43<29:24:41,  3.45it/s]
  2%|▏         | 5939/371472 [28:43<31:26:12,  3.23it/s]
  2%|▏         | 5940/371472 [28:44<30:10:44,  3.36it/s]
                                                        
{'loss': 5.0248, 'learning_rate': 9.860856730375572e-07, 'epoch': 0.26}

  2%|▏         | 5940/371472 [28:44<30:10:44,  3.36it/s]
  2%|▏         | 5941/371472 [28:44<28:51:46,  3.52it/s]
  2%|▏         | 5942/371472 [28:44<28:56:40,  3.51it/s]
  2%|▏         | 5943/371472 [28:44<28:22:10,  3.58it/s]
  2%|▏         | 5944/371472 [28:45<27:15:27,  3.73it/s]
  2%|▏         | 5945/371472 [28:45<27:30:52,  3.69it/s]
  2%|▏         | 5946/371472 [28:45<27:16:25,  3.72it/s]
  2%|▏         | 5947/371472 [28:45<26:51:33,  3.78it/s]
  2%|▏         | 5948/371472 [28:46<26:46:26,  3.79it/s]
  2%|▏         | 5949/371472 [28:46<26:42:17,  3.80it/s]
  2%|▏         | 5950/371472 [28:46<27:02:44,  3.75it/s]
  2%|▏         | 5951/371472 [28:46<26:53:02,  3.78it/s]
  2%|▏         | 5952/371472 [28:47<28:11:43,  3.60it/s]
  2%|▏         | 5953/371472 [28:47<27:46:15,  3.66it/s]
  2%|▏         | 5954/371472 [28:47<27:27:30,  3.70it/s]
  2%|▏         | 5955/371472 [28:48<27:15:18,  3.73it/s]
  2%|▏         | 5956/371472 [28:48<27:28:14,  3.70it/s]
  2%|▏         | 5957/371472 [28:48<28:28:06,  3.57it/s]
  2%|▏         | 5958/371472 [28:48<27:53:08,  3.64it/s]
  2%|▏         | 5959/371472 [28:49<28:20:19,  3.58it/s]
  2%|▏         | 5960/371472 [28:49<28:42:43,  3.54it/s]
                                                        
{'loss': 5.362, 'learning_rate': 9.860371910620785e-07, 'epoch': 0.26}

  2%|▏         | 5960/371472 [28:49<28:42:43,  3.54it/s]
  2%|▏         | 5961/371472 [28:49<28:31:45,  3.56it/s]
  2%|▏         | 5962/371472 [28:50<29:30:38,  3.44it/s]
  2%|▏         | 5963/371472 [28:50<28:46:15,  3.53it/s]
  2%|▏         | 5964/371472 [28:50<28:22:44,  3.58it/s]
  2%|▏         | 5965/371472 [28:50<28:53:59,  3.51it/s]
  2%|▏         | 5966/371472 [28:51<28:56:31,  3.51it/s]
  2%|▏         | 5967/371472 [28:51<30:00:28,  3.38it/s]
  2%|▏         | 5968/371472 [28:51<29:11:26,  3.48it/s]
  2%|▏         | 5969/371472 [28:52<29:16:35,  3.47it/s]
  2%|▏         | 5970/371472 [28:52<29:06:36,  3.49it/s]
  2%|▏         | 5971/371472 [28:52<28:10:59,  3.60it/s]
  2%|▏         | 5972/371472 [28:52<28:09:21,  3.61it/s]
  2%|▏         | 5973/371472 [28:53<34:24:35,  2.95it/s]
  2%|▏         | 5974/371472 [28:53<31:46:42,  3.19it/s]
  2%|▏         | 5975/371472 [28:53<30:48:54,  3.29it/s]
  2%|▏         | 5976/371472 [28:54<30:44:32,  3.30it/s]
  2%|▏         | 5977/371472 [28:54<31:33:14,  3.22it/s]
  2%|▏         | 5978/371472 [28:54<30:41:46,  3.31it/s]
  2%|▏         | 5979/371472 [28:55<29:59:47,  3.38it/s]
  2%|▏         | 5980/371472 [28:55<29:30:21,  3.44it/s]
                                                        
{'loss': 4.9936, 'learning_rate': 9.859887090865996e-07, 'epoch': 0.26}

  2%|▏         | 5980/371472 [28:55<29:30:21,  3.44it/s]
  2%|▏         | 5981/371472 [28:55<29:37:04,  3.43it/s]
  2%|▏         | 5982/371472 [28:55<28:37:45,  3.55it/s]
  2%|▏         | 5983/371472 [28:56<28:39:16,  3.54it/s]
  2%|▏         | 5984/371472 [28:56<28:04:04,  3.62it/s]
  2%|▏         | 5985/371472 [28:56<29:02:11,  3.50it/s]
  2%|▏         | 5986/371472 [28:57<29:42:48,  3.42it/s]
  2%|▏         | 5987/371472 [28:57<30:06:01,  3.37it/s]
  2%|▏         | 5988/371472 [28:57<29:59:54,  3.38it/s]
  2%|▏         | 5989/371472 [28:57<29:53:48,  3.40it/s]
  2%|▏         | 5990/371472 [28:58<29:43:53,  3.41it/s]
  2%|▏         | 5991/371472 [28:58<28:34:03,  3.55it/s]
  2%|▏         | 5992/371472 [28:58<27:42:38,  3.66it/s]
  2%|▏         | 5993/371472 [28:58<27:11:18,  3.73it/s]
  2%|▏         | 5994/371472 [28:59<35:01:47,  2.90it/s]
  2%|▏         | 5995/371472 [28:59<33:54:14,  2.99it/s]
  2%|▏         | 5996/371472 [29:00<31:52:50,  3.18it/s]
  2%|▏         | 5997/371472 [29:00<30:48:24,  3.30it/s]
  2%|▏         | 5998/371472 [29:00<30:50:56,  3.29it/s]
  2%|▏         | 5999/371472 [29:00<30:47:10,  3.30it/s]
  2%|▏         | 6000/371472 [29:01<29:44:33,  3.41it/s]
                                                        
{'loss': 5.5917, 'learning_rate': 9.859402271111206e-07, 'epoch': 0.26}

  2%|▏         | 6000/371472 [29:01<29:44:33,  3.41it/s]
  2%|▏         | 6001/371472 [29:01<29:15:56,  3.47it/s]
  2%|▏         | 6002/371472 [29:01<29:31:18,  3.44it/s]
  2%|▏         | 6003/371472 [29:02<28:20:05,  3.58it/s]
  2%|▏         | 6004/371472 [29:02<28:56:22,  3.51it/s]
  2%|▏         | 6005/371472 [29:02<28:40:08,  3.54it/s]
  2%|▏         | 6006/371472 [29:02<28:46:28,  3.53it/s]
  2%|▏         | 6007/371472 [29:03<28:16:32,  3.59it/s]
  2%|▏         | 6008/371472 [29:03<31:13:05,  3.25it/s]
  2%|▏         | 6009/371472 [29:03<30:32:09,  3.32it/s]
  2%|▏         | 6010/371472 [29:04<31:07:38,  3.26it/s]
  2%|▏         | 6011/371472 [29:04<30:19:00,  3.35it/s]
  2%|▏         | 6012/371472 [29:04<29:48:06,  3.41it/s]
  2%|▏         | 6013/371472 [29:05<29:12:53,  3.47it/s]
  2%|▏         | 6014/371472 [29:05<28:25:11,  3.57it/s]
  2%|▏         | 6015/371472 [29:05<36:50:22,  2.76it/s]
  2%|▏         | 6016/371472 [29:06<35:17:31,  2.88it/s]
  2%|▏         | 6017/371472 [29:06<32:29:07,  3.12it/s]
  2%|▏         | 6018/371472 [29:06<36:52:43,  2.75it/s]
  2%|▏         | 6019/371472 [29:07<34:46:33,  2.92it/s]
  2%|▏         | 6020/371472 [29:07<32:28:35,  3.13it/s]
                                                        
{'loss': 5.1554, 'learning_rate': 9.858917451356417e-07, 'epoch': 0.26}

  2%|▏         | 6020/371472 [29:07<32:28:35,  3.13it/s]
  2%|▏         | 6021/371472 [29:07<32:17:43,  3.14it/s]
  2%|▏         | 6022/371472 [29:08<31:27:46,  3.23it/s]
  2%|▏         | 6023/371472 [29:08<30:23:07,  3.34it/s]
  2%|▏         | 6024/371472 [29:08<30:35:51,  3.32it/s]
  2%|▏         | 6025/371472 [29:08<29:23:05,  3.45it/s]
  2%|▏         | 6026/371472 [29:09<28:55:40,  3.51it/s]
  2%|▏         | 6027/371472 [29:09<28:49:26,  3.52it/s]
  2%|▏         | 6028/371472 [29:09<28:50:17,  3.52it/s]
  2%|▏         | 6029/371472 [29:10<29:13:34,  3.47it/s]
  2%|▏         | 6030/371472 [29:10<30:17:12,  3.35it/s]
  2%|▏         | 6031/371472 [29:10<29:43:58,  3.41it/s]
  2%|▏         | 6032/371472 [29:10<28:30:42,  3.56it/s]
  2%|▏         | 6033/371472 [29:11<29:20:57,  3.46it/s]
  2%|▏         | 6034/371472 [29:11<29:16:54,  3.47it/s]
  2%|▏         | 6035/371472 [29:11<29:06:27,  3.49it/s]
  2%|▏         | 6036/371472 [29:12<30:24:00,  3.34it/s]
  2%|▏         | 6037/371472 [29:12<29:20:52,  3.46it/s]
  2%|▏         | 6038/371472 [29:12<29:12:32,  3.48it/s]
  2%|▏         | 6039/371472 [29:12<28:14:37,  3.59it/s]
  2%|▏         | 6040/371472 [29:13<28:28:48,  3.56it/s]
                                                        
{'loss': 5.3179, 'learning_rate': 9.858432631601628e-07, 'epoch': 0.26}

  2%|▏         | 6040/371472 [29:13<28:28:48,  3.56it/s]
  2%|▏         | 6041/371472 [29:13<28:00:57,  3.62it/s]
  2%|▏         | 6042/371472 [29:13<29:25:09,  3.45it/s]
  2%|▏         | 6043/371472 [29:14<28:49:50,  3.52it/s]
  2%|▏         | 6044/371472 [29:14<29:20:13,  3.46it/s]
  2%|▏         | 6045/371472 [29:14<28:09:48,  3.60it/s]
  2%|▏         | 6046/371472 [29:14<31:15:54,  3.25it/s]
  2%|▏         | 6047/371472 [29:15<30:29:55,  3.33it/s]
  2%|▏         | 6048/371472 [29:15<29:28:20,  3.44it/s]
  2%|▏         | 6049/371472 [29:15<31:49:10,  3.19it/s]
  2%|▏         | 6050/371472 [29:16<31:36:01,  3.21it/s]
  2%|▏         | 6051/371472 [29:16<32:14:47,  3.15it/s]
  2%|▏         | 6052/371472 [29:16<31:27:02,  3.23it/s]
  2%|▏         | 6053/371472 [29:17<29:31:01,  3.44it/s]
  2%|▏         | 6054/371472 [29:17<29:04:56,  3.49it/s]
  2%|▏         | 6055/371472 [29:17<29:27:47,  3.45it/s]
  2%|▏         | 6056/371472 [29:17<28:41:07,  3.54it/s]
  2%|▏         | 6057/371472 [29:18<28:36:30,  3.55it/s]
  2%|▏         | 6058/371472 [29:18<28:08:13,  3.61it/s]
  2%|▏         | 6059/371472 [29:18<30:07:06,  3.37it/s]
  2%|▏         | 6060/371472 [29:19<29:17:17,  3.47it/s]
                                                        
{'loss': 5.2851, 'learning_rate': 9.85794781184684e-07, 'epoch': 0.26}

  2%|▏         | 6060/371472 [29:19<29:17:17,  3.47it/s]
  2%|▏         | 6061/371472 [29:19<28:53:30,  3.51it/s]
  2%|▏         | 6062/371472 [29:19<27:43:25,  3.66it/s]
  2%|▏         | 6063/371472 [29:19<28:23:14,  3.58it/s]
  2%|▏         | 6064/371472 [29:20<27:18:37,  3.72it/s]
  2%|▏         | 6065/371472 [29:20<29:07:06,  3.49it/s]
  2%|▏         | 6066/371472 [29:20<28:27:45,  3.57it/s]
  2%|▏         | 6067/371472 [29:20<28:28:35,  3.56it/s]
  2%|▏         | 6068/371472 [29:21<27:49:02,  3.65it/s]
  2%|▏         | 6069/371472 [29:21<27:19:26,  3.71it/s]
  2%|▏         | 6070/371472 [29:21<27:26:16,  3.70it/s]
  2%|▏         | 6071/371472 [29:22<27:20:28,  3.71it/s]
  2%|▏         | 6072/371472 [29:22<28:46:21,  3.53it/s]
  2%|▏         | 6073/371472 [29:22<29:06:11,  3.49it/s]
  2%|▏         | 6074/371472 [29:22<28:13:03,  3.60it/s]
  2%|▏         | 6075/371472 [29:23<30:43:34,  3.30it/s]
  2%|▏         | 6076/371472 [29:23<29:14:13,  3.47it/s]
  2%|▏         | 6077/371472 [29:23<28:53:55,  3.51it/s]
  2%|▏         | 6078/371472 [29:24<28:09:11,  3.61it/s]
  2%|▏         | 6079/371472 [29:24<28:02:42,  3.62it/s]
  2%|▏         | 6080/371472 [29:24<27:05:56,  3.75it/s]
                                                        
{'loss': 5.2355, 'learning_rate': 9.857462992092051e-07, 'epoch': 0.26}

  2%|▏         | 6080/371472 [29:24<27:05:56,  3.75it/s]
  2%|▏         | 6081/371472 [29:24<27:48:22,  3.65it/s]
  2%|▏         | 6082/371472 [29:25<29:26:43,  3.45it/s]
  2%|▏         | 6083/371472 [29:25<33:03:10,  3.07it/s]
  2%|▏         | 6084/371472 [29:25<31:27:07,  3.23it/s]
  2%|▏         | 6085/371472 [29:26<30:22:08,  3.34it/s]
  2%|▏         | 6086/371472 [29:26<30:15:46,  3.35it/s]
  2%|▏         | 6087/371472 [29:26<29:33:24,  3.43it/s]
  2%|▏         | 6088/371472 [29:26<29:17:02,  3.47it/s]
  2%|▏         | 6089/371472 [29:27<28:45:01,  3.53it/s]
  2%|▏         | 6090/371472 [29:27<28:39:57,  3.54it/s]
  2%|▏         | 6091/371472 [29:27<28:37:08,  3.55it/s]
  2%|▏         | 6092/371472 [29:28<27:44:35,  3.66it/s]
  2%|▏         | 6093/371472 [29:28<27:12:48,  3.73it/s]
  2%|▏         | 6094/371472 [29:28<27:31:45,  3.69it/s]
  2%|▏         | 6095/371472 [29:28<27:59:31,  3.63it/s]
  2%|▏         | 6096/371472 [29:29<28:31:04,  3.56it/s]
  2%|▏         | 6097/371472 [29:29<28:54:09,  3.51it/s]
  2%|▏         | 6098/371472 [29:29<28:58:26,  3.50it/s]
  2%|▏         | 6099/371472 [29:30<29:14:17,  3.47it/s]
  2%|▏         | 6100/371472 [29:30<28:11:22,  3.60it/s]
                                                        
{'loss': 5.2866, 'learning_rate': 9.856978172337262e-07, 'epoch': 0.26}

  2%|▏         | 6100/371472 [29:30<28:11:22,  3.60it/s]
  2%|▏         | 6101/371472 [29:30<30:05:58,  3.37it/s]
  2%|▏         | 6102/371472 [29:30<29:15:00,  3.47it/s]
  2%|▏         | 6103/371472 [29:31<28:29:35,  3.56it/s]
  2%|▏         | 6104/371472 [29:31<28:03:22,  3.62it/s]
  2%|▏         | 6105/371472 [29:31<29:59:19,  3.38it/s]
  2%|▏         | 6106/371472 [29:32<28:29:28,  3.56it/s]
  2%|▏         | 6107/371472 [29:32<27:44:27,  3.66it/s]
  2%|▏         | 6108/371472 [29:32<28:24:57,  3.57it/s]
  2%|▏         | 6109/371472 [29:32<28:05:34,  3.61it/s]
  2%|▏         | 6110/371472 [29:33<28:31:21,  3.56it/s]
  2%|▏         | 6111/371472 [29:33<27:50:24,  3.65it/s]
  2%|▏         | 6112/371472 [29:33<28:19:32,  3.58it/s]
  2%|▏         | 6113/371472 [29:33<27:47:55,  3.65it/s]
  2%|▏         | 6114/371472 [29:34<27:14:53,  3.72it/s]
  2%|▏         | 6115/371472 [29:34<29:51:45,  3.40it/s]
  2%|▏         | 6116/371472 [29:34<29:59:25,  3.38it/s]
  2%|▏         | 6117/371472 [29:35<30:31:48,  3.32it/s]
  2%|▏         | 6118/371472 [29:35<30:31:24,  3.32it/s]
  2%|▏         | 6119/371472 [29:35<30:25:06,  3.34it/s]
  2%|▏         | 6120/371472 [29:36<29:13:36,  3.47it/s]
                                                        
{'loss': 5.2053, 'learning_rate': 9.85649335258247e-07, 'epoch': 0.26}

  2%|▏         | 6120/371472 [29:36<29:13:36,  3.47it/s]
  2%|▏         | 6121/371472 [29:36<28:35:40,  3.55it/s]
  2%|▏         | 6122/371472 [29:36<28:24:17,  3.57it/s]
  2%|▏         | 6123/371472 [29:36<28:57:00,  3.51it/s]
  2%|▏         | 6124/371472 [29:37<28:29:06,  3.56it/s]
  2%|▏         | 6125/371472 [29:37<29:10:31,  3.48it/s]
  2%|▏         | 6126/371472 [29:37<29:56:09,  3.39it/s]
  2%|▏         | 6127/371472 [29:38<29:31:29,  3.44it/s]
  2%|▏         | 6128/371472 [29:38<30:37:35,  3.31it/s]
  2%|▏         | 6129/371472 [29:38<29:35:58,  3.43it/s]
  2%|▏         | 6130/371472 [29:38<29:29:45,  3.44it/s]
  2%|▏         | 6131/371472 [29:39<29:28:38,  3.44it/s]
  2%|▏         | 6132/371472 [29:39<30:34:55,  3.32it/s]
  2%|▏         | 6133/371472 [29:39<29:51:51,  3.40it/s]
  2%|▏         | 6134/371472 [29:40<29:24:32,  3.45it/s]
  2%|▏         | 6135/371472 [29:40<30:26:13,  3.33it/s]
  2%|▏         | 6136/371472 [29:40<29:13:42,  3.47it/s]
  2%|▏         | 6137/371472 [29:40<29:00:33,  3.50it/s]
  2%|▏         | 6138/371472 [29:41<28:45:28,  3.53it/s]
  2%|▏         | 6139/371472 [29:41<28:33:43,  3.55it/s]
  2%|▏         | 6140/371472 [29:41<29:10:42,  3.48it/s]
                                                        
{'loss': 5.0226, 'learning_rate': 9.856008532827684e-07, 'epoch': 0.26}

  2%|▏         | 6140/371472 [29:41<29:10:42,  3.48it/s]
  2%|▏         | 6141/371472 [29:42<30:09:44,  3.36it/s]
  2%|▏         | 6142/371472 [29:42<29:22:24,  3.45it/s]
  2%|▏         | 6143/371472 [29:42<29:21:35,  3.46it/s]
  2%|▏         | 6144/371472 [29:43<29:35:08,  3.43it/s]
  2%|▏         | 6145/371472 [29:43<29:10:41,  3.48it/s]
  2%|▏         | 6146/371472 [29:43<28:36:01,  3.55it/s]
  2%|▏         | 6147/371472 [29:43<28:09:46,  3.60it/s]
  2%|▏         | 6148/371472 [29:44<29:54:08,  3.39it/s]
  2%|▏         | 6149/371472 [29:44<30:48:34,  3.29it/s]
  2%|▏         | 6150/371472 [29:44<29:56:03,  3.39it/s]
  2%|▏         | 6151/371472 [29:45<31:14:20,  3.25it/s]
  2%|▏         | 6152/371472 [29:45<30:19:29,  3.35it/s]
  2%|▏         | 6153/371472 [29:45<29:36:42,  3.43it/s]
  2%|▏         | 6154/371472 [29:45<28:44:10,  3.53it/s]
  2%|▏         | 6155/371472 [29:46<29:19:47,  3.46it/s]
  2%|▏         | 6156/371472 [29:46<29:33:39,  3.43it/s]
  2%|▏         | 6157/371472 [29:46<28:49:55,  3.52it/s]
  2%|▏         | 6158/371472 [29:47<28:12:31,  3.60it/s]
  2%|▏         | 6159/371472 [29:47<27:40:09,  3.67it/s]
  2%|▏         | 6160/371472 [29:47<29:11:23,  3.48it/s]
                                                        
{'loss': 5.2522, 'learning_rate': 9.855523713072894e-07, 'epoch': 0.27}

  2%|▏         | 6160/371472 [29:47<29:11:23,  3.48it/s]
  2%|▏         | 6161/371472 [29:47<28:26:21,  3.57it/s]
  2%|▏         | 6162/371472 [29:48<28:42:05,  3.54it/s]
  2%|▏         | 6163/371472 [29:48<30:16:05,  3.35it/s]
  2%|▏         | 6164/371472 [29:48<30:51:42,  3.29it/s]
  2%|▏         | 6165/371472 [29:49<31:02:43,  3.27it/s]
  2%|▏         | 6166/371472 [29:49<30:02:58,  3.38it/s]
  2%|▏         | 6167/371472 [29:49<30:13:20,  3.36it/s]
  2%|▏         | 6168/371472 [29:50<30:45:24,  3.30it/s]
  2%|▏         | 6169/371472 [29:50<30:54:06,  3.28it/s]
  2%|▏         | 6170/371472 [29:50<29:02:01,  3.49it/s]
  2%|▏         | 6171/371472 [29:50<28:32:51,  3.55it/s]
  2%|▏         | 6172/371472 [29:51<29:30:27,  3.44it/s]
  2%|▏         | 6173/371472 [29:51<31:13:08,  3.25it/s]
  2%|▏         | 6174/371472 [29:51<29:44:54,  3.41it/s]
  2%|▏         | 6175/371472 [29:52<28:45:42,  3.53it/s]
  2%|▏         | 6176/371472 [29:52<29:05:48,  3.49it/s]
  2%|▏         | 6177/371472 [29:52<28:11:07,  3.60it/s]
  2%|▏         | 6178/371472 [29:52<28:12:27,  3.60it/s]
  2%|▏         | 6179/371472 [29:53<27:48:21,  3.65it/s]
  2%|▏         | 6180/371472 [29:53<27:56:44,  3.63it/s]
                                                        
{'loss': 5.101, 'learning_rate': 9.855038893318105e-07, 'epoch': 0.27}

  2%|▏         | 6180/371472 [29:53<27:56:44,  3.63it/s]
  2%|▏         | 6181/371472 [29:53<29:06:47,  3.49it/s]
  2%|▏         | 6182/371472 [29:54<29:27:51,  3.44it/s]
  2%|▏         | 6183/371472 [29:54<29:42:05,  3.42it/s]
  2%|▏         | 6184/371472 [29:54<29:50:02,  3.40it/s]
  2%|▏         | 6185/371472 [29:54<29:10:33,  3.48it/s]
  2%|▏         | 6186/371472 [29:55<28:49:19,  3.52it/s]
  2%|▏         | 6187/371472 [29:55<28:54:01,  3.51it/s]
  2%|▏         | 6188/371472 [29:55<29:57:10,  3.39it/s]
  2%|▏         | 6189/371472 [29:56<29:19:27,  3.46it/s]
  2%|▏         | 6190/371472 [29:56<28:18:17,  3.58it/s]
  2%|▏         | 6191/371472 [29:56<29:55:03,  3.39it/s]
  2%|▏         | 6192/371472 [29:56<28:25:00,  3.57it/s]
  2%|▏         | 6193/371472 [29:57<27:55:30,  3.63it/s]
  2%|▏         | 6194/371472 [29:57<27:52:29,  3.64it/s]
  2%|▏         | 6195/371472 [29:57<28:24:39,  3.57it/s]
  2%|▏         | 6196/371472 [29:57<28:19:47,  3.58it/s]
  2%|▏         | 6197/371472 [29:58<29:59:11,  3.38it/s]
  2%|▏         | 6198/371472 [29:58<30:10:09,  3.36it/s]
  2%|▏         | 6199/371472 [29:58<29:15:51,  3.47it/s]
  2%|▏         | 6200/371472 [29:59<30:11:00,  3.36it/s]
                                                        
{'loss': 5.272, 'learning_rate': 9.854554073563318e-07, 'epoch': 0.27}

  2%|▏         | 6200/371472 [29:59<30:11:00,  3.36it/s]
  2%|▏         | 6201/371472 [29:59<31:33:34,  3.22it/s]
  2%|▏         | 6202/371472 [29:59<32:11:36,  3.15it/s]
  2%|▏         | 6203/371472 [30:00<30:49:45,  3.29it/s]
  2%|▏         | 6204/371472 [30:00<29:19:23,  3.46it/s]
  2%|▏         | 6205/371472 [30:00<28:51:05,  3.52it/s]
  2%|▏         | 6206/371472 [30:00<28:19:50,  3.58it/s]
  2%|▏         | 6207/371472 [30:01<29:07:44,  3.48it/s]
  2%|▏         | 6208/371472 [30:01<29:22:53,  3.45it/s]
  2%|▏         | 6209/371472 [30:01<29:12:54,  3.47it/s]
  2%|▏         | 6210/371472 [30:02<30:21:47,  3.34it/s]
  2%|▏         | 6211/371472 [30:02<30:27:33,  3.33it/s]
  2%|▏         | 6212/371472 [30:02<29:38:23,  3.42it/s]
  2%|▏         | 6213/371472 [30:03<29:00:41,  3.50it/s]
  2%|▏         | 6214/371472 [30:03<28:45:12,  3.53it/s]
  2%|▏         | 6215/371472 [30:03<30:06:18,  3.37it/s]
  2%|▏         | 6216/371472 [30:03<29:50:35,  3.40it/s]
  2%|▏         | 6217/371472 [30:04<28:32:08,  3.56it/s]
  2%|▏         | 6218/371472 [30:04<28:42:41,  3.53it/s]
  2%|▏         | 6219/371472 [30:04<28:44:32,  3.53it/s]
  2%|▏         | 6220/371472 [30:05<28:51:56,  3.51it/s]
                                                        
{'loss': 5.2802, 'learning_rate': 9.854069253808529e-07, 'epoch': 0.27}

  2%|▏         | 6220/371472 [30:05<28:51:56,  3.51it/s]
  2%|▏         | 6221/371472 [30:05<28:45:28,  3.53it/s]
  2%|▏         | 6222/371472 [30:05<30:15:14,  3.35it/s]
  2%|▏         | 6223/371472 [30:05<29:34:23,  3.43it/s]
  2%|▏         | 6224/371472 [30:06<32:15:33,  3.15it/s]
  2%|▏         | 6225/371472 [30:06<32:06:58,  3.16it/s]
  2%|▏         | 6226/371472 [30:06<31:00:09,  3.27it/s]
  2%|▏         | 6227/371472 [30:07<31:58:03,  3.17it/s]
  2%|▏         | 6228/371472 [30:07<30:15:35,  3.35it/s]
  2%|▏         | 6229/371472 [30:07<29:58:03,  3.39it/s]
  2%|▏         | 6230/371472 [30:08<29:53:01,  3.40it/s]
  2%|▏         | 6231/371472 [30:08<30:08:02,  3.37it/s]
  2%|▏         | 6232/371472 [30:08<29:17:49,  3.46it/s]
  2%|▏         | 6233/371472 [30:09<32:00:53,  3.17it/s]
  2%|▏         | 6234/371472 [30:09<30:44:04,  3.30it/s]
  2%|▏         | 6235/371472 [30:09<30:43:18,  3.30it/s]
  2%|▏         | 6236/371472 [30:09<29:52:33,  3.40it/s]
  2%|▏         | 6237/371472 [30:10<29:16:37,  3.47it/s]
  2%|▏         | 6238/371472 [30:10<28:41:28,  3.54it/s]
  2%|▏         | 6239/371472 [30:10<29:11:06,  3.48it/s]
  2%|▏         | 6240/371472 [30:10<28:59:33,  3.50it/s]
                                                        
{'loss': 5.3429, 'learning_rate': 9.85358443405374e-07, 'epoch': 0.27}

  2%|▏         | 6240/371472 [30:10<28:59:33,  3.50it/s]
  2%|▏         | 6241/371472 [30:11<31:12:46,  3.25it/s]
  2%|▏         | 6242/371472 [30:11<30:01:00,  3.38it/s]
  2%|▏         | 6243/371472 [30:11<29:06:52,  3.48it/s]
  2%|▏         | 6244/371472 [30:12<28:14:11,  3.59it/s]
  2%|▏         | 6245/371472 [30:12<28:00:00,  3.62it/s]
  2%|▏         | 6246/371472 [30:12<27:16:59,  3.72it/s]
  2%|▏         | 6247/371472 [30:12<27:50:55,  3.64it/s]
  2%|▏         | 6248/371472 [30:13<27:34:25,  3.68it/s]
  2%|▏         | 6249/371472 [30:13<27:24:03,  3.70it/s]
  2%|▏         | 6250/371472 [30:13<27:03:55,  3.75it/s]
  2%|▏         | 6251/371472 [30:14<29:43:00,  3.41it/s]
  2%|▏         | 6252/371472 [30:14<29:52:19,  3.40it/s]
  2%|▏         | 6253/371472 [30:14<29:00:48,  3.50it/s]
  2%|▏         | 6254/371472 [30:14<28:29:21,  3.56it/s]
  2%|▏         | 6255/371472 [30:15<28:22:38,  3.58it/s]
  2%|▏         | 6256/371472 [30:15<32:23:25,  3.13it/s]
  2%|▏         | 6257/371472 [30:15<31:05:52,  3.26it/s]
  2%|▏         | 6258/371472 [30:16<30:11:08,  3.36it/s]
  2%|▏         | 6259/371472 [30:16<29:37:12,  3.42it/s]
  2%|▏         | 6260/371472 [30:16<30:25:54,  3.33it/s]
                                                        
{'loss': 5.3596, 'learning_rate': 9.85309961429895e-07, 'epoch': 0.27}

  2%|▏         | 6260/371472 [30:16<30:25:54,  3.33it/s]
  2%|▏         | 6261/371472 [30:17<29:53:44,  3.39it/s]
  2%|▏         | 6262/371472 [30:17<30:27:21,  3.33it/s]
  2%|▏         | 6263/371472 [30:17<31:52:43,  3.18it/s]
  2%|▏         | 6264/371472 [30:17<29:54:20,  3.39it/s]
  2%|▏         | 6265/371472 [30:18<29:18:43,  3.46it/s]
  2%|▏         | 6266/371472 [30:18<28:47:05,  3.52it/s]
  2%|▏         | 6267/371472 [30:18<29:01:01,  3.50it/s]
  2%|▏         | 6268/371472 [30:19<28:44:49,  3.53it/s]
  2%|▏         | 6269/371472 [30:19<31:57:52,  3.17it/s]
  2%|▏         | 6270/371472 [30:19<32:10:26,  3.15it/s]
  2%|▏         | 6271/371472 [30:20<32:19:37,  3.14it/s]
  2%|▏         | 6272/371472 [30:20<32:29:36,  3.12it/s]
  2%|▏         | 6273/371472 [30:20<32:31:52,  3.12it/s]
  2%|▏         | 6274/371472 [30:21<31:56:15,  3.18it/s]
  2%|▏         | 6275/371472 [30:21<31:29:54,  3.22it/s]
  2%|▏         | 6276/371472 [30:21<30:03:10,  3.38it/s]
  2%|▏         | 6277/371472 [30:21<29:33:36,  3.43it/s]
  2%|▏         | 6278/371472 [30:22<31:41:41,  3.20it/s]
  2%|▏         | 6279/371472 [30:22<30:54:54,  3.28it/s]
  2%|▏         | 6280/371472 [30:22<30:37:06,  3.31it/s]
                                                        
{'loss': 4.9346, 'learning_rate': 9.85261479454416e-07, 'epoch': 0.27}

  2%|▏         | 6280/371472 [30:22<30:37:06,  3.31it/s]
  2%|▏         | 6281/371472 [30:23<29:34:24,  3.43it/s]
  2%|▏         | 6282/371472 [30:23<28:57:36,  3.50it/s]
  2%|▏         | 6283/371472 [30:23<30:17:42,  3.35it/s]
  2%|▏         | 6284/371472 [30:24<31:37:12,  3.21it/s]
  2%|▏         | 6285/371472 [30:24<30:55:49,  3.28it/s]
  2%|▏         | 6286/371472 [30:24<29:36:18,  3.43it/s]
  2%|▏         | 6287/371472 [30:24<29:18:29,  3.46it/s]
  2%|▏         | 6288/371472 [30:25<28:24:49,  3.57it/s]
  2%|▏         | 6289/371472 [30:25<29:27:35,  3.44it/s]
  2%|▏         | 6290/371472 [30:25<29:27:55,  3.44it/s]
  2%|▏         | 6291/371472 [30:26<30:46:37,  3.30it/s]
  2%|▏         | 6292/371472 [30:26<30:16:13,  3.35it/s]
  2%|▏         | 6293/371472 [30:26<29:08:26,  3.48it/s]
  2%|▏         | 6294/371472 [30:26<28:48:45,  3.52it/s]
  2%|▏         | 6295/371472 [30:27<28:02:12,  3.62it/s]
  2%|▏         | 6296/371472 [30:27<27:43:46,  3.66it/s]
  2%|▏         | 6297/371472 [30:27<28:07:24,  3.61it/s]
  2%|▏         | 6298/371472 [30:27<27:59:31,  3.62it/s]
  2%|▏         | 6299/371472 [30:28<28:05:22,  3.61it/s]
  2%|▏         | 6300/371472 [30:28<27:33:49,  3.68it/s]
                                                        
{'loss': 5.178, 'learning_rate': 9.852129974789373e-07, 'epoch': 0.27}

  2%|▏         | 6300/371472 [30:28<27:33:49,  3.68it/s]
  2%|▏         | 6301/371472 [30:28<28:05:52,  3.61it/s]
  2%|▏         | 6302/371472 [30:29<27:13:11,  3.73it/s]
  2%|▏         | 6303/371472 [30:29<28:09:02,  3.60it/s]
  2%|▏         | 6304/371472 [30:29<27:37:51,  3.67it/s]
  2%|▏         | 6305/371472 [30:29<30:15:04,  3.35it/s]
  2%|▏         | 6306/371472 [30:30<30:25:03,  3.33it/s]
  2%|▏         | 6307/371472 [30:30<30:58:40,  3.27it/s]
  2%|▏         | 6308/371472 [30:30<31:25:55,  3.23it/s]
  2%|▏         | 6309/371472 [30:31<31:42:25,  3.20it/s]
  2%|▏         | 6310/371472 [30:31<30:38:19,  3.31it/s]
  2%|▏         | 6311/371472 [30:31<31:18:02,  3.24it/s]
  2%|▏         | 6312/371472 [30:32<29:53:38,  3.39it/s]
  2%|▏         | 6313/371472 [30:32<30:47:39,  3.29it/s]
  2%|▏         | 6314/371472 [30:32<30:13:22,  3.36it/s]
  2%|▏         | 6315/371472 [30:32<29:36:15,  3.43it/s]
  2%|▏         | 6316/371472 [30:33<28:44:49,  3.53it/s]
  2%|▏         | 6317/371472 [30:33<29:19:23,  3.46it/s]
  2%|▏         | 6318/371472 [30:33<29:20:43,  3.46it/s]
  2%|▏         | 6319/371472 [30:34<28:25:33,  3.57it/s]
  2%|▏         | 6320/371472 [30:34<29:34:30,  3.43it/s]
                                                        
{'loss': 5.266, 'learning_rate': 9.851645155034582e-07, 'epoch': 0.27}

  2%|▏         | 6320/371472 [30:34<29:34:30,  3.43it/s]
  2%|▏         | 6321/371472 [30:34<29:08:18,  3.48it/s]
  2%|▏         | 6322/371472 [30:34<28:30:18,  3.56it/s]
  2%|▏         | 6323/371472 [30:35<27:28:05,  3.69it/s]
  2%|▏         | 6324/371472 [30:35<28:16:51,  3.59it/s]
  2%|▏         | 6325/371472 [30:35<28:40:01,  3.54it/s]
  2%|▏         | 6326/371472 [30:36<28:39:15,  3.54it/s]
  2%|▏         | 6327/371472 [30:36<28:25:41,  3.57it/s]
  2%|▏         | 6328/371472 [30:36<28:43:19,  3.53it/s]
  2%|▏         | 6329/371472 [30:36<30:24:15,  3.34it/s]
  2%|▏         | 6330/371472 [30:37<29:19:41,  3.46it/s]
  2%|▏         | 6331/371472 [30:37<28:43:25,  3.53it/s]
  2%|▏         | 6332/371472 [30:37<28:03:18,  3.62it/s]
  2%|▏         | 6333/371472 [30:38<28:32:03,  3.55it/s]
  2%|▏         | 6334/371472 [30:38<27:39:30,  3.67it/s]
  2%|▏         | 6335/371472 [30:38<28:41:44,  3.53it/s]
  2%|▏         | 6336/371472 [30:38<29:28:43,  3.44it/s]
  2%|▏         | 6337/371472 [30:39<28:42:02,  3.53it/s]
  2%|▏         | 6338/371472 [30:39<28:17:13,  3.59it/s]
  2%|▏         | 6339/371472 [30:39<28:41:36,  3.53it/s]
  2%|▏         | 6340/371472 [30:40<27:52:35,  3.64it/s]
                                                        
{'loss': 5.205, 'learning_rate': 9.851160335279795e-07, 'epoch': 0.27}

  2%|▏         | 6340/371472 [30:40<27:52:35,  3.64it/s]
  2%|▏         | 6341/371472 [30:40<31:27:16,  3.22it/s]
  2%|▏         | 6342/371472 [30:40<30:04:04,  3.37it/s]
  2%|▏         | 6343/371472 [30:40<29:42:43,  3.41it/s]
  2%|▏         | 6344/371472 [30:41<29:56:41,  3.39it/s]
  2%|▏         | 6345/371472 [30:41<29:50:11,  3.40it/s]
  2%|▏         | 6346/371472 [30:41<28:16:48,  3.59it/s]
  2%|▏         | 6347/371472 [30:42<29:22:33,  3.45it/s]
  2%|▏         | 6348/371472 [30:42<30:37:42,  3.31it/s]
  2%|▏         | 6349/371472 [30:42<31:02:36,  3.27it/s]
  2%|▏         | 6350/371472 [30:43<30:17:30,  3.35it/s]
  2%|▏         | 6351/371472 [30:43<31:31:00,  3.22it/s]
  2%|▏         | 6352/371472 [30:43<29:45:09,  3.41it/s]
  2%|▏         | 6353/371472 [30:43<30:03:38,  3.37it/s]
  2%|▏         | 6354/371472 [30:44<30:20:56,  3.34it/s]
  2%|▏         | 6355/371472 [30:44<30:40:49,  3.31it/s]
  2%|▏         | 6356/371472 [30:44<29:58:10,  3.38it/s]
  2%|▏         | 6357/371472 [30:45<30:47:48,  3.29it/s]
  2%|▏         | 6358/371472 [30:45<30:56:21,  3.28it/s]
  2%|▏         | 6359/371472 [30:45<31:17:08,  3.24it/s]
  2%|▏         | 6360/371472 [30:46<30:03:36,  3.37it/s]
                                                        
{'loss': 5.1011, 'learning_rate': 9.850675515525006e-07, 'epoch': 0.27}

  2%|▏         | 6360/371472 [30:46<30:03:36,  3.37it/s]
  2%|▏         | 6361/371472 [30:46<29:15:06,  3.47it/s]
  2%|▏         | 6362/371472 [30:46<30:39:24,  3.31it/s]
  2%|▏         | 6363/371472 [30:46<30:01:48,  3.38it/s]
  2%|▏         | 6364/371472 [30:47<30:15:45,  3.35it/s]
  2%|▏         | 6365/371472 [30:47<30:07:27,  3.37it/s]
  2%|▏         | 6366/371472 [30:47<29:28:18,  3.44it/s]
  2%|▏         | 6367/371472 [30:48<29:04:52,  3.49it/s]
  2%|▏         | 6368/371472 [30:48<29:14:19,  3.47it/s]
  2%|▏         | 6369/371472 [30:48<30:02:18,  3.38it/s]
  2%|▏         | 6370/371472 [30:48<28:19:52,  3.58it/s]
  2%|▏         | 6371/371472 [30:49<28:41:18,  3.54it/s]
  2%|▏         | 6372/371472 [30:49<28:03:17,  3.61it/s]
  2%|▏         | 6373/371472 [30:49<29:46:37,  3.41it/s]
  2%|▏         | 6374/371472 [30:50<32:03:33,  3.16it/s]
  2%|▏         | 6375/371472 [30:50<31:02:52,  3.27it/s]
  2%|▏         | 6376/371472 [30:50<29:50:42,  3.40it/s]
  2%|▏         | 6377/371472 [30:51<30:03:16,  3.37it/s]
  2%|▏         | 6378/371472 [30:51<29:33:27,  3.43it/s]
  2%|▏         | 6379/371472 [30:51<28:25:18,  3.57it/s]
  2%|▏         | 6380/371472 [30:51<28:21:36,  3.58it/s]
                                                        
{'loss': 5.3448, 'learning_rate': 9.850190695770216e-07, 'epoch': 0.27}

  2%|▏         | 6380/371472 [30:51<28:21:36,  3.58it/s]
  2%|▏         | 6381/371472 [30:52<28:55:15,  3.51it/s]
  2%|▏         | 6382/371472 [30:52<28:00:41,  3.62it/s]
  2%|▏         | 6383/371472 [30:52<28:05:01,  3.61it/s]
  2%|▏         | 6384/371472 [30:52<28:26:05,  3.57it/s]
  2%|▏         | 6385/371472 [30:53<28:44:18,  3.53it/s]
  2%|▏         | 6386/371472 [30:53<28:00:16,  3.62it/s]
  2%|▏         | 6387/371472 [30:53<28:51:10,  3.51it/s]
  2%|▏         | 6388/371472 [30:54<29:27:07,  3.44it/s]
  2%|▏         | 6389/371472 [30:54<29:07:28,  3.48it/s]
  2%|▏         | 6390/371472 [30:54<29:22:15,  3.45it/s]
  2%|▏         | 6391/371472 [30:54<28:38:55,  3.54it/s]
  2%|▏         | 6392/371472 [30:55<29:28:16,  3.44it/s]
  2%|▏         | 6393/371472 [30:55<29:56:38,  3.39it/s]
  2%|▏         | 6394/371472 [30:55<29:32:08,  3.43it/s]
  2%|▏         | 6395/371472 [30:56<28:53:13,  3.51it/s]
  2%|▏         | 6396/371472 [30:56<30:44:27,  3.30it/s]
  2%|▏         | 6397/371472 [30:56<29:53:50,  3.39it/s]
  2%|▏         | 6398/371472 [30:57<29:04:50,  3.49it/s]
  2%|▏         | 6399/371472 [30:57<28:56:00,  3.50it/s]
  2%|▏         | 6400/371472 [30:57<29:04:01,  3.49it/s]
                                                        
{'loss': 5.1696, 'learning_rate': 9.849705876015427e-07, 'epoch': 0.28}

  2%|▏         | 6400/371472 [30:57<29:04:01,  3.49it/s]
  2%|▏         | 6401/371472 [30:57<29:41:01,  3.42it/s]
  2%|▏         | 6402/371472 [30:58<28:18:44,  3.58it/s]
  2%|▏         | 6403/371472 [30:58<29:21:28,  3.45it/s]
  2%|▏         | 6404/371472 [30:58<29:55:10,  3.39it/s]
  2%|▏         | 6405/371472 [30:59<29:37:39,  3.42it/s]
  2%|▏         | 6406/371472 [30:59<29:47:19,  3.40it/s]
  2%|▏         | 6407/371472 [30:59<28:59:44,  3.50it/s]
  2%|▏         | 6408/371472 [31:00<31:49:47,  3.19it/s]
  2%|▏         | 6409/371472 [31:00<30:22:35,  3.34it/s]
  2%|▏         | 6410/371472 [31:00<29:49:10,  3.40it/s]
  2%|▏         | 6411/371472 [31:00<30:39:10,  3.31it/s]
  2%|▏         | 6412/371472 [31:01<31:34:36,  3.21it/s]
  2%|▏         | 6413/371472 [31:01<31:10:07,  3.25it/s]
  2%|▏         | 6414/371472 [31:01<29:58:10,  3.38it/s]
  2%|▏         | 6415/371472 [31:02<29:31:53,  3.43it/s]
  2%|▏         | 6416/371472 [31:02<28:41:01,  3.54it/s]
  2%|▏         | 6417/371472 [31:02<28:24:34,  3.57it/s]
  2%|▏         | 6418/371472 [31:02<28:48:59,  3.52it/s]
  2%|▏         | 6419/371472 [31:03<28:48:40,  3.52it/s]
  2%|▏         | 6420/371472 [31:03<30:39:24,  3.31it/s]
                                                        
{'loss': 4.74, 'learning_rate': 9.849221056260638e-07, 'epoch': 0.28}

  2%|▏         | 6420/371472 [31:03<30:39:24,  3.31it/s]
  2%|▏         | 6421/371472 [31:03<31:45:35,  3.19it/s]
  2%|▏         | 6422/371472 [31:04<29:50:42,  3.40it/s]
  2%|▏         | 6423/371472 [31:04<29:18:35,  3.46it/s]
  2%|▏         | 6424/371472 [31:04<29:10:30,  3.48it/s]
  2%|▏         | 6425/371472 [31:05<31:08:39,  3.26it/s]
  2%|▏         | 6426/371472 [31:05<35:31:45,  2.85it/s]
  2%|▏         | 6427/371472 [31:05<33:09:26,  3.06it/s]
  2%|▏         | 6428/371472 [31:05<31:11:03,  3.25it/s]
  2%|▏         | 6429/371472 [31:06<29:54:25,  3.39it/s]
  2%|▏         | 6430/371472 [31:06<28:34:02,  3.55it/s]
  2%|▏         | 6431/371472 [31:06<28:05:44,  3.61it/s]
  2%|▏         | 6432/371472 [31:07<28:42:15,  3.53it/s]
  2%|▏         | 6433/371472 [31:07<28:53:20,  3.51it/s]
  2%|▏         | 6434/371472 [31:07<30:09:02,  3.36it/s]
  2%|▏         | 6435/371472 [31:08<30:59:01,  3.27it/s]
  2%|▏         | 6436/371472 [31:08<29:44:25,  3.41it/s]
  2%|▏         | 6437/371472 [31:08<29:26:36,  3.44it/s]
  2%|▏         | 6438/371472 [31:08<29:20:13,  3.46it/s]
  2%|▏         | 6439/371472 [31:09<29:29:09,  3.44it/s]
  2%|▏         | 6440/371472 [31:09<29:03:50,  3.49it/s]
                                                        
{'loss': 5.101, 'learning_rate': 9.84873623650585e-07, 'epoch': 0.28}

  2%|▏         | 6440/371472 [31:09<29:03:50,  3.49it/s]
  2%|▏         | 6441/371472 [31:09<30:44:15,  3.30it/s]
  2%|▏         | 6442/371472 [31:10<29:54:02,  3.39it/s]
  2%|▏         | 6443/371472 [31:10<31:40:35,  3.20it/s]
  2%|▏         | 6444/371472 [31:10<32:40:41,  3.10it/s]
  2%|▏         | 6445/371472 [31:11<31:38:05,  3.21it/s]
  2%|▏         | 6446/371472 [31:11<31:50:11,  3.18it/s]
  2%|▏         | 6447/371472 [31:11<29:58:44,  3.38it/s]
  2%|▏         | 6448/371472 [31:11<29:09:41,  3.48it/s]
  2%|▏         | 6449/371472 [31:12<28:52:49,  3.51it/s]
  2%|▏         | 6450/371472 [31:12<28:08:19,  3.60it/s]
  2%|▏         | 6451/371472 [31:12<28:26:45,  3.56it/s]
  2%|▏         | 6452/371472 [31:13<29:16:02,  3.46it/s]
  2%|▏         | 6453/371472 [31:13<29:20:54,  3.45it/s]
  2%|▏         | 6454/371472 [31:13<28:22:04,  3.57it/s]
  2%|▏         | 6455/371472 [31:13<28:34:06,  3.55it/s]
  2%|▏         | 6456/371472 [31:14<29:16:54,  3.46it/s]
  2%|▏         | 6457/371472 [31:14<28:40:08,  3.54it/s]
  2%|▏         | 6458/371472 [31:14<29:16:56,  3.46it/s]
  2%|▏         | 6459/371472 [31:15<29:32:16,  3.43it/s]
  2%|▏         | 6460/371472 [31:15<31:51:14,  3.18it/s]
                                                        
{'loss': 5.1098, 'learning_rate': 9.848251416751061e-07, 'epoch': 0.28}

  2%|▏         | 6460/371472 [31:15<31:51:14,  3.18it/s]
  2%|▏         | 6461/371472 [31:15<30:15:18,  3.35it/s]
  2%|▏         | 6462/371472 [31:15<29:54:20,  3.39it/s]
  2%|▏         | 6463/371472 [31:16<29:08:08,  3.48it/s]
  2%|▏         | 6464/371472 [31:16<29:27:57,  3.44it/s]
  2%|▏         | 6465/371472 [31:16<28:28:41,  3.56it/s]
  2%|▏         | 6466/371472 [31:17<29:07:01,  3.48it/s]
  2%|▏         | 6467/371472 [31:17<28:22:34,  3.57it/s]
  2%|▏         | 6468/371472 [31:17<27:21:00,  3.71it/s]
  2%|▏         | 6469/371472 [31:17<29:23:01,  3.45it/s]
  2%|▏         | 6470/371472 [31:18<28:44:49,  3.53it/s]
  2%|▏         | 6471/371472 [31:18<27:39:50,  3.67it/s]
  2%|▏         | 6472/371472 [31:18<28:06:40,  3.61it/s]
  2%|▏         | 6473/371472 [31:19<30:13:59,  3.35it/s]
  2%|▏         | 6474/371472 [31:19<29:13:23,  3.47it/s]
  2%|▏         | 6475/371472 [31:19<29:30:16,  3.44it/s]
  2%|▏         | 6476/371472 [31:19<28:37:48,  3.54it/s]
  2%|▏         | 6477/371472 [31:20<28:10:22,  3.60it/s]
  2%|▏         | 6478/371472 [31:20<27:31:50,  3.68it/s]
  2%|▏         | 6479/371472 [31:20<27:28:13,  3.69it/s]
  2%|▏         | 6480/371472 [31:20<27:55:11,  3.63it/s]
                                                        
{'loss': 5.2632, 'learning_rate': 9.847766596996272e-07, 'epoch': 0.28}

  2%|▏         | 6480/371472 [31:20<27:55:11,  3.63it/s]
  2%|▏         | 6481/371472 [31:21<32:19:15,  3.14it/s]
  2%|▏         | 6482/371472 [31:21<30:47:21,  3.29it/s]
  2%|▏         | 6483/371472 [31:21<30:06:24,  3.37it/s]
  2%|▏         | 6484/371472 [31:22<28:48:49,  3.52it/s]
  2%|▏         | 6485/371472 [31:22<29:12:36,  3.47it/s]
  2%|▏         | 6486/371472 [31:22<28:30:09,  3.56it/s]
  2%|▏         | 6487/371472 [31:23<29:54:37,  3.39it/s]
  2%|▏         | 6488/371472 [31:23<29:46:00,  3.41it/s]
  2%|▏         | 6489/371472 [31:23<28:30:30,  3.56it/s]
  2%|▏         | 6490/371472 [31:23<29:16:24,  3.46it/s]
  2%|▏         | 6491/371472 [31:24<28:38:26,  3.54it/s]
  2%|▏         | 6492/371472 [31:24<29:03:36,  3.49it/s]
  2%|▏         | 6493/371472 [31:24<30:27:03,  3.33it/s]
  2%|▏         | 6494/371472 [31:25<28:48:45,  3.52it/s]
  2%|▏         | 6495/371472 [31:25<28:02:26,  3.62it/s]
  2%|▏         | 6496/371472 [31:25<28:28:50,  3.56it/s]
  2%|▏         | 6497/371472 [31:25<27:30:32,  3.69it/s]
  2%|▏         | 6498/371472 [31:26<28:36:57,  3.54it/s]
  2%|▏         | 6499/371472 [31:26<28:54:01,  3.51it/s]
  2%|▏         | 6500/371472 [31:26<28:15:08,  3.59it/s]
                                                        
{'loss': 5.2572, 'learning_rate': 9.847281777241483e-07, 'epoch': 0.28}

  2%|▏         | 6500/371472 [31:26<28:15:08,  3.59it/s]
  2%|▏         | 6501/371472 [31:26<27:31:41,  3.68it/s]
  2%|▏         | 6502/371472 [31:27<27:39:13,  3.67it/s]
  2%|▏         | 6503/371472 [31:27<27:21:11,  3.71it/s]
  2%|▏         | 6504/371472 [31:27<27:38:36,  3.67it/s]
  2%|▏         | 6505/371472 [31:28<29:29:29,  3.44it/s]
  2%|▏         | 6506/371472 [31:28<29:00:07,  3.50it/s]
  2%|▏         | 6507/371472 [31:28<29:53:37,  3.39it/s]
  2%|▏         | 6508/371472 [31:28<29:13:11,  3.47it/s]
  2%|▏         | 6509/371472 [31:29<30:22:48,  3.34it/s]
  2%|▏         | 6510/371472 [31:29<28:42:42,  3.53it/s]
  2%|▏         | 6511/371472 [31:29<28:32:17,  3.55it/s]
  2%|▏         | 6512/371472 [31:30<27:51:32,  3.64it/s]
  2%|▏         | 6513/371472 [31:30<27:30:58,  3.68it/s]
  2%|▏         | 6514/371472 [31:30<28:10:38,  3.60it/s]
  2%|▏         | 6515/371472 [31:30<28:05:07,  3.61it/s]
  2%|▏         | 6516/371472 [31:31<27:48:16,  3.65it/s]
  2%|▏         | 6517/371472 [31:31<26:55:20,  3.77it/s]
  2%|▏         | 6518/371472 [31:31<27:00:14,  3.75it/s]
  2%|▏         | 6519/371472 [31:31<26:35:41,  3.81it/s]
  2%|▏         | 6520/371472 [31:32<30:06:08,  3.37it/s]
                                                        
{'loss': 5.2582, 'learning_rate': 9.846796957486693e-07, 'epoch': 0.28}

  2%|▏         | 6520/371472 [31:32<30:06:08,  3.37it/s]
  2%|▏         | 6521/371472 [31:32<28:38:25,  3.54it/s]
  2%|▏         | 6522/371472 [31:32<28:38:35,  3.54it/s]
  2%|▏         | 6523/371472 [31:33<28:36:07,  3.54it/s]
  2%|▏         | 6524/371472 [31:33<27:50:27,  3.64it/s]
  2%|▏         | 6525/371472 [31:33<29:05:19,  3.48it/s]
  2%|▏         | 6526/371472 [31:34<29:04:35,  3.49it/s]
  2%|▏         | 6527/371472 [31:34<28:54:05,  3.51it/s]
  2%|▏         | 6528/371472 [31:34<29:49:30,  3.40it/s]
  2%|▏         | 6529/371472 [31:34<28:31:56,  3.55it/s]
  2%|▏         | 6530/371472 [31:35<28:09:21,  3.60it/s]
  2%|▏         | 6531/371472 [31:35<27:58:42,  3.62it/s]
  2%|▏         | 6532/371472 [31:35<28:01:59,  3.62it/s]
  2%|▏         | 6533/371472 [31:35<28:12:06,  3.59it/s]
  2%|▏         | 6534/371472 [31:36<28:12:16,  3.59it/s]
  2%|▏         | 6535/371472 [31:36<28:00:26,  3.62it/s]
  2%|▏         | 6536/371472 [31:36<27:37:57,  3.67it/s]
  2%|▏         | 6537/371472 [31:37<27:20:51,  3.71it/s]
  2%|▏         | 6538/371472 [31:37<27:43:00,  3.66it/s]
  2%|▏         | 6539/371472 [31:37<29:23:55,  3.45it/s]
  2%|▏         | 6540/371472 [31:38<32:06:03,  3.16it/s]
                                                        
{'loss': 5.3315, 'learning_rate': 9.846312137731906e-07, 'epoch': 0.28}

  2%|▏         | 6540/371472 [31:38<32:06:03,  3.16it/s]
  2%|▏         | 6541/371472 [31:38<30:51:48,  3.28it/s]
  2%|▏         | 6542/371472 [31:38<30:11:32,  3.36it/s]
  2%|▏         | 6543/371472 [31:38<29:03:56,  3.49it/s]
  2%|▏         | 6544/371472 [31:39<28:49:19,  3.52it/s]
  2%|▏         | 6545/371472 [31:39<29:35:01,  3.43it/s]
  2%|▏         | 6546/371472 [31:39<29:07:57,  3.48it/s]
  2%|▏         | 6547/371472 [31:40<29:46:06,  3.41it/s]
  2%|▏         | 6548/371472 [31:40<30:42:23,  3.30it/s]
  2%|▏         | 6549/371472 [31:40<32:20:25,  3.13it/s]
  2%|▏         | 6550/371472 [31:40<30:12:02,  3.36it/s]
  2%|▏         | 6551/371472 [31:41<29:05:40,  3.48it/s]
  2%|▏         | 6552/371472 [31:41<28:48:20,  3.52it/s]
  2%|▏         | 6553/371472 [31:41<28:01:22,  3.62it/s]
  2%|▏         | 6554/371472 [31:42<29:09:51,  3.48it/s]
  2%|▏         | 6555/371472 [31:42<27:49:03,  3.64it/s]
  2%|▏         | 6556/371472 [31:42<27:24:52,  3.70it/s]
  2%|▏         | 6557/371472 [31:42<27:08:46,  3.73it/s]
  2%|▏         | 6558/371472 [31:43<27:02:36,  3.75it/s]
  2%|▏         | 6559/371472 [31:43<26:49:26,  3.78it/s]
  2%|▏         | 6560/371472 [31:43<26:37:54,  3.81it/s]
                                                        
{'loss': 4.955, 'learning_rate': 9.845827317977115e-07, 'epoch': 0.28}

  2%|▏         | 6560/371472 [31:43<26:37:54,  3.81it/s]
  2%|▏         | 6561/371472 [31:43<28:45:42,  3.52it/s]
  2%|▏         | 6562/371472 [31:44<27:51:29,  3.64it/s]
  2%|▏         | 6563/371472 [31:44<28:34:53,  3.55it/s]
  2%|▏         | 6564/371472 [31:44<31:43:12,  3.20it/s]
  2%|▏         | 6565/371472 [31:45<30:19:07,  3.34it/s]
  2%|▏         | 6566/371472 [31:45<29:44:59,  3.41it/s]
  2%|▏         | 6567/371472 [31:45<30:06:30,  3.37it/s]
  2%|▏         | 6568/371472 [31:46<30:53:26,  3.28it/s]
  2%|▏         | 6569/371472 [31:46<29:37:26,  3.42it/s]
  2%|▏         | 6570/371472 [31:46<29:16:12,  3.46it/s]
  2%|▏         | 6571/371472 [31:46<28:53:16,  3.51it/s]
  2%|▏         | 6572/371472 [31:47<29:17:53,  3.46it/s]
  2%|▏         | 6573/371472 [31:47<29:51:44,  3.39it/s]
  2%|▏         | 6574/371472 [31:47<28:50:09,  3.52it/s]
  2%|▏         | 6575/371472 [31:48<28:22:10,  3.57it/s]
  2%|▏         | 6576/371472 [31:48<29:08:42,  3.48it/s]
  2%|▏         | 6577/371472 [31:48<28:42:48,  3.53it/s]
  2%|▏         | 6578/371472 [31:48<28:23:04,  3.57it/s]
  2%|▏         | 6579/371472 [31:49<27:27:38,  3.69it/s]
  2%|▏         | 6580/371472 [31:49<28:08:34,  3.60it/s]
                                                        
{'loss': 5.2012, 'learning_rate': 9.845342498222328e-07, 'epoch': 0.28}

  2%|▏         | 6580/371472 [31:49<28:08:34,  3.60it/s]
  2%|▏         | 6581/371472 [31:49<27:25:35,  3.70it/s]
  2%|▏         | 6582/371472 [31:49<27:44:29,  3.65it/s]
  2%|▏         | 6583/371472 [31:50<27:51:08,  3.64it/s]
  2%|▏         | 6584/371472 [31:50<28:30:35,  3.56it/s]
  2%|▏         | 6585/371472 [31:50<27:58:44,  3.62it/s]
  2%|▏         | 6586/371472 [31:51<27:54:59,  3.63it/s]
  2%|▏         | 6587/371472 [31:51<28:28:16,  3.56it/s]
  2%|▏         | 6588/371472 [31:51<30:23:29,  3.34it/s]
  2%|▏         | 6589/371472 [31:51<30:09:18,  3.36it/s]
  2%|▏         | 6590/371472 [31:52<33:50:23,  3.00it/s]
  2%|▏         | 6591/371472 [31:52<31:50:37,  3.18it/s]
  2%|▏         | 6592/371472 [31:52<30:48:30,  3.29it/s]
  2%|▏         | 6593/371472 [31:53<31:27:08,  3.22it/s]
  2%|▏         | 6594/371472 [31:53<30:21:36,  3.34it/s]
  2%|▏         | 6595/371472 [31:53<30:00:52,  3.38it/s]
  2%|▏         | 6596/371472 [31:54<29:57:08,  3.38it/s]
  2%|▏         | 6597/371472 [31:54<28:57:41,  3.50it/s]
  2%|▏         | 6598/371472 [31:54<28:15:15,  3.59it/s]
  2%|▏         | 6599/371472 [31:54<29:57:08,  3.38it/s]
  2%|▏         | 6600/371472 [31:55<29:07:31,  3.48it/s]
                                                        
{'loss': 5.3038, 'learning_rate': 9.844857678467538e-07, 'epoch': 0.28}

  2%|▏         | 6600/371472 [31:55<29:07:31,  3.48it/s]
  2%|▏         | 6601/371472 [31:55<31:50:37,  3.18it/s]
  2%|▏         | 6602/371472 [31:55<30:24:18,  3.33it/s]
  2%|▏         | 6603/371472 [31:56<31:04:25,  3.26it/s]
  2%|▏         | 6604/371472 [31:56<30:17:27,  3.35it/s]
  2%|▏         | 6605/371472 [31:56<28:49:55,  3.52it/s]
  2%|▏         | 6606/371472 [31:57<28:30:06,  3.56it/s]
  2%|▏         | 6607/371472 [31:57<28:21:34,  3.57it/s]
  2%|▏         | 6608/371472 [31:57<28:41:44,  3.53it/s]
  2%|▏         | 6609/371472 [31:57<28:37:07,  3.54it/s]
  2%|▏         | 6610/371472 [31:58<29:23:08,  3.45it/s]
  2%|▏         | 6611/371472 [31:58<28:48:07,  3.52it/s]
  2%|▏         | 6612/371472 [31:58<27:43:43,  3.66it/s]
  2%|▏         | 6613/371472 [31:58<27:47:07,  3.65it/s]
  2%|▏         | 6614/371472 [31:59<26:44:13,  3.79it/s]
  2%|▏         | 6615/371472 [31:59<26:50:42,  3.78it/s]
  2%|▏         | 6616/371472 [31:59<27:49:33,  3.64it/s]
  2%|▏         | 6617/371472 [32:00<28:09:55,  3.60it/s]
  2%|▏         | 6618/371472 [32:00<27:59:18,  3.62it/s]
  2%|▏         | 6619/371472 [32:00<28:08:34,  3.60it/s]
  2%|▏         | 6620/371472 [32:00<27:56:34,  3.63it/s]
                                                        
{'loss': 5.2074, 'learning_rate': 9.84437285871275e-07, 'epoch': 0.29}

  2%|▏         | 6620/371472 [32:00<27:56:34,  3.63it/s]
  2%|▏         | 6621/371472 [32:01<27:44:34,  3.65it/s]
  2%|▏         | 6622/371472 [32:01<28:10:07,  3.60it/s]
  2%|▏         | 6623/371472 [32:01<27:41:16,  3.66it/s]
  2%|▏         | 6624/371472 [32:01<27:02:16,  3.75it/s]
  2%|▏         | 6625/371472 [32:02<26:57:01,  3.76it/s]
  2%|▏         | 6626/371472 [32:02<27:01:34,  3.75it/s]
  2%|▏         | 6627/371472 [32:02<28:21:37,  3.57it/s]
  2%|▏         | 6628/371472 [32:03<28:30:24,  3.56it/s]
  2%|▏         | 6629/371472 [32:03<29:17:03,  3.46it/s]
  2%|▏         | 6630/371472 [32:03<29:43:19,  3.41it/s]
  2%|▏         | 6631/371472 [32:04<30:23:57,  3.33it/s]
  2%|▏         | 6632/371472 [32:04<31:11:03,  3.25it/s]
  2%|▏         | 6633/371472 [32:04<31:37:44,  3.20it/s]
  2%|▏         | 6634/371472 [32:04<29:47:45,  3.40it/s]
  2%|▏         | 6635/371472 [32:05<30:26:02,  3.33it/s]
  2%|▏         | 6636/371472 [32:05<29:48:11,  3.40it/s]
  2%|▏         | 6637/371472 [32:05<31:47:59,  3.19it/s]
  2%|▏         | 6638/371472 [32:06<30:46:56,  3.29it/s]
  2%|▏         | 6639/371472 [32:06<29:49:54,  3.40it/s]
  2%|▏         | 6640/371472 [32:06<30:39:31,  3.31it/s]
                                                        
{'loss': 5.0363, 'learning_rate': 9.84388803895796e-07, 'epoch': 0.29}

  2%|▏         | 6640/371472 [32:06<30:39:31,  3.31it/s]
  2%|▏         | 6641/371472 [32:07<31:23:32,  3.23it/s]
  2%|▏         | 6642/371472 [32:07<29:45:18,  3.41it/s]
  2%|▏         | 6643/371472 [32:07<28:52:04,  3.51it/s]
  2%|▏         | 6644/371472 [32:07<27:53:13,  3.63it/s]
  2%|▏         | 6645/371472 [32:08<27:41:31,  3.66it/s]
  2%|▏         | 6646/371472 [32:08<30:17:32,  3.35it/s]
  2%|▏         | 6647/371472 [32:08<30:15:42,  3.35it/s]
  2%|▏         | 6648/371472 [32:09<28:55:29,  3.50it/s]
  2%|▏         | 6649/371472 [32:09<28:09:55,  3.60it/s]
  2%|▏         | 6650/371472 [32:09<28:09:23,  3.60it/s]
  2%|▏         | 6651/371472 [32:09<27:35:32,  3.67it/s]
  2%|▏         | 6652/371472 [32:10<27:43:31,  3.66it/s]
  2%|▏         | 6653/371472 [32:10<28:11:09,  3.60it/s]
  2%|▏         | 6654/371472 [32:10<28:44:14,  3.53it/s]
  2%|▏         | 6655/371472 [32:10<28:20:09,  3.58it/s]
  2%|▏         | 6656/371472 [32:11<28:27:00,  3.56it/s]
  2%|▏         | 6657/371472 [32:11<27:34:34,  3.67it/s]
  2%|▏         | 6658/371472 [32:11<27:11:45,  3.73it/s]
  2%|▏         | 6659/371472 [32:12<28:06:10,  3.61it/s]
  2%|▏         | 6660/371472 [32:12<27:53:54,  3.63it/s]
                                                        
{'loss': 5.1664, 'learning_rate': 9.84340321920317e-07, 'epoch': 0.29}

  2%|▏         | 6660/371472 [32:12<27:53:54,  3.63it/s]
  2%|▏         | 6661/371472 [32:12<29:10:02,  3.47it/s]
  2%|▏         | 6662/371472 [32:12<28:10:24,  3.60it/s]
  2%|▏         | 6663/371472 [32:13<28:43:06,  3.53it/s]
  2%|▏         | 6664/371472 [32:13<28:26:04,  3.56it/s]
  2%|▏         | 6665/371472 [32:13<31:54:13,  3.18it/s]
  2%|▏         | 6666/371472 [32:14<30:18:50,  3.34it/s]
  2%|▏         | 6667/371472 [32:14<29:24:35,  3.45it/s]
  2%|▏         | 6668/371472 [32:14<28:24:51,  3.57it/s]
  2%|▏         | 6669/371472 [32:14<28:22:56,  3.57it/s]
  2%|▏         | 6670/371472 [32:15<27:57:00,  3.63it/s]
  2%|▏         | 6671/371472 [32:15<28:30:36,  3.55it/s]
  2%|▏         | 6672/371472 [32:15<29:31:40,  3.43it/s]
  2%|▏         | 6673/371472 [32:16<29:09:53,  3.47it/s]
  2%|▏         | 6674/371472 [32:16<29:18:37,  3.46it/s]
  2%|▏         | 6675/371472 [32:16<28:35:46,  3.54it/s]
  2%|▏         | 6676/371472 [32:16<28:26:46,  3.56it/s]
  2%|▏         | 6677/371472 [32:17<28:15:44,  3.59it/s]
  2%|▏         | 6678/371472 [32:17<27:34:52,  3.67it/s]
  2%|▏         | 6679/371472 [32:17<29:04:17,  3.49it/s]
  2%|▏         | 6680/371472 [32:18<28:29:18,  3.56it/s]
                                                        
{'loss': 5.1214, 'learning_rate': 9.842918399448383e-07, 'epoch': 0.29}

  2%|▏         | 6680/371472 [32:18<28:29:18,  3.56it/s]
  2%|▏         | 6681/371472 [32:18<28:33:51,  3.55it/s]
  2%|▏         | 6682/371472 [32:18<30:46:43,  3.29it/s]
  2%|▏         | 6683/371472 [32:18<29:55:07,  3.39it/s]
  2%|▏         | 6684/371472 [32:19<29:27:32,  3.44it/s]
  2%|▏         | 6685/371472 [32:19<29:28:30,  3.44it/s]
  2%|▏         | 6686/371472 [32:19<28:17:55,  3.58it/s]
  2%|▏         | 6687/371472 [32:20<27:57:56,  3.62it/s]
  2%|▏         | 6688/371472 [32:20<30:22:36,  3.34it/s]
  2%|▏         | 6689/371472 [32:20<31:24:26,  3.23it/s]
  2%|▏         | 6690/371472 [32:21<34:29:43,  2.94it/s]
  2%|▏         | 6691/371472 [32:21<34:02:39,  2.98it/s]
  2%|▏         | 6692/371472 [32:21<32:12:13,  3.15it/s]
  2%|▏         | 6693/371472 [32:22<31:00:48,  3.27it/s]
  2%|▏         | 6694/371472 [32:22<30:58:11,  3.27it/s]
  2%|▏         | 6695/371472 [32:22<29:28:47,  3.44it/s]
  2%|▏         | 6696/371472 [32:22<28:43:16,  3.53it/s]
  2%|▏         | 6697/371472 [32:23<29:42:24,  3.41it/s]
  2%|▏         | 6698/371472 [32:23<30:26:20,  3.33it/s]
  2%|▏         | 6699/371472 [32:23<29:35:34,  3.42it/s]
  2%|▏         | 6700/371472 [32:24<29:32:21,  3.43it/s]
                                                        
{'loss': 4.9995, 'learning_rate': 9.842433579693592e-07, 'epoch': 0.29}

  2%|▏         | 6700/371472 [32:24<29:32:21,  3.43it/s]
  2%|▏         | 6701/371472 [32:24<28:16:43,  3.58it/s]
  2%|▏         | 6702/371472 [32:24<28:10:03,  3.60it/s]
  2%|▏         | 6703/371472 [32:24<28:23:13,  3.57it/s]
  2%|▏         | 6704/371472 [32:25<27:31:13,  3.68it/s]
  2%|▏         | 6705/371472 [32:25<27:12:08,  3.72it/s]
  2%|▏         | 6706/371472 [32:25<26:43:47,  3.79it/s]
  2%|▏         | 6707/371472 [32:25<26:54:23,  3.77it/s]
  2%|▏         | 6708/371472 [32:26<29:30:06,  3.43it/s]
  2%|▏         | 6709/371472 [32:26<29:23:52,  3.45it/s]
  2%|▏         | 6710/371472 [32:26<29:51:37,  3.39it/s]
  2%|▏         | 6711/371472 [32:27<29:59:13,  3.38it/s]
  2%|▏         | 6712/371472 [32:27<29:21:38,  3.45it/s]
  2%|▏         | 6713/371472 [32:27<30:00:43,  3.38it/s]
  2%|▏         | 6714/371472 [32:27<29:03:36,  3.49it/s]
  2%|▏         | 6715/371472 [32:28<31:46:55,  3.19it/s]
  2%|▏         | 6716/371472 [32:28<30:21:01,  3.34it/s]
  2%|▏         | 6717/371472 [32:28<29:32:30,  3.43it/s]
  2%|▏         | 6718/371472 [32:29<28:45:39,  3.52it/s]
  2%|▏         | 6719/371472 [32:29<28:46:10,  3.52it/s]
  2%|▏         | 6720/371472 [32:29<29:42:24,  3.41it/s]
                                                        
{'loss': 5.0777, 'learning_rate': 9.841948759938805e-07, 'epoch': 0.29}

  2%|▏         | 6720/371472 [32:29<29:42:24,  3.41it/s]
  2%|▏         | 6721/371472 [32:30<29:54:34,  3.39it/s]
  2%|▏         | 6722/371472 [32:30<28:26:30,  3.56it/s]
  2%|▏         | 6723/371472 [32:30<28:02:58,  3.61it/s]
  2%|▏         | 6724/371472 [32:30<27:12:27,  3.72it/s]
  2%|▏         | 6725/371472 [32:31<27:03:32,  3.74it/s]
  2%|▏         | 6726/371472 [32:31<27:18:46,  3.71it/s]
  2%|▏         | 6727/371472 [32:31<28:06:41,  3.60it/s]
  2%|▏         | 6728/371472 [32:31<28:22:09,  3.57it/s]
  2%|▏         | 6729/371472 [32:32<30:40:20,  3.30it/s]
  2%|▏         | 6730/371472 [32:32<32:27:22,  3.12it/s]
  2%|▏         | 6731/371472 [32:32<30:56:39,  3.27it/s]
  2%|▏         | 6732/371472 [32:33<32:06:52,  3.15it/s]
  2%|▏         | 6733/371472 [32:33<31:08:40,  3.25it/s]
  2%|▏         | 6734/371472 [32:33<31:27:20,  3.22it/s]
  2%|▏         | 6735/371472 [32:34<31:02:56,  3.26it/s]
  2%|▏         | 6736/371472 [32:34<30:50:58,  3.28it/s]
  2%|▏         | 6737/371472 [32:34<30:56:49,  3.27it/s]
  2%|▏         | 6738/371472 [32:35<29:42:27,  3.41it/s]
  2%|▏         | 6739/371472 [32:35<32:08:19,  3.15it/s]
  2%|▏         | 6740/371472 [32:35<30:53:10,  3.28it/s]
                                                        
{'loss': 5.1652, 'learning_rate': 9.841463940184016e-07, 'epoch': 0.29}

  2%|▏         | 6740/371472 [32:35<30:53:10,  3.28it/s]
  2%|▏         | 6741/371472 [32:36<31:03:53,  3.26it/s]
  2%|▏         | 6742/371472 [32:36<30:54:28,  3.28it/s]
  2%|▏         | 6743/371472 [32:36<28:59:48,  3.49it/s]
  2%|▏         | 6744/371472 [32:36<28:09:41,  3.60it/s]
  2%|▏         | 6745/371472 [32:37<27:53:13,  3.63it/s]
  2%|▏         | 6746/371472 [32:37<27:12:05,  3.72it/s]
  2%|▏         | 6747/371472 [32:37<28:07:48,  3.60it/s]
  2%|▏         | 6748/371472 [32:38<32:12:50,  3.14it/s]
  2%|▏         | 6749/371472 [32:38<32:13:46,  3.14it/s]
  2%|▏         | 6750/371472 [32:38<30:42:52,  3.30it/s]
  2%|▏         | 6751/371472 [32:38<29:36:54,  3.42it/s]
  2%|▏         | 6752/371472 [32:39<28:54:23,  3.50it/s]
  2%|▏         | 6753/371472 [32:39<28:25:28,  3.56it/s]
  2%|▏         | 6754/371472 [32:39<28:13:36,  3.59it/s]
  2%|▏         | 6755/371472 [32:40<28:40:09,  3.53it/s]
  2%|▏         | 6756/371472 [32:40<30:34:17,  3.31it/s]
  2%|▏         | 6757/371472 [32:40<28:52:03,  3.51it/s]
  2%|▏         | 6758/371472 [32:40<28:16:06,  3.58it/s]
  2%|▏         | 6759/371472 [32:41<28:36:16,  3.54it/s]
  2%|▏         | 6760/371472 [32:41<27:40:55,  3.66it/s]
                                                        
{'loss': 5.1024, 'learning_rate': 9.840979120429226e-07, 'epoch': 0.29}

  2%|▏         | 6760/371472 [32:41<27:40:55,  3.66it/s]
  2%|▏         | 6761/371472 [32:41<27:30:09,  3.68it/s]
  2%|▏         | 6762/371472 [32:41<27:42:49,  3.66it/s]
  2%|▏         | 6763/371472 [32:42<27:15:10,  3.72it/s]
  2%|▏         | 6764/371472 [32:42<30:01:16,  3.37it/s]
  2%|▏         | 6765/371472 [32:42<28:28:43,  3.56it/s]
  2%|▏         | 6766/371472 [32:43<29:37:49,  3.42it/s]
  2%|▏         | 6767/371472 [32:43<28:44:30,  3.52it/s]
  2%|▏         | 6768/371472 [32:43<28:53:21,  3.51it/s]
  2%|▏         | 6769/371472 [32:43<29:06:15,  3.48it/s]
  2%|▏         | 6770/371472 [32:44<28:44:07,  3.53it/s]
  2%|▏         | 6771/371472 [32:44<29:26:16,  3.44it/s]
  2%|▏         | 6772/371472 [32:44<32:00:06,  3.17it/s]
  2%|▏         | 6773/371472 [32:45<32:35:17,  3.11it/s]
  2%|▏         | 6774/371472 [32:45<30:24:46,  3.33it/s]
  2%|▏         | 6775/371472 [32:45<29:57:20,  3.38it/s]
  2%|▏         | 6776/371472 [32:46<30:03:01,  3.37it/s]
  2%|▏         | 6777/371472 [32:46<30:49:45,  3.29it/s]
  2%|▏         | 6778/371472 [32:46<30:15:27,  3.35it/s]
  2%|▏         | 6779/371472 [32:47<30:14:53,  3.35it/s]
  2%|▏         | 6780/371472 [32:47<29:25:28,  3.44it/s]
                                                        
{'loss': 5.054, 'learning_rate': 9.840494300674437e-07, 'epoch': 0.29}

  2%|▏         | 6780/371472 [32:47<29:25:28,  3.44it/s]
  2%|▏         | 6781/371472 [32:47<29:07:52,  3.48it/s]
  2%|▏         | 6782/371472 [32:47<29:28:39,  3.44it/s]
  2%|▏         | 6783/371472 [32:48<29:50:24,  3.39it/s]
  2%|▏         | 6784/371472 [32:48<29:04:25,  3.48it/s]
  2%|▏         | 6785/371472 [32:48<30:03:07,  3.37it/s]
  2%|▏         | 6786/371472 [32:49<29:13:23,  3.47it/s]
  2%|▏         | 6787/371472 [32:49<30:58:42,  3.27it/s]
  2%|▏         | 6788/371472 [32:49<29:41:13,  3.41it/s]
  2%|▏         | 6789/371472 [32:49<28:31:31,  3.55it/s]
  2%|▏         | 6790/371472 [32:50<31:07:25,  3.25it/s]
  2%|▏         | 6791/371472 [32:50<29:37:53,  3.42it/s]
  2%|▏         | 6792/371472 [32:50<29:26:50,  3.44it/s]
  2%|▏         | 6793/371472 [32:51<28:31:25,  3.55it/s]
  2%|▏         | 6794/371472 [32:51<28:52:49,  3.51it/s]
  2%|▏         | 6795/371472 [32:51<28:47:56,  3.52it/s]
  2%|▏         | 6796/371472 [32:51<28:09:59,  3.60it/s]
  2%|▏         | 6797/371472 [32:52<28:04:48,  3.61it/s]
  2%|▏         | 6798/371472 [32:52<28:57:19,  3.50it/s]
  2%|▏         | 6799/371472 [32:52<27:43:14,  3.65it/s]
  2%|▏         | 6800/371472 [32:53<27:34:48,  3.67it/s]
                                                        
{'loss': 5.2045, 'learning_rate': 9.840009480919648e-07, 'epoch': 0.29}

  2%|▏         | 6800/371472 [32:53<27:34:48,  3.67it/s]
  2%|▏         | 6801/371472 [32:53<28:10:40,  3.59it/s]
  2%|▏         | 6802/371472 [32:53<28:18:32,  3.58it/s]
  2%|▏         | 6803/371472 [32:53<29:38:00,  3.42it/s]
  2%|▏         | 6804/371472 [32:54<28:44:34,  3.52it/s]
  2%|▏         | 6805/371472 [32:54<28:46:24,  3.52it/s]
  2%|▏         | 6806/371472 [32:54<29:26:25,  3.44it/s]
  2%|▏         | 6807/371472 [32:55<28:44:19,  3.52it/s]
  2%|▏         | 6808/371472 [32:55<27:34:05,  3.67it/s]
  2%|▏         | 6809/371472 [32:55<27:05:26,  3.74it/s]
  2%|▏         | 6810/371472 [32:55<26:54:30,  3.76it/s]
  2%|▏         | 6811/371472 [32:56<28:39:34,  3.53it/s]
  2%|▏         | 6812/371472 [32:56<27:39:09,  3.66it/s]
  2%|▏         | 6813/371472 [32:56<27:34:51,  3.67it/s]
  2%|▏         | 6814/371472 [32:56<27:39:54,  3.66it/s]
  2%|▏         | 6815/371472 [32:57<26:34:31,  3.81it/s]
  2%|▏         | 6816/371472 [32:57<26:37:02,  3.81it/s]
  2%|▏         | 6817/371472 [32:57<27:30:36,  3.68it/s]
  2%|▏         | 6818/371472 [32:57<27:50:53,  3.64it/s]
  2%|▏         | 6819/371472 [32:58<27:25:29,  3.69it/s]
  2%|▏         | 6820/371472 [32:58<27:01:12,  3.75it/s]
                                                        
{'loss': 5.3555, 'learning_rate': 9.83952466116486e-07, 'epoch': 0.29}

  2%|▏         | 6820/371472 [32:58<27:01:12,  3.75it/s]
  2%|▏         | 6821/371472 [32:58<27:51:53,  3.64it/s]
  2%|▏         | 6822/371472 [32:59<27:02:27,  3.75it/s]
  2%|▏         | 6823/371472 [32:59<28:25:59,  3.56it/s]
  2%|▏         | 6824/371472 [32:59<27:14:09,  3.72it/s]
  2%|▏         | 6825/371472 [32:59<27:30:58,  3.68it/s]
  2%|▏         | 6826/371472 [33:00<30:35:54,  3.31it/s]
  2%|▏         | 6827/371472 [33:00<29:39:22,  3.42it/s]
  2%|▏         | 6828/371472 [33:00<28:57:35,  3.50it/s]
  2%|▏         | 6829/371472 [33:01<28:12:48,  3.59it/s]
  2%|▏         | 6830/371472 [33:01<28:13:36,  3.59it/s]
  2%|▏         | 6831/371472 [33:01<27:15:15,  3.72it/s]
  2%|▏         | 6832/371472 [33:01<27:54:41,  3.63it/s]
  2%|▏         | 6833/371472 [33:02<28:06:38,  3.60it/s]
  2%|▏         | 6834/371472 [33:02<28:56:53,  3.50it/s]
  2%|▏         | 6835/371472 [33:02<29:34:06,  3.43it/s]
  2%|▏         | 6836/371472 [33:03<30:05:29,  3.37it/s]
  2%|▏         | 6837/371472 [33:03<29:33:36,  3.43it/s]
  2%|▏         | 6838/371472 [33:03<29:16:25,  3.46it/s]
  2%|▏         | 6839/371472 [33:03<29:54:55,  3.39it/s]
  2%|▏         | 6840/371472 [33:04<28:48:08,  3.52it/s]
                                                        
{'loss': 5.1176, 'learning_rate': 9.839039841410071e-07, 'epoch': 0.29}

  2%|▏         | 6840/371472 [33:04<28:48:08,  3.52it/s]
  2%|▏         | 6841/371472 [33:04<28:49:08,  3.51it/s]
  2%|▏         | 6842/371472 [33:04<28:55:18,  3.50it/s]
  2%|▏         | 6843/371472 [33:05<28:13:43,  3.59it/s]
  2%|▏         | 6844/371472 [33:05<27:51:42,  3.64it/s]
  2%|▏         | 6845/371472 [33:05<27:45:14,  3.65it/s]
  2%|▏         | 6846/371472 [33:05<27:37:22,  3.67it/s]
  2%|▏         | 6847/371472 [33:06<29:33:22,  3.43it/s]
  2%|▏         | 6848/371472 [33:06<28:18:40,  3.58it/s]
  2%|▏         | 6849/371472 [33:06<27:59:14,  3.62it/s]
  2%|▏         | 6850/371472 [33:06<28:11:56,  3.59it/s]
  2%|▏         | 6851/371472 [33:07<28:15:55,  3.58it/s]
  2%|▏         | 6852/371472 [33:07<28:24:42,  3.56it/s]
  2%|▏         | 6853/371472 [33:07<28:04:01,  3.61it/s]
  2%|▏         | 6854/371472 [33:08<28:18:36,  3.58it/s]
  2%|▏         | 6855/371472 [33:08<28:57:43,  3.50it/s]
  2%|▏         | 6856/371472 [33:08<27:46:15,  3.65it/s]
  2%|▏         | 6857/371472 [33:08<27:59:21,  3.62it/s]
  2%|▏         | 6858/371472 [33:09<27:08:08,  3.73it/s]
  2%|▏         | 6859/371472 [33:09<26:22:25,  3.84it/s]
  2%|▏         | 6860/371472 [33:09<27:04:25,  3.74it/s]
                                                        
{'loss': 5.4848, 'learning_rate': 9.838555021655282e-07, 'epoch': 0.3}

  2%|▏         | 6860/371472 [33:09<27:04:25,  3.74it/s]
  2%|▏         | 6861/371472 [33:09<27:48:55,  3.64it/s]
  2%|▏         | 6862/371472 [33:10<29:24:39,  3.44it/s]
  2%|▏         | 6863/371472 [33:10<29:19:45,  3.45it/s]
  2%|▏         | 6864/371472 [33:10<28:51:24,  3.51it/s]
  2%|▏         | 6865/371472 [33:11<28:07:34,  3.60it/s]
  2%|▏         | 6866/371472 [33:11<28:31:49,  3.55it/s]
  2%|▏         | 6867/371472 [33:11<30:07:25,  3.36it/s]
  2%|▏         | 6868/371472 [33:12<28:56:15,  3.50it/s]
  2%|▏         | 6869/371472 [33:12<30:14:50,  3.35it/s]
  2%|▏         | 6870/371472 [33:12<29:31:04,  3.43it/s]
  2%|▏         | 6871/371472 [33:12<29:49:59,  3.39it/s]
  2%|▏         | 6872/371472 [33:13<28:52:45,  3.51it/s]
  2%|▏         | 6873/371472 [33:13<29:58:29,  3.38it/s]
  2%|▏         | 6874/371472 [33:13<29:47:04,  3.40it/s]
  2%|▏         | 6875/371472 [33:14<29:08:42,  3.47it/s]
  2%|▏         | 6876/371472 [33:14<28:01:05,  3.61it/s]
  2%|▏         | 6877/371472 [33:14<28:34:57,  3.54it/s]
  2%|▏         | 6878/371472 [33:14<28:10:21,  3.59it/s]
  2%|▏         | 6879/371472 [33:15<29:12:16,  3.47it/s]
  2%|▏         | 6880/371472 [33:15<30:50:15,  3.28it/s]
                                                        
{'loss': 5.1506, 'learning_rate': 9.838070201900493e-07, 'epoch': 0.3}

  2%|▏         | 6880/371472 [33:15<30:50:15,  3.28it/s]
  2%|▏         | 6881/371472 [33:15<29:24:03,  3.44it/s]
  2%|▏         | 6882/371472 [33:16<28:35:07,  3.54it/s]
  2%|▏         | 6883/371472 [33:16<28:17:56,  3.58it/s]
  2%|▏         | 6884/371472 [33:16<28:06:46,  3.60it/s]
  2%|▏         | 6885/371472 [33:16<28:32:52,  3.55it/s]
  2%|▏         | 6886/371472 [33:17<28:07:48,  3.60it/s]
  2%|▏         | 6887/371472 [33:17<27:49:00,  3.64it/s]
  2%|▏         | 6888/371472 [33:17<27:20:58,  3.70it/s]
  2%|▏         | 6889/371472 [33:18<28:11:53,  3.59it/s]
  2%|▏         | 6890/371472 [33:18<27:22:52,  3.70it/s]
  2%|▏         | 6891/371472 [33:18<30:49:30,  3.29it/s]
  2%|▏         | 6892/371472 [33:18<29:40:25,  3.41it/s]
  2%|▏         | 6893/371472 [33:19<29:05:26,  3.48it/s]
  2%|▏         | 6894/371472 [33:19<28:21:06,  3.57it/s]
  2%|▏         | 6895/371472 [33:19<28:34:55,  3.54it/s]
  2%|▏         | 6896/371472 [33:19<27:50:41,  3.64it/s]
  2%|▏         | 6897/371472 [33:20<27:55:10,  3.63it/s]
  2%|▏         | 6898/371472 [33:20<29:31:48,  3.43it/s]
  2%|▏         | 6899/371472 [33:20<28:51:05,  3.51it/s]
  2%|▏         | 6900/371472 [33:21<28:50:44,  3.51it/s]
                                                        
{'loss': 5.1673, 'learning_rate': 9.837585382145703e-07, 'epoch': 0.3}

  2%|▏         | 6900/371472 [33:21<28:50:44,  3.51it/s]
  2%|▏         | 6901/371472 [33:21<27:57:36,  3.62it/s]
  2%|▏         | 6902/371472 [33:21<27:07:27,  3.73it/s]
  2%|▏         | 6903/371472 [33:21<26:49:11,  3.78it/s]
  2%|▏         | 6904/371472 [33:22<28:03:17,  3.61it/s]
  2%|▏         | 6905/371472 [33:22<28:25:08,  3.56it/s]
  2%|▏         | 6906/371472 [33:22<28:43:47,  3.52it/s]
  2%|▏         | 6907/371472 [33:23<28:46:42,  3.52it/s]
  2%|▏         | 6908/371472 [33:23<29:26:31,  3.44it/s]
  2%|▏         | 6909/371472 [33:23<29:33:29,  3.43it/s]
  2%|▏         | 6910/371472 [33:23<29:36:41,  3.42it/s]
  2%|▏         | 6911/371472 [33:24<28:18:23,  3.58it/s]
  2%|▏         | 6912/371472 [33:24<29:35:34,  3.42it/s]
  2%|▏         | 6913/371472 [33:24<28:45:21,  3.52it/s]
  2%|▏         | 6914/371472 [33:25<28:27:27,  3.56it/s]
  2%|▏         | 6915/371472 [33:25<28:13:34,  3.59it/s]
  2%|▏         | 6916/371472 [33:25<29:00:16,  3.49it/s]
  2%|▏         | 6917/371472 [33:25<29:00:07,  3.49it/s]
  2%|▏         | 6918/371472 [33:26<28:08:09,  3.60it/s]
  2%|▏         | 6919/371472 [33:26<29:34:11,  3.42it/s]
  2%|▏         | 6920/371472 [33:26<29:30:05,  3.43it/s]
                                                        
{'loss': 5.0694, 'learning_rate': 9.837100562390916e-07, 'epoch': 0.3}

  2%|▏         | 6920/371472 [33:26<29:30:05,  3.43it/s]
  2%|▏         | 6921/371472 [33:27<28:41:24,  3.53it/s]
  2%|▏         | 6922/371472 [33:27<28:02:11,  3.61it/s]
  2%|▏         | 6923/371472 [33:27<27:20:59,  3.70it/s]
  2%|▏         | 6924/371472 [33:27<26:41:53,  3.79it/s]
  2%|▏         | 6925/371472 [33:28<27:23:44,  3.70it/s]
  2%|▏         | 6926/371472 [33:28<28:52:47,  3.51it/s]
  2%|▏         | 6927/371472 [33:28<28:21:45,  3.57it/s]
  2%|▏         | 6928/371472 [33:29<28:24:29,  3.56it/s]
  2%|▏         | 6929/371472 [33:29<28:12:21,  3.59it/s]
  2%|▏         | 6930/371472 [33:29<28:05:04,  3.61it/s]
  2%|▏         | 6931/371472 [33:29<29:49:09,  3.40it/s]
  2%|▏         | 6932/371472 [33:30<29:34:08,  3.42it/s]
  2%|▏         | 6933/371472 [33:30<28:10:36,  3.59it/s]
  2%|▏         | 6934/371472 [33:30<27:32:24,  3.68it/s]
  2%|▏         | 6935/371472 [33:30<27:09:08,  3.73it/s]
  2%|▏         | 6936/371472 [33:31<26:51:19,  3.77it/s]
  2%|▏         | 6937/371472 [33:31<26:51:31,  3.77it/s]
  2%|▏         | 6938/371472 [33:31<29:17:34,  3.46it/s]
  2%|▏         | 6939/371472 [33:32<28:26:09,  3.56it/s]
  2%|▏         | 6940/371472 [33:32<27:59:39,  3.62it/s]
                                                        
{'loss': 5.4286, 'learning_rate': 9.836615742636125e-07, 'epoch': 0.3}

  2%|▏         | 6940/371472 [33:32<27:59:39,  3.62it/s]
  2%|▏         | 6941/371472 [33:32<28:31:45,  3.55it/s]
  2%|▏         | 6942/371472 [33:32<30:31:30,  3.32it/s]
  2%|▏         | 6943/371472 [33:33<29:50:36,  3.39it/s]
  2%|▏         | 6944/371472 [33:33<29:08:20,  3.47it/s]
  2%|▏         | 6945/371472 [33:33<28:56:57,  3.50it/s]
  2%|▏         | 6946/371472 [33:34<29:21:22,  3.45it/s]
  2%|▏         | 6947/371472 [33:34<30:39:56,  3.30it/s]
  2%|▏         | 6948/371472 [33:34<32:29:25,  3.12it/s]
  2%|▏         | 6949/371472 [33:35<31:28:12,  3.22it/s]
  2%|▏         | 6950/371472 [33:35<32:33:20,  3.11it/s]
  2%|▏         | 6951/371472 [33:35<31:14:30,  3.24it/s]
  2%|▏         | 6952/371472 [33:36<32:18:35,  3.13it/s]
  2%|▏         | 6953/371472 [33:36<30:35:57,  3.31it/s]
  2%|▏         | 6954/371472 [33:36<30:02:11,  3.37it/s]
  2%|▏         | 6955/371472 [33:36<29:10:53,  3.47it/s]
  2%|▏         | 6956/371472 [33:37<28:19:21,  3.58it/s]
  2%|▏         | 6957/371472 [33:37<29:42:03,  3.41it/s]
  2%|▏         | 6958/371472 [33:37<28:36:54,  3.54it/s]
  2%|▏         | 6959/371472 [33:37<27:42:15,  3.65it/s]
  2%|▏         | 6960/371472 [33:38<27:51:59,  3.63it/s]
                                                        
{'loss': 4.9144, 'learning_rate': 9.836130922881338e-07, 'epoch': 0.3}

  2%|▏         | 6960/371472 [33:38<27:51:59,  3.63it/s]
  2%|▏         | 6961/371472 [33:38<27:54:43,  3.63it/s]
  2%|▏         | 6962/371472 [33:38<32:15:24,  3.14it/s]
  2%|▏         | 6963/371472 [33:39<36:03:32,  2.81it/s]
  2%|▏         | 6964/371472 [33:39<33:35:48,  3.01it/s]
  2%|▏         | 6965/371472 [33:40<34:03:04,  2.97it/s]
  2%|▏         | 6966/371472 [33:40<34:13:15,  2.96it/s]
  2%|▏         | 6967/371472 [33:40<31:51:24,  3.18it/s]
  2%|▏         | 6968/371472 [33:40<30:09:03,  3.36it/s]
  2%|▏         | 6969/371472 [33:41<28:58:18,  3.49it/s]
  2%|▏         | 6970/371472 [33:41<32:08:30,  3.15it/s]
  2%|▏         | 6971/371472 [33:41<31:42:24,  3.19it/s]
  2%|▏         | 6972/371472 [33:42<31:30:01,  3.21it/s]
  2%|▏         | 6973/371472 [33:42<31:20:46,  3.23it/s]
  2%|▏         | 6974/371472 [33:42<29:46:15,  3.40it/s]
  2%|▏         | 6975/371472 [33:42<29:21:21,  3.45it/s]
  2%|▏         | 6976/371472 [33:43<28:41:50,  3.53it/s]
  2%|▏         | 6977/371472 [33:43<28:25:56,  3.56it/s]
  2%|▏         | 6978/371472 [33:43<28:10:44,  3.59it/s]
  2%|▏         | 6979/371472 [33:44<28:10:22,  3.59it/s]
  2%|▏         | 6980/371472 [33:44<27:41:34,  3.66it/s]
                                                        
{'loss': 4.9661, 'learning_rate': 9.835646103126548e-07, 'epoch': 0.3}

  2%|▏         | 6980/371472 [33:44<27:41:34,  3.66it/s]
  2%|▏         | 6981/371472 [33:44<28:02:37,  3.61it/s]
  2%|▏         | 6982/371472 [33:44<28:05:17,  3.60it/s]
  2%|▏         | 6983/371472 [33:45<28:00:53,  3.61it/s]
  2%|▏         | 6984/371472 [33:45<29:31:29,  3.43it/s]
  2%|▏         | 6985/371472 [33:45<28:32:44,  3.55it/s]
  2%|▏         | 6986/371472 [33:46<29:40:16,  3.41it/s]
  2%|▏         | 6987/371472 [33:46<28:35:50,  3.54it/s]
  2%|▏         | 6988/371472 [33:46<28:46:44,  3.52it/s]
  2%|▏         | 6989/371472 [33:46<28:27:11,  3.56it/s]
  2%|▏         | 6990/371472 [33:47<29:06:19,  3.48it/s]
  2%|▏         | 6991/371472 [33:47<30:23:37,  3.33it/s]
  2%|▏         | 6992/371472 [33:47<30:03:03,  3.37it/s]
  2%|▏         | 6993/371472 [33:48<30:29:05,  3.32it/s]
  2%|▏         | 6994/371472 [33:48<31:47:16,  3.18it/s]
  2%|▏         | 6995/371472 [33:48<30:28:04,  3.32it/s]
  2%|▏         | 6996/371472 [33:48<29:09:07,  3.47it/s]
  2%|▏         | 6997/371472 [33:49<28:47:31,  3.52it/s]
  2%|▏         | 6998/371472 [33:49<28:20:59,  3.57it/s]
  2%|▏         | 6999/371472 [33:49<28:09:16,  3.60it/s]
  2%|▏         | 7000/371472 [33:50<27:40:34,  3.66it/s]
                                                        
{'loss': 5.0778, 'learning_rate': 9.83516128337176e-07, 'epoch': 0.3}

  2%|▏         | 7000/371472 [33:50<27:40:34,  3.66it/s]
  2%|▏         | 7001/371472 [33:50<27:20:22,  3.70it/s]
  2%|▏         | 7002/371472 [33:50<27:06:43,  3.73it/s]
  2%|▏         | 7003/371472 [33:50<27:50:20,  3.64it/s]
  2%|▏         | 7004/371472 [33:51<28:38:53,  3.53it/s]
  2%|▏         | 7005/371472 [33:51<28:20:49,  3.57it/s]
  2%|▏         | 7006/371472 [33:51<28:28:36,  3.56it/s]
  2%|▏         | 7007/371472 [33:52<27:26:16,  3.69it/s]
  2%|▏         | 7008/371472 [33:52<27:27:10,  3.69it/s]
  2%|▏         | 7009/371472 [33:52<28:25:23,  3.56it/s]
  2%|▏         | 7010/371472 [33:52<27:52:38,  3.63it/s]
  2%|▏         | 7011/371472 [33:53<29:02:43,  3.49it/s]
  2%|▏         | 7012/371472 [33:53<28:42:46,  3.53it/s]
  2%|▏         | 7013/371472 [33:53<29:17:42,  3.46it/s]
  2%|▏         | 7014/371472 [33:54<29:45:57,  3.40it/s]
  2%|▏         | 7015/371472 [33:54<28:46:45,  3.52it/s]
  2%|▏         | 7016/371472 [33:54<28:21:53,  3.57it/s]
  2%|▏         | 7017/371472 [33:54<28:21:30,  3.57it/s]
  2%|▏         | 7018/371472 [33:55<29:46:24,  3.40it/s]
  2%|▏         | 7019/371472 [33:55<28:51:27,  3.51it/s]
  2%|▏         | 7020/371472 [33:55<28:34:38,  3.54it/s]
                                                        
{'loss': 5.14, 'learning_rate': 9.83467646361697e-07, 'epoch': 0.3}

  2%|▏         | 7020/371472 [33:55<28:34:38,  3.54it/s]
  2%|▏         | 7021/371472 [33:56<28:56:52,  3.50it/s]
  2%|▏         | 7022/371472 [33:56<29:36:27,  3.42it/s]
  2%|▏         | 7023/371472 [33:56<34:27:14,  2.94it/s]
  2%|▏         | 7024/371472 [33:57<32:55:27,  3.07it/s]
  2%|▏         | 7025/371472 [33:57<32:06:37,  3.15it/s]
  2%|▏         | 7026/371472 [33:57<30:16:10,  3.34it/s]
  2%|▏         | 7027/371472 [33:58<32:53:52,  3.08it/s]
  2%|▏         | 7028/371472 [33:58<31:12:34,  3.24it/s]
  2%|▏         | 7029/371472 [33:58<30:12:04,  3.35it/s]
  2%|▏         | 7030/371472 [33:58<28:53:27,  3.50it/s]
  2%|▏         | 7031/371472 [33:59<28:30:44,  3.55it/s]
  2%|▏         | 7032/371472 [33:59<27:44:22,  3.65it/s]
  2%|▏         | 7033/371472 [33:59<27:50:59,  3.63it/s]
  2%|▏         | 7034/371472 [33:59<27:28:11,  3.69it/s]
  2%|▏         | 7035/371472 [34:00<30:33:39,  3.31it/s]
  2%|▏         | 7036/371472 [34:00<29:22:54,  3.45it/s]
  2%|▏         | 7037/371472 [34:00<28:41:06,  3.53it/s]
  2%|▏         | 7038/371472 [34:01<28:12:09,  3.59it/s]
  2%|▏         | 7039/371472 [34:01<28:08:06,  3.60it/s]
  2%|▏         | 7040/371472 [34:01<27:40:07,  3.66it/s]
                                                        
{'loss': 5.1204, 'learning_rate': 9.83419164386218e-07, 'epoch': 0.3}

  2%|▏         | 7040/371472 [34:01<27:40:07,  3.66it/s]
  2%|▏         | 7041/371472 [34:01<26:49:32,  3.77it/s]
  2%|▏         | 7042/371472 [34:02<28:43:53,  3.52it/s]
  2%|▏         | 7043/371472 [34:02<31:13:15,  3.24it/s]
  2%|▏         | 7044/371472 [34:02<30:39:33,  3.30it/s]
  2%|▏         | 7045/371472 [34:03<29:45:51,  3.40it/s]
  2%|▏         | 7046/371472 [34:03<28:48:18,  3.51it/s]
  2%|▏         | 7047/371472 [34:03<28:30:56,  3.55it/s]
  2%|▏         | 7048/371472 [34:03<30:03:54,  3.37it/s]
  2%|▏         | 7049/371472 [34:04<29:41:51,  3.41it/s]
  2%|▏         | 7050/371472 [34:04<29:20:34,  3.45it/s]
  2%|▏         | 7051/371472 [34:04<28:42:49,  3.53it/s]
  2%|▏         | 7052/371472 [34:05<27:44:46,  3.65it/s]
  2%|▏         | 7053/371472 [34:05<37:07:05,  2.73it/s]
  2%|▏         | 7054/371472 [34:05<34:19:50,  2.95it/s]
  2%|▏         | 7055/371472 [34:06<32:30:16,  3.11it/s]
  2%|▏         | 7056/371472 [34:06<31:07:27,  3.25it/s]
  2%|▏         | 7057/371472 [34:06<30:18:48,  3.34it/s]
  2%|▏         | 7058/371472 [34:07<29:41:49,  3.41it/s]
  2%|▏         | 7059/371472 [34:07<29:32:51,  3.43it/s]
  2%|▏         | 7060/371472 [34:07<30:14:38,  3.35it/s]
                                                        
{'loss': 4.942, 'learning_rate': 9.833706824107393e-07, 'epoch': 0.3}

  2%|▏         | 7060/371472 [34:07<30:14:38,  3.35it/s]
  2%|▏         | 7061/371472 [34:07<29:26:55,  3.44it/s]
  2%|▏         | 7062/371472 [34:08<28:49:45,  3.51it/s]
  2%|▏         | 7063/371472 [34:08<29:24:40,  3.44it/s]
  2%|▏         | 7064/371472 [34:08<27:57:38,  3.62it/s]
  2%|▏         | 7065/371472 [34:09<28:43:17,  3.52it/s]
  2%|▏         | 7066/371472 [34:09<28:58:55,  3.49it/s]
  2%|▏         | 7067/371472 [34:09<29:54:54,  3.38it/s]
  2%|▏         | 7068/371472 [34:09<29:35:13,  3.42it/s]
  2%|▏         | 7069/371472 [34:10<29:34:18,  3.42it/s]
  2%|▏         | 7070/371472 [34:10<29:09:59,  3.47it/s]
  2%|▏         | 7071/371472 [34:10<28:27:48,  3.56it/s]
  2%|▏         | 7072/371472 [34:11<28:56:18,  3.50it/s]
  2%|▏         | 7073/371472 [34:11<28:54:39,  3.50it/s]
  2%|▏         | 7074/371472 [34:11<28:42:35,  3.53it/s]
  2%|▏         | 7075/371472 [34:11<27:39:45,  3.66it/s]
  2%|▏         | 7076/371472 [34:12<27:04:40,  3.74it/s]
  2%|▏         | 7077/371472 [34:12<29:00:30,  3.49it/s]
  2%|▏         | 7078/371472 [34:12<29:16:06,  3.46it/s]
  2%|▏         | 7079/371472 [34:12<28:40:29,  3.53it/s]
  2%|▏         | 7080/371472 [34:13<34:35:14,  2.93it/s]
                                                        
{'loss': 5.08, 'learning_rate': 9.833222004352604e-07, 'epoch': 0.3}

  2%|▏         | 7080/371472 [34:13<34:35:14,  2.93it/s]
  2%|▏         | 7081/371472 [34:13<32:41:17,  3.10it/s]
  2%|▏         | 7082/371472 [34:14<32:04:16,  3.16it/s]
  2%|▏         | 7083/371472 [34:14<30:34:03,  3.31it/s]
  2%|▏         | 7084/371472 [34:14<30:18:19,  3.34it/s]
  2%|▏         | 7085/371472 [34:14<29:27:47,  3.44it/s]
  2%|▏         | 7086/371472 [34:15<29:55:43,  3.38it/s]
  2%|▏         | 7087/371472 [34:15<29:15:11,  3.46it/s]
  2%|▏         | 7088/371472 [34:15<28:12:10,  3.59it/s]
  2%|▏         | 7089/371472 [34:15<27:48:18,  3.64it/s]
  2%|▏         | 7090/371472 [34:16<27:11:02,  3.72it/s]
  2%|▏         | 7091/371472 [34:16<27:05:38,  3.74it/s]
  2%|▏         | 7092/371472 [34:16<27:37:35,  3.66it/s]
  2%|▏         | 7093/371472 [34:17<26:47:56,  3.78it/s]
  2%|▏         | 7094/371472 [34:17<26:54:34,  3.76it/s]
  2%|▏         | 7095/371472 [34:17<26:25:35,  3.83it/s]
  2%|▏         | 7096/371472 [34:17<27:49:40,  3.64it/s]
  2%|▏         | 7097/371472 [34:18<26:59:58,  3.75it/s]
  2%|▏         | 7098/371472 [34:18<28:48:28,  3.51it/s]
  2%|▏         | 7099/371472 [34:18<28:18:59,  3.57it/s]
  2%|▏         | 7100/371472 [34:18<28:15:30,  3.58it/s]
                                                        
{'loss': 5.1513, 'learning_rate': 9.832737184597815e-07, 'epoch': 0.31}

  2%|▏         | 7100/371472 [34:18<28:15:30,  3.58it/s]
  2%|▏         | 7101/371472 [34:19<28:50:37,  3.51it/s]
  2%|▏         | 7102/371472 [34:19<29:41:10,  3.41it/s]
  2%|▏         | 7103/371472 [34:20<33:58:09,  2.98it/s]
  2%|▏         | 7104/371472 [34:20<34:16:17,  2.95it/s]
  2%|▏         | 7105/371472 [34:20<32:35:00,  3.11it/s]
  2%|▏         | 7106/371472 [34:20<31:34:43,  3.21it/s]
  2%|▏         | 7107/371472 [34:21<29:47:48,  3.40it/s]
  2%|▏         | 7108/371472 [34:21<28:38:59,  3.53it/s]
  2%|▏         | 7109/371472 [34:21<30:22:20,  3.33it/s]
  2%|▏         | 7110/371472 [34:22<32:01:30,  3.16it/s]
  2%|▏         | 7111/371472 [34:22<30:33:22,  3.31it/s]
  2%|▏         | 7112/371472 [34:22<30:17:56,  3.34it/s]
  2%|▏         | 7113/371472 [34:22<28:41:21,  3.53it/s]
  2%|▏         | 7114/371472 [34:23<27:39:09,  3.66it/s]
  2%|▏         | 7115/371472 [34:23<27:00:57,  3.75it/s]
  2%|▏         | 7116/371472 [34:23<26:52:51,  3.77it/s]
  2%|▏         | 7117/371472 [34:23<27:12:38,  3.72it/s]
  2%|▏         | 7118/371472 [34:24<27:03:06,  3.74it/s]
  2%|▏         | 7119/371472 [34:24<27:20:32,  3.70it/s]
  2%|▏         | 7120/371472 [34:24<27:14:28,  3.72it/s]
                                                        
{'loss': 5.0832, 'learning_rate': 9.832252364843028e-07, 'epoch': 0.31}

  2%|▏         | 7120/371472 [34:24<27:14:28,  3.72it/s]
  2%|▏         | 7121/371472 [34:25<26:34:45,  3.81it/s]
  2%|▏         | 7122/371472 [34:25<28:09:54,  3.59it/s]
  2%|▏         | 7123/371472 [34:25<27:32:35,  3.67it/s]
  2%|▏         | 7124/371472 [34:25<27:46:14,  3.64it/s]
  2%|▏         | 7125/371472 [34:26<28:33:59,  3.54it/s]
  2%|▏         | 7126/371472 [34:26<27:48:46,  3.64it/s]
  2%|▏         | 7127/371472 [34:26<27:32:13,  3.68it/s]
  2%|▏         | 7128/371472 [34:27<27:29:53,  3.68it/s]
  2%|▏         | 7129/371472 [34:27<27:03:11,  3.74it/s]
  2%|▏         | 7130/371472 [34:27<26:33:22,  3.81it/s]
  2%|▏         | 7131/371472 [34:27<28:28:13,  3.55it/s]
  2%|▏         | 7132/371472 [34:28<31:40:33,  3.20it/s]
  2%|▏         | 7133/371472 [34:28<30:58:44,  3.27it/s]
  2%|▏         | 7134/371472 [34:28<29:31:04,  3.43it/s]
  2%|▏         | 7135/371472 [34:29<28:32:58,  3.54it/s]
  2%|▏         | 7136/371472 [34:29<29:17:36,  3.45it/s]
  2%|▏         | 7137/371472 [34:29<30:15:34,  3.34it/s]
  2%|▏         | 7138/371472 [34:29<30:04:31,  3.37it/s]
  2%|▏         | 7139/371472 [34:30<29:31:12,  3.43it/s]
  2%|▏         | 7140/371472 [34:30<28:28:40,  3.55it/s]
                                                        
{'loss': 5.1246, 'learning_rate': 9.831767545088236e-07, 'epoch': 0.31}

  2%|▏         | 7140/371472 [34:30<28:28:40,  3.55it/s]
  2%|▏         | 7141/371472 [34:30<29:20:24,  3.45it/s]
  2%|▏         | 7142/371472 [34:31<29:37:35,  3.42it/s]
  2%|▏         | 7143/371472 [34:31<29:11:45,  3.47it/s]
  2%|▏         | 7144/371472 [34:31<29:11:48,  3.47it/s]
  2%|▏         | 7145/371472 [34:31<29:48:57,  3.39it/s]
  2%|▏         | 7146/371472 [34:32<30:53:03,  3.28it/s]
  2%|▏         | 7147/371472 [34:32<35:06:48,  2.88it/s]
  2%|▏         | 7148/371472 [34:33<32:55:41,  3.07it/s]
  2%|▏         | 7149/371472 [34:33<32:11:29,  3.14it/s]
  2%|▏         | 7150/371472 [34:33<31:23:46,  3.22it/s]
  2%|▏         | 7151/371472 [34:33<30:42:08,  3.30it/s]
  2%|▏         | 7152/371472 [34:34<31:04:04,  3.26it/s]
  2%|▏         | 7153/371472 [34:34<30:22:47,  3.33it/s]
  2%|▏         | 7154/371472 [34:34<29:26:57,  3.44it/s]
  2%|▏         | 7155/371472 [34:35<28:38:02,  3.53it/s]
  2%|▏         | 7156/371472 [34:35<29:53:01,  3.39it/s]
  2%|▏         | 7157/371472 [34:35<29:10:19,  3.47it/s]
  2%|▏         | 7158/371472 [34:35<28:50:26,  3.51it/s]
  2%|▏         | 7159/371472 [34:36<30:04:27,  3.36it/s]
  2%|▏         | 7160/371472 [34:36<29:07:44,  3.47it/s]
                                                        
{'loss': 5.1067, 'learning_rate': 9.83128272533345e-07, 'epoch': 0.31}

  2%|▏         | 7160/371472 [34:36<29:07:44,  3.47it/s]
  2%|▏         | 7161/371472 [34:36<28:48:07,  3.51it/s]
  2%|▏         | 7162/371472 [34:37<30:20:49,  3.33it/s]
  2%|▏         | 7163/371472 [34:37<29:20:36,  3.45it/s]
  2%|▏         | 7164/371472 [34:37<28:51:09,  3.51it/s]
  2%|▏         | 7165/371472 [34:37<28:30:33,  3.55it/s]
  2%|▏         | 7166/371472 [34:38<28:35:04,  3.54it/s]
  2%|▏         | 7167/371472 [34:38<28:15:40,  3.58it/s]
  2%|▏         | 7168/371472 [34:38<27:42:49,  3.65it/s]
  2%|▏         | 7169/371472 [34:39<27:51:19,  3.63it/s]
  2%|▏         | 7170/371472 [34:39<28:32:42,  3.55it/s]
  2%|▏         | 7171/371472 [34:39<28:12:23,  3.59it/s]
  2%|▏         | 7172/371472 [34:39<28:27:11,  3.56it/s]
  2%|▏         | 7173/371472 [34:40<28:39:04,  3.53it/s]
  2%|▏         | 7174/371472 [34:40<28:13:36,  3.59it/s]
  2%|▏         | 7175/371472 [34:40<29:16:40,  3.46it/s]
  2%|▏         | 7176/371472 [34:41<28:27:56,  3.55it/s]
  2%|▏         | 7177/371472 [34:41<27:50:59,  3.63it/s]
  2%|▏         | 7178/371472 [34:41<27:30:41,  3.68it/s]
  2%|▏         | 7179/371472 [34:41<29:20:05,  3.45it/s]
  2%|▏         | 7180/371472 [34:42<29:01:41,  3.49it/s]
                                                        
{'loss': 5.0547, 'learning_rate': 9.830797905578658e-07, 'epoch': 0.31}

  2%|▏         | 7180/371472 [34:42<29:01:41,  3.49it/s]
  2%|▏         | 7181/371472 [34:42<30:20:41,  3.33it/s]
  2%|▏         | 7182/371472 [34:42<30:31:36,  3.31it/s]
  2%|▏         | 7183/371472 [34:43<29:26:38,  3.44it/s]
  2%|▏         | 7184/371472 [34:43<28:56:42,  3.50it/s]
  2%|▏         | 7185/371472 [34:43<28:51:23,  3.51it/s]
  2%|▏         | 7186/371472 [34:43<30:40:33,  3.30it/s]
  2%|▏         | 7187/371472 [34:44<30:43:34,  3.29it/s]
  2%|▏         | 7188/371472 [34:44<30:25:34,  3.33it/s]
  2%|▏         | 7189/371472 [34:44<29:47:43,  3.40it/s]
  2%|▏         | 7190/371472 [34:45<28:59:32,  3.49it/s]
  2%|▏         | 7191/371472 [34:45<28:45:21,  3.52it/s]
  2%|▏         | 7192/371472 [34:45<28:31:14,  3.55it/s]
  2%|▏         | 7193/371472 [34:45<29:03:08,  3.48it/s]
  2%|▏         | 7194/371472 [34:46<29:00:58,  3.49it/s]
  2%|▏         | 7195/371472 [34:46<29:04:08,  3.48it/s]
  2%|▏         | 7196/371472 [34:46<30:09:14,  3.36it/s]
  2%|▏         | 7197/371472 [34:47<29:04:28,  3.48it/s]
  2%|▏         | 7198/371472 [34:47<28:10:57,  3.59it/s]
  2%|▏         | 7199/371472 [34:47<35:24:24,  2.86it/s]
  2%|▏         | 7200/371472 [34:48<33:52:43,  2.99it/s]
                                                        
{'loss': 5.3209, 'learning_rate': 9.83031308582387e-07, 'epoch': 0.31}

  2%|▏         | 7200/371472 [34:48<33:52:43,  2.99it/s]
  2%|▏         | 7201/371472 [34:48<31:34:55,  3.20it/s]
  2%|▏         | 7202/371472 [34:48<31:06:34,  3.25it/s]
  2%|▏         | 7203/371472 [34:49<30:42:24,  3.30it/s]
  2%|▏         | 7204/371472 [34:49<30:12:42,  3.35it/s]
  2%|▏         | 7205/371472 [34:49<30:40:21,  3.30it/s]
  2%|▏         | 7206/371472 [34:49<30:07:29,  3.36it/s]
  2%|▏         | 7207/371472 [34:50<29:21:05,  3.45it/s]
  2%|▏         | 7208/371472 [34:50<28:31:28,  3.55it/s]
  2%|▏         | 7209/371472 [34:50<29:06:04,  3.48it/s]
  2%|▏         | 7210/371472 [34:51<28:54:44,  3.50it/s]
  2%|▏         | 7211/371472 [34:51<28:07:58,  3.60it/s]
  2%|▏         | 7212/371472 [34:51<28:05:42,  3.60it/s]
  2%|▏         | 7213/371472 [34:51<27:56:03,  3.62it/s]
  2%|▏         | 7214/371472 [34:52<27:46:09,  3.64it/s]
  2%|▏         | 7215/371472 [34:52<27:20:44,  3.70it/s]
  2%|▏         | 7216/371472 [34:52<30:10:47,  3.35it/s]
  2%|▏         | 7217/371472 [34:53<29:40:07,  3.41it/s]
  2%|▏         | 7218/371472 [34:53<32:37:05,  3.10it/s]
  2%|▏         | 7219/371472 [34:53<32:17:32,  3.13it/s]
  2%|▏         | 7220/371472 [34:54<30:55:24,  3.27it/s]
                                                        
{'loss': 5.1226, 'learning_rate': 9.829828266069081e-07, 'epoch': 0.31}

  2%|▏         | 7220/371472 [34:54<30:55:24,  3.27it/s]
  2%|▏         | 7221/371472 [34:54<29:25:15,  3.44it/s]
  2%|▏         | 7222/371472 [34:54<29:31:19,  3.43it/s]
  2%|▏         | 7223/371472 [34:54<29:14:17,  3.46it/s]
  2%|▏         | 7224/371472 [34:55<28:31:09,  3.55it/s]
  2%|▏         | 7225/371472 [34:55<28:04:16,  3.60it/s]
  2%|▏         | 7226/371472 [34:55<27:35:37,  3.67it/s]
  2%|▏         | 7227/371472 [34:55<27:47:59,  3.64it/s]
  2%|▏         | 7228/371472 [34:56<27:12:46,  3.72it/s]
  2%|▏         | 7229/371472 [34:56<27:09:21,  3.73it/s]
  2%|▏         | 7230/371472 [34:56<27:27:02,  3.69it/s]
  2%|▏         | 7231/371472 [34:56<27:50:37,  3.63it/s]
  2%|▏         | 7232/371472 [34:57<29:13:45,  3.46it/s]
  2%|▏         | 7233/371472 [34:57<29:34:15,  3.42it/s]
  2%|▏         | 7234/371472 [34:57<28:51:05,  3.51it/s]
  2%|▏         | 7235/371472 [34:58<28:37:42,  3.53it/s]
  2%|▏         | 7236/371472 [34:58<27:58:33,  3.62it/s]
  2%|▏         | 7237/371472 [34:58<27:35:01,  3.67it/s]
  2%|▏         | 7238/371472 [34:58<27:13:21,  3.72it/s]
  2%|▏         | 7239/371472 [34:59<27:29:58,  3.68it/s]
  2%|▏         | 7240/371472 [34:59<27:23:07,  3.69it/s]
                                                        
{'loss': 5.2013, 'learning_rate': 9.829343446314292e-07, 'epoch': 0.31}

  2%|▏         | 7240/371472 [34:59<27:23:07,  3.69it/s]
  2%|▏         | 7241/371472 [34:59<27:42:50,  3.65it/s]
  2%|▏         | 7242/371472 [35:00<28:35:06,  3.54it/s]
  2%|▏         | 7243/371472 [35:00<28:51:27,  3.51it/s]
  2%|▏         | 7244/371472 [35:00<28:34:53,  3.54it/s]
  2%|▏         | 7245/371472 [35:01<34:03:09,  2.97it/s]
  2%|▏         | 7246/371472 [35:01<35:31:24,  2.85it/s]
  2%|▏         | 7247/371472 [35:01<32:49:04,  3.08it/s]
  2%|▏         | 7248/371472 [35:02<31:25:58,  3.22it/s]
  2%|▏         | 7249/371472 [35:02<30:15:25,  3.34it/s]
  2%|▏         | 7250/371472 [35:02<29:17:59,  3.45it/s]
  2%|▏         | 7251/371472 [35:02<28:29:24,  3.55it/s]
  2%|▏         | 7252/371472 [35:03<28:08:47,  3.59it/s]
  2%|▏         | 7253/371472 [35:03<28:56:09,  3.50it/s]
  2%|▏         | 7254/371472 [35:03<28:58:46,  3.49it/s]
  2%|▏         | 7255/371472 [35:03<28:19:44,  3.57it/s]
  2%|▏         | 7256/371472 [35:04<30:35:22,  3.31it/s]
  2%|▏         | 7257/371472 [35:04<30:10:31,  3.35it/s]
  2%|▏         | 7258/371472 [35:04<28:50:34,  3.51it/s]
  2%|▏         | 7259/371472 [35:05<28:17:18,  3.58it/s]
  2%|▏         | 7260/371472 [35:05<28:13:01,  3.59it/s]
                                                        
{'loss': 5.1918, 'learning_rate': 9.828858626559505e-07, 'epoch': 0.31}

  2%|▏         | 7260/371472 [35:05<28:13:01,  3.59it/s]
  2%|▏         | 7261/371472 [35:05<27:36:31,  3.66it/s]
  2%|▏         | 7262/371472 [35:05<28:20:28,  3.57it/s]
  2%|▏         | 7263/371472 [35:06<28:26:07,  3.56it/s]
  2%|▏         | 7264/371472 [35:06<28:50:55,  3.51it/s]
  2%|▏         | 7265/371472 [35:06<28:48:45,  3.51it/s]
  2%|▏         | 7266/371472 [35:07<29:32:42,  3.42it/s]
  2%|▏         | 7267/371472 [35:07<29:59:13,  3.37it/s]
  2%|▏         | 7268/371472 [35:07<28:44:54,  3.52it/s]
  2%|▏         | 7269/371472 [35:07<28:20:43,  3.57it/s]
  2%|▏         | 7270/371472 [35:08<28:08:19,  3.60it/s]
  2%|▏         | 7271/371472 [35:08<27:45:06,  3.65it/s]
  2%|▏         | 7272/371472 [35:08<28:19:12,  3.57it/s]
  2%|▏         | 7273/371472 [35:09<29:54:28,  3.38it/s]
  2%|▏         | 7274/371472 [35:09<30:18:15,  3.34it/s]
  2%|▏         | 7275/371472 [35:09<30:39:28,  3.30it/s]
  2%|▏         | 7276/371472 [35:10<29:09:36,  3.47it/s]
  2%|▏         | 7277/371472 [35:10<28:39:16,  3.53it/s]
  2%|▏         | 7278/371472 [35:10<28:18:56,  3.57it/s]
  2%|▏         | 7279/371472 [35:10<28:04:36,  3.60it/s]
  2%|▏         | 7280/371472 [35:11<28:01:22,  3.61it/s]
                                                        
{'loss': 5.1001, 'learning_rate': 9.828373806804713e-07, 'epoch': 0.31}

  2%|▏         | 7280/371472 [35:11<28:01:22,  3.61it/s]
  2%|▏         | 7281/371472 [35:11<28:55:14,  3.50it/s]
  2%|▏         | 7282/371472 [35:11<30:53:26,  3.27it/s]
  2%|▏         | 7283/371472 [35:12<31:00:57,  3.26it/s]
  2%|▏         | 7284/371472 [35:12<30:52:53,  3.28it/s]
  2%|▏         | 7285/371472 [35:12<30:03:27,  3.37it/s]
  2%|▏         | 7286/371472 [35:12<28:40:19,  3.53it/s]
  2%|▏         | 7287/371472 [35:13<28:11:38,  3.59it/s]
  2%|▏         | 7288/371472 [35:13<29:11:06,  3.47it/s]
  2%|▏         | 7289/371472 [35:13<29:04:25,  3.48it/s]
  2%|▏         | 7290/371472 [35:14<29:26:09,  3.44it/s]
  2%|▏         | 7291/371472 [35:14<28:43:19,  3.52it/s]
  2%|▏         | 7292/371472 [35:14<29:19:38,  3.45it/s]
  2%|▏         | 7293/371472 [35:14<28:21:20,  3.57it/s]
  2%|▏         | 7294/371472 [35:15<28:03:07,  3.61it/s]
  2%|▏         | 7295/371472 [35:15<30:12:35,  3.35it/s]
  2%|▏         | 7296/371472 [35:15<30:14:55,  3.34it/s]
  2%|▏         | 7297/371472 [35:16<30:11:09,  3.35it/s]
  2%|▏         | 7298/371472 [35:16<33:37:47,  3.01it/s]
  2%|▏         | 7299/371472 [35:16<33:32:34,  3.02it/s]
  2%|▏         | 7300/371472 [35:17<32:34:57,  3.10it/s]
                                                        
{'loss': 5.1812, 'learning_rate': 9.827888987049926e-07, 'epoch': 0.31}

  2%|▏         | 7300/371472 [35:17<32:34:57,  3.10it/s]
  2%|▏         | 7301/371472 [35:17<33:23:25,  3.03it/s]
  2%|▏         | 7302/371472 [35:17<32:10:58,  3.14it/s]
  2%|▏         | 7303/371472 [35:18<30:04:34,  3.36it/s]
  2%|▏         | 7304/371472 [35:18<32:23:37,  3.12it/s]
  2%|▏         | 7305/371472 [35:18<31:13:49,  3.24it/s]
  2%|▏         | 7306/371472 [35:18<29:31:57,  3.43it/s]
  2%|▏         | 7307/371472 [35:19<30:48:59,  3.28it/s]
  2%|▏         | 7308/371472 [35:19<30:46:01,  3.29it/s]
  2%|▏         | 7309/371472 [35:19<30:42:08,  3.29it/s]
  2%|▏         | 7310/371472 [35:20<29:33:28,  3.42it/s]
  2%|▏         | 7311/371472 [35:20<28:33:19,  3.54it/s]
  2%|▏         | 7312/371472 [35:20<28:29:42,  3.55it/s]
  2%|▏         | 7313/371472 [35:20<27:35:26,  3.67it/s]
  2%|▏         | 7314/371472 [35:21<29:23:15,  3.44it/s]
  2%|▏         | 7315/371472 [35:21<30:26:17,  3.32it/s]
  2%|▏         | 7316/371472 [35:21<30:10:31,  3.35it/s]
  2%|▏         | 7317/371472 [35:22<29:03:59,  3.48it/s]
  2%|▏         | 7318/371472 [35:22<28:07:06,  3.60it/s]
  2%|▏         | 7319/371472 [35:22<27:49:32,  3.64it/s]
  2%|▏         | 7320/371472 [35:22<27:22:19,  3.70it/s]
                                                        
{'loss': 4.9552, 'learning_rate': 9.827404167295135e-07, 'epoch': 0.32}

  2%|▏         | 7320/371472 [35:22<27:22:19,  3.70it/s]
  2%|▏         | 7321/371472 [35:23<26:52:40,  3.76it/s]
  2%|▏         | 7322/371472 [35:23<26:47:14,  3.78it/s]
  2%|▏         | 7323/371472 [35:23<27:52:19,  3.63it/s]
  2%|▏         | 7324/371472 [35:24<27:36:48,  3.66it/s]
  2%|▏         | 7325/371472 [35:24<27:28:38,  3.68it/s]
  2%|▏         | 7326/371472 [35:24<26:57:49,  3.75it/s]
  2%|▏         | 7327/371472 [35:24<26:38:52,  3.80it/s]
  2%|▏         | 7328/371472 [35:25<26:26:03,  3.83it/s]
  2%|▏         | 7329/371472 [35:25<28:55:33,  3.50it/s]
  2%|▏         | 7330/371472 [35:25<29:04:58,  3.48it/s]
  2%|▏         | 7331/371472 [35:25<29:03:43,  3.48it/s]
  2%|▏         | 7332/371472 [35:26<29:29:50,  3.43it/s]
  2%|▏         | 7333/371472 [35:26<29:02:05,  3.48it/s]
  2%|▏         | 7334/371472 [35:26<28:56:49,  3.49it/s]
  2%|▏         | 7335/371472 [35:27<28:03:03,  3.61it/s]
  2%|▏         | 7336/371472 [35:27<28:44:39,  3.52it/s]
  2%|▏         | 7337/371472 [35:27<28:48:33,  3.51it/s]
  2%|▏         | 7338/371472 [35:27<29:08:05,  3.47it/s]
  2%|▏         | 7339/371472 [35:28<29:57:56,  3.38it/s]
  2%|▏         | 7340/371472 [35:28<28:51:42,  3.50it/s]
                                                        
{'loss': 5.221, 'learning_rate': 9.826919347540348e-07, 'epoch': 0.32}

  2%|▏         | 7340/371472 [35:28<28:51:42,  3.50it/s]
  2%|▏         | 7341/371472 [35:28<28:19:23,  3.57it/s]
  2%|▏         | 7342/371472 [35:29<28:46:39,  3.51it/s]
  2%|▏         | 7343/371472 [35:29<31:28:29,  3.21it/s]
  2%|▏         | 7344/371472 [35:29<30:13:14,  3.35it/s]
  2%|▏         | 7345/371472 [35:30<28:37:53,  3.53it/s]
  2%|▏         | 7346/371472 [35:30<28:38:12,  3.53it/s]
  2%|▏         | 7347/371472 [35:30<28:09:35,  3.59it/s]
  2%|▏         | 7348/371472 [35:30<28:57:02,  3.49it/s]
  2%|▏         | 7349/371472 [35:31<29:37:13,  3.41it/s]
  2%|▏         | 7350/371472 [35:31<30:04:38,  3.36it/s]
  2%|▏         | 7351/371472 [35:31<30:27:37,  3.32it/s]
  2%|▏         | 7352/371472 [35:32<29:04:44,  3.48it/s]
  2%|▏         | 7353/371472 [35:32<29:37:16,  3.41it/s]
  2%|▏         | 7354/371472 [35:32<29:02:49,  3.48it/s]
  2%|▏         | 7355/371472 [35:32<28:46:29,  3.51it/s]
  2%|▏         | 7356/371472 [35:33<28:46:13,  3.52it/s]
  2%|▏         | 7357/371472 [35:33<28:20:56,  3.57it/s]
  2%|▏         | 7358/371472 [35:33<28:10:04,  3.59it/s]
  2%|▏         | 7359/371472 [35:34<31:16:41,  3.23it/s]
  2%|▏         | 7360/371472 [35:34<31:30:53,  3.21it/s]
                                                        
{'loss': 4.8989, 'learning_rate': 9.826434527785558e-07, 'epoch': 0.32}

  2%|▏         | 7360/371472 [35:34<31:30:53,  3.21it/s]
  2%|▏         | 7361/371472 [35:34<30:05:37,  3.36it/s]
  2%|▏         | 7362/371472 [35:34<28:50:43,  3.51it/s]
  2%|▏         | 7363/371472 [35:35<29:31:01,  3.43it/s]
  2%|▏         | 7364/371472 [35:35<28:45:31,  3.52it/s]
  2%|▏         | 7365/371472 [35:35<27:45:06,  3.64it/s]
  2%|▏         | 7366/371472 [35:36<28:49:08,  3.51it/s]
  2%|▏         | 7367/371472 [35:36<30:12:10,  3.35it/s]
  2%|▏         | 7368/371472 [35:36<29:28:06,  3.43it/s]
  2%|▏         | 7369/371472 [35:36<29:29:42,  3.43it/s]
  2%|▏         | 7370/371472 [35:37<29:56:58,  3.38it/s]
  2%|▏         | 7371/371472 [35:37<29:42:43,  3.40it/s]
  2%|▏         | 7372/371472 [35:37<28:27:19,  3.55it/s]
  2%|▏         | 7373/371472 [35:38<27:53:33,  3.63it/s]
  2%|▏         | 7374/371472 [35:38<28:35:29,  3.54it/s]
  2%|▏         | 7375/371472 [35:38<27:47:03,  3.64it/s]
  2%|▏         | 7376/371472 [35:38<26:48:18,  3.77it/s]
  2%|▏         | 7377/371472 [35:39<26:32:08,  3.81it/s]
  2%|▏         | 7378/371472 [35:39<27:00:17,  3.75it/s]
  2%|▏         | 7379/371472 [35:39<27:14:57,  3.71it/s]
  2%|▏         | 7380/371472 [35:39<26:43:59,  3.78it/s]
                                                        
{'loss': 5.2631, 'learning_rate': 9.82594970803077e-07, 'epoch': 0.32}

  2%|▏         | 7380/371472 [35:39<26:43:59,  3.78it/s]
  2%|▏         | 7381/371472 [35:40<29:42:00,  3.41it/s]
  2%|▏         | 7382/371472 [35:40<29:40:31,  3.41it/s]
  2%|▏         | 7383/371472 [35:40<29:40:11,  3.41it/s]
  2%|▏         | 7384/371472 [35:41<30:05:09,  3.36it/s]
  2%|▏         | 7385/371472 [35:41<30:51:59,  3.28it/s]
  2%|▏         | 7386/371472 [35:41<29:31:23,  3.43it/s]
  2%|▏         | 7387/371472 [35:42<30:43:26,  3.29it/s]
  2%|▏         | 7388/371472 [35:42<29:23:16,  3.44it/s]
  2%|▏         | 7389/371472 [35:42<28:36:10,  3.54it/s]
  2%|▏         | 7390/371472 [35:42<27:59:46,  3.61it/s]
  2%|▏         | 7391/371472 [35:43<28:32:10,  3.54it/s]
  2%|▏         | 7392/371472 [35:43<28:13:05,  3.58it/s]
  2%|▏         | 7393/371472 [35:43<29:06:23,  3.47it/s]
  2%|▏         | 7394/371472 [35:44<28:32:22,  3.54it/s]
  2%|▏         | 7395/371472 [35:44<28:43:58,  3.52it/s]
  2%|▏         | 7396/371472 [35:44<28:41:17,  3.53it/s]
  2%|▏         | 7397/371472 [35:44<29:23:55,  3.44it/s]
  2%|▏         | 7398/371472 [35:45<28:27:35,  3.55it/s]
  2%|▏         | 7399/371472 [35:45<28:54:58,  3.50it/s]
  2%|▏         | 7400/371472 [35:45<29:42:01,  3.41it/s]
                                                        
{'loss': 5.0938, 'learning_rate': 9.82546488827598e-07, 'epoch': 0.32}

  2%|▏         | 7400/371472 [35:45<29:42:01,  3.41it/s]
  2%|▏         | 7401/371472 [35:46<28:52:07,  3.50it/s]
  2%|▏         | 7402/371472 [35:46<27:52:22,  3.63it/s]
  2%|▏         | 7403/371472 [35:46<27:15:31,  3.71it/s]
  2%|▏         | 7404/371472 [35:46<30:06:42,  3.36it/s]
  2%|▏         | 7405/371472 [35:47<30:26:38,  3.32it/s]
  2%|▏         | 7406/371472 [35:47<29:57:31,  3.38it/s]
  2%|▏         | 7407/371472 [35:47<29:47:06,  3.40it/s]
  2%|▏         | 7408/371472 [35:48<30:11:07,  3.35it/s]
  2%|▏         | 7409/371472 [35:48<29:18:33,  3.45it/s]
  2%|▏         | 7410/371472 [35:48<29:00:41,  3.49it/s]
  2%|▏         | 7411/371472 [35:48<30:06:06,  3.36it/s]
  2%|▏         | 7412/371472 [35:49<29:38:25,  3.41it/s]
  2%|▏         | 7413/371472 [35:49<29:19:23,  3.45it/s]
  2%|▏         | 7414/371472 [35:49<29:43:29,  3.40it/s]
  2%|▏         | 7415/371472 [35:50<28:43:01,  3.52it/s]
  2%|▏         | 7416/371472 [35:50<27:55:42,  3.62it/s]
  2%|▏         | 7417/371472 [35:50<29:11:35,  3.46it/s]
  2%|▏         | 7418/371472 [35:50<29:20:04,  3.45it/s]
  2%|▏         | 7419/371472 [35:51<31:27:48,  3.21it/s]
  2%|▏         | 7420/371472 [35:51<31:52:32,  3.17it/s]
                                                        
{'loss': 5.0062, 'learning_rate': 9.82498006852119e-07, 'epoch': 0.32}

  2%|▏         | 7420/371472 [35:51<31:52:32,  3.17it/s]
  2%|▏         | 7421/371472 [35:51<30:50:15,  3.28it/s]
  2%|▏         | 7422/371472 [35:52<29:03:47,  3.48it/s]
  2%|▏         | 7423/371472 [35:52<28:29:39,  3.55it/s]
  2%|▏         | 7424/371472 [35:52<28:34:08,  3.54it/s]
  2%|▏         | 7425/371472 [35:53<28:17:01,  3.58it/s]
  2%|▏         | 7426/371472 [35:53<29:29:08,  3.43it/s]
  2%|▏         | 7427/371472 [35:53<29:14:20,  3.46it/s]
  2%|▏         | 7428/371472 [35:53<29:22:26,  3.44it/s]
  2%|▏         | 7429/371472 [35:54<29:57:34,  3.38it/s]
  2%|▏         | 7430/371472 [35:54<31:06:55,  3.25it/s]
  2%|▏         | 7431/371472 [35:54<34:10:08,  2.96it/s]
  2%|▏         | 7432/371472 [35:55<32:23:15,  3.12it/s]
  2%|▏         | 7433/371472 [35:55<31:25:32,  3.22it/s]
  2%|▏         | 7434/371472 [35:55<31:40:09,  3.19it/s]
  2%|▏         | 7435/371472 [35:56<32:36:16,  3.10it/s]
  2%|▏         | 7436/371472 [35:56<30:53:01,  3.27it/s]
  2%|▏         | 7437/371472 [35:56<30:57:00,  3.27it/s]
  2%|▏         | 7438/371472 [35:57<30:01:43,  3.37it/s]
  2%|▏         | 7439/371472 [35:57<29:03:19,  3.48it/s]
  2%|▏         | 7440/371472 [35:57<28:03:17,  3.60it/s]
                                                        
{'loss': 4.9372, 'learning_rate': 9.824495248766403e-07, 'epoch': 0.32}

  2%|▏         | 7440/371472 [35:57<28:03:17,  3.60it/s]
  2%|▏         | 7441/371472 [35:57<27:44:27,  3.65it/s]
  2%|▏         | 7442/371472 [35:58<27:57:04,  3.62it/s]
  2%|▏         | 7443/371472 [35:58<27:18:50,  3.70it/s]
  2%|▏         | 7444/371472 [35:58<26:48:01,  3.77it/s]
  2%|▏         | 7445/371472 [35:58<27:19:15,  3.70it/s]
  2%|▏         | 7446/371472 [35:59<27:24:09,  3.69it/s]
  2%|▏         | 7447/371472 [35:59<27:18:36,  3.70it/s]
  2%|▏         | 7448/371472 [35:59<27:59:33,  3.61it/s]
  2%|▏         | 7449/371472 [36:00<27:58:24,  3.61it/s]
  2%|▏         | 7450/371472 [36:00<29:21:18,  3.44it/s]
  2%|▏         | 7451/371472 [36:00<32:13:35,  3.14it/s]
  2%|▏         | 7452/371472 [36:01<30:57:53,  3.27it/s]
  2%|▏         | 7453/371472 [36:01<30:07:20,  3.36it/s]
  2%|▏         | 7454/371472 [36:01<34:17:12,  2.95it/s]
  2%|▏         | 7455/371472 [36:02<34:50:02,  2.90it/s]
  2%|▏         | 7456/371472 [36:02<33:10:59,  3.05it/s]
  2%|▏         | 7457/371472 [36:02<37:49:24,  2.67it/s]
  2%|▏         | 7458/371472 [36:03<34:25:12,  2.94it/s]
  2%|▏         | 7459/371472 [36:03<32:21:06,  3.13it/s]
  2%|▏         | 7460/371472 [36:03<30:08:14,  3.36it/s]
                                                        
{'loss': 4.8481, 'learning_rate': 9.824010429011614e-07, 'epoch': 0.32}

  2%|▏         | 7460/371472 [36:03<30:08:14,  3.36it/s]
  2%|▏         | 7461/371472 [36:03<30:39:26,  3.30it/s]
  2%|▏         | 7462/371472 [36:04<30:53:09,  3.27it/s]
  2%|▏         | 7463/371472 [36:04<29:10:28,  3.47it/s]
  2%|▏         | 7464/371472 [36:04<28:49:53,  3.51it/s]
  2%|▏         | 7465/371472 [36:05<27:59:03,  3.61it/s]
  2%|▏         | 7466/371472 [36:05<28:12:41,  3.58it/s]
  2%|▏         | 7467/371472 [36:05<27:32:21,  3.67it/s]
  2%|▏         | 7468/371472 [36:05<27:00:56,  3.74it/s]
  2%|▏         | 7469/371472 [36:06<27:41:13,  3.65it/s]
  2%|▏         | 7470/371472 [36:06<29:32:39,  3.42it/s]
  2%|▏         | 7471/371472 [36:06<28:54:00,  3.50it/s]
  2%|▏         | 7472/371472 [36:07<29:58:46,  3.37it/s]
  2%|▏         | 7473/371472 [36:07<29:41:58,  3.40it/s]
  2%|▏         | 7474/371472 [36:07<29:54:40,  3.38it/s]
  2%|▏         | 7475/371472 [36:07<28:18:09,  3.57it/s]
  2%|▏         | 7476/371472 [36:08<27:51:25,  3.63it/s]
  2%|▏         | 7477/371472 [36:08<38:59:04,  2.59it/s]
  2%|▏         | 7478/371472 [36:09<34:59:50,  2.89it/s]
  2%|▏         | 7479/371472 [36:09<34:23:25,  2.94it/s]
  2%|▏         | 7480/371472 [36:09<32:30:52,  3.11it/s]
                                                        
{'loss': 4.8534, 'learning_rate': 9.823525609256825e-07, 'epoch': 0.32}

  2%|▏         | 7480/371472 [36:09<32:30:52,  3.11it/s]
  2%|▏         | 7481/371472 [36:09<32:12:45,  3.14it/s]
  2%|▏         | 7482/371472 [36:10<30:36:44,  3.30it/s]
  2%|▏         | 7483/371472 [36:10<30:20:28,  3.33it/s]
  2%|▏         | 7484/371472 [36:10<28:58:34,  3.49it/s]
  2%|▏         | 7485/371472 [36:11<29:08:30,  3.47it/s]
  2%|▏         | 7486/371472 [36:11<29:04:44,  3.48it/s]
  2%|▏         | 7487/371472 [36:11<29:50:27,  3.39it/s]
  2%|▏         | 7488/371472 [36:11<29:16:10,  3.45it/s]
  2%|▏         | 7489/371472 [36:12<29:38:45,  3.41it/s]
  2%|▏         | 7490/371472 [36:12<28:59:31,  3.49it/s]
  2%|▏         | 7491/371472 [36:12<29:32:35,  3.42it/s]
  2%|▏         | 7492/371472 [36:13<30:05:14,  3.36it/s]
  2%|▏         | 7493/371472 [36:13<29:21:22,  3.44it/s]
  2%|▏         | 7494/371472 [36:13<29:49:05,  3.39it/s]
  2%|▏         | 7495/371472 [36:13<29:18:14,  3.45it/s]
  2%|▏         | 7496/371472 [36:14<29:06:32,  3.47it/s]
  2%|▏         | 7497/371472 [36:14<27:49:49,  3.63it/s]
  2%|▏         | 7498/371472 [36:14<27:21:39,  3.70it/s]
  2%|▏         | 7499/371472 [36:15<30:40:33,  3.30it/s]
  2%|▏         | 7500/371472 [36:15<29:35:17,  3.42it/s]
                                                        
{'loss': 4.9954, 'learning_rate': 9.823040789502038e-07, 'epoch': 0.32}

  2%|▏         | 7500/371472 [36:15<29:35:17,  3.42it/s]
  2%|▏         | 7501/371472 [36:15<30:39:28,  3.30it/s]
  2%|▏         | 7502/371472 [36:16<30:04:10,  3.36it/s]
  2%|▏         | 7503/371472 [36:16<29:14:55,  3.46it/s]
  2%|▏         | 7504/371472 [36:16<28:40:50,  3.53it/s]
  2%|▏         | 7505/371472 [36:16<28:11:20,  3.59it/s]
  2%|▏         | 7506/371472 [36:17<31:05:34,  3.25it/s]
  2%|▏         | 7507/371472 [36:17<29:26:35,  3.43it/s]
  2%|▏         | 7508/371472 [36:17<29:09:35,  3.47it/s]
  2%|▏         | 7509/371472 [36:18<28:58:07,  3.49it/s]
  2%|▏         | 7510/371472 [36:18<28:56:59,  3.49it/s]
  2%|▏         | 7511/371472 [36:18<29:17:48,  3.45it/s]
  2%|▏         | 7512/371472 [36:18<28:28:47,  3.55it/s]
  2%|▏         | 7513/371472 [36:19<28:07:30,  3.59it/s]
  2%|▏         | 7514/371472 [36:19<31:18:07,  3.23it/s]
  2%|▏         | 7515/371472 [36:19<30:11:43,  3.35it/s]
  2%|▏         | 7516/371472 [36:20<28:55:09,  3.50it/s]
  2%|▏         | 7517/371472 [36:20<28:02:20,  3.61it/s]
  2%|▏         | 7518/371472 [36:20<30:18:09,  3.34it/s]
  2%|▏         | 7519/371472 [36:21<31:15:51,  3.23it/s]
  2%|▏         | 7520/371472 [36:21<29:56:04,  3.38it/s]
                                                        
{'loss': 4.8983, 'learning_rate': 9.822555969747246e-07, 'epoch': 0.32}

  2%|▏         | 7520/371472 [36:21<29:56:04,  3.38it/s]
  2%|▏         | 7521/371472 [36:21<29:38:11,  3.41it/s]
  2%|▏         | 7522/371472 [36:21<30:51:20,  3.28it/s]
  2%|▏         | 7523/371472 [36:22<29:42:52,  3.40it/s]
  2%|▏         | 7524/371472 [36:22<28:40:48,  3.52it/s]
  2%|▏         | 7525/371472 [36:22<27:51:48,  3.63it/s]
  2%|▏         | 7526/371472 [36:22<27:52:29,  3.63it/s]
  2%|▏         | 7527/371472 [36:23<29:12:23,  3.46it/s]
  2%|▏         | 7528/371472 [36:23<28:48:32,  3.51it/s]
  2%|▏         | 7529/371472 [36:23<29:26:35,  3.43it/s]
  2%|▏         | 7530/371472 [36:24<28:46:48,  3.51it/s]
  2%|▏         | 7531/371472 [36:24<28:43:04,  3.52it/s]
  2%|▏         | 7532/371472 [36:24<28:05:18,  3.60it/s]
  2%|▏         | 7533/371472 [36:24<28:18:44,  3.57it/s]
  2%|▏         | 7534/371472 [36:25<31:37:32,  3.20it/s]
  2%|▏         | 7535/371472 [36:25<30:46:45,  3.28it/s]
  2%|▏         | 7536/371472 [36:25<30:44:35,  3.29it/s]
  2%|▏         | 7537/371472 [36:26<29:42:06,  3.40it/s]
  2%|▏         | 7538/371472 [36:26<29:46:31,  3.40it/s]
  2%|▏         | 7539/371472 [36:26<30:45:44,  3.29it/s]
  2%|▏         | 7540/371472 [36:27<29:46:36,  3.40it/s]
                                                        
{'loss': 5.0276, 'learning_rate': 9.82207114999246e-07, 'epoch': 0.32}

  2%|▏         | 7540/371472 [36:27<29:46:36,  3.40it/s]
  2%|▏         | 7541/371472 [36:27<29:56:28,  3.38it/s]
  2%|▏         | 7542/371472 [36:27<29:27:51,  3.43it/s]
  2%|▏         | 7543/371472 [36:27<28:48:08,  3.51it/s]
  2%|▏         | 7544/371472 [36:28<27:59:11,  3.61it/s]
  2%|▏         | 7545/371472 [36:28<29:55:21,  3.38it/s]
  2%|▏         | 7546/371472 [36:28<29:54:53,  3.38it/s]
  2%|▏         | 7547/371472 [36:29<31:11:37,  3.24it/s]
  2%|▏         | 7548/371472 [36:29<29:30:41,  3.43it/s]
  2%|▏         | 7549/371472 [36:29<28:52:38,  3.50it/s]
  2%|▏         | 7550/371472 [36:29<28:38:38,  3.53it/s]
  2%|▏         | 7551/371472 [36:30<28:16:57,  3.57it/s]
  2%|▏         | 7552/371472 [36:30<28:01:26,  3.61it/s]
  2%|▏         | 7553/371472 [36:30<29:01:52,  3.48it/s]
  2%|▏         | 7554/371472 [36:31<28:16:17,  3.58it/s]
  2%|▏         | 7555/371472 [36:31<27:50:47,  3.63it/s]
  2%|▏         | 7556/371472 [36:31<28:25:29,  3.56it/s]
  2%|▏         | 7557/371472 [36:31<29:51:41,  3.39it/s]
  2%|▏         | 7558/371472 [36:32<29:53:50,  3.38it/s]
  2%|▏         | 7559/371472 [36:32<31:10:07,  3.24it/s]
  2%|▏         | 7560/371472 [36:32<29:50:48,  3.39it/s]
                                                        
{'loss': 4.787, 'learning_rate': 9.821586330237668e-07, 'epoch': 0.33}

  2%|▏         | 7560/371472 [36:32<29:50:48,  3.39it/s]
  2%|▏         | 7561/371472 [36:33<31:28:30,  3.21it/s]
  2%|▏         | 7562/371472 [36:33<30:33:37,  3.31it/s]
  2%|▏         | 7563/371472 [36:33<30:07:10,  3.36it/s]
  2%|▏         | 7564/371472 [36:34<29:21:30,  3.44it/s]
  2%|▏         | 7565/371472 [36:34<29:07:56,  3.47it/s]
  2%|▏         | 7566/371472 [36:34<28:35:40,  3.54it/s]
  2%|▏         | 7567/371472 [36:34<29:43:39,  3.40it/s]
  2%|▏         | 7568/371472 [36:35<31:34:45,  3.20it/s]
  2%|▏         | 7569/371472 [36:35<31:02:10,  3.26it/s]
  2%|▏         | 7570/371472 [36:35<29:54:58,  3.38it/s]
  2%|▏         | 7571/371472 [36:36<29:14:28,  3.46it/s]
  2%|▏         | 7572/371472 [36:36<28:29:28,  3.55it/s]
  2%|▏         | 7573/371472 [36:36<29:03:12,  3.48it/s]
  2%|▏         | 7574/371472 [36:36<28:58:22,  3.49it/s]
  2%|▏         | 7575/371472 [36:37<28:16:39,  3.57it/s]
  2%|▏         | 7576/371472 [36:37<27:31:23,  3.67it/s]
  2%|▏         | 7577/371472 [36:37<27:06:46,  3.73it/s]
  2%|▏         | 7578/371472 [36:38<27:09:32,  3.72it/s]
  2%|▏         | 7579/371472 [36:38<27:17:35,  3.70it/s]
  2%|▏         | 7580/371472 [36:38<26:54:22,  3.76it/s]
                                                        
{'loss': 5.4519, 'learning_rate': 9.82110151048288e-07, 'epoch': 0.33}

  2%|▏         | 7580/371472 [36:38<26:54:22,  3.76it/s]
  2%|▏         | 7581/371472 [36:38<27:35:05,  3.66it/s]
  2%|▏         | 7582/371472 [36:39<28:45:10,  3.52it/s]
  2%|▏         | 7583/371472 [36:39<29:34:31,  3.42it/s]
  2%|▏         | 7584/371472 [36:39<30:21:41,  3.33it/s]
  2%|▏         | 7585/371472 [36:40<31:18:34,  3.23it/s]
  2%|▏         | 7586/371472 [36:40<29:22:38,  3.44it/s]
  2%|▏         | 7587/371472 [36:40<29:00:30,  3.48it/s]
  2%|▏         | 7588/371472 [36:40<29:52:12,  3.38it/s]
  2%|▏         | 7589/371472 [36:41<28:42:23,  3.52it/s]
  2%|▏         | 7590/371472 [36:41<27:47:18,  3.64it/s]
  2%|▏         | 7591/371472 [36:41<27:33:51,  3.67it/s]
  2%|▏         | 7592/371472 [36:42<27:42:05,  3.65it/s]
  2%|▏         | 7593/371472 [36:42<27:36:06,  3.66it/s]
  2%|▏         | 7594/371472 [36:42<27:48:03,  3.64it/s]
  2%|▏         | 7595/371472 [36:42<28:05:45,  3.60it/s]
  2%|▏         | 7596/371472 [36:43<28:37:36,  3.53it/s]
  2%|▏         | 7597/371472 [36:43<28:13:28,  3.58it/s]
  2%|▏         | 7598/371472 [36:43<28:44:43,  3.52it/s]
  2%|▏         | 7599/371472 [36:44<30:04:47,  3.36it/s]
  2%|▏         | 7600/371472 [36:44<29:32:32,  3.42it/s]
                                                        
{'loss': 5.1657, 'learning_rate': 9.820616690728091e-07, 'epoch': 0.33}

  2%|▏         | 7600/371472 [36:44<29:32:32,  3.42it/s]
  2%|▏         | 7601/371472 [36:44<29:36:29,  3.41it/s]
  2%|▏         | 7602/371472 [36:44<29:06:35,  3.47it/s]
  2%|▏         | 7603/371472 [36:45<30:11:50,  3.35it/s]
  2%|▏         | 7604/371472 [36:45<29:40:07,  3.41it/s]
  2%|▏         | 7605/371472 [36:45<29:41:12,  3.40it/s]
  2%|▏         | 7606/371472 [36:46<29:29:09,  3.43it/s]
  2%|▏         | 7607/371472 [36:46<29:41:36,  3.40it/s]
  2%|▏         | 7608/371472 [36:46<28:30:31,  3.55it/s]
  2%|▏         | 7609/371472 [36:46<28:45:04,  3.52it/s]
  2%|▏         | 7610/371472 [36:47<28:15:04,  3.58it/s]
  2%|▏         | 7611/371472 [36:47<29:20:48,  3.44it/s]
  2%|▏         | 7612/371472 [36:47<30:12:50,  3.35it/s]
  2%|▏         | 7613/371472 [36:48<30:09:33,  3.35it/s]
  2%|▏         | 7614/371472 [36:48<30:38:50,  3.30it/s]
  2%|▏         | 7615/371472 [36:48<29:54:57,  3.38it/s]
  2%|▏         | 7616/371472 [36:48<28:42:23,  3.52it/s]
  2%|▏         | 7617/371472 [36:49<28:12:47,  3.58it/s]
  2%|▏         | 7618/371472 [36:49<27:54:12,  3.62it/s]
  2%|▏         | 7619/371472 [36:49<28:02:46,  3.60it/s]
  2%|▏         | 7620/371472 [36:50<26:46:17,  3.78it/s]
                                                        
{'loss': 5.0934, 'learning_rate': 9.820131870973302e-07, 'epoch': 0.33}

  2%|▏         | 7620/371472 [36:50<26:46:17,  3.78it/s]
  2%|▏         | 7621/371472 [36:50<26:55:28,  3.75it/s]
  2%|▏         | 7622/371472 [36:50<27:07:03,  3.73it/s]
  2%|▏         | 7623/371472 [36:50<26:31:02,  3.81it/s]
  2%|▏         | 7624/371472 [36:51<28:07:22,  3.59it/s]
  2%|▏         | 7625/371472 [36:51<27:58:24,  3.61it/s]
  2%|▏         | 7626/371472 [36:51<27:30:28,  3.67it/s]
  2%|▏         | 7627/371472 [36:51<27:42:53,  3.65it/s]
  2%|▏         | 7628/371472 [36:52<28:47:08,  3.51it/s]
  2%|▏         | 7629/371472 [36:52<28:03:35,  3.60it/s]
  2%|▏         | 7630/371472 [36:52<28:31:07,  3.54it/s]
  2%|▏         | 7631/371472 [36:53<28:10:30,  3.59it/s]
  2%|▏         | 7632/371472 [36:53<30:02:32,  3.36it/s]
  2%|▏         | 7633/371472 [36:53<29:22:20,  3.44it/s]
  2%|▏         | 7634/371472 [36:54<29:23:29,  3.44it/s]
  2%|▏         | 7635/371472 [36:54<30:56:17,  3.27it/s]
  2%|▏         | 7636/371472 [36:54<31:14:53,  3.23it/s]
  2%|▏         | 7637/371472 [36:54<31:04:00,  3.25it/s]
  2%|▏         | 7638/371472 [36:55<29:42:30,  3.40it/s]
  2%|▏         | 7639/371472 [36:55<32:57:13,  3.07it/s]
  2%|▏         | 7640/371472 [36:55<31:03:58,  3.25it/s]
                                                        
{'loss': 5.1082, 'learning_rate': 9.819647051218515e-07, 'epoch': 0.33}

  2%|▏         | 7640/371472 [36:55<31:03:58,  3.25it/s]
  2%|▏         | 7641/371472 [36:56<30:52:49,  3.27it/s]
  2%|▏         | 7642/371472 [36:56<29:32:26,  3.42it/s]
  2%|▏         | 7643/371472 [36:56<30:26:25,  3.32it/s]
  2%|▏         | 7644/371472 [36:57<29:16:44,  3.45it/s]
  2%|▏         | 7645/371472 [36:57<29:56:38,  3.38it/s]
  2%|▏         | 7646/371472 [36:57<29:20:30,  3.44it/s]
  2%|▏         | 7647/371472 [36:57<28:36:43,  3.53it/s]
  2%|▏         | 7648/371472 [36:58<29:21:36,  3.44it/s]
  2%|▏         | 7649/371472 [36:58<28:31:17,  3.54it/s]
  2%|▏         | 7650/371472 [36:58<28:31:24,  3.54it/s]
  2%|▏         | 7651/371472 [36:59<29:25:27,  3.43it/s]
  2%|▏         | 7652/371472 [36:59<27:57:41,  3.61it/s]
  2%|▏         | 7653/371472 [36:59<28:55:09,  3.49it/s]
  2%|▏         | 7654/371472 [36:59<30:26:10,  3.32it/s]
  2%|▏         | 7655/371472 [37:00<32:50:55,  3.08it/s]
  2%|▏         | 7656/371472 [37:00<32:43:33,  3.09it/s]
  2%|▏         | 7657/371472 [37:00<33:30:20,  3.02it/s]
  2%|▏         | 7658/371472 [37:01<32:49:04,  3.08it/s]
  2%|▏         | 7659/371472 [37:01<31:13:19,  3.24it/s]
  2%|▏         | 7660/371472 [37:01<31:54:18,  3.17it/s]
                                                        
{'loss': 4.9206, 'learning_rate': 9.819162231463723e-07, 'epoch': 0.33}

  2%|▏         | 7660/371472 [37:01<31:54:18,  3.17it/s]
  2%|▏         | 7661/371472 [37:02<30:06:39,  3.36it/s]
  2%|▏         | 7662/371472 [37:02<29:04:05,  3.48it/s]
  2%|▏         | 7663/371472 [37:02<27:38:38,  3.66it/s]
  2%|▏         | 7664/371472 [37:02<28:39:38,  3.53it/s]
  2%|▏         | 7665/371472 [37:03<29:00:02,  3.48it/s]
  2%|▏         | 7666/371472 [37:03<28:56:06,  3.49it/s]
  2%|▏         | 7667/371472 [37:03<29:09:46,  3.47it/s]
  2%|▏         | 7668/371472 [37:04<28:07:01,  3.59it/s]
  2%|▏         | 7669/371472 [37:04<28:18:45,  3.57it/s]
  2%|▏         | 7670/371472 [37:04<28:59:13,  3.49it/s]
  2%|▏         | 7671/371472 [37:04<28:09:50,  3.59it/s]
  2%|▏         | 7672/371472 [37:05<28:05:35,  3.60it/s]
  2%|▏         | 7673/371472 [37:05<27:56:33,  3.62it/s]
  2%|▏         | 7674/371472 [37:05<27:48:18,  3.63it/s]
  2%|▏         | 7675/371472 [37:06<31:02:17,  3.26it/s]
  2%|▏         | 7676/371472 [37:06<29:00:36,  3.48it/s]
  2%|▏         | 7677/371472 [37:06<29:22:18,  3.44it/s]
  2%|▏         | 7678/371472 [37:06<29:19:43,  3.45it/s]
  2%|▏         | 7679/371472 [37:07<29:19:34,  3.45it/s]
  2%|▏         | 7680/371472 [37:07<28:37:25,  3.53it/s]
                                                        
{'loss': 5.1762, 'learning_rate': 9.818677411708936e-07, 'epoch': 0.33}

  2%|▏         | 7680/371472 [37:07<28:37:25,  3.53it/s]
  2%|▏         | 7681/371472 [37:07<28:42:23,  3.52it/s]
  2%|▏         | 7682/371472 [37:08<28:02:51,  3.60it/s]
  2%|▏         | 7683/371472 [37:08<28:22:00,  3.56it/s]
  2%|▏         | 7684/371472 [37:08<28:52:52,  3.50it/s]
  2%|▏         | 7685/371472 [37:08<28:51:04,  3.50it/s]
  2%|▏         | 7686/371472 [37:09<31:30:31,  3.21it/s]
  2%|▏         | 7687/371472 [37:09<30:16:53,  3.34it/s]
  2%|▏         | 7688/371472 [37:09<29:24:02,  3.44it/s]
  2%|▏         | 7689/371472 [37:10<29:54:18,  3.38it/s]
  2%|▏         | 7690/371472 [37:10<28:17:50,  3.57it/s]
  2%|▏         | 7691/371472 [37:10<27:37:45,  3.66it/s]
  2%|▏         | 7692/371472 [37:10<27:23:45,  3.69it/s]
  2%|▏         | 7693/371472 [37:11<30:23:58,  3.32it/s]
  2%|▏         | 7694/371472 [37:11<29:23:14,  3.44it/s]
  2%|▏         | 7695/371472 [37:11<28:49:48,  3.50it/s]
  2%|▏         | 7696/371472 [37:12<28:03:54,  3.60it/s]
  2%|▏         | 7697/371472 [37:12<28:16:19,  3.57it/s]
  2%|▏         | 7698/371472 [37:12<28:38:05,  3.53it/s]
  2%|▏         | 7699/371472 [37:12<29:12:07,  3.46it/s]
  2%|▏         | 7700/371472 [37:13<28:58:17,  3.49it/s]
                                                        
{'loss': 4.9105, 'learning_rate': 9.818192591954147e-07, 'epoch': 0.33}

  2%|▏         | 7700/371472 [37:13<28:58:17,  3.49it/s]
  2%|▏         | 7701/371472 [37:13<28:16:13,  3.57it/s]
  2%|▏         | 7702/371472 [37:13<28:47:28,  3.51it/s]
  2%|▏         | 7703/371472 [37:14<28:22:26,  3.56it/s]
  2%|▏         | 7704/371472 [37:14<28:31:00,  3.54it/s]
  2%|▏         | 7705/371472 [37:14<29:12:46,  3.46it/s]
  2%|▏         | 7706/371472 [37:15<29:38:59,  3.41it/s]
  2%|▏         | 7707/371472 [37:15<29:28:22,  3.43it/s]
  2%|▏         | 7708/371472 [37:15<29:21:19,  3.44it/s]
  2%|▏         | 7709/371472 [37:15<29:39:16,  3.41it/s]
  2%|▏         | 7710/371472 [37:16<28:49:32,  3.51it/s]
  2%|▏         | 7711/371472 [37:16<28:57:36,  3.49it/s]
  2%|▏         | 7712/371472 [37:16<29:19:23,  3.45it/s]
  2%|▏         | 7713/371472 [37:17<29:34:50,  3.42it/s]
  2%|▏         | 7714/371472 [37:17<28:26:49,  3.55it/s]
  2%|▏         | 7715/371472 [37:17<27:43:31,  3.64it/s]
  2%|▏         | 7716/371472 [37:17<26:58:53,  3.74it/s]
  2%|▏         | 7717/371472 [37:18<28:09:30,  3.59it/s]
  2%|▏         | 7718/371472 [37:18<27:47:06,  3.64it/s]
  2%|▏         | 7719/371472 [37:18<27:02:19,  3.74it/s]
  2%|▏         | 7720/371472 [37:18<27:39:14,  3.65it/s]
                                                        
{'loss': 5.1632, 'learning_rate': 9.817707772199358e-07, 'epoch': 0.33}

  2%|▏         | 7720/371472 [37:18<27:39:14,  3.65it/s]
  2%|▏         | 7721/371472 [37:19<27:58:03,  3.61it/s]
  2%|▏         | 7722/371472 [37:19<27:05:19,  3.73it/s]
  2%|▏         | 7723/371472 [37:19<29:48:03,  3.39it/s]
  2%|▏         | 7724/371472 [37:20<28:46:10,  3.51it/s]
  2%|▏         | 7725/371472 [37:20<27:46:49,  3.64it/s]
  2%|▏         | 7726/371472 [37:20<27:24:37,  3.69it/s]
  2%|▏         | 7727/371472 [37:20<27:12:10,  3.71it/s]
  2%|▏         | 7728/371472 [37:21<26:53:01,  3.76it/s]
  2%|▏         | 7729/371472 [37:21<26:53:33,  3.76it/s]
  2%|▏         | 7730/371472 [37:21<27:33:55,  3.67it/s]
  2%|▏         | 7731/371472 [37:21<26:59:33,  3.74it/s]
  2%|▏         | 7732/371472 [37:22<27:05:36,  3.73it/s]
  2%|▏         | 7733/371472 [37:22<27:30:13,  3.67it/s]
  2%|▏         | 7734/371472 [37:22<30:10:14,  3.35it/s]
  2%|▏         | 7735/371472 [37:23<29:08:01,  3.47it/s]
  2%|▏         | 7736/371472 [37:23<29:10:35,  3.46it/s]
  2%|▏         | 7737/371472 [37:23<29:28:43,  3.43it/s]
  2%|▏         | 7738/371472 [37:24<31:37:30,  3.19it/s]
  2%|▏         | 7739/371472 [37:24<30:00:05,  3.37it/s]
  2%|▏         | 7740/371472 [37:24<29:35:54,  3.41it/s]
                                                        
{'loss': 5.2379, 'learning_rate': 9.817222952444568e-07, 'epoch': 0.33}

  2%|▏         | 7740/371472 [37:24<29:35:54,  3.41it/s]
  2%|▏         | 7741/371472 [37:24<31:23:13,  3.22it/s]
  2%|▏         | 7742/371472 [37:25<29:57:44,  3.37it/s]
  2%|▏         | 7743/371472 [37:25<31:33:19,  3.20it/s]
  2%|▏         | 7744/371472 [37:25<30:30:18,  3.31it/s]
  2%|▏         | 7745/371472 [37:26<29:11:05,  3.46it/s]
  2%|▏         | 7746/371472 [37:26<28:34:34,  3.54it/s]
  2%|▏         | 7747/371472 [37:26<27:28:02,  3.68it/s]
  2%|▏         | 7748/371472 [37:26<28:15:03,  3.58it/s]
  2%|▏         | 7749/371472 [37:27<28:51:25,  3.50it/s]
  2%|▏         | 7750/371472 [37:27<28:25:32,  3.55it/s]
  2%|▏         | 7751/371472 [37:27<28:04:59,  3.60it/s]
  2%|▏         | 7752/371472 [37:28<28:16:14,  3.57it/s]
  2%|▏         | 7753/371472 [37:28<28:59:02,  3.49it/s]
  2%|▏         | 7754/371472 [37:28<30:39:40,  3.30it/s]
  2%|▏         | 7755/371472 [37:28<30:08:11,  3.35it/s]
  2%|▏         | 7756/371472 [37:29<28:59:43,  3.48it/s]
  2%|▏         | 7757/371472 [37:29<28:07:12,  3.59it/s]
  2%|▏         | 7758/371472 [37:29<29:43:14,  3.40it/s]
  2%|▏         | 7759/371472 [37:30<28:42:46,  3.52it/s]
  2%|▏         | 7760/371472 [37:30<29:18:33,  3.45it/s]
                                                        
{'loss': 5.1562, 'learning_rate': 9.81673813268978e-07, 'epoch': 0.33}

  2%|▏         | 7760/371472 [37:30<29:18:33,  3.45it/s]
  2%|▏         | 7761/371472 [37:30<30:02:58,  3.36it/s]
  2%|▏         | 7762/371472 [37:30<29:15:36,  3.45it/s]
  2%|▏         | 7763/371472 [37:31<28:53:05,  3.50it/s]
  2%|▏         | 7764/371472 [37:31<28:24:48,  3.56it/s]
  2%|▏         | 7765/371472 [37:31<28:28:32,  3.55it/s]
  2%|▏         | 7766/371472 [37:32<28:12:27,  3.58it/s]
  2%|▏         | 7767/371472 [37:32<27:21:10,  3.69it/s]
  2%|▏         | 7768/371472 [37:32<27:16:28,  3.70it/s]
  2%|▏         | 7769/371472 [37:32<30:40:40,  3.29it/s]
  2%|▏         | 7770/371472 [37:33<29:23:35,  3.44it/s]
  2%|▏         | 7771/371472 [37:33<30:01:10,  3.37it/s]
  2%|▏         | 7772/371472 [37:33<31:23:48,  3.22it/s]
  2%|▏         | 7773/371472 [37:34<30:53:12,  3.27it/s]
  2%|▏         | 7774/371472 [37:34<30:16:17,  3.34it/s]
  2%|▏         | 7775/371472 [37:34<30:57:04,  3.26it/s]
  2%|▏         | 7776/371472 [37:35<31:53:15,  3.17it/s]
  2%|▏         | 7777/371472 [37:35<30:08:13,  3.35it/s]
  2%|▏         | 7778/371472 [37:35<31:09:01,  3.24it/s]
  2%|▏         | 7779/371472 [37:35<29:29:19,  3.43it/s]
  2%|▏         | 7780/371472 [37:36<29:03:30,  3.48it/s]
                                                        
{'loss': 5.0009, 'learning_rate': 9.81625331293499e-07, 'epoch': 0.34}

  2%|▏         | 7780/371472 [37:36<29:03:30,  3.48it/s]
  2%|▏         | 7781/371472 [37:36<32:28:24,  3.11it/s]
  2%|▏         | 7782/371472 [37:36<33:23:07,  3.03it/s]
  2%|▏         | 7783/371472 [37:37<32:20:42,  3.12it/s]
  2%|▏         | 7784/371472 [37:37<31:28:35,  3.21it/s]
  2%|▏         | 7785/371472 [37:37<30:56:06,  3.27it/s]
  2%|▏         | 7786/371472 [37:38<29:31:54,  3.42it/s]
  2%|▏         | 7787/371472 [37:38<29:35:50,  3.41it/s]
  2%|▏         | 7788/371472 [37:38<28:23:47,  3.56it/s]
  2%|▏         | 7789/371472 [37:38<28:15:10,  3.58it/s]
  2%|▏         | 7790/371472 [37:39<27:45:48,  3.64it/s]
  2%|▏         | 7791/371472 [37:39<28:47:52,  3.51it/s]
  2%|▏         | 7792/371472 [37:39<28:05:05,  3.60it/s]
  2%|▏         | 7793/371472 [37:40<28:06:37,  3.59it/s]
  2%|▏         | 7794/371472 [37:40<27:24:41,  3.69it/s]
  2%|▏         | 7795/371472 [37:40<28:28:11,  3.55it/s]
  2%|▏         | 7796/371472 [37:40<28:01:43,  3.60it/s]
  2%|▏         | 7797/371472 [37:41<30:06:13,  3.36it/s]
  2%|▏         | 7798/371472 [37:41<30:25:09,  3.32it/s]
  2%|▏         | 7799/371472 [37:41<30:46:35,  3.28it/s]
  2%|▏         | 7800/371472 [37:42<30:03:41,  3.36it/s]
                                                        
{'loss': 4.8898, 'learning_rate': 9.8157684931802e-07, 'epoch': 0.34}

  2%|▏         | 7800/371472 [37:42<30:03:41,  3.36it/s]
  2%|▏         | 7801/371472 [37:42<30:09:53,  3.35it/s]
  2%|▏         | 7802/371472 [37:42<28:51:17,  3.50it/s]
  2%|▏         | 7803/371472 [37:42<27:46:46,  3.64it/s]
  2%|▏         | 7804/371472 [37:43<27:45:18,  3.64it/s]
  2%|▏         | 7805/371472 [37:43<27:04:18,  3.73it/s]
  2%|▏         | 7806/371472 [37:43<27:27:00,  3.68it/s]
  2%|▏         | 7807/371472 [37:44<28:54:46,  3.49it/s]
  2%|▏         | 7808/371472 [37:44<28:59:34,  3.48it/s]
  2%|▏         | 7809/371472 [37:44<28:46:32,  3.51it/s]
  2%|▏         | 7810/371472 [37:44<28:23:44,  3.56it/s]
  2%|▏         | 7811/371472 [37:45<28:39:06,  3.53it/s]
  2%|▏         | 7812/371472 [37:45<27:40:16,  3.65it/s]
  2%|▏         | 7813/371472 [37:45<28:40:40,  3.52it/s]
  2%|▏         | 7814/371472 [37:46<27:43:42,  3.64it/s]
  2%|▏         | 7815/371472 [37:46<27:28:58,  3.68it/s]
  2%|▏         | 7816/371472 [37:46<28:50:22,  3.50it/s]
  2%|▏         | 7817/371472 [37:46<29:16:47,  3.45it/s]
  2%|▏         | 7818/371472 [37:47<28:48:56,  3.51it/s]
  2%|▏         | 7819/371472 [37:47<29:49:21,  3.39it/s]
  2%|▏         | 7820/371472 [37:47<29:47:11,  3.39it/s]
                                                        
{'loss': 4.9866, 'learning_rate': 9.815283673425413e-07, 'epoch': 0.34}

  2%|▏         | 7820/371472 [37:47<29:47:11,  3.39it/s]
  2%|▏         | 7821/371472 [37:48<30:17:24,  3.33it/s]
  2%|▏         | 7822/371472 [37:48<31:13:35,  3.23it/s]
  2%|▏         | 7823/371472 [37:48<30:00:00,  3.37it/s]
  2%|▏         | 7824/371472 [37:48<29:54:52,  3.38it/s]
  2%|▏         | 7825/371472 [37:49<28:52:38,  3.50it/s]
  2%|▏         | 7826/371472 [37:49<30:28:22,  3.31it/s]
  2%|▏         | 7827/371472 [37:49<30:35:35,  3.30it/s]
  2%|▏         | 7828/371472 [37:50<30:55:01,  3.27it/s]
  2%|▏         | 7829/371472 [37:50<29:30:28,  3.42it/s]
  2%|▏         | 7830/371472 [37:50<28:18:28,  3.57it/s]
  2%|▏         | 7831/371472 [37:50<27:57:35,  3.61it/s]
  2%|▏         | 7832/371472 [37:51<28:55:31,  3.49it/s]
  2%|▏         | 7833/371472 [37:51<28:10:27,  3.59it/s]
  2%|▏         | 7834/371472 [37:51<28:00:38,  3.61it/s]
  2%|▏         | 7835/371472 [37:52<28:24:44,  3.56it/s]
  2%|▏         | 7836/371472 [37:52<27:56:04,  3.62it/s]
  2%|▏         | 7837/371472 [37:52<27:16:42,  3.70it/s]
  2%|▏         | 7838/371472 [37:52<26:56:37,  3.75it/s]
  2%|▏         | 7839/371472 [37:53<27:12:12,  3.71it/s]
  2%|▏         | 7840/371472 [37:53<29:30:04,  3.42it/s]
                                                        
{'loss': 4.8798, 'learning_rate': 9.814798853670624e-07, 'epoch': 0.34}

  2%|▏         | 7840/371472 [37:53<29:30:04,  3.42it/s]
  2%|▏         | 7841/371472 [37:53<31:10:40,  3.24it/s]
  2%|▏         | 7842/371472 [37:54<30:46:23,  3.28it/s]
  2%|▏         | 7843/371472 [37:54<29:26:11,  3.43it/s]
  2%|▏         | 7844/371472 [37:54<31:01:01,  3.26it/s]
  2%|▏         | 7845/371472 [37:55<30:14:54,  3.34it/s]
  2%|▏         | 7846/371472 [37:55<30:22:41,  3.32it/s]
  2%|▏         | 7847/371472 [37:55<29:47:09,  3.39it/s]
  2%|▏         | 7848/371472 [37:56<32:07:34,  3.14it/s]
  2%|▏         | 7849/371472 [37:56<31:04:23,  3.25it/s]
  2%|▏         | 7850/371472 [37:56<29:55:55,  3.37it/s]
  2%|▏         | 7851/371472 [37:56<28:48:28,  3.51it/s]
  2%|▏         | 7852/371472 [37:57<28:09:26,  3.59it/s]
  2%|▏         | 7853/371472 [37:57<28:03:54,  3.60it/s]
  2%|▏         | 7854/371472 [37:57<28:33:09,  3.54it/s]
  2%|▏         | 7855/371472 [37:57<29:37:24,  3.41it/s]
  2%|▏         | 7856/371472 [37:58<32:02:43,  3.15it/s]
  2%|▏         | 7857/371472 [37:58<31:54:19,  3.17it/s]
  2%|▏         | 7858/371472 [37:58<31:10:48,  3.24it/s]
  2%|▏         | 7859/371472 [37:59<29:57:14,  3.37it/s]
  2%|▏         | 7860/371472 [37:59<29:44:21,  3.40it/s]
                                                        
{'loss': 4.9858, 'learning_rate': 9.814314033915835e-07, 'epoch': 0.34}

  2%|▏         | 7860/371472 [37:59<29:44:21,  3.40it/s]
  2%|▏         | 7861/371472 [37:59<31:01:17,  3.26it/s]
  2%|▏         | 7862/371472 [38:00<30:13:27,  3.34it/s]
  2%|▏         | 7863/371472 [38:00<29:59:42,  3.37it/s]
  2%|▏         | 7864/371472 [38:00<29:00:56,  3.48it/s]
  2%|▏         | 7865/371472 [38:00<28:06:03,  3.59it/s]
  2%|▏         | 7866/371472 [38:01<28:21:42,  3.56it/s]
  2%|▏         | 7867/371472 [38:01<28:05:41,  3.60it/s]
  2%|▏         | 7868/371472 [38:01<27:24:10,  3.69it/s]
  2%|▏         | 7869/371472 [38:02<27:15:02,  3.71it/s]
  2%|▏         | 7870/371472 [38:02<26:59:48,  3.74it/s]
  2%|▏         | 7871/371472 [38:02<26:31:10,  3.81it/s]
  2%|▏         | 7872/371472 [38:02<28:26:28,  3.55it/s]
  2%|▏         | 7873/371472 [38:03<29:02:03,  3.48it/s]
  2%|▏         | 7874/371472 [38:03<28:08:42,  3.59it/s]
  2%|▏         | 7875/371472 [38:03<28:27:47,  3.55it/s]
  2%|▏         | 7876/371472 [38:04<30:21:57,  3.33it/s]
  2%|▏         | 7877/371472 [38:04<29:18:38,  3.45it/s]
  2%|▏         | 7878/371472 [38:04<29:09:07,  3.46it/s]
  2%|▏         | 7879/371472 [38:04<29:16:36,  3.45it/s]
  2%|▏         | 7880/371472 [38:05<28:37:28,  3.53it/s]
                                                        
{'loss': 5.1652, 'learning_rate': 9.813829214161047e-07, 'epoch': 0.34}

  2%|▏         | 7880/371472 [38:05<28:37:28,  3.53it/s]
  2%|▏         | 7881/371472 [38:05<28:46:54,  3.51it/s]
  2%|▏         | 7882/371472 [38:05<28:13:15,  3.58it/s]
  2%|▏         | 7883/371472 [38:06<32:24:18,  3.12it/s]
  2%|▏         | 7884/371472 [38:06<30:52:17,  3.27it/s]
  2%|▏         | 7885/371472 [38:06<29:30:14,  3.42it/s]
  2%|▏         | 7886/371472 [38:06<28:17:46,  3.57it/s]
  2%|▏         | 7887/371472 [38:07<29:32:07,  3.42it/s]
  2%|▏         | 7888/371472 [38:07<29:30:20,  3.42it/s]
  2%|▏         | 7889/371472 [38:07<29:06:18,  3.47it/s]
  2%|▏         | 7890/371472 [38:08<29:30:03,  3.42it/s]
  2%|▏         | 7891/371472 [38:08<28:13:15,  3.58it/s]
  2%|▏         | 7892/371472 [38:08<28:09:19,  3.59it/s]
  2%|▏         | 7893/371472 [38:08<28:19:25,  3.57it/s]
  2%|▏         | 7894/371472 [38:09<28:06:42,  3.59it/s]
  2%|▏         | 7895/371472 [38:09<28:07:32,  3.59it/s]
  2%|▏         | 7896/371472 [38:09<27:29:06,  3.67it/s]
  2%|▏         | 7897/371472 [38:09<26:52:21,  3.76it/s]
  2%|▏         | 7898/371472 [38:10<27:22:08,  3.69it/s]
  2%|▏         | 7899/371472 [38:10<27:41:19,  3.65it/s]
  2%|▏         | 7900/371472 [38:10<28:55:23,  3.49it/s]
                                                        
{'loss': 5.0168, 'learning_rate': 9.813344394406256e-07, 'epoch': 0.34}

  2%|▏         | 7900/371472 [38:10<28:55:23,  3.49it/s]
  2%|▏         | 7901/371472 [38:11<29:12:05,  3.46it/s]
  2%|▏         | 7902/371472 [38:11<29:51:47,  3.38it/s]
  2%|▏         | 7903/371472 [38:11<30:54:14,  3.27it/s]
  2%|▏         | 7904/371472 [38:12<33:12:00,  3.04it/s]
  2%|▏         | 7905/371472 [38:12<30:44:37,  3.28it/s]
  2%|▏         | 7906/371472 [38:12<31:16:57,  3.23it/s]
  2%|▏         | 7907/371472 [38:13<31:03:33,  3.25it/s]
  2%|▏         | 7908/371472 [38:13<30:02:01,  3.36it/s]
  2%|▏         | 7909/371472 [38:13<29:38:28,  3.41it/s]
  2%|▏         | 7910/371472 [38:13<29:18:24,  3.45it/s]
  2%|▏         | 7911/371472 [38:14<28:23:30,  3.56it/s]
  2%|▏         | 7912/371472 [38:14<27:39:25,  3.65it/s]
  2%|▏         | 7913/371472 [38:14<29:25:28,  3.43it/s]
  2%|▏         | 7914/371472 [38:15<28:42:02,  3.52it/s]
  2%|▏         | 7915/371472 [38:15<28:55:54,  3.49it/s]
  2%|▏         | 7916/371472 [38:15<32:34:56,  3.10it/s]
  2%|▏         | 7917/371472 [38:15<31:20:06,  3.22it/s]
  2%|▏         | 7918/371472 [38:16<29:49:54,  3.39it/s]
  2%|▏         | 7919/371472 [38:16<28:42:40,  3.52it/s]
  2%|▏         | 7920/371472 [38:16<29:19:22,  3.44it/s]
                                                        
{'loss': 4.9382, 'learning_rate': 9.812859574651469e-07, 'epoch': 0.34}

  2%|▏         | 7920/371472 [38:16<29:19:22,  3.44it/s]
  2%|▏         | 7921/371472 [38:17<29:21:18,  3.44it/s]
  2%|▏         | 7922/371472 [38:17<30:13:19,  3.34it/s]
  2%|▏         | 7923/371472 [38:17<29:33:20,  3.42it/s]
  2%|▏         | 7924/371472 [38:17<28:40:37,  3.52it/s]
  2%|▏         | 7925/371472 [38:18<30:32:03,  3.31it/s]
  2%|▏         | 7926/371472 [38:18<29:34:48,  3.41it/s]
  2%|▏         | 7927/371472 [38:18<29:30:37,  3.42it/s]
  2%|▏         | 7928/371472 [38:19<29:39:06,  3.41it/s]
  2%|▏         | 7929/371472 [38:19<32:30:15,  3.11it/s]
  2%|▏         | 7930/371472 [38:19<30:33:07,  3.31it/s]
  2%|▏         | 7931/371472 [38:20<29:34:30,  3.41it/s]
  2%|▏         | 7932/371472 [38:20<28:29:31,  3.54it/s]
  2%|▏         | 7933/371472 [38:20<27:44:01,  3.64it/s]
  2%|▏         | 7934/371472 [38:20<27:54:05,  3.62it/s]
  2%|▏         | 7935/371472 [38:21<27:37:18,  3.66it/s]
  2%|▏         | 7936/371472 [38:21<27:58:10,  3.61it/s]
  2%|▏         | 7937/371472 [38:21<27:49:02,  3.63it/s]
  2%|▏         | 7938/371472 [38:22<29:41:31,  3.40it/s]
  2%|▏         | 7939/371472 [38:22<29:55:47,  3.37it/s]
  2%|▏         | 7940/371472 [38:22<30:02:20,  3.36it/s]
                                                        
{'loss': 5.1187, 'learning_rate': 9.812374754896678e-07, 'epoch': 0.34}

  2%|▏         | 7940/371472 [38:22<30:02:20,  3.36it/s]
  2%|▏         | 7941/371472 [38:22<28:44:01,  3.51it/s]
  2%|▏         | 7942/371472 [38:23<28:33:36,  3.54it/s]
  2%|▏         | 7943/371472 [38:23<29:05:46,  3.47it/s]
  2%|▏         | 7944/371472 [38:23<28:28:19,  3.55it/s]
  2%|▏         | 7945/371472 [38:23<27:35:10,  3.66it/s]
  2%|▏         | 7946/371472 [38:24<30:32:47,  3.31it/s]
  2%|▏         | 7947/371472 [38:24<29:18:29,  3.45it/s]
  2%|▏         | 7948/371472 [38:24<29:28:36,  3.43it/s]
  2%|▏         | 7949/371472 [38:25<28:18:54,  3.57it/s]
  2%|▏         | 7950/371472 [38:25<29:16:56,  3.45it/s]
  2%|▏         | 7951/371472 [38:25<29:22:48,  3.44it/s]
  2%|▏         | 7952/371472 [38:26<28:05:48,  3.59it/s]
  2%|▏         | 7953/371472 [38:26<27:20:25,  3.69it/s]
  2%|▏         | 7954/371472 [38:26<27:01:58,  3.74it/s]
  2%|▏         | 7955/371472 [38:26<26:49:40,  3.76it/s]
  2%|▏         | 7956/371472 [38:27<28:36:28,  3.53it/s]
  2%|▏         | 7957/371472 [38:27<28:16:30,  3.57it/s]
  2%|▏         | 7958/371472 [38:27<28:54:25,  3.49it/s]
  2%|▏         | 7959/371472 [38:28<30:14:42,  3.34it/s]
  2%|▏         | 7960/371472 [38:28<30:51:34,  3.27it/s]
                                                        
{'loss': 4.8829, 'learning_rate': 9.81188993514189e-07, 'epoch': 0.34}

  2%|▏         | 7960/371472 [38:28<30:51:34,  3.27it/s]
  2%|▏         | 7961/371472 [38:28<29:22:57,  3.44it/s]
  2%|▏         | 7962/371472 [38:28<28:16:30,  3.57it/s]
  2%|▏         | 7963/371472 [38:29<27:39:59,  3.65it/s]
  2%|▏         | 7964/371472 [38:29<28:30:16,  3.54it/s]
  2%|▏         | 7965/371472 [38:29<28:45:51,  3.51it/s]
  2%|▏         | 7966/371472 [38:30<29:20:52,  3.44it/s]
  2%|▏         | 7967/371472 [38:30<29:13:25,  3.46it/s]
  2%|▏         | 7968/371472 [38:30<29:18:40,  3.44it/s]
  2%|▏         | 7969/371472 [38:30<28:12:27,  3.58it/s]
  2%|▏         | 7970/371472 [38:31<28:27:06,  3.55it/s]
  2%|▏         | 7971/371472 [38:31<29:50:10,  3.38it/s]
  2%|▏         | 7972/371472 [38:31<28:30:44,  3.54it/s]
  2%|▏         | 7973/371472 [38:31<27:36:13,  3.66it/s]
  2%|▏         | 7974/371472 [38:32<28:05:07,  3.60it/s]
  2%|▏         | 7975/371472 [38:32<28:39:10,  3.52it/s]
  2%|▏         | 7976/371472 [38:32<27:34:29,  3.66it/s]
  2%|▏         | 7977/371472 [38:33<27:44:27,  3.64it/s]
  2%|▏         | 7978/371472 [38:33<27:26:49,  3.68it/s]
  2%|▏         | 7979/371472 [38:33<27:03:47,  3.73it/s]
  2%|▏         | 7980/371472 [38:33<27:36:42,  3.66it/s]
                                                        
{'loss': 4.8803, 'learning_rate': 9.811405115387101e-07, 'epoch': 0.34}

  2%|▏         | 7980/371472 [38:33<27:36:42,  3.66it/s]
  2%|▏         | 7981/371472 [38:34<28:00:28,  3.61it/s]
  2%|▏         | 7982/371472 [38:34<27:37:43,  3.65it/s]
  2%|▏         | 7983/371472 [38:34<27:39:33,  3.65it/s]
  2%|▏         | 7984/371472 [38:35<29:18:33,  3.44it/s]
  2%|▏         | 7985/371472 [38:35<29:38:01,  3.41it/s]
  2%|▏         | 7986/371472 [38:35<28:40:37,  3.52it/s]
  2%|▏         | 7987/371472 [38:35<29:44:16,  3.40it/s]
  2%|▏         | 7988/371472 [38:36<30:19:23,  3.33it/s]
  2%|▏         | 7989/371472 [38:36<30:07:11,  3.35it/s]
  2%|▏         | 7990/371472 [38:36<28:36:57,  3.53it/s]
  2%|▏         | 7991/371472 [38:37<28:20:52,  3.56it/s]
  2%|▏         | 7992/371472 [38:37<29:01:42,  3.48it/s]
  2%|▏         | 7993/371472 [38:37<28:56:50,  3.49it/s]
  2%|▏         | 7994/371472 [38:38<30:57:50,  3.26it/s]
  2%|▏         | 7995/371472 [38:38<37:16:51,  2.71it/s]
  2%|▏         | 7996/371472 [38:38<34:25:22,  2.93it/s]
  2%|▏         | 7997/371472 [38:39<32:12:10,  3.14it/s]
  2%|▏         | 7998/371472 [38:39<33:19:46,  3.03it/s]
  2%|▏         | 7999/371472 [38:39<31:20:56,  3.22it/s]
  2%|▏         | 8000/371472 [38:39<29:47:35,  3.39it/s]
                                                        
{'loss': 4.9934, 'learning_rate': 9.810920295632312e-07, 'epoch': 0.34}

  2%|▏         | 8000/371472 [38:39<29:47:35,  3.39it/s]
  2%|▏         | 8001/371472 [38:40<29:23:41,  3.43it/s]
  2%|▏         | 8002/371472 [38:40<29:26:45,  3.43it/s]
  2%|▏         | 8003/371472 [38:40<29:03:40,  3.47it/s]
  2%|▏         | 8004/371472 [38:41<30:10:41,  3.35it/s]
  2%|▏         | 8005/371472 [38:41<29:42:00,  3.40it/s]
  2%|▏         | 8006/371472 [38:41<28:47:50,  3.51it/s]
  2%|▏         | 8007/371472 [38:41<29:19:46,  3.44it/s]
  2%|▏         | 8008/371472 [38:42<28:53:20,  3.49it/s]
  2%|▏         | 8009/371472 [38:42<28:12:10,  3.58it/s]
  2%|▏         | 8010/371472 [38:42<28:35:34,  3.53it/s]
  2%|▏         | 8011/371472 [38:43<28:52:25,  3.50it/s]
  2%|▏         | 8012/371472 [38:43<29:35:29,  3.41it/s]
  2%|▏         | 8013/371472 [38:43<29:39:28,  3.40it/s]
  2%|▏         | 8014/371472 [38:44<29:53:25,  3.38it/s]
  2%|▏         | 8015/371472 [38:44<28:48:39,  3.50it/s]
  2%|▏         | 8016/371472 [38:44<27:59:04,  3.61it/s]
  2%|▏         | 8017/371472 [38:44<28:20:09,  3.56it/s]
  2%|▏         | 8018/371472 [38:45<28:21:03,  3.56it/s]
  2%|▏         | 8019/371472 [38:45<28:49:23,  3.50it/s]
  2%|▏         | 8020/371472 [38:45<28:44:17,  3.51it/s]
                                                        
{'loss': 5.0201, 'learning_rate': 9.810435475877525e-07, 'epoch': 0.35}

  2%|▏         | 8020/371472 [38:45<28:44:17,  3.51it/s]
  2%|▏         | 8021/371472 [38:45<29:10:24,  3.46it/s]
  2%|▏         | 8022/371472 [38:46<29:10:57,  3.46it/s]
  2%|▏         | 8023/371472 [38:46<28:07:10,  3.59it/s]
  2%|▏         | 8024/371472 [38:46<28:50:40,  3.50it/s]
  2%|▏         | 8025/371472 [38:47<28:29:56,  3.54it/s]
  2%|▏         | 8026/371472 [38:47<27:37:37,  3.65it/s]
  2%|▏         | 8027/371472 [38:47<28:09:23,  3.59it/s]
  2%|▏         | 8028/371472 [38:47<27:54:17,  3.62it/s]
  2%|▏         | 8029/371472 [38:48<27:32:58,  3.66it/s]
  2%|▏         | 8030/371472 [38:48<27:48:59,  3.63it/s]
  2%|▏         | 8031/371472 [38:48<29:34:32,  3.41it/s]
  2%|▏         | 8032/371472 [38:49<28:54:17,  3.49it/s]
  2%|▏         | 8033/371472 [38:49<28:35:05,  3.53it/s]
  2%|▏         | 8034/371472 [38:49<29:18:20,  3.44it/s]
  2%|▏         | 8035/371472 [38:50<33:19:53,  3.03it/s]
  2%|▏         | 8036/371472 [38:50<32:45:32,  3.08it/s]
  2%|▏         | 8037/371472 [38:50<32:12:55,  3.13it/s]
  2%|▏         | 8038/371472 [38:50<30:20:06,  3.33it/s]
  2%|▏         | 8039/371472 [38:51<28:37:54,  3.53it/s]
  2%|▏         | 8040/371472 [38:51<28:43:34,  3.51it/s]
                                                        
{'loss': 5.2234, 'learning_rate': 9.809950656122733e-07, 'epoch': 0.35}

  2%|▏         | 8040/371472 [38:51<28:43:34,  3.51it/s]
  2%|▏         | 8041/371472 [38:51<28:15:20,  3.57it/s]
  2%|▏         | 8042/371472 [38:52<27:49:32,  3.63it/s]
  2%|▏         | 8043/371472 [38:52<28:04:29,  3.60it/s]
  2%|▏         | 8044/371472 [38:52<28:14:57,  3.57it/s]
  2%|▏         | 8045/371472 [38:52<28:22:17,  3.56it/s]
  2%|▏         | 8046/371472 [38:53<28:30:48,  3.54it/s]
  2%|▏         | 8047/371472 [38:53<30:50:49,  3.27it/s]
  2%|▏         | 8048/371472 [38:53<31:01:47,  3.25it/s]
  2%|▏         | 8049/371472 [38:54<32:27:09,  3.11it/s]
  2%|▏         | 8050/371472 [38:54<30:54:14,  3.27it/s]
  2%|▏         | 8051/371472 [38:54<30:22:15,  3.32it/s]
  2%|▏         | 8052/371472 [38:55<32:32:19,  3.10it/s]
  2%|▏         | 8053/371472 [38:55<32:38:56,  3.09it/s]
  2%|▏         | 8054/371472 [38:55<30:22:03,  3.32it/s]
  2%|▏         | 8055/371472 [38:56<31:53:43,  3.17it/s]
  2%|▏         | 8056/371472 [38:56<33:08:03,  3.05it/s]
  2%|▏         | 8057/371472 [38:56<30:34:09,  3.30it/s]
  2%|▏         | 8058/371472 [38:56<30:30:35,  3.31it/s]
  2%|▏         | 8059/371472 [38:57<29:53:48,  3.38it/s]
  2%|▏         | 8060/371472 [38:57<29:25:33,  3.43it/s]
                                                        
{'loss': 5.102, 'learning_rate': 9.809465836367946e-07, 'epoch': 0.35}

  2%|▏         | 8060/371472 [38:57<29:25:33,  3.43it/s]
  2%|▏         | 8061/371472 [38:57<30:34:00,  3.30it/s]
  2%|▏         | 8062/371472 [38:58<30:29:24,  3.31it/s]
  2%|▏         | 8063/371472 [38:58<30:09:31,  3.35it/s]
  2%|▏         | 8064/371472 [38:58<31:23:36,  3.22it/s]
  2%|▏         | 8065/371472 [38:59<30:48:52,  3.28it/s]
  2%|▏         | 8066/371472 [38:59<30:43:38,  3.29it/s]
  2%|▏         | 8067/371472 [38:59<30:08:23,  3.35it/s]
  2%|▏         | 8068/371472 [38:59<28:37:40,  3.53it/s]
  2%|▏         | 8069/371472 [39:00<27:52:01,  3.62it/s]
  2%|▏         | 8070/371472 [39:00<27:34:48,  3.66it/s]
  2%|▏         | 8071/371472 [39:00<27:53:20,  3.62it/s]
  2%|▏         | 8072/371472 [39:00<27:41:27,  3.65it/s]
  2%|▏         | 8073/371472 [39:01<29:59:06,  3.37it/s]
  2%|▏         | 8074/371472 [39:01<31:44:04,  3.18it/s]
  2%|▏         | 8075/371472 [39:02<33:08:59,  3.05it/s]
  2%|▏         | 8076/371472 [39:02<31:48:00,  3.17it/s]
  2%|▏         | 8077/371472 [39:02<29:56:32,  3.37it/s]
  2%|▏         | 8078/371472 [39:02<29:32:47,  3.42it/s]
  2%|▏         | 8079/371472 [39:03<28:53:37,  3.49it/s]
  2%|▏         | 8080/371472 [39:03<30:21:38,  3.32it/s]
                                                        
{'loss': 5.0268, 'learning_rate': 9.808981016613157e-07, 'epoch': 0.35}

  2%|▏         | 8080/371472 [39:03<30:21:38,  3.32it/s]
  2%|▏         | 8081/371472 [39:03<31:00:34,  3.26it/s]
  2%|▏         | 8082/371472 [39:04<29:28:09,  3.43it/s]
  2%|▏         | 8083/371472 [39:04<29:12:38,  3.46it/s]
  2%|▏         | 8084/371472 [39:04<30:26:31,  3.32it/s]
  2%|▏         | 8085/371472 [39:04<30:48:10,  3.28it/s]
  2%|▏         | 8086/371472 [39:05<31:08:25,  3.24it/s]
  2%|▏         | 8087/371472 [39:05<30:03:27,  3.36it/s]
  2%|▏         | 8088/371472 [39:05<29:25:36,  3.43it/s]
  2%|▏         | 8089/371472 [39:06<31:15:20,  3.23it/s]
  2%|▏         | 8090/371472 [39:06<30:03:52,  3.36it/s]
  2%|▏         | 8091/371472 [39:06<32:45:45,  3.08it/s]
  2%|▏         | 8092/371472 [39:07<32:19:45,  3.12it/s]
  2%|▏         | 8093/371472 [39:07<30:09:28,  3.35it/s]
  2%|▏         | 8094/371472 [39:07<30:08:10,  3.35it/s]
  2%|▏         | 8095/371472 [39:08<31:09:52,  3.24it/s]
  2%|▏         | 8096/371472 [39:08<29:29:39,  3.42it/s]
  2%|▏         | 8097/371472 [39:08<32:51:30,  3.07it/s]
  2%|▏         | 8098/371472 [39:08<32:59:45,  3.06it/s]
  2%|▏         | 8099/371472 [39:09<32:00:20,  3.15it/s]
  2%|▏         | 8100/371472 [39:09<30:44:31,  3.28it/s]
                                                        
{'loss': 4.6825, 'learning_rate': 9.808496196858367e-07, 'epoch': 0.35}

  2%|▏         | 8100/371472 [39:09<30:44:31,  3.28it/s]
  2%|▏         | 8101/371472 [39:09<30:21:28,  3.32it/s]
  2%|▏         | 8102/371472 [39:10<29:53:26,  3.38it/s]
  2%|▏         | 8103/371472 [39:10<28:46:02,  3.51it/s]
  2%|▏         | 8104/371472 [39:10<29:24:16,  3.43it/s]
  2%|▏         | 8105/371472 [39:10<28:49:36,  3.50it/s]
  2%|▏         | 8106/371472 [39:11<27:25:48,  3.68it/s]
  2%|▏         | 8107/371472 [39:11<28:19:48,  3.56it/s]
  2%|▏         | 8108/371472 [39:11<28:02:18,  3.60it/s]
  2%|▏         | 8109/371472 [39:12<27:53:35,  3.62it/s]
  2%|▏         | 8110/371472 [39:12<27:39:27,  3.65it/s]
  2%|▏         | 8111/371472 [39:12<27:51:42,  3.62it/s]
  2%|▏         | 8112/371472 [39:12<27:27:26,  3.68it/s]
  2%|▏         | 8113/371472 [39:13<27:23:35,  3.68it/s]
  2%|▏         | 8114/371472 [39:13<27:07:15,  3.72it/s]
  2%|▏         | 8115/371472 [39:13<27:19:10,  3.69it/s]
  2%|▏         | 8116/371472 [39:13<27:14:05,  3.71it/s]
  2%|▏         | 8117/371472 [39:14<27:51:51,  3.62it/s]
  2%|▏         | 8118/371472 [39:14<27:22:04,  3.69it/s]
  2%|▏         | 8119/371472 [39:14<27:26:32,  3.68it/s]
  2%|▏         | 8120/371472 [39:15<28:58:43,  3.48it/s]
                                                        
{'loss': 5.0273, 'learning_rate': 9.80801137710358e-07, 'epoch': 0.35}

  2%|▏         | 8120/371472 [39:15<28:58:43,  3.48it/s]
  2%|▏         | 8121/371472 [39:15<27:52:44,  3.62it/s]
  2%|▏         | 8122/371472 [39:15<28:28:29,  3.54it/s]
  2%|▏         | 8123/371472 [39:15<28:25:44,  3.55it/s]
  2%|▏         | 8124/371472 [39:16<27:25:46,  3.68it/s]
  2%|▏         | 8125/371472 [39:16<26:32:56,  3.80it/s]
  2%|▏         | 8126/371472 [39:16<27:18:27,  3.70it/s]
  2%|▏         | 8127/371472 [39:16<27:07:34,  3.72it/s]
  2%|▏         | 8128/371472 [39:17<27:43:38,  3.64it/s]
  2%|▏         | 8129/371472 [39:17<27:52:45,  3.62it/s]
  2%|▏         | 8130/371472 [39:17<32:05:59,  3.14it/s]
  2%|▏         | 8131/371472 [39:18<31:16:09,  3.23it/s]
  2%|▏         | 8132/371472 [39:18<29:57:42,  3.37it/s]
  2%|▏         | 8133/371472 [39:18<30:50:53,  3.27it/s]
  2%|▏         | 8134/371472 [39:19<31:09:01,  3.24it/s]
  2%|▏         | 8135/371472 [39:19<31:54:58,  3.16it/s]
  2%|▏         | 8136/371472 [39:19<31:44:39,  3.18it/s]
  2%|▏         | 8137/371472 [39:20<30:57:31,  3.26it/s]
  2%|▏         | 8138/371472 [39:20<31:37:54,  3.19it/s]
  2%|▏         | 8139/371472 [39:20<29:55:05,  3.37it/s]
  2%|▏         | 8140/371472 [39:21<32:09:47,  3.14it/s]
                                                        
{'loss': 4.76, 'learning_rate': 9.807526557348789e-07, 'epoch': 0.35}

  2%|▏         | 8140/371472 [39:21<32:09:47,  3.14it/s]
  2%|▏         | 8141/371472 [39:21<31:33:48,  3.20it/s]
  2%|▏         | 8142/371472 [39:21<31:18:18,  3.22it/s]
  2%|▏         | 8143/371472 [39:22<32:35:13,  3.10it/s]
  2%|▏         | 8144/371472 [39:22<31:46:20,  3.18it/s]
  2%|▏         | 8145/371472 [39:22<30:22:49,  3.32it/s]
  2%|▏         | 8146/371472 [39:22<28:48:44,  3.50it/s]
  2%|▏         | 8147/371472 [39:23<28:24:48,  3.55it/s]
  2%|▏         | 8148/371472 [39:23<30:27:16,  3.31it/s]
  2%|▏         | 8149/371472 [39:23<29:43:47,  3.39it/s]
  2%|▏         | 8150/371472 [39:23<28:38:52,  3.52it/s]
  2%|▏         | 8151/371472 [39:24<28:02:17,  3.60it/s]
  2%|▏         | 8152/371472 [39:24<28:38:03,  3.52it/s]
  2%|▏         | 8153/371472 [39:24<28:27:23,  3.55it/s]
  2%|▏         | 8154/371472 [39:25<27:48:27,  3.63it/s]
  2%|▏         | 8155/371472 [39:25<28:46:36,  3.51it/s]
  2%|▏         | 8156/371472 [39:25<29:35:30,  3.41it/s]
  2%|▏         | 8157/371472 [39:25<28:33:01,  3.53it/s]
  2%|▏         | 8158/371472 [39:26<28:05:05,  3.59it/s]
  2%|▏         | 8159/371472 [39:26<28:08:43,  3.59it/s]
  2%|▏         | 8160/371472 [39:27<35:14:21,  2.86it/s]
                                                        
{'loss': 4.8518, 'learning_rate': 9.807041737594002e-07, 'epoch': 0.35}

  2%|▏         | 8160/371472 [39:27<35:14:21,  2.86it/s]
  2%|▏         | 8161/371472 [39:27<33:33:32,  3.01it/s]
  2%|▏         | 8162/371472 [39:27<35:46:21,  2.82it/s]
  2%|▏         | 8163/371472 [39:28<34:01:54,  2.97it/s]
  2%|▏         | 8164/371472 [39:28<31:55:36,  3.16it/s]
  2%|▏         | 8165/371472 [39:28<30:46:45,  3.28it/s]
  2%|▏         | 8166/371472 [39:28<29:50:17,  3.38it/s]
  2%|▏         | 8167/371472 [39:29<28:18:06,  3.57it/s]
  2%|▏         | 8168/371472 [39:29<28:12:05,  3.58it/s]
  2%|▏         | 8169/371472 [39:29<28:37:58,  3.52it/s]
  2%|▏         | 8170/371472 [39:29<28:06:45,  3.59it/s]
  2%|▏         | 8171/371472 [39:30<27:02:45,  3.73it/s]
  2%|▏         | 8172/371472 [39:30<28:00:13,  3.60it/s]
  2%|▏         | 8173/371472 [39:30<28:38:05,  3.52it/s]
  2%|▏         | 8174/371472 [39:31<28:02:42,  3.60it/s]
  2%|▏         | 8175/371472 [39:31<29:04:16,  3.47it/s]
  2%|▏         | 8176/371472 [39:31<28:37:05,  3.53it/s]
  2%|▏         | 8177/371472 [39:31<30:24:16,  3.32it/s]
  2%|▏         | 8178/371472 [39:32<29:26:16,  3.43it/s]
  2%|▏         | 8179/371472 [39:32<28:42:50,  3.51it/s]
  2%|▏         | 8180/371472 [39:32<29:06:57,  3.47it/s]
                                                        
{'loss': 5.0516, 'learning_rate': 9.80655691783921e-07, 'epoch': 0.35}

  2%|▏         | 8180/371472 [39:32<29:06:57,  3.47it/s]
  2%|▏         | 8181/371472 [39:33<29:33:04,  3.41it/s]
  2%|▏         | 8182/371472 [39:33<28:51:35,  3.50it/s]
  2%|▏         | 8183/371472 [39:33<28:05:43,  3.59it/s]
  2%|▏         | 8184/371472 [39:33<28:35:50,  3.53it/s]
  2%|▏         | 8185/371472 [39:34<29:24:33,  3.43it/s]
  2%|▏         | 8186/371472 [39:34<30:02:13,  3.36it/s]
  2%|▏         | 8187/371472 [39:34<28:56:21,  3.49it/s]
  2%|▏         | 8188/371472 [39:35<31:41:45,  3.18it/s]
  2%|▏         | 8189/371472 [39:35<29:49:51,  3.38it/s]
  2%|▏         | 8190/371472 [39:35<29:22:00,  3.44it/s]
  2%|▏         | 8191/371472 [39:35<28:54:46,  3.49it/s]
  2%|▏         | 8192/371472 [39:36<29:29:16,  3.42it/s]
  2%|▏         | 8193/371472 [39:36<28:43:23,  3.51it/s]
  2%|▏         | 8194/371472 [39:36<28:14:25,  3.57it/s]
  2%|▏         | 8195/371472 [39:37<30:07:53,  3.35it/s]
  2%|▏         | 8196/371472 [39:37<29:57:58,  3.37it/s]
  2%|▏         | 8197/371472 [39:37<28:14:45,  3.57it/s]
  2%|▏         | 8198/371472 [39:37<27:49:43,  3.63it/s]
  2%|▏         | 8199/371472 [39:38<28:34:22,  3.53it/s]
  2%|▏         | 8200/371472 [39:38<27:25:38,  3.68it/s]
                                                        
{'loss': 5.2637, 'learning_rate': 9.806072098084423e-07, 'epoch': 0.35}

  2%|▏         | 8200/371472 [39:38<27:25:38,  3.68it/s]
  2%|▏         | 8201/371472 [39:38<28:05:56,  3.59it/s]
  2%|▏         | 8202/371472 [39:39<28:43:19,  3.51it/s]
  2%|▏         | 8203/371472 [39:39<30:19:44,  3.33it/s]
  2%|▏         | 8204/371472 [39:39<32:46:18,  3.08it/s]
  2%|▏         | 8205/371472 [39:40<31:37:02,  3.19it/s]
  2%|▏         | 8206/371472 [39:40<31:42:48,  3.18it/s]
  2%|▏         | 8207/371472 [39:40<32:50:23,  3.07it/s]
  2%|▏         | 8208/371472 [39:41<30:18:16,  3.33it/s]
  2%|▏         | 8209/371472 [39:41<28:40:18,  3.52it/s]
  2%|▏         | 8210/371472 [39:41<27:33:12,  3.66it/s]
  2%|▏         | 8211/371472 [39:41<28:59:44,  3.48it/s]
  2%|▏         | 8212/371472 [39:42<28:44:53,  3.51it/s]
  2%|▏         | 8213/371472 [39:42<31:11:31,  3.23it/s]
  2%|▏         | 8214/371472 [39:42<30:12:00,  3.34it/s]
  2%|▏         | 8215/371472 [39:43<29:14:54,  3.45it/s]
  2%|▏         | 8216/371472 [39:43<28:11:58,  3.58it/s]
  2%|▏         | 8217/371472 [39:43<27:25:43,  3.68it/s]
  2%|▏         | 8218/371472 [39:43<28:08:21,  3.59it/s]
  2%|▏         | 8219/371472 [39:44<30:07:07,  3.35it/s]
  2%|▏         | 8220/371472 [39:44<30:40:41,  3.29it/s]
                                                        
{'loss': 5.178, 'learning_rate': 9.805587278329634e-07, 'epoch': 0.35}

  2%|▏         | 8220/371472 [39:44<30:40:41,  3.29it/s]
  2%|▏         | 8221/371472 [39:44<30:41:40,  3.29it/s]
  2%|▏         | 8222/371472 [39:45<29:41:16,  3.40it/s]
  2%|▏         | 8223/371472 [39:45<28:38:39,  3.52it/s]
  2%|▏         | 8224/371472 [39:45<30:28:45,  3.31it/s]
  2%|▏         | 8225/371472 [39:45<29:54:32,  3.37it/s]
  2%|▏         | 8226/371472 [39:46<28:33:21,  3.53it/s]
  2%|▏         | 8227/371472 [39:46<28:39:17,  3.52it/s]
  2%|▏         | 8228/371472 [39:46<27:49:28,  3.63it/s]
  2%|▏         | 8229/371472 [39:47<29:07:11,  3.47it/s]
  2%|▏         | 8230/371472 [39:47<28:50:28,  3.50it/s]
  2%|▏         | 8231/371472 [39:47<29:08:12,  3.46it/s]
  2%|▏         | 8232/371472 [39:47<28:48:43,  3.50it/s]
  2%|▏         | 8233/371472 [39:48<30:54:42,  3.26it/s]
  2%|▏         | 8234/371472 [39:48<30:30:43,  3.31it/s]
  2%|▏         | 8235/371472 [39:48<31:40:38,  3.19it/s]
  2%|▏         | 8236/371472 [39:49<30:28:52,  3.31it/s]
  2%|▏         | 8237/371472 [39:49<29:37:59,  3.40it/s]
  2%|▏         | 8238/371472 [39:49<29:05:06,  3.47it/s]
  2%|▏         | 8239/371472 [39:49<27:59:49,  3.60it/s]
  2%|▏         | 8240/371472 [39:50<30:39:54,  3.29it/s]
                                                        
{'loss': 5.163, 'learning_rate': 9.805102458574845e-07, 'epoch': 0.35}

  2%|▏         | 8240/371472 [39:50<30:39:54,  3.29it/s]
  2%|▏         | 8241/371472 [39:50<30:30:17,  3.31it/s]
  2%|▏         | 8242/371472 [39:50<29:19:04,  3.44it/s]
  2%|▏         | 8243/371472 [39:51<30:14:06,  3.34it/s]
  2%|▏         | 8244/371472 [39:51<30:43:57,  3.28it/s]
  2%|▏         | 8245/371472 [39:51<31:13:56,  3.23it/s]
  2%|▏         | 8246/371472 [39:52<30:10:37,  3.34it/s]
  2%|▏         | 8247/371472 [39:52<30:56:31,  3.26it/s]
  2%|▏         | 8248/371472 [39:52<29:56:38,  3.37it/s]
  2%|▏         | 8249/371472 [39:53<29:10:11,  3.46it/s]
  2%|▏         | 8250/371472 [39:53<28:42:10,  3.52it/s]
  2%|▏         | 8251/371472 [39:53<28:59:43,  3.48it/s]
  2%|▏         | 8252/371472 [39:53<29:12:47,  3.45it/s]
  2%|▏         | 8253/371472 [39:54<28:17:39,  3.57it/s]
  2%|▏         | 8254/371472 [39:54<28:25:41,  3.55it/s]
  2%|▏         | 8255/371472 [39:54<27:52:27,  3.62it/s]
  2%|▏         | 8256/371472 [39:54<28:21:28,  3.56it/s]
  2%|▏         | 8257/371472 [39:55<29:43:01,  3.40it/s]
  2%|▏         | 8258/371472 [39:55<28:35:36,  3.53it/s]
  2%|▏         | 8259/371472 [39:55<28:14:46,  3.57it/s]
  2%|▏         | 8260/371472 [39:56<27:32:14,  3.66it/s]
                                                        
{'loss': 4.9961, 'learning_rate': 9.804617638820057e-07, 'epoch': 0.36}

  2%|▏         | 8260/371472 [39:56<27:32:14,  3.66it/s]
  2%|▏         | 8261/371472 [39:56<27:28:52,  3.67it/s]
  2%|▏         | 8262/371472 [39:56<27:47:12,  3.63it/s]
  2%|▏         | 8263/371472 [39:56<30:19:14,  3.33it/s]
  2%|▏         | 8264/371472 [39:57<29:29:39,  3.42it/s]
  2%|▏         | 8265/371472 [39:57<29:20:26,  3.44it/s]
  2%|▏         | 8266/371472 [39:57<28:06:54,  3.59it/s]
  2%|▏         | 8267/371472 [39:58<27:50:13,  3.62it/s]
  2%|▏         | 8268/371472 [39:58<27:58:51,  3.61it/s]
  2%|▏         | 8269/371472 [39:58<29:35:57,  3.41it/s]
  2%|▏         | 8270/371472 [39:58<29:48:21,  3.38it/s]
  2%|▏         | 8271/371472 [39:59<29:43:37,  3.39it/s]
  2%|▏         | 8272/371472 [39:59<28:19:57,  3.56it/s]
  2%|▏         | 8273/371472 [39:59<27:47:46,  3.63it/s]
  2%|▏         | 8274/371472 [40:00<30:29:49,  3.31it/s]
  2%|▏         | 8275/371472 [40:00<28:49:52,  3.50it/s]
  2%|▏         | 8276/371472 [40:00<28:36:43,  3.53it/s]
  2%|▏         | 8277/371472 [40:00<27:46:19,  3.63it/s]
  2%|▏         | 8278/371472 [40:01<27:37:14,  3.65it/s]
  2%|▏         | 8279/371472 [40:01<28:26:53,  3.55it/s]
  2%|▏         | 8280/371472 [40:01<31:56:46,  3.16it/s]
                                                        
{'loss': 4.8015, 'learning_rate': 9.804132819065266e-07, 'epoch': 0.36}

  2%|▏         | 8280/371472 [40:01<31:56:46,  3.16it/s]
  2%|▏         | 8281/371472 [40:02<30:22:11,  3.32it/s]
  2%|▏         | 8282/371472 [40:02<31:00:05,  3.25it/s]
  2%|▏         | 8283/371472 [40:02<30:55:43,  3.26it/s]
  2%|▏         | 8284/371472 [40:03<32:02:42,  3.15it/s]
  2%|▏         | 8285/371472 [40:03<32:56:27,  3.06it/s]
  2%|▏         | 8286/371472 [40:03<31:29:14,  3.20it/s]
  2%|▏         | 8287/371472 [40:04<29:42:11,  3.40it/s]
  2%|▏         | 8288/371472 [40:04<29:24:00,  3.43it/s]
  2%|▏         | 8289/371472 [40:04<29:11:58,  3.45it/s]
  2%|▏         | 8290/371472 [40:04<28:26:07,  3.55it/s]
  2%|▏         | 8291/371472 [40:05<29:42:26,  3.40it/s]
  2%|▏         | 8292/371472 [40:05<29:36:22,  3.41it/s]
  2%|▏         | 8293/371472 [40:05<28:41:10,  3.52it/s]
  2%|▏         | 8294/371472 [40:06<29:04:18,  3.47it/s]
  2%|▏         | 8295/371472 [40:06<28:04:47,  3.59it/s]
  2%|▏         | 8296/371472 [40:06<29:19:10,  3.44it/s]
  2%|▏         | 8297/371472 [40:06<27:50:21,  3.62it/s]
  2%|▏         | 8298/371472 [40:07<30:03:01,  3.36it/s]
  2%|▏         | 8299/371472 [40:07<28:53:56,  3.49it/s]
  2%|▏         | 8300/371472 [40:07<28:39:45,  3.52it/s]
                                                        
{'loss': 4.8818, 'learning_rate': 9.803647999310479e-07, 'epoch': 0.36}

  2%|▏         | 8300/371472 [40:07<28:39:45,  3.52it/s]
  2%|▏         | 8301/371472 [40:08<29:54:07,  3.37it/s]
  2%|▏         | 8302/371472 [40:08<28:32:28,  3.53it/s]
  2%|▏         | 8303/371472 [40:08<29:19:08,  3.44it/s]
  2%|▏         | 8304/371472 [40:08<28:10:56,  3.58it/s]
  2%|▏         | 8305/371472 [40:09<28:00:39,  3.60it/s]
  2%|▏         | 8306/371472 [40:09<30:52:06,  3.27it/s]
  2%|▏         | 8307/371472 [40:09<29:42:44,  3.40it/s]
  2%|▏         | 8308/371472 [40:10<28:58:07,  3.48it/s]
  2%|▏         | 8309/371472 [40:10<28:10:52,  3.58it/s]
  2%|▏         | 8310/371472 [40:10<29:05:58,  3.47it/s]
  2%|▏         | 8311/371472 [40:10<29:05:42,  3.47it/s]
  2%|▏         | 8312/371472 [40:11<28:20:15,  3.56it/s]
  2%|▏         | 8313/371472 [40:11<29:44:48,  3.39it/s]
  2%|▏         | 8314/371472 [40:11<29:03:12,  3.47it/s]
  2%|▏         | 8315/371472 [40:12<29:12:59,  3.45it/s]
  2%|▏         | 8316/371472 [40:12<29:19:52,  3.44it/s]
  2%|▏         | 8317/371472 [40:12<31:49:04,  3.17it/s]
  2%|▏         | 8318/371472 [40:13<33:07:52,  3.04it/s]
  2%|▏         | 8319/371472 [40:13<31:23:18,  3.21it/s]
  2%|▏         | 8320/371472 [40:13<29:48:04,  3.38it/s]
                                                        
{'loss': 4.9811, 'learning_rate': 9.803163179555687e-07, 'epoch': 0.36}

  2%|▏         | 8320/371472 [40:13<29:48:04,  3.38it/s]
  2%|▏         | 8321/371472 [40:13<30:56:37,  3.26it/s]
  2%|▏         | 8322/371472 [40:14<30:06:25,  3.35it/s]
  2%|▏         | 8323/371472 [40:14<29:48:33,  3.38it/s]
  2%|▏         | 8324/371472 [40:14<31:07:53,  3.24it/s]
  2%|▏         | 8325/371472 [40:15<29:59:57,  3.36it/s]
  2%|▏         | 8326/371472 [40:15<29:05:59,  3.47it/s]
  2%|▏         | 8327/371472 [40:15<28:46:09,  3.51it/s]
  2%|▏         | 8328/371472 [40:15<29:30:24,  3.42it/s]
  2%|▏         | 8329/371472 [40:16<29:09:18,  3.46it/s]
  2%|▏         | 8330/371472 [40:16<28:31:57,  3.54it/s]
  2%|▏         | 8331/371472 [40:16<28:40:39,  3.52it/s]
  2%|▏         | 8332/371472 [40:17<27:43:46,  3.64it/s]
  2%|▏         | 8333/371472 [40:17<28:16:55,  3.57it/s]
  2%|▏         | 8334/371472 [40:17<27:50:55,  3.62it/s]
  2%|▏         | 8335/371472 [40:17<27:36:19,  3.65it/s]
  2%|▏         | 8336/371472 [40:18<29:25:38,  3.43it/s]
  2%|▏         | 8337/371472 [40:18<30:20:54,  3.32it/s]
  2%|▏         | 8338/371472 [40:18<29:30:14,  3.42it/s]
  2%|▏         | 8339/371472 [40:19<28:54:36,  3.49it/s]
  2%|▏         | 8340/371472 [40:19<28:19:58,  3.56it/s]
                                                        
{'loss': 4.9989, 'learning_rate': 9.8026783598009e-07, 'epoch': 0.36}

  2%|▏         | 8340/371472 [40:19<28:19:58,  3.56it/s]
  2%|▏         | 8341/371472 [40:19<28:09:45,  3.58it/s]
  2%|▏         | 8342/371472 [40:19<27:51:48,  3.62it/s]
  2%|▏         | 8343/371472 [40:20<27:31:43,  3.66it/s]
  2%|▏         | 8344/371472 [40:20<28:11:03,  3.58it/s]
  2%|▏         | 8345/371472 [40:20<27:16:53,  3.70it/s]
  2%|▏         | 8346/371472 [40:21<27:15:30,  3.70it/s]
  2%|▏         | 8347/371472 [40:21<28:26:39,  3.55it/s]
  2%|▏         | 8348/371472 [40:21<27:55:36,  3.61it/s]
  2%|▏         | 8349/371472 [40:21<27:41:49,  3.64it/s]
  2%|▏         | 8350/371472 [40:22<26:46:04,  3.77it/s]
  2%|▏         | 8351/371472 [40:22<28:01:31,  3.60it/s]
  2%|▏         | 8352/371472 [40:22<28:19:44,  3.56it/s]
  2%|▏         | 8353/371472 [40:23<30:56:26,  3.26it/s]
  2%|▏         | 8354/371472 [40:23<31:16:49,  3.22it/s]
  2%|▏         | 8355/371472 [40:23<29:33:35,  3.41it/s]
  2%|▏         | 8356/371472 [40:24<32:13:54,  3.13it/s]
  2%|▏         | 8357/371472 [40:24<32:08:51,  3.14it/s]
  2%|▏         | 8358/371472 [40:24<30:29:05,  3.31it/s]
  2%|▏         | 8359/371472 [40:24<30:22:16,  3.32it/s]
  2%|▏         | 8360/371472 [40:25<32:15:12,  3.13it/s]
                                                        
{'loss': 4.7071, 'learning_rate': 9.80219354004611e-07, 'epoch': 0.36}

  2%|▏         | 8360/371472 [40:25<32:15:12,  3.13it/s]
  2%|▏         | 8361/371472 [40:25<32:57:38,  3.06it/s]
  2%|▏         | 8362/371472 [40:25<31:40:20,  3.18it/s]
  2%|▏         | 8363/371472 [40:26<30:14:14,  3.34it/s]
  2%|▏         | 8364/371472 [40:26<29:27:44,  3.42it/s]
  2%|▏         | 8365/371472 [40:26<28:57:26,  3.48it/s]
  2%|▏         | 8366/371472 [40:26<28:29:37,  3.54it/s]
  2%|▏         | 8367/371472 [40:27<30:10:01,  3.34it/s]
  2%|▏         | 8368/371472 [40:27<29:41:04,  3.40it/s]
  2%|▏         | 8369/371472 [40:27<29:25:56,  3.43it/s]
  2%|▏         | 8370/371472 [40:28<28:42:03,  3.51it/s]
  2%|▏         | 8371/371472 [40:28<29:58:24,  3.37it/s]
  2%|▏         | 8372/371472 [40:28<32:18:31,  3.12it/s]
  2%|▏         | 8373/371472 [40:29<30:24:31,  3.32it/s]
  2%|▏         | 8374/371472 [40:29<29:07:47,  3.46it/s]
  2%|▏         | 8375/371472 [40:29<29:16:15,  3.45it/s]
  2%|▏         | 8376/371472 [40:29<29:18:55,  3.44it/s]
  2%|▏         | 8377/371472 [40:30<28:38:08,  3.52it/s]
  2%|▏         | 8378/371472 [40:30<27:57:09,  3.61it/s]
  2%|▏         | 8379/371472 [40:30<28:13:31,  3.57it/s]
  2%|▏         | 8380/371472 [40:31<27:23:40,  3.68it/s]
                                                        
{'loss': 5.0305, 'learning_rate': 9.801708720291322e-07, 'epoch': 0.36}

  2%|▏         | 8380/371472 [40:31<27:23:40,  3.68it/s]
  2%|▏         | 8381/371472 [40:31<29:28:51,  3.42it/s]
  2%|▏         | 8382/371472 [40:31<28:27:03,  3.54it/s]
  2%|▏         | 8383/371472 [40:31<28:41:14,  3.52it/s]
  2%|▏         | 8384/371472 [40:32<28:43:16,  3.51it/s]
  2%|▏         | 8385/371472 [40:32<30:13:27,  3.34it/s]
  2%|▏         | 8386/371472 [40:32<29:13:34,  3.45it/s]
  2%|▏         | 8387/371472 [40:33<28:10:47,  3.58it/s]
  2%|▏         | 8388/371472 [40:33<27:47:59,  3.63it/s]
  2%|▏         | 8389/371472 [40:33<27:43:52,  3.64it/s]
  2%|▏         | 8390/371472 [40:33<28:27:35,  3.54it/s]
  2%|▏         | 8391/371472 [40:34<27:32:55,  3.66it/s]
  2%|▏         | 8392/371472 [40:34<27:15:55,  3.70it/s]
  2%|▏         | 8393/371472 [40:34<28:10:41,  3.58it/s]
  2%|▏         | 8394/371472 [40:34<27:40:50,  3.64it/s]
  2%|▏         | 8395/371472 [40:35<27:28:49,  3.67it/s]
  2%|▏         | 8396/371472 [40:35<27:29:31,  3.67it/s]
  2%|▏         | 8397/371472 [40:35<29:00:51,  3.48it/s]
  2%|▏         | 8398/371472 [40:36<29:21:21,  3.44it/s]
  2%|▏         | 8399/371472 [40:36<29:47:05,  3.39it/s]
  2%|▏         | 8400/371472 [40:36<28:59:24,  3.48it/s]
                                                        
{'loss': 4.7833, 'learning_rate': 9.801223900536535e-07, 'epoch': 0.36}

  2%|▏         | 8400/371472 [40:36<28:59:24,  3.48it/s]
  2%|▏         | 8401/371472 [40:37<30:53:08,  3.27it/s]
  2%|▏         | 8402/371472 [40:37<30:18:43,  3.33it/s]
  2%|▏         | 8403/371472 [40:37<30:36:45,  3.29it/s]
  2%|▏         | 8404/371472 [40:37<29:24:24,  3.43it/s]
  2%|▏         | 8405/371472 [40:38<27:56:33,  3.61it/s]
  2%|▏         | 8406/371472 [40:38<28:53:38,  3.49it/s]
  2%|▏         | 8407/371472 [40:38<28:39:55,  3.52it/s]
  2%|▏         | 8408/371472 [40:39<30:59:42,  3.25it/s]
  2%|▏         | 8409/371472 [40:39<30:53:22,  3.26it/s]
  2%|▏         | 8410/371472 [40:39<29:36:52,  3.41it/s]
  2%|▏         | 8411/371472 [40:39<29:53:48,  3.37it/s]
  2%|▏         | 8412/371472 [40:40<29:33:36,  3.41it/s]
  2%|▏         | 8413/371472 [40:40<30:00:35,  3.36it/s]
  2%|▏         | 8414/371472 [40:40<28:44:04,  3.51it/s]
  2%|▏         | 8415/371472 [40:41<29:55:28,  3.37it/s]
  2%|▏         | 8416/371472 [40:41<31:35:28,  3.19it/s]
  2%|▏         | 8417/371472 [40:41<32:11:05,  3.13it/s]
  2%|▏         | 8418/371472 [40:42<30:58:52,  3.26it/s]
  2%|▏         | 8419/371472 [40:42<31:31:10,  3.20it/s]
  2%|▏         | 8420/371472 [40:42<29:51:53,  3.38it/s]
                                                        
{'loss': 4.714, 'learning_rate': 9.800739080781743e-07, 'epoch': 0.36}

  2%|▏         | 8420/371472 [40:42<29:51:53,  3.38it/s]
  2%|▏         | 8421/371472 [40:42<29:20:23,  3.44it/s]
  2%|▏         | 8422/371472 [40:43<28:37:47,  3.52it/s]
  2%|▏         | 8423/371472 [40:43<28:18:27,  3.56it/s]
  2%|▏         | 8424/371472 [40:43<28:24:08,  3.55it/s]
  2%|▏         | 8425/371472 [40:44<29:10:15,  3.46it/s]
  2%|▏         | 8426/371472 [40:44<31:43:37,  3.18it/s]
  2%|▏         | 8427/371472 [40:44<30:13:00,  3.34it/s]
  2%|▏         | 8428/371472 [40:45<29:17:31,  3.44it/s]
  2%|▏         | 8429/371472 [40:45<30:24:14,  3.32it/s]
  2%|▏         | 8430/371472 [40:45<30:23:34,  3.32it/s]
  2%|▏         | 8431/371472 [40:45<29:11:01,  3.46it/s]
  2%|▏         | 8432/371472 [40:46<28:13:34,  3.57it/s]
  2%|▏         | 8433/371472 [40:46<29:07:18,  3.46it/s]
  2%|▏         | 8434/371472 [40:46<28:37:05,  3.52it/s]
  2%|▏         | 8435/371472 [40:47<28:42:02,  3.51it/s]
  2%|▏         | 8436/371472 [40:47<28:07:13,  3.59it/s]
  2%|▏         | 8437/371472 [40:47<27:35:13,  3.66it/s]
  2%|▏         | 8438/371472 [40:47<28:32:04,  3.53it/s]
  2%|▏         | 8439/371472 [40:48<29:27:37,  3.42it/s]
  2%|▏         | 8440/371472 [40:48<33:29:12,  3.01it/s]
                                                        
{'loss': 4.7957, 'learning_rate': 9.800254261026956e-07, 'epoch': 0.36}

  2%|▏         | 8440/371472 [40:48<33:29:12,  3.01it/s]
  2%|▏         | 8441/371472 [40:48<31:38:31,  3.19it/s]
  2%|▏         | 8442/371472 [40:49<30:29:28,  3.31it/s]
  2%|▏         | 8443/371472 [40:49<31:16:28,  3.22it/s]
  2%|▏         | 8444/371472 [40:49<30:34:06,  3.30it/s]
  2%|▏         | 8445/371472 [40:50<29:38:47,  3.40it/s]
  2%|▏         | 8446/371472 [40:50<28:46:39,  3.50it/s]
  2%|▏         | 8447/371472 [40:50<27:43:06,  3.64it/s]
  2%|▏         | 8448/371472 [40:50<29:20:22,  3.44it/s]
  2%|▏         | 8449/371472 [40:51<29:27:07,  3.42it/s]
  2%|▏         | 8450/371472 [40:51<29:17:21,  3.44it/s]
  2%|▏         | 8451/371472 [40:51<28:21:10,  3.56it/s]
  2%|▏         | 8452/371472 [40:51<28:18:15,  3.56it/s]
  2%|▏         | 8453/371472 [40:52<28:38:21,  3.52it/s]
  2%|▏         | 8454/371472 [40:52<27:40:57,  3.64it/s]
  2%|▏         | 8455/371472 [40:52<28:29:16,  3.54it/s]
  2%|▏         | 8456/371472 [40:53<27:39:43,  3.65it/s]
  2%|▏         | 8457/371472 [40:53<28:31:49,  3.53it/s]
  2%|▏         | 8458/371472 [40:53<29:14:13,  3.45it/s]
  2%|▏         | 8459/371472 [40:53<28:32:25,  3.53it/s]
  2%|▏         | 8460/371472 [40:54<27:51:53,  3.62it/s]
                                                        
{'loss': 4.9877, 'learning_rate': 9.799769441272167e-07, 'epoch': 0.36}

  2%|▏         | 8460/371472 [40:54<27:51:53,  3.62it/s]
  2%|▏         | 8461/371472 [40:54<29:15:16,  3.45it/s]
  2%|▏         | 8462/371472 [40:54<28:30:40,  3.54it/s]
  2%|▏         | 8463/371472 [40:55<34:48:07,  2.90it/s]
  2%|▏         | 8464/371472 [40:55<33:42:35,  2.99it/s]
  2%|▏         | 8465/371472 [40:55<31:33:39,  3.19it/s]
  2%|▏         | 8466/371472 [40:56<33:07:30,  3.04it/s]
  2%|▏         | 8467/371472 [40:56<32:00:49,  3.15it/s]
  2%|▏         | 8468/371472 [40:56<30:21:48,  3.32it/s]
  2%|▏         | 8469/371472 [40:57<29:27:47,  3.42it/s]
  2%|▏         | 8470/371472 [40:57<29:15:55,  3.45it/s]
  2%|▏         | 8471/371472 [40:57<29:43:21,  3.39it/s]
  2%|▏         | 8472/371472 [40:57<30:18:55,  3.33it/s]
  2%|▏         | 8473/371472 [40:58<29:37:30,  3.40it/s]
  2%|▏         | 8474/371472 [40:58<28:08:50,  3.58it/s]
  2%|▏         | 8475/371472 [40:58<28:11:17,  3.58it/s]
  2%|▏         | 8476/371472 [40:59<27:22:49,  3.68it/s]
  2%|▏         | 8477/371472 [40:59<27:32:04,  3.66it/s]
  2%|▏         | 8478/371472 [40:59<27:32:36,  3.66it/s]
  2%|▏         | 8479/371472 [40:59<26:57:51,  3.74it/s]
  2%|▏         | 8480/371472 [41:00<27:27:11,  3.67it/s]
                                                        
{'loss': 5.1407, 'learning_rate': 9.799284621517377e-07, 'epoch': 0.37}

  2%|▏         | 8480/371472 [41:00<27:27:11,  3.67it/s]
  2%|▏         | 8481/371472 [41:00<27:25:39,  3.68it/s]
  2%|▏         | 8482/371472 [41:00<26:48:01,  3.76it/s]
  2%|▏         | 8483/371472 [41:00<27:09:34,  3.71it/s]
  2%|▏         | 8484/371472 [41:01<27:28:02,  3.67it/s]
  2%|▏         | 8485/371472 [41:01<29:03:12,  3.47it/s]
  2%|▏         | 8486/371472 [41:01<29:27:34,  3.42it/s]
  2%|▏         | 8487/371472 [41:02<28:21:45,  3.56it/s]
  2%|▏         | 8488/371472 [41:02<27:08:32,  3.71it/s]
  2%|▏         | 8489/371472 [41:02<27:01:06,  3.73it/s]
  2%|▏         | 8490/371472 [41:02<27:13:44,  3.70it/s]
  2%|▏         | 8491/371472 [41:03<27:55:48,  3.61it/s]
  2%|▏         | 8492/371472 [41:03<29:02:01,  3.47it/s]
  2%|▏         | 8493/371472 [41:03<28:58:27,  3.48it/s]
  2%|▏         | 8494/371472 [41:04<30:59:12,  3.25it/s]
  2%|▏         | 8495/371472 [41:04<29:45:08,  3.39it/s]
  2%|▏         | 8496/371472 [41:04<29:53:23,  3.37it/s]
  2%|▏         | 8497/371472 [41:04<29:09:57,  3.46it/s]
  2%|▏         | 8498/371472 [41:05<27:45:05,  3.63it/s]
  2%|▏         | 8499/371472 [41:05<29:17:46,  3.44it/s]
  2%|▏         | 8500/371472 [41:05<29:11:45,  3.45it/s]
                                                        
{'loss': 5.0109, 'learning_rate': 9.79879980176259e-07, 'epoch': 0.37}

  2%|▏         | 8500/371472 [41:05<29:11:45,  3.45it/s]
  2%|▏         | 8501/371472 [41:06<28:32:08,  3.53it/s]
  2%|▏         | 8502/371472 [41:06<27:44:29,  3.63it/s]
  2%|▏         | 8503/371472 [41:06<27:51:52,  3.62it/s]
  2%|▏         | 8504/371472 [41:07<31:35:25,  3.19it/s]
  2%|▏         | 8505/371472 [41:07<29:51:19,  3.38it/s]
  2%|▏         | 8506/371472 [41:07<29:58:46,  3.36it/s]
  2%|▏         | 8507/371472 [41:07<29:17:29,  3.44it/s]
  2%|▏         | 8508/371472 [41:08<30:43:54,  3.28it/s]
  2%|▏         | 8509/371472 [41:08<29:55:59,  3.37it/s]
  2%|▏         | 8510/371472 [41:08<30:02:59,  3.36it/s]
  2%|▏         | 8511/371472 [41:09<29:05:45,  3.47it/s]
  2%|▏         | 8512/371472 [41:09<29:17:58,  3.44it/s]
  2%|▏         | 8513/371472 [41:09<30:24:20,  3.32it/s]
  2%|▏         | 8514/371472 [41:09<29:04:26,  3.47it/s]
  2%|▏         | 8515/371472 [41:10<29:29:45,  3.42it/s]
  2%|▏         | 8516/371472 [41:10<28:44:39,  3.51it/s]
  2%|▏         | 8517/371472 [41:10<31:44:48,  3.18it/s]
  2%|▏         | 8518/371472 [41:11<29:51:17,  3.38it/s]
  2%|▏         | 8519/371472 [41:11<29:40:00,  3.40it/s]
  2%|▏         | 8520/371472 [41:11<29:23:45,  3.43it/s]
                                                        
{'loss': 5.0929, 'learning_rate': 9.798314982007799e-07, 'epoch': 0.37}

  2%|▏         | 8520/371472 [41:11<29:23:45,  3.43it/s]
  2%|▏         | 8521/371472 [41:11<28:39:52,  3.52it/s]
  2%|▏         | 8522/371472 [41:12<28:15:19,  3.57it/s]
  2%|▏         | 8523/371472 [41:12<29:26:22,  3.42it/s]
  2%|▏         | 8524/371472 [41:12<28:18:35,  3.56it/s]
  2%|▏         | 8525/371472 [41:13<27:50:38,  3.62it/s]
  2%|▏         | 8526/371472 [41:13<27:07:21,  3.72it/s]
  2%|▏         | 8527/371472 [41:13<28:02:41,  3.59it/s]
  2%|▏         | 8528/371472 [41:13<28:12:28,  3.57it/s]
  2%|▏         | 8529/371472 [41:14<28:00:14,  3.60it/s]
  2%|▏         | 8530/371472 [41:14<30:32:03,  3.30it/s]
  2%|▏         | 8531/371472 [41:14<30:44:02,  3.28it/s]
  2%|▏         | 8532/371472 [41:15<29:11:56,  3.45it/s]
  2%|▏         | 8533/371472 [41:15<27:51:52,  3.62it/s]
  2%|▏         | 8534/371472 [41:15<27:21:15,  3.69it/s]
  2%|▏         | 8535/371472 [41:15<27:28:18,  3.67it/s]
  2%|▏         | 8536/371472 [41:16<28:02:51,  3.59it/s]
  2%|▏         | 8537/371472 [41:16<29:13:19,  3.45it/s]
  2%|▏         | 8538/371472 [41:16<29:12:06,  3.45it/s]
  2%|▏         | 8539/371472 [41:17<30:38:20,  3.29it/s]
  2%|▏         | 8540/371472 [41:17<31:47:19,  3.17it/s]
                                                        
{'loss': 4.8868, 'learning_rate': 9.797830162253012e-07, 'epoch': 0.37}

  2%|▏         | 8540/371472 [41:17<31:47:19,  3.17it/s]
  2%|▏         | 8541/371472 [41:17<30:14:09,  3.33it/s]
  2%|▏         | 8542/371472 [41:18<30:12:44,  3.34it/s]
  2%|▏         | 8543/371472 [41:18<30:09:11,  3.34it/s]
  2%|▏         | 8544/371472 [41:18<30:04:05,  3.35it/s]
  2%|▏         | 8545/371472 [41:18<28:39:40,  3.52it/s]
  2%|▏         | 8546/371472 [41:19<28:07:33,  3.58it/s]
  2%|▏         | 8547/371472 [41:19<27:40:18,  3.64it/s]
  2%|▏         | 8548/371472 [41:19<27:13:35,  3.70it/s]
  2%|▏         | 8549/371472 [41:19<28:10:33,  3.58it/s]
  2%|▏         | 8550/371472 [41:20<30:06:57,  3.35it/s]
  2%|▏         | 8551/371472 [41:20<30:02:24,  3.36it/s]
  2%|▏         | 8552/371472 [41:20<30:17:02,  3.33it/s]
  2%|▏         | 8553/371472 [41:21<31:07:03,  3.24it/s]
  2%|▏         | 8554/371472 [41:21<29:40:13,  3.40it/s]
  2%|▏         | 8555/371472 [41:21<28:04:16,  3.59it/s]
  2%|▏         | 8556/371472 [41:22<27:52:03,  3.62it/s]
  2%|▏         | 8557/371472 [41:22<29:14:04,  3.45it/s]
  2%|▏         | 8558/371472 [41:22<28:08:29,  3.58it/s]
  2%|▏         | 8559/371472 [41:22<28:06:18,  3.59it/s]
  2%|▏         | 8560/371472 [41:23<29:14:13,  3.45it/s]
                                                        
{'loss': 5.0758, 'learning_rate': 9.79734534249822e-07, 'epoch': 0.37}

  2%|▏         | 8560/371472 [41:23<29:14:13,  3.45it/s]
  2%|▏         | 8561/371472 [41:23<30:14:56,  3.33it/s]
  2%|▏         | 8562/371472 [41:23<33:08:06,  3.04it/s]
  2%|▏         | 8563/371472 [41:24<32:49:07,  3.07it/s]
  2%|▏         | 8564/371472 [41:24<31:00:58,  3.25it/s]
  2%|▏         | 8565/371472 [41:24<29:13:11,  3.45it/s]
  2%|▏         | 8566/371472 [41:24<28:19:58,  3.56it/s]
  2%|▏         | 8567/371472 [41:25<28:01:13,  3.60it/s]
  2%|▏         | 8568/371472 [41:25<28:20:18,  3.56it/s]
  2%|▏         | 8569/371472 [41:25<29:18:50,  3.44it/s]
  2%|▏         | 8570/371472 [41:26<29:47:01,  3.38it/s]
  2%|▏         | 8571/371472 [41:26<29:09:16,  3.46it/s]
  2%|▏         | 8572/371472 [41:26<29:02:35,  3.47it/s]
  2%|▏         | 8573/371472 [41:27<29:45:42,  3.39it/s]
  2%|▏         | 8574/371472 [41:27<28:40:53,  3.51it/s]
  2%|▏         | 8575/371472 [41:27<28:39:08,  3.52it/s]
  2%|▏         | 8576/371472 [41:27<28:50:49,  3.49it/s]
  2%|▏         | 8577/371472 [41:28<30:35:57,  3.29it/s]
  2%|▏         | 8578/371472 [41:28<29:52:00,  3.38it/s]
  2%|▏         | 8579/371472 [41:28<31:57:24,  3.15it/s]
  2%|▏         | 8580/371472 [41:29<31:31:37,  3.20it/s]
                                                        
{'loss': 4.7914, 'learning_rate': 9.796860522743433e-07, 'epoch': 0.37}

  2%|▏         | 8580/371472 [41:29<31:31:37,  3.20it/s]
  2%|▏         | 8581/371472 [41:29<31:58:20,  3.15it/s]
  2%|▏         | 8582/371472 [41:29<29:48:50,  3.38it/s]
  2%|▏         | 8583/371472 [41:30<30:15:57,  3.33it/s]
  2%|▏         | 8584/371472 [41:30<30:14:47,  3.33it/s]
  2%|▏         | 8585/371472 [41:30<30:56:53,  3.26it/s]
  2%|▏         | 8586/371472 [41:30<29:35:00,  3.41it/s]
  2%|▏         | 8587/371472 [41:31<28:29:55,  3.54it/s]
  2%|▏         | 8588/371472 [41:31<28:37:09,  3.52it/s]
  2%|▏         | 8589/371472 [41:31<27:59:11,  3.60it/s]
  2%|▏         | 8590/371472 [41:31<27:33:53,  3.66it/s]
  2%|▏         | 8591/371472 [41:32<28:53:50,  3.49it/s]
  2%|▏         | 8592/371472 [41:32<29:38:08,  3.40it/s]
  2%|▏         | 8593/371472 [41:32<29:04:26,  3.47it/s]
  2%|▏         | 8594/371472 [41:33<28:00:26,  3.60it/s]
  2%|▏         | 8595/371472 [41:33<27:47:09,  3.63it/s]
  2%|▏         | 8596/371472 [41:33<28:14:21,  3.57it/s]
  2%|▏         | 8597/371472 [41:34<28:56:35,  3.48it/s]
  2%|▏         | 8598/371472 [41:34<28:08:54,  3.58it/s]
  2%|▏         | 8599/371472 [41:34<30:06:19,  3.35it/s]
  2%|▏         | 8600/371472 [41:34<29:03:48,  3.47it/s]
                                                        
{'loss': 4.9024, 'learning_rate': 9.796375702988644e-07, 'epoch': 0.37}

  2%|▏         | 8600/371472 [41:34<29:03:48,  3.47it/s]
  2%|▏         | 8601/371472 [41:35<29:46:11,  3.39it/s]
  2%|▏         | 8602/371472 [41:35<29:04:13,  3.47it/s]
  2%|▏         | 8603/371472 [41:35<28:05:53,  3.59it/s]
  2%|▏         | 8604/371472 [41:35<27:23:53,  3.68it/s]
  2%|▏         | 8605/371472 [41:36<27:32:28,  3.66it/s]
  2%|▏         | 8606/371472 [41:36<27:46:21,  3.63it/s]
  2%|▏         | 8607/371472 [41:36<27:14:32,  3.70it/s]
  2%|▏         | 8608/371472 [41:37<29:07:59,  3.46it/s]
  2%|▏         | 8609/371472 [41:37<29:05:05,  3.47it/s]
  2%|▏         | 8610/371472 [41:37<30:09:59,  3.34it/s]
  2%|▏         | 8611/371472 [41:37<28:46:41,  3.50it/s]
  2%|▏         | 8612/371472 [41:38<28:21:57,  3.55it/s]
  2%|▏         | 8613/371472 [41:38<28:06:07,  3.59it/s]
  2%|▏         | 8614/371472 [41:38<28:49:27,  3.50it/s]
  2%|▏         | 8615/371472 [41:39<28:33:50,  3.53it/s]
  2%|▏         | 8616/371472 [41:39<27:43:54,  3.63it/s]
  2%|▏         | 8617/371472 [41:39<29:20:12,  3.44it/s]
  2%|▏         | 8618/371472 [41:39<28:35:43,  3.52it/s]
  2%|▏         | 8619/371472 [41:40<30:23:19,  3.32it/s]
  2%|▏         | 8620/371472 [41:40<28:50:05,  3.50it/s]
                                                        
{'loss': 5.1092, 'learning_rate': 9.795890883233855e-07, 'epoch': 0.37}

  2%|▏         | 8620/371472 [41:40<28:50:05,  3.50it/s]
  2%|▏         | 8621/371472 [41:40<28:14:35,  3.57it/s]
  2%|▏         | 8622/371472 [41:41<28:11:05,  3.58it/s]
  2%|▏         | 8623/371472 [41:41<27:53:53,  3.61it/s]
  2%|▏         | 8624/371472 [41:41<27:41:58,  3.64it/s]
  2%|▏         | 8625/371472 [41:41<27:49:05,  3.62it/s]
  2%|▏         | 8626/371472 [41:42<27:41:25,  3.64it/s]
  2%|▏         | 8627/371472 [41:42<27:15:33,  3.70it/s]
  2%|▏         | 8628/371472 [41:42<27:36:39,  3.65it/s]
  2%|▏         | 8629/371472 [41:43<27:05:43,  3.72it/s]
  2%|▏         | 8630/371472 [41:43<27:17:33,  3.69it/s]
  2%|▏         | 8631/371472 [41:43<27:14:55,  3.70it/s]
  2%|▏         | 8632/371472 [41:43<27:00:49,  3.73it/s]
  2%|▏         | 8633/371472 [41:44<26:28:47,  3.81it/s]
  2%|▏         | 8634/371472 [41:44<26:58:18,  3.74it/s]
  2%|▏         | 8635/371472 [41:44<26:29:14,  3.81it/s]
  2%|▏         | 8636/371472 [41:44<27:17:17,  3.69it/s]
  2%|▏         | 8637/371472 [41:45<26:55:13,  3.74it/s]
  2%|▏         | 8638/371472 [41:45<27:08:36,  3.71it/s]
  2%|▏         | 8639/371472 [41:45<28:32:59,  3.53it/s]
  2%|▏         | 8640/371472 [41:45<27:25:34,  3.67it/s]
                                                        
{'loss': 5.0201, 'learning_rate': 9.795406063479067e-07, 'epoch': 0.37}

  2%|▏         | 8640/371472 [41:45<27:25:34,  3.67it/s]
  2%|▏         | 8641/371472 [41:46<28:09:15,  3.58it/s]
  2%|▏         | 8642/371472 [41:46<28:51:29,  3.49it/s]
  2%|▏         | 8643/371472 [41:46<28:57:18,  3.48it/s]
  2%|▏         | 8644/371472 [41:47<28:26:21,  3.54it/s]
  2%|▏         | 8645/371472 [41:47<27:32:18,  3.66it/s]
  2%|▏         | 8646/371472 [41:47<29:35:32,  3.41it/s]
  2%|▏         | 8647/371472 [41:48<30:12:25,  3.34it/s]
  2%|▏         | 8648/371472 [41:48<29:09:16,  3.46it/s]
  2%|▏         | 8649/371472 [41:48<28:44:23,  3.51it/s]
  2%|▏         | 8650/371472 [41:48<27:14:07,  3.70it/s]
  2%|▏         | 8651/371472 [41:49<28:14:29,  3.57it/s]
  2%|▏         | 8652/371472 [41:49<27:47:29,  3.63it/s]
  2%|▏         | 8653/371472 [41:49<27:53:11,  3.61it/s]
  2%|▏         | 8654/371472 [41:49<27:24:09,  3.68it/s]
  2%|▏         | 8655/371472 [41:50<26:28:13,  3.81it/s]
  2%|▏         | 8656/371472 [41:50<26:43:37,  3.77it/s]
  2%|▏         | 8657/371472 [41:50<30:28:43,  3.31it/s]
  2%|▏         | 8658/371472 [41:51<29:24:26,  3.43it/s]
  2%|▏         | 8659/371472 [41:51<29:24:16,  3.43it/s]
  2%|▏         | 8660/371472 [41:51<28:39:12,  3.52it/s]
                                                        
{'loss': 4.9426, 'learning_rate': 9.794921243724276e-07, 'epoch': 0.37}

  2%|▏         | 8660/371472 [41:51<28:39:12,  3.52it/s]
  2%|▏         | 8661/371472 [41:51<28:04:49,  3.59it/s]
  2%|▏         | 8662/371472 [41:52<28:16:18,  3.56it/s]
  2%|▏         | 8663/371472 [41:52<27:41:32,  3.64it/s]
  2%|▏         | 8664/371472 [41:52<27:24:05,  3.68it/s]
  2%|▏         | 8665/371472 [41:52<26:35:41,  3.79it/s]
  2%|▏         | 8666/371472 [41:53<27:09:41,  3.71it/s]
  2%|▏         | 8667/371472 [41:53<27:04:18,  3.72it/s]
  2%|▏         | 8668/371472 [41:53<28:38:30,  3.52it/s]
  2%|▏         | 8669/371472 [41:54<28:35:14,  3.53it/s]
  2%|▏         | 8670/371472 [41:54<27:48:01,  3.63it/s]
  2%|▏         | 8671/371472 [41:54<27:15:47,  3.70it/s]
  2%|▏         | 8672/371472 [41:54<27:19:15,  3.69it/s]
  2%|▏         | 8673/371472 [41:55<27:42:24,  3.64it/s]
  2%|▏         | 8674/371472 [41:55<27:53:34,  3.61it/s]
  2%|▏         | 8675/371472 [41:55<31:02:02,  3.25it/s]
  2%|▏         | 8676/371472 [41:56<31:19:21,  3.22it/s]
  2%|▏         | 8677/371472 [41:56<31:38:30,  3.18it/s]
  2%|▏         | 8678/371472 [41:56<30:36:11,  3.29it/s]
  2%|▏         | 8679/371472 [41:57<29:34:48,  3.41it/s]
  2%|▏         | 8680/371472 [41:57<29:58:02,  3.36it/s]
                                                        
{'loss': 5.0351, 'learning_rate': 9.794436423969489e-07, 'epoch': 0.37}

  2%|▏         | 8680/371472 [41:57<29:58:02,  3.36it/s]
  2%|▏         | 8681/371472 [41:57<30:56:42,  3.26it/s]
  2%|▏         | 8682/371472 [41:57<29:45:30,  3.39it/s]
  2%|▏         | 8683/371472 [41:58<31:32:27,  3.20it/s]
  2%|▏         | 8684/371472 [41:58<30:12:09,  3.34it/s]
  2%|▏         | 8685/371472 [41:58<31:17:49,  3.22it/s]
  2%|▏         | 8686/371472 [41:59<31:01:53,  3.25it/s]
  2%|▏         | 8687/371472 [41:59<30:11:31,  3.34it/s]
  2%|▏         | 8688/371472 [41:59<33:36:33,  3.00it/s]
  2%|▏         | 8689/371472 [42:00<31:58:36,  3.15it/s]
  2%|▏         | 8690/371472 [42:00<30:44:50,  3.28it/s]
  2%|▏         | 8691/371472 [42:00<31:11:34,  3.23it/s]
  2%|▏         | 8692/371472 [42:01<32:34:09,  3.09it/s]
  2%|▏         | 8693/371472 [42:01<31:11:39,  3.23it/s]
  2%|▏         | 8694/371472 [42:01<30:52:00,  3.26it/s]
  2%|▏         | 8695/371472 [42:02<30:46:48,  3.27it/s]
  2%|▏         | 8696/371472 [42:02<29:38:56,  3.40it/s]
  2%|▏         | 8697/371472 [42:02<29:44:06,  3.39it/s]
  2%|▏         | 8698/371472 [42:02<29:20:47,  3.43it/s]
  2%|▏         | 8699/371472 [42:03<29:07:31,  3.46it/s]
  2%|▏         | 8700/371472 [42:03<29:32:42,  3.41it/s]
                                                        
{'loss': 4.855, 'learning_rate': 9.7939516042147e-07, 'epoch': 0.37}

  2%|▏         | 8700/371472 [42:03<29:32:42,  3.41it/s]
  2%|▏         | 8701/371472 [42:03<29:50:32,  3.38it/s]
  2%|▏         | 8702/371472 [42:04<28:35:49,  3.52it/s]
  2%|▏         | 8703/371472 [42:04<28:31:28,  3.53it/s]
  2%|▏         | 8704/371472 [42:04<28:38:18,  3.52it/s]
  2%|▏         | 8705/371472 [42:04<28:40:18,  3.51it/s]
  2%|▏         | 8706/371472 [42:05<28:16:23,  3.56it/s]
  2%|▏         | 8707/371472 [42:05<27:48:19,  3.62it/s]
  2%|▏         | 8708/371472 [42:05<27:39:01,  3.64it/s]
  2%|▏         | 8709/371472 [42:05<27:40:29,  3.64it/s]
  2%|▏         | 8710/371472 [42:06<29:33:18,  3.41it/s]
  2%|▏         | 8711/371472 [42:06<28:12:49,  3.57it/s]
  2%|▏         | 8712/371472 [42:06<29:12:15,  3.45it/s]
  2%|▏         | 8713/371472 [42:07<29:34:17,  3.41it/s]
  2%|▏         | 8714/371472 [42:07<29:08:01,  3.46it/s]
  2%|▏         | 8715/371472 [42:07<28:50:05,  3.49it/s]
  2%|▏         | 8716/371472 [42:07<28:38:57,  3.52it/s]
  2%|▏         | 8717/371472 [42:08<28:25:40,  3.54it/s]
  2%|▏         | 8718/371472 [42:08<28:01:15,  3.60it/s]
  2%|▏         | 8719/371472 [42:08<27:31:58,  3.66it/s]
  2%|▏         | 8720/371472 [42:09<28:03:04,  3.59it/s]
                                                        
{'loss': 4.9019, 'learning_rate': 9.79346678445991e-07, 'epoch': 0.38}

  2%|▏         | 8720/371472 [42:09<28:03:04,  3.59it/s]
  2%|▏         | 8721/371472 [42:09<29:36:21,  3.40it/s]
  2%|▏         | 8722/371472 [42:09<32:30:13,  3.10it/s]
  2%|▏         | 8723/371472 [42:10<34:02:40,  2.96it/s]
  2%|▏         | 8724/371472 [42:10<32:26:06,  3.11it/s]
  2%|▏         | 8725/371472 [42:10<30:21:10,  3.32it/s]
  2%|▏         | 8726/371472 [42:11<30:09:15,  3.34it/s]
  2%|▏         | 8727/371472 [42:11<29:46:25,  3.38it/s]
  2%|▏         | 8728/371472 [42:11<28:27:24,  3.54it/s]
  2%|▏         | 8729/371472 [42:11<28:21:34,  3.55it/s]
  2%|▏         | 8730/371472 [42:12<28:37:18,  3.52it/s]
  2%|▏         | 8731/371472 [42:12<27:39:14,  3.64it/s]
  2%|▏         | 8732/371472 [42:12<29:50:40,  3.38it/s]
  2%|▏         | 8733/371472 [42:12<29:15:13,  3.44it/s]
  2%|▏         | 8734/371472 [42:13<29:09:47,  3.46it/s]
  2%|▏         | 8735/371472 [42:13<29:03:17,  3.47it/s]
  2%|▏         | 8736/371472 [42:13<28:56:14,  3.48it/s]
  2%|▏         | 8737/371472 [42:14<28:49:27,  3.50it/s]
  2%|▏         | 8738/371472 [42:14<28:18:30,  3.56it/s]
  2%|▏         | 8739/371472 [42:14<27:46:45,  3.63it/s]
  2%|▏         | 8740/371472 [42:14<29:02:00,  3.47it/s]
                                                        
{'loss': 4.9067, 'learning_rate': 9.792981964705123e-07, 'epoch': 0.38}

  2%|▏         | 8740/371472 [42:14<29:02:00,  3.47it/s]
  2%|▏         | 8741/371472 [42:15<30:33:43,  3.30it/s]
  2%|▏         | 8742/371472 [42:15<30:31:05,  3.30it/s]
  2%|▏         | 8743/371472 [42:15<31:45:00,  3.17it/s]
  2%|▏         | 8744/371472 [42:16<31:11:42,  3.23it/s]
  2%|▏         | 8745/371472 [42:16<29:42:44,  3.39it/s]
  2%|▏         | 8746/371472 [42:16<28:34:57,  3.53it/s]
  2%|▏         | 8747/371472 [42:17<30:18:40,  3.32it/s]
  2%|▏         | 8748/371472 [42:17<29:37:30,  3.40it/s]
  2%|▏         | 8749/371472 [42:17<29:01:30,  3.47it/s]
  2%|▏         | 8750/371472 [42:17<30:08:08,  3.34it/s]
  2%|▏         | 8751/371472 [42:18<30:02:29,  3.35it/s]
  2%|▏         | 8752/371472 [42:18<29:25:38,  3.42it/s]
  2%|▏         | 8753/371472 [42:18<29:35:48,  3.40it/s]
  2%|▏         | 8754/371472 [42:19<29:34:30,  3.41it/s]
  2%|▏         | 8755/371472 [42:19<29:24:47,  3.43it/s]
  2%|▏         | 8756/371472 [42:19<28:54:29,  3.49it/s]
  2%|▏         | 8757/371472 [42:19<27:54:32,  3.61it/s]
  2%|▏         | 8758/371472 [42:20<28:38:55,  3.52it/s]
  2%|▏         | 8759/371472 [42:20<28:34:53,  3.53it/s]
  2%|▏         | 8760/371472 [42:20<29:37:30,  3.40it/s]
                                                        
{'loss': 4.9602, 'learning_rate': 9.792497144950332e-07, 'epoch': 0.38}

  2%|▏         | 8760/371472 [42:20<29:37:30,  3.40it/s]
  2%|▏         | 8761/371472 [42:21<30:05:15,  3.35it/s]
  2%|▏         | 8762/371472 [42:21<29:25:23,  3.42it/s]
  2%|▏         | 8763/371472 [42:21<27:57:42,  3.60it/s]
  2%|▏         | 8764/371472 [42:21<27:28:03,  3.67it/s]
  2%|▏         | 8765/371472 [42:22<27:11:53,  3.70it/s]
  2%|▏         | 8766/371472 [42:22<28:33:41,  3.53it/s]
  2%|▏         | 8767/371472 [42:22<29:59:02,  3.36it/s]
  2%|▏         | 8768/371472 [42:23<29:36:34,  3.40it/s]
  2%|▏         | 8769/371472 [42:23<29:28:52,  3.42it/s]
  2%|▏         | 8770/371472 [42:23<29:30:46,  3.41it/s]
  2%|▏         | 8771/371472 [42:24<29:11:51,  3.45it/s]
  2%|▏         | 8772/371472 [42:24<30:25:31,  3.31it/s]
  2%|▏         | 8773/371472 [42:24<30:11:11,  3.34it/s]
  2%|▏         | 8774/371472 [42:24<30:16:19,  3.33it/s]
  2%|▏         | 8775/371472 [42:25<28:47:25,  3.50it/s]
  2%|▏         | 8776/371472 [42:25<29:36:37,  3.40it/s]
  2%|▏         | 8777/371472 [42:25<28:41:18,  3.51it/s]
  2%|▏         | 8778/371472 [42:26<30:38:36,  3.29it/s]
  2%|▏         | 8779/371472 [42:26<29:11:26,  3.45it/s]
  2%|▏         | 8780/371472 [42:26<28:18:47,  3.56it/s]
                                                        
{'loss': 5.1773, 'learning_rate': 9.792012325195544e-07, 'epoch': 0.38}

  2%|▏         | 8780/371472 [42:26<28:18:47,  3.56it/s]
  2%|▏         | 8781/371472 [42:26<27:35:23,  3.65it/s]
  2%|▏         | 8782/371472 [42:27<28:14:07,  3.57it/s]
  2%|▏         | 8783/371472 [42:27<27:46:52,  3.63it/s]
  2%|▏         | 8784/371472 [42:27<27:45:26,  3.63it/s]
  2%|▏         | 8785/371472 [42:28<29:03:17,  3.47it/s]
  2%|▏         | 8786/371472 [42:28<28:50:55,  3.49it/s]
  2%|▏         | 8787/371472 [42:28<32:05:50,  3.14it/s]
  2%|▏         | 8788/371472 [42:29<31:16:21,  3.22it/s]
  2%|▏         | 8789/371472 [42:29<30:10:48,  3.34it/s]
  2%|▏         | 8790/371472 [42:29<29:07:11,  3.46it/s]
  2%|▏         | 8791/371472 [42:29<30:21:54,  3.32it/s]
  2%|▏         | 8792/371472 [42:30<29:22:50,  3.43it/s]
  2%|▏         | 8793/371472 [42:30<28:55:35,  3.48it/s]
  2%|▏         | 8794/371472 [42:30<30:49:13,  3.27it/s]
  2%|▏         | 8795/371472 [42:31<29:37:30,  3.40it/s]
  2%|▏         | 8796/371472 [42:31<27:56:50,  3.60it/s]
  2%|▏         | 8797/371472 [42:31<29:06:53,  3.46it/s]
  2%|▏         | 8798/371472 [42:31<30:25:42,  3.31it/s]
  2%|▏         | 8799/371472 [42:32<30:18:23,  3.32it/s]
  2%|▏         | 8800/371472 [42:32<28:50:02,  3.49it/s]
                                                        
{'loss': 4.8999, 'learning_rate': 9.791527505440753e-07, 'epoch': 0.38}

  2%|▏         | 8800/371472 [42:32<28:50:02,  3.49it/s]
  2%|▏         | 8801/371472 [42:32<30:30:48,  3.30it/s]
  2%|▏         | 8802/371472 [42:33<30:39:22,  3.29it/s]
  2%|▏         | 8803/371472 [42:33<30:01:05,  3.36it/s]
  2%|▏         | 8804/371472 [42:33<29:16:16,  3.44it/s]
  2%|▏         | 8805/371472 [42:33<28:40:32,  3.51it/s]
  2%|▏         | 8806/371472 [42:34<29:37:51,  3.40it/s]
  2%|▏         | 8807/371472 [42:34<28:10:46,  3.57it/s]
  2%|▏         | 8808/371472 [42:34<29:41:14,  3.39it/s]
  2%|▏         | 8809/371472 [42:35<30:26:51,  3.31it/s]
  2%|▏         | 8810/371472 [42:35<30:46:25,  3.27it/s]
  2%|▏         | 8811/371472 [42:35<30:37:03,  3.29it/s]
  2%|▏         | 8812/371472 [42:36<31:00:18,  3.25it/s]
  2%|▏         | 8813/371472 [42:36<30:11:19,  3.34it/s]
  2%|▏         | 8814/371472 [42:36<29:18:16,  3.44it/s]
  2%|▏         | 8815/371472 [42:36<28:44:36,  3.50it/s]
  2%|▏         | 8816/371472 [42:37<28:13:52,  3.57it/s]
  2%|▏         | 8817/371472 [42:37<28:41:53,  3.51it/s]
  2%|▏         | 8818/371472 [42:37<27:41:49,  3.64it/s]
  2%|▏         | 8819/371472 [42:38<33:26:24,  3.01it/s]
  2%|▏         | 8820/371472 [42:38<31:20:35,  3.21it/s]
                                                        
{'loss': 5.1569, 'learning_rate': 9.791042685685966e-07, 'epoch': 0.38}

  2%|▏         | 8820/371472 [42:38<31:20:35,  3.21it/s]
  2%|▏         | 8821/371472 [42:38<29:56:35,  3.36it/s]
  2%|▏         | 8822/371472 [42:39<30:03:20,  3.35it/s]
  2%|▏         | 8823/371472 [42:39<29:38:38,  3.40it/s]
  2%|▏         | 8824/371472 [42:39<28:33:52,  3.53it/s]
  2%|▏         | 8825/371472 [42:39<30:23:37,  3.31it/s]
  2%|▏         | 8826/371472 [42:40<29:09:53,  3.45it/s]
  2%|▏         | 8827/371472 [42:40<27:56:21,  3.61it/s]
  2%|▏         | 8828/371472 [42:40<27:14:03,  3.70it/s]
  2%|▏         | 8829/371472 [42:40<26:55:43,  3.74it/s]
  2%|▏         | 8830/371472 [42:41<29:03:59,  3.47it/s]
  2%|▏         | 8831/371472 [42:41<28:08:18,  3.58it/s]
  2%|▏         | 8832/371472 [42:41<30:00:06,  3.36it/s]
  2%|▏         | 8833/371472 [42:42<30:49:31,  3.27it/s]
  2%|▏         | 8834/371472 [42:42<29:23:13,  3.43it/s]
  2%|▏         | 8835/371472 [42:42<29:22:07,  3.43it/s]
  2%|▏         | 8836/371472 [42:43<29:19:57,  3.43it/s]
  2%|▏         | 8837/371472 [42:43<28:47:01,  3.50it/s]
  2%|▏         | 8838/371472 [42:43<28:27:27,  3.54it/s]
  2%|▏         | 8839/371472 [42:44<32:40:59,  3.08it/s]
  2%|▏         | 8840/371472 [42:44<31:05:44,  3.24it/s]
                                                        
{'loss': 5.0223, 'learning_rate': 9.790557865931177e-07, 'epoch': 0.38}

  2%|▏         | 8840/371472 [42:44<31:05:44,  3.24it/s]
  2%|▏         | 8841/371472 [42:44<29:25:49,  3.42it/s]
  2%|▏         | 8842/371472 [42:44<28:17:30,  3.56it/s]
  2%|▏         | 8843/371472 [42:45<27:37:23,  3.65it/s]
  2%|▏         | 8844/371472 [42:45<27:27:46,  3.67it/s]
  2%|▏         | 8845/371472 [42:45<28:52:47,  3.49it/s]
  2%|▏         | 8846/371472 [42:45<27:57:06,  3.60it/s]
  2%|▏         | 8847/371472 [42:46<29:42:52,  3.39it/s]
  2%|▏         | 8848/371472 [42:46<29:12:32,  3.45it/s]
  2%|▏         | 8849/371472 [42:46<28:14:47,  3.57it/s]
  2%|▏         | 8850/371472 [42:47<27:01:05,  3.73it/s]
  2%|▏         | 8851/371472 [42:47<27:11:44,  3.70it/s]
  2%|▏         | 8852/371472 [42:47<29:07:34,  3.46it/s]
  2%|▏         | 8853/371472 [42:48<31:28:55,  3.20it/s]
  2%|▏         | 8854/371472 [42:48<31:09:34,  3.23it/s]
  2%|▏         | 8855/371472 [42:48<36:38:07,  2.75it/s]
  2%|▏         | 8856/371472 [42:49<34:46:18,  2.90it/s]
  2%|▏         | 8857/371472 [42:49<32:28:56,  3.10it/s]
  2%|▏         | 8858/371472 [42:49<31:20:04,  3.21it/s]
  2%|▏         | 8859/371472 [42:49<30:52:49,  3.26it/s]
  2%|▏         | 8860/371472 [42:50<30:15:14,  3.33it/s]
                                                        
{'loss': 4.9746, 'learning_rate': 9.790073046176387e-07, 'epoch': 0.38}

  2%|▏         | 8860/371472 [42:50<30:15:14,  3.33it/s]
  2%|▏         | 8861/371472 [42:50<31:44:52,  3.17it/s]
  2%|▏         | 8862/371472 [42:50<29:41:08,  3.39it/s]
  2%|▏         | 8863/371472 [42:51<30:29:45,  3.30it/s]
  2%|▏         | 8864/371472 [42:51<29:55:27,  3.37it/s]
  2%|▏         | 8865/371472 [42:51<29:24:30,  3.43it/s]
  2%|▏         | 8866/371472 [42:51<28:22:06,  3.55it/s]
  2%|▏         | 8867/371472 [42:52<29:18:53,  3.44it/s]
  2%|▏         | 8868/371472 [42:52<28:47:17,  3.50it/s]
  2%|▏         | 8869/371472 [42:52<28:41:21,  3.51it/s]
  2%|▏         | 8870/371472 [42:53<29:34:54,  3.40it/s]
  2%|▏         | 8871/371472 [42:53<28:23:28,  3.55it/s]
  2%|▏         | 8872/371472 [42:53<28:50:11,  3.49it/s]
  2%|▏         | 8873/371472 [42:54<28:57:36,  3.48it/s]
  2%|▏         | 8874/371472 [42:54<28:28:27,  3.54it/s]
  2%|▏         | 8875/371472 [42:54<28:55:44,  3.48it/s]
  2%|▏         | 8876/371472 [42:54<31:24:03,  3.21it/s]
  2%|▏         | 8877/371472 [42:55<31:21:57,  3.21it/s]
  2%|▏         | 8878/371472 [42:55<29:45:00,  3.39it/s]
  2%|▏         | 8879/371472 [42:55<29:13:38,  3.45it/s]
  2%|▏         | 8880/371472 [42:56<29:10:12,  3.45it/s]
                                                        
{'loss': 4.7316, 'learning_rate': 9.7895882264216e-07, 'epoch': 0.38}

  2%|▏         | 8880/371472 [42:56<29:10:12,  3.45it/s]
  2%|▏         | 8881/371472 [42:56<30:16:08,  3.33it/s]
  2%|▏         | 8882/371472 [42:56<29:40:48,  3.39it/s]
  2%|▏         | 8883/371472 [42:56<30:06:19,  3.35it/s]
  2%|▏         | 8884/371472 [42:57<32:30:40,  3.10it/s]
  2%|▏         | 8885/371472 [42:57<30:22:43,  3.32it/s]
  2%|▏         | 8886/371472 [42:57<30:57:33,  3.25it/s]
  2%|▏         | 8887/371472 [42:58<30:03:48,  3.35it/s]
  2%|▏         | 8888/371472 [42:58<28:39:06,  3.52it/s]
  2%|▏         | 8889/371472 [42:58<29:05:00,  3.46it/s]
  2%|▏         | 8890/371472 [42:59<29:34:46,  3.40it/s]
  2%|▏         | 8891/371472 [42:59<28:47:36,  3.50it/s]
  2%|▏         | 8892/371472 [42:59<35:39:18,  2.82it/s]
  2%|▏         | 8893/371472 [43:00<33:10:10,  3.04it/s]
  2%|▏         | 8894/371472 [43:00<32:03:27,  3.14it/s]
  2%|▏         | 8895/371472 [43:00<31:02:15,  3.24it/s]
  2%|▏         | 8896/371472 [43:00<30:15:54,  3.33it/s]
  2%|▏         | 8897/371472 [43:01<30:19:00,  3.32it/s]
  2%|▏         | 8898/371472 [43:01<31:52:03,  3.16it/s]
  2%|▏         | 8899/371472 [43:01<31:37:19,  3.18it/s]
  2%|▏         | 8900/371472 [43:02<31:01:06,  3.25it/s]
                                                        
{'loss': 4.8671, 'learning_rate': 9.789103406666809e-07, 'epoch': 0.38}

  2%|▏         | 8900/371472 [43:02<31:01:06,  3.25it/s]
  2%|▏         | 8901/371472 [43:02<29:43:22,  3.39it/s]
  2%|▏         | 8902/371472 [43:02<30:30:47,  3.30it/s]
  2%|▏         | 8903/371472 [43:03<30:48:14,  3.27it/s]
  2%|▏         | 8904/371472 [43:03<30:23:37,  3.31it/s]
  2%|▏         | 8905/371472 [43:03<30:03:50,  3.35it/s]
  2%|▏         | 8906/371472 [43:04<29:33:00,  3.41it/s]
  2%|▏         | 8907/371472 [43:04<29:03:15,  3.47it/s]
  2%|▏         | 8908/371472 [43:04<31:46:36,  3.17it/s]
  2%|▏         | 8909/371472 [43:04<30:30:25,  3.30it/s]
  2%|▏         | 8910/371472 [43:05<30:04:20,  3.35it/s]
  2%|▏         | 8911/371472 [43:05<29:10:40,  3.45it/s]
  2%|▏         | 8912/371472 [43:05<27:54:00,  3.61it/s]
  2%|▏         | 8913/371472 [43:06<28:05:59,  3.58it/s]
  2%|▏         | 8914/371472 [43:06<28:03:26,  3.59it/s]
  2%|▏         | 8915/371472 [43:06<28:28:14,  3.54it/s]
  2%|▏         | 8916/371472 [43:06<28:04:26,  3.59it/s]
  2%|▏         | 8917/371472 [43:07<27:27:48,  3.67it/s]
  2%|▏         | 8918/371472 [43:07<28:02:13,  3.59it/s]
  2%|▏         | 8919/371472 [43:07<30:24:37,  3.31it/s]
  2%|▏         | 8920/371472 [43:08<29:46:27,  3.38it/s]
                                                        
{'loss': 4.8685, 'learning_rate': 9.788618586912022e-07, 'epoch': 0.38}

  2%|▏         | 8920/371472 [43:08<29:46:27,  3.38it/s]
  2%|▏         | 8921/371472 [43:08<29:07:59,  3.46it/s]
  2%|▏         | 8922/371472 [43:08<29:29:52,  3.41it/s]
  2%|▏         | 8923/371472 [43:08<28:47:42,  3.50it/s]
  2%|▏         | 8924/371472 [43:09<29:46:55,  3.38it/s]
  2%|▏         | 8925/371472 [43:09<29:07:37,  3.46it/s]
  2%|▏         | 8926/371472 [43:09<29:01:59,  3.47it/s]
  2%|▏         | 8927/371472 [43:10<27:36:22,  3.65it/s]
  2%|▏         | 8928/371472 [43:10<27:04:13,  3.72it/s]
  2%|▏         | 8929/371472 [43:10<30:26:44,  3.31it/s]
  2%|▏         | 8930/371472 [43:10<31:23:59,  3.21it/s]
  2%|▏         | 8931/371472 [43:11<30:08:41,  3.34it/s]
  2%|▏         | 8932/371472 [43:11<29:15:53,  3.44it/s]
  2%|▏         | 8933/371472 [43:11<28:25:59,  3.54it/s]
  2%|▏         | 8934/371472 [43:12<28:05:48,  3.58it/s]
  2%|▏         | 8935/371472 [43:12<28:04:49,  3.59it/s]
  2%|▏         | 8936/371472 [43:12<27:59:17,  3.60it/s]
  2%|▏         | 8937/371472 [43:12<28:54:24,  3.48it/s]
  2%|▏         | 8938/371472 [43:13<28:05:50,  3.58it/s]
  2%|▏         | 8939/371472 [43:13<28:22:45,  3.55it/s]
  2%|▏         | 8940/371472 [43:13<28:25:49,  3.54it/s]
                                                        
{'loss': 5.0705, 'learning_rate': 9.78813376715723e-07, 'epoch': 0.39}

  2%|▏         | 8940/371472 [43:13<28:25:49,  3.54it/s]
  2%|▏         | 8941/371472 [43:14<30:28:20,  3.30it/s]
  2%|▏         | 8942/371472 [43:14<29:21:05,  3.43it/s]
  2%|▏         | 8943/371472 [43:14<28:15:45,  3.56it/s]
  2%|▏         | 8944/371472 [43:14<28:15:48,  3.56it/s]
  2%|▏         | 8945/371472 [43:15<28:47:26,  3.50it/s]
  2%|▏         | 8946/371472 [43:15<29:03:15,  3.47it/s]
  2%|▏         | 8947/371472 [43:15<29:46:38,  3.38it/s]
  2%|▏         | 8948/371472 [43:16<28:49:05,  3.49it/s]
  2%|▏         | 8949/371472 [43:16<29:02:26,  3.47it/s]
  2%|▏         | 8950/371472 [43:16<29:06:01,  3.46it/s]
  2%|▏         | 8951/371472 [43:16<28:05:32,  3.58it/s]
  2%|▏         | 8952/371472 [43:17<28:14:34,  3.57it/s]
  2%|▏         | 8953/371472 [43:17<28:36:48,  3.52it/s]
  2%|▏         | 8954/371472 [43:17<28:57:42,  3.48it/s]
  2%|▏         | 8955/371472 [43:18<28:10:28,  3.57it/s]
  2%|▏         | 8956/371472 [43:18<27:37:05,  3.65it/s]
  2%|▏         | 8957/371472 [43:18<27:36:59,  3.65it/s]
  2%|▏         | 8958/371472 [43:18<29:27:48,  3.42it/s]
  2%|▏         | 8959/371472 [43:19<28:35:30,  3.52it/s]
  2%|▏         | 8960/371472 [43:19<28:44:19,  3.50it/s]
                                                        
{'loss': 5.0033, 'learning_rate': 9.787648947402443e-07, 'epoch': 0.39}

  2%|▏         | 8960/371472 [43:19<28:44:19,  3.50it/s]
  2%|▏         | 8961/371472 [43:19<29:13:51,  3.44it/s]
  2%|▏         | 8962/371472 [43:20<30:11:46,  3.33it/s]
  2%|▏         | 8963/371472 [43:20<28:59:05,  3.47it/s]
  2%|▏         | 8964/371472 [43:20<28:37:14,  3.52it/s]
  2%|▏         | 8965/371472 [43:20<27:55:32,  3.61it/s]
  2%|▏         | 8966/371472 [43:21<27:49:56,  3.62it/s]
  2%|▏         | 8967/371472 [43:21<28:03:52,  3.59it/s]
  2%|▏         | 8968/371472 [43:21<28:02:30,  3.59it/s]
  2%|▏         | 8969/371472 [43:22<28:44:09,  3.50it/s]
  2%|▏         | 8970/371472 [43:22<28:07:53,  3.58it/s]
  2%|▏         | 8971/371472 [43:22<28:39:54,  3.51it/s]
  2%|▏         | 8972/371472 [43:22<28:42:52,  3.51it/s]
  2%|▏         | 8973/371472 [43:23<32:30:31,  3.10it/s]
  2%|▏         | 8974/371472 [43:23<31:31:45,  3.19it/s]
  2%|▏         | 8975/371472 [43:23<31:31:22,  3.19it/s]
  2%|▏         | 8976/371472 [43:24<29:54:48,  3.37it/s]
  2%|▏         | 8977/371472 [43:24<30:36:44,  3.29it/s]
  2%|▏         | 8978/371472 [43:24<28:50:54,  3.49it/s]
  2%|▏         | 8979/371472 [43:25<29:46:04,  3.38it/s]
  2%|▏         | 8980/371472 [43:25<28:42:41,  3.51it/s]
                                                        
{'loss': 5.13, 'learning_rate': 9.787164127647654e-07, 'epoch': 0.39}

  2%|▏         | 8980/371472 [43:25<28:42:41,  3.51it/s]
  2%|▏         | 8981/371472 [43:25<28:44:35,  3.50it/s]
  2%|▏         | 8982/371472 [43:25<28:29:16,  3.53it/s]
  2%|▏         | 8983/371472 [43:26<28:21:38,  3.55it/s]
  2%|▏         | 8984/371472 [43:26<29:11:23,  3.45it/s]
  2%|▏         | 8985/371472 [43:26<28:35:21,  3.52it/s]
  2%|▏         | 8986/371472 [43:26<27:44:00,  3.63it/s]
  2%|▏         | 8987/371472 [43:27<28:02:11,  3.59it/s]
  2%|▏         | 8988/371472 [43:27<29:33:43,  3.41it/s]
  2%|▏         | 8989/371472 [43:27<28:46:37,  3.50it/s]
  2%|▏         | 8990/371472 [43:28<28:24:55,  3.54it/s]
  2%|▏         | 8991/371472 [43:28<28:33:53,  3.52it/s]
  2%|▏         | 8992/371472 [43:28<29:10:01,  3.45it/s]
  2%|▏         | 8993/371472 [43:28<28:00:14,  3.60it/s]
  2%|▏         | 8994/371472 [43:29<29:28:13,  3.42it/s]
  2%|▏         | 8995/371472 [43:29<29:09:45,  3.45it/s]
  2%|▏         | 8996/371472 [43:29<29:21:54,  3.43it/s]
  2%|▏         | 8997/371472 [43:30<28:26:19,  3.54it/s]
  2%|▏         | 8998/371472 [43:30<29:45:13,  3.38it/s]
  2%|▏         | 8999/371472 [43:30<28:45:50,  3.50it/s]
  2%|▏         | 9000/371472 [43:30<28:08:25,  3.58it/s]
                                                        
{'loss': 4.9016, 'learning_rate': 9.786679307892864e-07, 'epoch': 0.39}

  2%|▏         | 9000/371472 [43:30<28:08:25,  3.58it/s]
  2%|▏         | 9001/371472 [43:31<27:35:28,  3.65it/s]
  2%|▏         | 9002/371472 [43:31<28:02:01,  3.59it/s]
  2%|▏         | 9003/371472 [43:31<28:10:53,  3.57it/s]
  2%|▏         | 9004/371472 [43:32<28:35:07,  3.52it/s]
  2%|▏         | 9005/371472 [43:32<28:05:55,  3.58it/s]
  2%|▏         | 9006/371472 [43:32<28:05:38,  3.58it/s]
  2%|▏         | 9007/371472 [43:32<28:23:25,  3.55it/s]
  2%|▏         | 9008/371472 [43:33<29:18:01,  3.44it/s]
  2%|▏         | 9009/371472 [43:33<28:20:22,  3.55it/s]
  2%|▏         | 9010/371472 [43:33<29:16:07,  3.44it/s]
  2%|▏         | 9011/371472 [43:34<28:51:31,  3.49it/s]
  2%|▏         | 9012/371472 [43:34<28:18:00,  3.56it/s]
  2%|▏         | 9013/371472 [43:34<29:48:22,  3.38it/s]
  2%|▏         | 9014/371472 [43:35<29:50:51,  3.37it/s]
  2%|▏         | 9015/371472 [43:35<29:51:46,  3.37it/s]
  2%|▏         | 9016/371472 [43:35<29:38:35,  3.40it/s]
  2%|▏         | 9017/371472 [43:35<28:28:04,  3.54it/s]
  2%|▏         | 9018/371472 [43:36<29:12:58,  3.45it/s]
  2%|▏         | 9019/371472 [43:36<29:09:21,  3.45it/s]
  2%|▏         | 9020/371472 [43:36<28:24:21,  3.54it/s]
                                                        
{'loss': 4.5963, 'learning_rate': 9.786194488138077e-07, 'epoch': 0.39}

  2%|▏         | 9020/371472 [43:36<28:24:21,  3.54it/s]
  2%|▏         | 9021/371472 [43:37<29:59:05,  3.36it/s]
  2%|▏         | 9022/371472 [43:37<30:28:58,  3.30it/s]
  2%|▏         | 9023/371472 [43:37<29:55:42,  3.36it/s]
  2%|▏         | 9024/371472 [43:37<28:56:17,  3.48it/s]
  2%|▏         | 9025/371472 [43:38<28:37:45,  3.52it/s]
  2%|▏         | 9026/371472 [43:38<28:09:14,  3.58it/s]
  2%|▏         | 9027/371472 [43:38<29:59:09,  3.36it/s]
  2%|▏         | 9028/371472 [43:39<29:33:56,  3.41it/s]
  2%|▏         | 9029/371472 [43:39<28:32:35,  3.53it/s]
  2%|▏         | 9030/371472 [43:39<28:02:53,  3.59it/s]
  2%|▏         | 9031/371472 [43:39<29:47:46,  3.38it/s]
  2%|▏         | 9032/371472 [43:40<29:24:02,  3.42it/s]
  2%|▏         | 9033/371472 [43:40<28:36:25,  3.52it/s]
  2%|▏         | 9034/371472 [43:40<29:31:23,  3.41it/s]
  2%|▏         | 9035/371472 [43:41<28:59:18,  3.47it/s]
  2%|▏         | 9036/371472 [43:41<27:57:18,  3.60it/s]
  2%|▏         | 9037/371472 [43:41<27:25:46,  3.67it/s]
  2%|▏         | 9038/371472 [43:41<28:15:05,  3.56it/s]
  2%|▏         | 9039/371472 [43:42<28:30:36,  3.53it/s]
  2%|▏         | 9040/371472 [43:42<31:24:53,  3.20it/s]
                                                        
{'loss': 5.1174, 'learning_rate': 9.785709668383288e-07, 'epoch': 0.39}

  2%|▏         | 9040/371472 [43:42<31:24:53,  3.20it/s]
  2%|▏         | 9041/371472 [43:42<31:56:28,  3.15it/s]
  2%|▏         | 9042/371472 [43:43<30:52:52,  3.26it/s]
  2%|▏         | 9043/371472 [43:43<30:33:51,  3.29it/s]
  2%|▏         | 9044/371472 [43:43<31:26:48,  3.20it/s]
  2%|▏         | 9045/371472 [43:44<30:28:59,  3.30it/s]
  2%|▏         | 9046/371472 [43:44<30:17:30,  3.32it/s]
  2%|▏         | 9047/371472 [43:44<30:34:53,  3.29it/s]
  2%|▏         | 9048/371472 [43:44<30:12:17,  3.33it/s]
  2%|▏         | 9049/371472 [43:45<29:02:06,  3.47it/s]
  2%|▏         | 9050/371472 [43:45<29:09:23,  3.45it/s]
  2%|▏         | 9051/371472 [43:45<29:24:36,  3.42it/s]
  2%|▏         | 9052/371472 [43:46<30:30:40,  3.30it/s]
  2%|▏         | 9053/371472 [43:46<30:06:07,  3.34it/s]
  2%|▏         | 9054/371472 [43:46<29:45:23,  3.38it/s]
  2%|▏         | 9055/371472 [43:46<28:06:34,  3.58it/s]
  2%|▏         | 9056/371472 [43:47<28:07:15,  3.58it/s]
  2%|▏         | 9057/371472 [43:47<27:52:08,  3.61it/s]
  2%|▏         | 9058/371472 [43:47<28:26:10,  3.54it/s]
  2%|▏         | 9059/371472 [43:48<30:26:08,  3.31it/s]
  2%|▏         | 9060/371472 [43:48<31:16:35,  3.22it/s]
                                                        
{'loss': 4.6056, 'learning_rate': 9.785224848628499e-07, 'epoch': 0.39}

  2%|▏         | 9060/371472 [43:48<31:16:35,  3.22it/s]
  2%|▏         | 9061/371472 [43:48<29:37:06,  3.40it/s]
  2%|▏         | 9062/371472 [43:49<29:08:57,  3.45it/s]
  2%|▏         | 9063/371472 [43:49<29:01:16,  3.47it/s]
  2%|▏         | 9064/371472 [43:49<28:01:18,  3.59it/s]
  2%|▏         | 9065/371472 [43:49<27:34:38,  3.65it/s]
  2%|▏         | 9066/371472 [43:50<27:22:37,  3.68it/s]
  2%|▏         | 9067/371472 [43:50<29:02:44,  3.47it/s]
  2%|▏         | 9068/371472 [43:50<28:10:41,  3.57it/s]
  2%|▏         | 9069/371472 [43:50<28:00:20,  3.59it/s]
  2%|▏         | 9070/371472 [43:51<27:51:40,  3.61it/s]
  2%|▏         | 9071/371472 [43:51<28:45:53,  3.50it/s]
  2%|▏         | 9072/371472 [43:51<28:59:54,  3.47it/s]
  2%|▏         | 9073/371472 [43:52<28:30:36,  3.53it/s]
  2%|▏         | 9074/371472 [43:52<28:37:46,  3.52it/s]
  2%|▏         | 9075/371472 [43:52<28:24:44,  3.54it/s]
  2%|▏         | 9076/371472 [43:52<27:57:11,  3.60it/s]
  2%|▏         | 9077/371472 [43:53<28:55:21,  3.48it/s]
  2%|▏         | 9078/371472 [43:53<27:39:29,  3.64it/s]
  2%|▏         | 9079/371472 [43:53<29:40:04,  3.39it/s]
  2%|▏         | 9080/371472 [43:54<28:24:35,  3.54it/s]
                                                        
{'loss': 5.1854, 'learning_rate': 9.78474002887371e-07, 'epoch': 0.39}

  2%|▏         | 9080/371472 [43:54<28:24:35,  3.54it/s]
  2%|▏         | 9081/371472 [43:54<28:09:14,  3.58it/s]
  2%|▏         | 9082/371472 [43:54<28:05:04,  3.58it/s]
  2%|▏         | 9083/371472 [43:54<28:10:30,  3.57it/s]
  2%|▏         | 9084/371472 [43:55<27:32:54,  3.65it/s]
  2%|▏         | 9085/371472 [43:55<27:30:35,  3.66it/s]
  2%|▏         | 9086/371472 [43:55<28:10:14,  3.57it/s]
  2%|▏         | 9087/371472 [43:56<27:58:02,  3.60it/s]
  2%|▏         | 9088/371472 [43:56<27:56:13,  3.60it/s]
  2%|▏         | 9089/371472 [43:56<27:23:26,  3.68it/s]
  2%|▏         | 9090/371472 [43:56<27:09:57,  3.71it/s]
  2%|▏         | 9091/371472 [43:57<27:13:09,  3.70it/s]
  2%|▏         | 9092/371472 [43:57<28:19:51,  3.55it/s]
  2%|▏         | 9093/371472 [43:57<29:05:40,  3.46it/s]
  2%|▏         | 9094/371472 [43:58<28:38:33,  3.51it/s]
  2%|▏         | 9095/371472 [43:58<28:50:21,  3.49it/s]
  2%|▏         | 9096/371472 [43:58<28:43:34,  3.50it/s]
  2%|▏         | 9097/371472 [43:58<28:17:58,  3.56it/s]
  2%|▏         | 9098/371472 [43:59<27:19:07,  3.68it/s]
  2%|▏         | 9099/371472 [43:59<29:30:41,  3.41it/s]
  2%|▏         | 9100/371472 [43:59<28:09:38,  3.57it/s]
                                                        
{'loss': 5.0354, 'learning_rate': 9.78425520911892e-07, 'epoch': 0.39}

  2%|▏         | 9100/371472 [43:59<28:09:38,  3.57it/s]
  2%|▏         | 9101/371472 [43:59<27:24:11,  3.67it/s]
  2%|▏         | 9102/371472 [44:00<28:10:35,  3.57it/s]
  2%|▏         | 9103/371472 [44:00<29:02:23,  3.47it/s]
  2%|▏         | 9104/371472 [44:00<28:26:51,  3.54it/s]
  2%|▏         | 9105/371472 [44:01<29:37:10,  3.40it/s]
  2%|▏         | 9106/371472 [44:01<29:44:12,  3.38it/s]
  2%|▏         | 9107/371472 [44:01<29:04:25,  3.46it/s]
  2%|▏         | 9108/371472 [44:01<28:25:02,  3.54it/s]
  2%|▏         | 9109/371472 [44:02<27:44:50,  3.63it/s]
  2%|▏         | 9110/371472 [44:02<27:59:54,  3.60it/s]
  2%|▏         | 9111/371472 [44:02<28:10:49,  3.57it/s]
  2%|▏         | 9112/371472 [44:03<28:03:52,  3.59it/s]
  2%|▏         | 9113/371472 [44:03<27:13:09,  3.70it/s]
  2%|▏         | 9114/371472 [44:03<27:40:49,  3.64it/s]
  2%|▏         | 9115/371472 [44:03<27:39:43,  3.64it/s]
  2%|▏         | 9116/371472 [44:04<28:35:10,  3.52it/s]
  2%|▏         | 9117/371472 [44:04<28:35:45,  3.52it/s]
  2%|▏         | 9118/371472 [44:04<28:22:00,  3.55it/s]
  2%|▏         | 9119/371472 [44:05<29:03:07,  3.46it/s]
  2%|▏         | 9120/371472 [44:05<30:29:29,  3.30it/s]
                                                        
{'loss': 4.973, 'learning_rate': 9.783770389364133e-07, 'epoch': 0.39}

  2%|▏         | 9120/371472 [44:05<30:29:29,  3.30it/s]
  2%|▏         | 9121/371472 [44:05<29:42:19,  3.39it/s]
  2%|▏         | 9122/371472 [44:05<29:45:23,  3.38it/s]
  2%|▏         | 9123/371472 [44:06<29:47:24,  3.38it/s]
  2%|▏         | 9124/371472 [44:06<30:37:29,  3.29it/s]
  2%|▏         | 9125/371472 [44:06<32:07:46,  3.13it/s]
  2%|▏         | 9126/371472 [44:07<31:12:58,  3.22it/s]
  2%|▏         | 9127/371472 [44:07<30:07:18,  3.34it/s]
  2%|▏         | 9128/371472 [44:07<30:01:55,  3.35it/s]
  2%|▏         | 9129/371472 [44:08<29:41:11,  3.39it/s]
  2%|▏         | 9130/371472 [44:08<29:47:11,  3.38it/s]
  2%|▏         | 9131/371472 [44:08<30:23:53,  3.31it/s]
  2%|▏         | 9132/371472 [44:08<30:04:15,  3.35it/s]
  2%|▏         | 9133/371472 [44:09<29:22:27,  3.43it/s]
  2%|▏         | 9134/371472 [44:09<28:36:50,  3.52it/s]
  2%|▏         | 9135/371472 [44:09<28:59:10,  3.47it/s]
  2%|▏         | 9136/371472 [44:10<29:00:56,  3.47it/s]
  2%|▏         | 9137/371472 [44:10<29:28:06,  3.42it/s]
  2%|▏         | 9138/371472 [44:10<29:16:37,  3.44it/s]
  2%|▏         | 9139/371472 [44:11<29:06:45,  3.46it/s]
  2%|▏         | 9140/371472 [44:11<28:33:12,  3.52it/s]
                                                        
{'loss': 4.9599, 'learning_rate': 9.783285569609342e-07, 'epoch': 0.39}

  2%|▏         | 9140/371472 [44:11<28:33:12,  3.52it/s]
  2%|▏         | 9141/371472 [44:11<31:59:08,  3.15it/s]
  2%|▏         | 9142/371472 [44:11<31:47:24,  3.17it/s]
  2%|▏         | 9143/371472 [44:12<31:08:57,  3.23it/s]
  2%|▏         | 9144/371472 [44:12<30:16:30,  3.32it/s]
  2%|▏         | 9145/371472 [44:12<31:11:25,  3.23it/s]
  2%|▏         | 9146/371472 [44:13<31:40:13,  3.18it/s]
  2%|▏         | 9147/371472 [44:13<31:12:05,  3.23it/s]
  2%|▏         | 9148/371472 [44:13<31:08:03,  3.23it/s]
  2%|▏         | 9149/371472 [44:14<32:31:03,  3.10it/s]
  2%|▏         | 9150/371472 [44:14<31:32:48,  3.19it/s]
  2%|▏         | 9151/371472 [44:14<30:29:10,  3.30it/s]
  2%|▏         | 9152/371472 [44:15<30:45:20,  3.27it/s]
  2%|▏         | 9153/371472 [44:15<30:02:35,  3.35it/s]
  2%|▏         | 9154/371472 [44:15<31:22:11,  3.21it/s]
  2%|▏         | 9155/371472 [44:15<31:07:38,  3.23it/s]
  2%|▏         | 9156/371472 [44:16<29:55:33,  3.36it/s]
  2%|▏         | 9157/371472 [44:16<29:51:33,  3.37it/s]
  2%|▏         | 9158/371472 [44:16<28:33:58,  3.52it/s]
  2%|▏         | 9159/371472 [44:17<27:37:30,  3.64it/s]
  2%|▏         | 9160/371472 [44:17<28:48:23,  3.49it/s]
                                                        
{'loss': 4.8212, 'learning_rate': 9.782800749854554e-07, 'epoch': 0.39}

  2%|▏         | 9160/371472 [44:17<28:48:23,  3.49it/s]
  2%|▏         | 9161/371472 [44:17<28:17:36,  3.56it/s]
  2%|▏         | 9162/371472 [44:17<29:02:08,  3.47it/s]
  2%|▏         | 9163/371472 [44:18<28:47:02,  3.50it/s]
  2%|▏         | 9164/371472 [44:18<30:03:05,  3.35it/s]
  2%|▏         | 9165/371472 [44:18<29:08:26,  3.45it/s]
  2%|▏         | 9166/371472 [44:19<29:35:25,  3.40it/s]
  2%|▏         | 9167/371472 [44:19<29:07:25,  3.46it/s]
  2%|▏         | 9168/371472 [44:19<30:41:13,  3.28it/s]
  2%|▏         | 9169/371472 [44:20<30:21:14,  3.32it/s]
  2%|▏         | 9170/371472 [44:20<29:30:33,  3.41it/s]
  2%|▏         | 9171/371472 [44:20<29:52:06,  3.37it/s]
  2%|▏         | 9172/371472 [44:20<29:07:38,  3.46it/s]
  2%|▏         | 9173/371472 [44:21<28:09:57,  3.57it/s]
  2%|▏         | 9174/371472 [44:21<27:25:19,  3.67it/s]
  2%|▏         | 9175/371472 [44:21<30:15:29,  3.33it/s]
  2%|▏         | 9176/371472 [44:22<30:09:38,  3.34it/s]
  2%|▏         | 9177/371472 [44:22<28:57:59,  3.47it/s]
  2%|▏         | 9178/371472 [44:22<28:55:45,  3.48it/s]
  2%|▏         | 9179/371472 [44:22<28:37:48,  3.52it/s]
  2%|▏         | 9180/371472 [44:23<27:49:04,  3.62it/s]
                                                        
{'loss': 4.7895, 'learning_rate': 9.782315930099763e-07, 'epoch': 0.4}

  2%|▏         | 9180/371472 [44:23<27:49:04,  3.62it/s]
  2%|▏         | 9181/371472 [44:23<28:51:46,  3.49it/s]
  2%|▏         | 9182/371472 [44:23<29:15:30,  3.44it/s]
  2%|▏         | 9183/371472 [44:24<28:29:28,  3.53it/s]
  2%|▏         | 9184/371472 [44:24<30:02:49,  3.35it/s]
  2%|▏         | 9185/371472 [44:24<29:51:12,  3.37it/s]
  2%|▏         | 9186/371472 [44:24<28:46:06,  3.50it/s]
  2%|▏         | 9187/371472 [44:25<28:01:19,  3.59it/s]
  2%|▏         | 9188/371472 [44:25<27:46:10,  3.62it/s]
  2%|▏         | 9189/371472 [44:25<27:12:22,  3.70it/s]
  2%|▏         | 9190/371472 [44:25<27:05:55,  3.71it/s]
  2%|▏         | 9191/371472 [44:26<26:51:01,  3.75it/s]
  2%|▏         | 9192/371472 [44:26<26:53:33,  3.74it/s]
  2%|▏         | 9193/371472 [44:26<29:12:03,  3.45it/s]
  2%|▏         | 9194/371472 [44:27<28:37:14,  3.52it/s]
  2%|▏         | 9195/371472 [44:27<29:16:57,  3.44it/s]
  2%|▏         | 9196/371472 [44:27<29:10:43,  3.45it/s]
  2%|▏         | 9197/371472 [44:27<28:51:57,  3.49it/s]
  2%|▏         | 9198/371472 [44:28<29:02:55,  3.46it/s]
  2%|▏         | 9199/371472 [44:28<28:04:31,  3.58it/s]
  2%|▏         | 9200/371472 [44:28<29:59:28,  3.36it/s]
                                                        
{'loss': 5.0378, 'learning_rate': 9.781831110344976e-07, 'epoch': 0.4}

  2%|▏         | 9200/371472 [44:28<29:59:28,  3.36it/s]
  2%|▏         | 9201/371472 [44:29<29:57:40,  3.36it/s]
  2%|▏         | 9202/371472 [44:29<29:27:41,  3.42it/s]
  2%|▏         | 9203/371472 [44:29<28:57:27,  3.48it/s]
  2%|▏         | 9204/371472 [44:30<29:20:02,  3.43it/s]
  2%|▏         | 9205/371472 [44:30<29:45:00,  3.38it/s]
  2%|▏         | 9206/371472 [44:30<31:12:58,  3.22it/s]
  2%|▏         | 9207/371472 [44:31<32:35:57,  3.09it/s]
  2%|▏         | 9208/371472 [44:31<30:54:50,  3.26it/s]
  2%|▏         | 9209/371472 [44:31<30:48:39,  3.27it/s]
  2%|▏         | 9210/371472 [44:31<29:33:40,  3.40it/s]
  2%|▏         | 9211/371472 [44:32<30:14:33,  3.33it/s]
  2%|▏         | 9212/371472 [44:32<28:48:51,  3.49it/s]
  2%|▏         | 9213/371472 [44:32<28:02:43,  3.59it/s]
  2%|▏         | 9214/371472 [44:32<26:59:43,  3.73it/s]
  2%|▏         | 9215/371472 [44:33<27:02:41,  3.72it/s]
  2%|▏         | 9216/371472 [44:33<26:31:13,  3.79it/s]
  2%|▏         | 9217/371472 [44:33<28:35:54,  3.52it/s]
  2%|▏         | 9218/371472 [44:34<30:08:39,  3.34it/s]
  2%|▏         | 9219/371472 [44:34<35:15:09,  2.85it/s]
  2%|▏         | 9220/371472 [44:34<32:36:41,  3.09it/s]
                                                        
{'loss': 5.1935, 'learning_rate': 9.781346290590187e-07, 'epoch': 0.4}

  2%|▏         | 9220/371472 [44:34<32:36:41,  3.09it/s]
  2%|▏         | 9221/371472 [44:35<30:40:03,  3.28it/s]
  2%|▏         | 9222/371472 [44:35<31:25:15,  3.20it/s]
  2%|▏         | 9223/371472 [44:35<30:47:43,  3.27it/s]
  2%|▏         | 9224/371472 [44:36<32:13:52,  3.12it/s]
  2%|▏         | 9225/371472 [44:36<30:26:59,  3.30it/s]
  2%|▏         | 9226/371472 [44:36<30:42:58,  3.28it/s]
  2%|▏         | 9227/371472 [44:36<29:37:28,  3.40it/s]
  2%|▏         | 9228/371472 [44:37<30:21:13,  3.32it/s]
  2%|▏         | 9229/371472 [44:37<31:55:49,  3.15it/s]
  2%|▏         | 9230/371472 [44:37<31:15:59,  3.22it/s]
  2%|▏         | 9231/371472 [44:38<34:27:18,  2.92it/s]
  2%|▏         | 9232/371472 [44:38<31:49:43,  3.16it/s]
  2%|▏         | 9233/371472 [44:38<31:32:30,  3.19it/s]
  2%|▏         | 9234/371472 [44:39<32:19:59,  3.11it/s]
  2%|▏         | 9235/371472 [44:39<31:16:48,  3.22it/s]
  2%|▏         | 9236/371472 [44:39<29:56:14,  3.36it/s]
  2%|▏         | 9237/371472 [44:40<28:42:50,  3.50it/s]
  2%|▏         | 9238/371472 [44:40<29:33:56,  3.40it/s]
  2%|▏         | 9239/371472 [44:40<29:07:05,  3.46it/s]
  2%|▏         | 9240/371472 [44:40<28:18:51,  3.55it/s]
                                                        
{'loss': 5.0377, 'learning_rate': 9.780861470835397e-07, 'epoch': 0.4}

  2%|▏         | 9240/371472 [44:40<28:18:51,  3.55it/s]
  2%|▏         | 9241/371472 [44:41<27:16:58,  3.69it/s]
  2%|▏         | 9242/371472 [44:41<27:06:28,  3.71it/s]
  2%|▏         | 9243/371472 [44:41<30:02:50,  3.35it/s]
  2%|▏         | 9244/371472 [44:42<30:28:40,  3.30it/s]
  2%|▏         | 9245/371472 [44:42<30:36:07,  3.29it/s]
  2%|▏         | 9246/371472 [44:42<30:14:04,  3.33it/s]
  2%|▏         | 9247/371472 [44:42<29:09:30,  3.45it/s]
  2%|▏         | 9248/371472 [44:43<29:46:37,  3.38it/s]
  2%|▏         | 9249/371472 [44:43<29:25:09,  3.42it/s]
  2%|▏         | 9250/371472 [44:43<29:41:34,  3.39it/s]
  2%|▏         | 9251/371472 [44:44<28:41:45,  3.51it/s]
  2%|▏         | 9252/371472 [44:44<28:05:38,  3.58it/s]
  2%|▏         | 9253/371472 [44:44<27:56:35,  3.60it/s]
  2%|▏         | 9254/371472 [44:44<29:33:09,  3.40it/s]
  2%|▏         | 9255/371472 [44:45<29:49:55,  3.37it/s]
  2%|▏         | 9256/371472 [44:45<31:16:34,  3.22it/s]
  2%|▏         | 9257/371472 [44:45<29:58:22,  3.36it/s]
  2%|▏         | 9258/371472 [44:46<29:32:10,  3.41it/s]
  2%|▏         | 9259/371472 [44:46<28:31:28,  3.53it/s]
  2%|▏         | 9260/371472 [44:46<29:01:03,  3.47it/s]
                                                        
{'loss': 5.2153, 'learning_rate': 9.78037665108061e-07, 'epoch': 0.4}

  2%|▏         | 9260/371472 [44:46<29:01:03,  3.47it/s]
  2%|▏         | 9261/371472 [44:47<29:12:15,  3.45it/s]
  2%|▏         | 9262/371472 [44:47<30:33:03,  3.29it/s]
  2%|▏         | 9263/371472 [44:47<31:13:43,  3.22it/s]
  2%|▏         | 9264/371472 [44:47<29:50:43,  3.37it/s]
  2%|▏         | 9265/371472 [44:48<29:31:19,  3.41it/s]
  2%|▏         | 9266/371472 [44:48<29:28:49,  3.41it/s]
  2%|▏         | 9267/371472 [44:48<30:41:17,  3.28it/s]
  2%|▏         | 9268/371472 [44:49<29:42:42,  3.39it/s]
  2%|▏         | 9269/371472 [44:49<31:52:57,  3.16it/s]
  2%|▏         | 9270/371472 [44:49<31:19:06,  3.21it/s]
  2%|▏         | 9271/371472 [44:50<31:07:09,  3.23it/s]
  2%|▏         | 9272/371472 [44:50<29:47:28,  3.38it/s]
  2%|▏         | 9273/371472 [44:50<29:23:56,  3.42it/s]
  2%|▏         | 9274/371472 [44:50<28:27:52,  3.53it/s]
  2%|▏         | 9275/371472 [44:51<27:35:56,  3.65it/s]
  2%|▏         | 9276/371472 [44:51<27:00:16,  3.73it/s]
  2%|▏         | 9277/371472 [44:51<27:29:07,  3.66it/s]
  2%|▏         | 9278/371472 [44:51<27:03:00,  3.72it/s]
  2%|▏         | 9279/371472 [44:52<27:38:06,  3.64it/s]
  2%|▏         | 9280/371472 [44:52<28:10:57,  3.57it/s]
                                                        
{'loss': 5.0034, 'learning_rate': 9.77989183132582e-07, 'epoch': 0.4}

  2%|▏         | 9280/371472 [44:52<28:10:57,  3.57it/s]
  2%|▏         | 9281/371472 [44:52<28:31:18,  3.53it/s]
  2%|▏         | 9282/371472 [44:53<29:20:55,  3.43it/s]
  2%|▏         | 9283/371472 [44:53<28:33:45,  3.52it/s]
  2%|▏         | 9284/371472 [44:53<28:19:20,  3.55it/s]
  2%|▏         | 9285/371472 [44:54<30:04:46,  3.34it/s]
  2%|▏         | 9286/371472 [44:54<29:51:33,  3.37it/s]
  3%|▎         | 9287/371472 [44:54<29:06:39,  3.46it/s]
  3%|▎         | 9288/371472 [44:54<29:41:44,  3.39it/s]
  3%|▎         | 9289/371472 [44:55<29:04:16,  3.46it/s]
  3%|▎         | 9290/371472 [44:55<28:58:10,  3.47it/s]
  3%|▎         | 9291/371472 [44:55<29:03:54,  3.46it/s]
  3%|▎         | 9292/371472 [44:56<28:59:25,  3.47it/s]
  3%|▎         | 9293/371472 [44:56<30:20:03,  3.32it/s]
  3%|▎         | 9294/371472 [44:56<32:02:53,  3.14it/s]
  3%|▎         | 9295/371472 [44:57<30:53:44,  3.26it/s]
  3%|▎         | 9296/371472 [44:57<29:41:00,  3.39it/s]
  3%|▎         | 9297/371472 [44:57<28:48:32,  3.49it/s]
  3%|▎         | 9298/371472 [44:57<28:26:54,  3.54it/s]
  3%|▎         | 9299/371472 [44:58<28:35:25,  3.52it/s]
  3%|▎         | 9300/371472 [44:58<28:32:59,  3.52it/s]
                                                        
{'loss': 5.0281, 'learning_rate': 9.779407011571032e-07, 'epoch': 0.4}

  3%|▎         | 9300/371472 [44:58<28:32:59,  3.52it/s]
  3%|▎         | 9301/371472 [44:58<29:02:04,  3.46it/s]
  3%|▎         | 9302/371472 [44:59<29:48:42,  3.37it/s]
  3%|▎         | 9303/371472 [44:59<29:18:17,  3.43it/s]
  3%|▎         | 9304/371472 [44:59<29:20:49,  3.43it/s]
  3%|▎         | 9305/371472 [44:59<29:32:53,  3.40it/s]
  3%|▎         | 9306/371472 [45:00<30:42:28,  3.28it/s]
  3%|▎         | 9307/371472 [45:00<29:50:40,  3.37it/s]
  3%|▎         | 9308/371472 [45:00<30:31:26,  3.30it/s]
  3%|▎         | 9309/371472 [45:01<29:54:15,  3.36it/s]
  3%|▎         | 9310/371472 [45:01<29:48:26,  3.38it/s]
  3%|▎         | 9311/371472 [45:01<28:47:53,  3.49it/s]
  3%|▎         | 9312/371472 [45:01<28:08:54,  3.57it/s]
  3%|▎         | 9313/371472 [45:02<28:03:48,  3.58it/s]
  3%|▎         | 9314/371472 [45:02<30:03:58,  3.35it/s]
  3%|▎         | 9315/371472 [45:02<28:50:34,  3.49it/s]
  3%|▎         | 9316/371472 [45:03<28:32:11,  3.53it/s]
  3%|▎         | 9317/371472 [45:03<31:35:16,  3.18it/s]
  3%|▎         | 9318/371472 [45:03<30:19:01,  3.32it/s]
  3%|▎         | 9319/371472 [45:04<31:41:53,  3.17it/s]
  3%|▎         | 9320/371472 [45:04<31:44:02,  3.17it/s]
                                                        
{'loss': 4.5347, 'learning_rate': 9.778922191816242e-07, 'epoch': 0.4}

  3%|▎         | 9320/371472 [45:04<31:44:02,  3.17it/s]
  3%|▎         | 9321/371472 [45:04<31:07:58,  3.23it/s]
  3%|▎         | 9322/371472 [45:04<30:00:30,  3.35it/s]
  3%|▎         | 9323/371472 [45:05<31:40:27,  3.18it/s]
  3%|▎         | 9324/371472 [45:05<32:14:50,  3.12it/s]
  3%|▎         | 9325/371472 [45:06<33:17:04,  3.02it/s]
  3%|▎         | 9326/371472 [45:06<31:42:15,  3.17it/s]
  3%|▎         | 9327/371472 [45:06<30:55:31,  3.25it/s]
  3%|▎         | 9328/371472 [45:06<29:27:21,  3.42it/s]
  3%|▎         | 9329/371472 [45:07<31:17:12,  3.22it/s]
  3%|▎         | 9330/371472 [45:07<31:15:13,  3.22it/s]
  3%|▎         | 9331/371472 [45:07<29:49:23,  3.37it/s]
  3%|▎         | 9332/371472 [45:08<29:53:14,  3.37it/s]
  3%|▎         | 9333/371472 [45:08<30:37:01,  3.29it/s]
  3%|▎         | 9334/371472 [45:08<30:25:52,  3.31it/s]
  3%|▎         | 9335/371472 [45:08<29:04:55,  3.46it/s]
  3%|▎         | 9336/371472 [45:09<28:48:36,  3.49it/s]
  3%|▎         | 9337/371472 [45:09<28:09:33,  3.57it/s]
  3%|▎         | 9338/371472 [45:09<27:56:45,  3.60it/s]
  3%|▎         | 9339/371472 [45:10<27:09:11,  3.70it/s]
  3%|▎         | 9340/371472 [45:10<26:38:18,  3.78it/s]
                                                        
{'loss': 4.7715, 'learning_rate': 9.778437372061453e-07, 'epoch': 0.4}

  3%|▎         | 9340/371472 [45:10<26:38:18,  3.78it/s]
  3%|▎         | 9341/371472 [45:10<26:36:53,  3.78it/s]
  3%|▎         | 9342/371472 [45:10<27:21:01,  3.68it/s]
  3%|▎         | 9343/371472 [45:11<29:44:19,  3.38it/s]
  3%|▎         | 9344/371472 [45:11<29:28:14,  3.41it/s]
  3%|▎         | 9345/371472 [45:11<30:38:50,  3.28it/s]
  3%|▎         | 9346/371472 [45:12<29:10:24,  3.45it/s]
  3%|▎         | 9347/371472 [45:12<28:30:25,  3.53it/s]
  3%|▎         | 9348/371472 [45:12<28:12:43,  3.57it/s]
  3%|▎         | 9349/371472 [45:12<28:38:16,  3.51it/s]
  3%|▎         | 9350/371472 [45:13<27:48:03,  3.62it/s]
  3%|▎         | 9351/371472 [45:13<26:46:32,  3.76it/s]
  3%|▎         | 9352/371472 [45:13<26:12:45,  3.84it/s]
  3%|▎         | 9353/371472 [45:13<26:37:21,  3.78it/s]
  3%|▎         | 9354/371472 [45:14<26:06:21,  3.85it/s]
  3%|▎         | 9355/371472 [45:14<27:13:37,  3.69it/s]
  3%|▎         | 9356/371472 [45:14<26:42:27,  3.77it/s]
  3%|▎         | 9357/371472 [45:14<27:15:59,  3.69it/s]
  3%|▎         | 9358/371472 [45:15<27:33:01,  3.65it/s]
  3%|▎         | 9359/371472 [45:15<29:21:06,  3.43it/s]
  3%|▎         | 9360/371472 [45:15<28:12:56,  3.56it/s]
                                                        
{'loss': 5.0449, 'learning_rate': 9.777952552306664e-07, 'epoch': 0.4}

  3%|▎         | 9360/371472 [45:15<28:12:56,  3.56it/s]
  3%|▎         | 9361/371472 [45:16<29:14:43,  3.44it/s]
  3%|▎         | 9362/371472 [45:16<30:44:52,  3.27it/s]
  3%|▎         | 9363/371472 [45:16<29:50:43,  3.37it/s]
  3%|▎         | 9364/371472 [45:17<28:20:14,  3.55it/s]
  3%|▎         | 9365/371472 [45:17<30:02:29,  3.35it/s]
  3%|▎         | 9366/371472 [45:17<29:11:49,  3.45it/s]
  3%|▎         | 9367/371472 [45:17<28:11:04,  3.57it/s]
  3%|▎         | 9368/371472 [45:18<28:28:51,  3.53it/s]
  3%|▎         | 9369/371472 [45:18<30:17:43,  3.32it/s]
  3%|▎         | 9370/371472 [45:18<30:19:28,  3.32it/s]
  3%|▎         | 9371/371472 [45:19<28:32:30,  3.52it/s]
  3%|▎         | 9372/371472 [45:19<29:41:58,  3.39it/s]
  3%|▎         | 9373/371472 [45:19<28:32:41,  3.52it/s]
  3%|▎         | 9374/371472 [45:19<27:47:33,  3.62it/s]
  3%|▎         | 9375/371472 [45:20<27:42:19,  3.63it/s]
  3%|▎         | 9376/371472 [45:20<30:29:19,  3.30it/s]
  3%|▎         | 9377/371472 [45:20<30:16:29,  3.32it/s]
  3%|▎         | 9378/371472 [45:21<29:07:22,  3.45it/s]
  3%|▎         | 9379/371472 [45:21<30:50:29,  3.26it/s]
  3%|▎         | 9380/371472 [45:21<29:37:53,  3.39it/s]
                                                        
{'loss': 5.1752, 'learning_rate': 9.777467732551874e-07, 'epoch': 0.4}

  3%|▎         | 9380/371472 [45:21<29:37:53,  3.39it/s]
  3%|▎         | 9381/371472 [45:21<28:58:40,  3.47it/s]
  3%|▎         | 9382/371472 [45:22<27:59:24,  3.59it/s]
  3%|▎         | 9383/371472 [45:22<27:56:36,  3.60it/s]
  3%|▎         | 9384/371472 [45:22<30:13:24,  3.33it/s]
  3%|▎         | 9385/371472 [45:23<28:57:04,  3.47it/s]
  3%|▎         | 9386/371472 [45:23<28:11:06,  3.57it/s]
  3%|▎         | 9387/371472 [45:23<29:59:05,  3.35it/s]
  3%|▎         | 9388/371472 [45:24<29:11:15,  3.45it/s]
  3%|▎         | 9389/371472 [45:24<29:10:14,  3.45it/s]
  3%|▎         | 9390/371472 [45:24<28:37:49,  3.51it/s]
  3%|▎         | 9391/371472 [45:24<28:18:25,  3.55it/s]
  3%|▎         | 9392/371472 [45:25<27:40:01,  3.64it/s]
  3%|▎         | 9393/371472 [45:25<27:09:48,  3.70it/s]
  3%|▎         | 9394/371472 [45:25<27:33:14,  3.65it/s]
  3%|▎         | 9395/371472 [45:25<27:01:23,  3.72it/s]
  3%|▎         | 9396/371472 [45:26<27:05:09,  3.71it/s]
  3%|▎         | 9397/371472 [45:26<26:34:12,  3.79it/s]
  3%|▎         | 9398/371472 [45:26<26:28:32,  3.80it/s]
  3%|▎         | 9399/371472 [45:26<26:56:46,  3.73it/s]
  3%|▎         | 9400/371472 [45:27<28:05:55,  3.58it/s]
                                                        
{'loss': 5.063, 'learning_rate': 9.776982912797087e-07, 'epoch': 0.4}

  3%|▎         | 9400/371472 [45:27<28:05:55,  3.58it/s]
  3%|▎         | 9401/371472 [45:27<27:50:30,  3.61it/s]
  3%|▎         | 9402/371472 [45:27<27:23:26,  3.67it/s]
  3%|▎         | 9403/371472 [45:28<28:47:03,  3.49it/s]
  3%|▎         | 9404/371472 [45:28<29:10:03,  3.45it/s]
  3%|▎         | 9405/371472 [45:28<28:35:18,  3.52it/s]
  3%|▎         | 9406/371472 [45:28<28:41:55,  3.50it/s]
  3%|▎         | 9407/371472 [45:29<30:07:49,  3.34it/s]
  3%|▎         | 9408/371472 [45:29<29:00:48,  3.47it/s]
  3%|▎         | 9409/371472 [45:29<28:51:22,  3.49it/s]
  3%|▎         | 9410/371472 [45:30<28:42:18,  3.50it/s]
  3%|▎         | 9411/371472 [45:30<30:13:39,  3.33it/s]
  3%|▎         | 9412/371472 [45:30<29:23:49,  3.42it/s]
  3%|▎         | 9413/371472 [45:31<30:41:04,  3.28it/s]
  3%|▎         | 9414/371472 [45:31<29:27:41,  3.41it/s]
  3%|▎         | 9415/371472 [45:31<30:10:51,  3.33it/s]
  3%|▎         | 9416/371472 [45:31<29:16:56,  3.43it/s]
  3%|▎         | 9417/371472 [45:32<29:56:45,  3.36it/s]
  3%|▎         | 9418/371472 [45:32<28:17:00,  3.56it/s]
  3%|▎         | 9419/371472 [45:32<27:08:19,  3.71it/s]
  3%|▎         | 9420/371472 [45:33<27:12:51,  3.70it/s]
                                                        
{'loss': 4.8293, 'learning_rate': 9.776498093042298e-07, 'epoch': 0.41}

  3%|▎         | 9420/371472 [45:33<27:12:51,  3.70it/s]
  3%|▎         | 9421/371472 [45:33<26:55:51,  3.73it/s]
  3%|▎         | 9422/371472 [45:33<26:44:59,  3.76it/s]
  3%|▎         | 9423/371472 [45:33<27:39:31,  3.64it/s]
  3%|▎         | 9424/371472 [45:34<26:59:32,  3.73it/s]
  3%|▎         | 9425/371472 [45:34<26:13:08,  3.84it/s]
  3%|▎         | 9426/371472 [45:34<26:39:47,  3.77it/s]
  3%|▎         | 9427/371472 [45:34<26:59:23,  3.73it/s]
  3%|▎         | 9428/371472 [45:35<26:41:59,  3.77it/s]
  3%|▎         | 9429/371472 [45:35<27:26:38,  3.66it/s]
  3%|▎         | 9430/371472 [45:35<28:45:52,  3.50it/s]
  3%|▎         | 9431/371472 [45:36<28:29:52,  3.53it/s]
  3%|▎         | 9432/371472 [45:36<28:22:22,  3.54it/s]
  3%|▎         | 9433/371472 [45:36<27:52:19,  3.61it/s]
  3%|▎         | 9434/371472 [45:36<28:05:39,  3.58it/s]
  3%|▎         | 9435/371472 [45:37<28:58:06,  3.47it/s]
  3%|▎         | 9436/371472 [45:37<28:29:26,  3.53it/s]
  3%|▎         | 9437/371472 [45:37<29:10:52,  3.45it/s]
  3%|▎         | 9438/371472 [45:38<29:23:19,  3.42it/s]
  3%|▎         | 9439/371472 [45:38<29:55:54,  3.36it/s]
  3%|▎         | 9440/371472 [45:38<31:21:29,  3.21it/s]
                                                        
{'loss': 5.0506, 'learning_rate': 9.776013273287509e-07, 'epoch': 0.41}

  3%|▎         | 9440/371472 [45:38<31:21:29,  3.21it/s]
  3%|▎         | 9441/371472 [45:38<30:47:30,  3.27it/s]
  3%|▎         | 9442/371472 [45:39<29:37:47,  3.39it/s]
  3%|▎         | 9443/371472 [45:39<28:58:15,  3.47it/s]
  3%|▎         | 9444/371472 [45:39<28:41:39,  3.50it/s]
  3%|▎         | 9445/371472 [45:40<29:10:14,  3.45it/s]
  3%|▎         | 9446/371472 [45:40<29:31:53,  3.41it/s]
  3%|▎         | 9447/371472 [45:40<29:18:50,  3.43it/s]
  3%|▎         | 9448/371472 [45:40<28:18:21,  3.55it/s]
  3%|▎         | 9449/371472 [45:41<29:00:36,  3.47it/s]
  3%|▎         | 9450/371472 [45:41<28:48:59,  3.49it/s]
  3%|▎         | 9451/371472 [45:41<28:47:16,  3.49it/s]
  3%|▎         | 9452/371472 [45:42<29:50:52,  3.37it/s]
  3%|▎         | 9453/371472 [45:42<29:48:26,  3.37it/s]
  3%|▎         | 9454/371472 [45:42<32:39:27,  3.08it/s]
  3%|▎         | 9455/371472 [45:43<30:59:35,  3.24it/s]
  3%|▎         | 9456/371472 [45:43<31:29:18,  3.19it/s]
  3%|▎         | 9457/371472 [45:43<30:29:46,  3.30it/s]
  3%|▎         | 9458/371472 [45:43<29:22:30,  3.42it/s]
  3%|▎         | 9459/371472 [45:44<31:53:33,  3.15it/s]
  3%|▎         | 9460/371472 [45:44<29:50:35,  3.37it/s]
                                                        
{'loss': 5.0681, 'learning_rate': 9.77552845353272e-07, 'epoch': 0.41}

  3%|▎         | 9460/371472 [45:44<29:50:35,  3.37it/s]
  3%|▎         | 9461/371472 [45:44<28:56:42,  3.47it/s]
  3%|▎         | 9462/371472 [45:45<28:55:01,  3.48it/s]
  3%|▎         | 9463/371472 [45:45<28:18:37,  3.55it/s]
  3%|▎         | 9464/371472 [45:45<28:40:39,  3.51it/s]
  3%|▎         | 9465/371472 [45:45<28:34:03,  3.52it/s]
  3%|▎         | 9466/371472 [45:46<29:07:55,  3.45it/s]
  3%|▎         | 9467/371472 [45:46<28:51:03,  3.49it/s]
  3%|▎         | 9468/371472 [45:46<31:12:54,  3.22it/s]
  3%|▎         | 9469/371472 [45:47<32:14:45,  3.12it/s]
  3%|▎         | 9470/371472 [45:47<31:04:11,  3.24it/s]
  3%|▎         | 9471/371472 [45:47<29:21:27,  3.43it/s]
  3%|▎         | 9472/371472 [45:48<28:08:24,  3.57it/s]
  3%|▎         | 9473/371472 [45:48<30:53:35,  3.25it/s]
  3%|▎         | 9474/371472 [45:48<29:30:35,  3.41it/s]
  3%|▎         | 9475/371472 [45:48<29:45:21,  3.38it/s]
  3%|▎         | 9476/371472 [45:49<28:54:26,  3.48it/s]
  3%|▎         | 9477/371472 [45:49<29:43:01,  3.38it/s]
  3%|▎         | 9478/371472 [45:49<28:35:27,  3.52it/s]
  3%|▎         | 9479/371472 [45:50<28:00:44,  3.59it/s]
  3%|▎         | 9480/371472 [45:50<27:44:07,  3.63it/s]
                                                        
{'loss': 4.9795, 'learning_rate': 9.77504363377793e-07, 'epoch': 0.41}

  3%|▎         | 9480/371472 [45:50<27:44:07,  3.63it/s]
  3%|▎         | 9481/371472 [45:50<27:10:11,  3.70it/s]
  3%|▎         | 9482/371472 [45:50<28:14:18,  3.56it/s]
  3%|▎         | 9483/371472 [45:51<27:20:14,  3.68it/s]
  3%|▎         | 9484/371472 [45:51<26:59:28,  3.73it/s]
  3%|▎         | 9485/371472 [45:51<30:40:23,  3.28it/s]
  3%|▎         | 9486/371472 [45:52<30:14:47,  3.32it/s]
  3%|▎         | 9487/371472 [45:52<29:15:48,  3.44it/s]
  3%|▎         | 9488/371472 [45:52<28:18:08,  3.55it/s]
  3%|▎         | 9489/371472 [45:52<27:56:24,  3.60it/s]
  3%|▎         | 9490/371472 [45:53<27:37:10,  3.64it/s]
  3%|▎         | 9491/371472 [45:53<27:34:10,  3.65it/s]
  3%|▎         | 9492/371472 [45:53<28:17:18,  3.55it/s]
  3%|▎         | 9493/371472 [45:54<28:04:10,  3.58it/s]
  3%|▎         | 9494/371472 [45:54<30:55:45,  3.25it/s]
  3%|▎         | 9495/371472 [45:54<30:02:02,  3.35it/s]
  3%|▎         | 9496/371472 [45:54<30:20:32,  3.31it/s]
  3%|▎         | 9497/371472 [45:55<29:39:11,  3.39it/s]
  3%|▎         | 9498/371472 [45:55<28:42:01,  3.50it/s]
  3%|▎         | 9499/371472 [45:55<29:03:48,  3.46it/s]
  3%|▎         | 9500/371472 [45:56<29:01:52,  3.46it/s]
                                                        
{'loss': 4.7326, 'learning_rate': 9.774558814023143e-07, 'epoch': 0.41}

  3%|▎         | 9500/371472 [45:56<29:01:52,  3.46it/s]
  3%|▎         | 9501/371472 [45:56<29:18:24,  3.43it/s]
  3%|▎         | 9502/371472 [45:56<30:59:18,  3.24it/s]
  3%|▎         | 9503/371472 [45:57<30:45:11,  3.27it/s]
  3%|▎         | 9504/371472 [45:57<29:36:34,  3.40it/s]
  3%|▎         | 9505/371472 [45:57<31:58:43,  3.14it/s]
  3%|▎         | 9506/371472 [45:57<30:25:45,  3.30it/s]
  3%|▎         | 9507/371472 [45:58<29:21:32,  3.42it/s]
  3%|▎         | 9508/371472 [45:58<29:25:46,  3.42it/s]
  3%|▎         | 9509/371472 [45:58<29:16:49,  3.43it/s]
  3%|▎         | 9510/371472 [45:59<29:56:16,  3.36it/s]
  3%|▎         | 9511/371472 [45:59<29:19:08,  3.43it/s]
  3%|▎         | 9512/371472 [45:59<29:27:27,  3.41it/s]
  3%|▎         | 9513/371472 [45:59<28:53:52,  3.48it/s]
  3%|▎         | 9514/371472 [46:00<28:41:32,  3.50it/s]
  3%|▎         | 9515/371472 [46:00<28:13:10,  3.56it/s]
  3%|▎         | 9516/371472 [46:00<28:24:59,  3.54it/s]
  3%|▎         | 9517/371472 [46:01<27:31:59,  3.65it/s]
  3%|▎         | 9518/371472 [46:01<28:19:05,  3.55it/s]
  3%|▎         | 9519/371472 [46:01<27:37:24,  3.64it/s]
  3%|▎         | 9520/371472 [46:01<27:55:43,  3.60it/s]
                                                        
{'loss': 4.5815, 'learning_rate': 9.774073994268352e-07, 'epoch': 0.41}

  3%|▎         | 9520/371472 [46:01<27:55:43,  3.60it/s]
  3%|▎         | 9521/371472 [46:02<27:36:05,  3.64it/s]
  3%|▎         | 9522/371472 [46:02<30:07:19,  3.34it/s]
  3%|▎         | 9523/371472 [46:02<30:22:32,  3.31it/s]
  3%|▎         | 9524/371472 [46:03<29:16:21,  3.43it/s]
  3%|▎         | 9525/371472 [46:03<29:52:55,  3.36it/s]
  3%|▎         | 9526/371472 [46:03<29:30:40,  3.41it/s]
  3%|▎         | 9527/371472 [46:04<30:19:41,  3.32it/s]
  3%|▎         | 9528/371472 [46:04<29:01:12,  3.46it/s]
  3%|▎         | 9529/371472 [46:04<28:27:23,  3.53it/s]
  3%|▎         | 9530/371472 [46:04<27:42:21,  3.63it/s]
  3%|▎         | 9531/371472 [46:05<27:08:45,  3.70it/s]
  3%|▎         | 9532/371472 [46:05<27:05:54,  3.71it/s]
  3%|▎         | 9533/371472 [46:05<28:28:47,  3.53it/s]
  3%|▎         | 9534/371472 [46:05<28:32:35,  3.52it/s]
  3%|▎         | 9535/371472 [46:06<28:49:39,  3.49it/s]
  3%|▎         | 9536/371472 [46:06<28:53:29,  3.48it/s]
  3%|▎         | 9537/371472 [46:06<29:03:24,  3.46it/s]
  3%|▎         | 9538/371472 [46:07<28:34:20,  3.52it/s]
  3%|▎         | 9539/371472 [46:07<29:53:30,  3.36it/s]
  3%|▎         | 9540/371472 [46:07<28:32:29,  3.52it/s]
                                                        
{'loss': 5.0059, 'learning_rate': 9.773589174513564e-07, 'epoch': 0.41}

  3%|▎         | 9540/371472 [46:07<28:32:29,  3.52it/s]
  3%|▎         | 9541/371472 [46:07<28:03:25,  3.58it/s]
  3%|▎         | 9542/371472 [46:08<27:21:24,  3.67it/s]
  3%|▎         | 9543/371472 [46:08<28:30:37,  3.53it/s]
  3%|▎         | 9544/371472 [46:08<27:54:34,  3.60it/s]
  3%|▎         | 9545/371472 [46:09<26:55:58,  3.73it/s]
  3%|▎         | 9546/371472 [46:09<27:07:19,  3.71it/s]
  3%|▎         | 9547/371472 [46:09<27:58:49,  3.59it/s]
  3%|▎         | 9548/371472 [46:09<28:05:45,  3.58it/s]
  3%|▎         | 9549/371472 [46:10<28:21:56,  3.54it/s]
  3%|▎         | 9550/371472 [46:10<29:34:08,  3.40it/s]
  3%|▎         | 9551/371472 [46:10<30:59:07,  3.24it/s]
  3%|▎         | 9552/371472 [46:11<30:52:34,  3.26it/s]
  3%|▎         | 9553/371472 [46:11<29:29:40,  3.41it/s]
  3%|▎         | 9554/371472 [46:11<28:22:30,  3.54it/s]
  3%|▎         | 9555/371472 [46:11<29:07:34,  3.45it/s]
  3%|▎         | 9556/371472 [46:12<29:44:22,  3.38it/s]
  3%|▎         | 9557/371472 [46:12<29:31:12,  3.41it/s]
  3%|▎         | 9558/371472 [46:12<28:47:06,  3.49it/s]
  3%|▎         | 9559/371472 [46:13<28:18:10,  3.55it/s]
  3%|▎         | 9560/371472 [46:13<30:24:04,  3.31it/s]
                                                        
{'loss': 4.8963, 'learning_rate': 9.773104354758773e-07, 'epoch': 0.41}

  3%|▎         | 9560/371472 [46:13<30:24:04,  3.31it/s]
  3%|▎         | 9561/371472 [46:13<32:33:59,  3.09it/s]
  3%|▎         | 9562/371472 [46:14<32:18:25,  3.11it/s]
  3%|▎         | 9563/371472 [46:14<30:36:03,  3.29it/s]
  3%|▎         | 9564/371472 [46:14<29:54:09,  3.36it/s]
  3%|▎         | 9565/371472 [46:14<29:04:06,  3.46it/s]
  3%|▎         | 9566/371472 [46:15<29:58:47,  3.35it/s]
  3%|▎         | 9567/371472 [46:15<29:46:47,  3.38it/s]
  3%|▎         | 9568/371472 [46:15<29:25:20,  3.42it/s]
  3%|▎         | 9569/371472 [46:16<28:29:17,  3.53it/s]
  3%|▎         | 9570/371472 [46:16<27:21:34,  3.67it/s]
  3%|▎         | 9571/371472 [46:16<27:04:46,  3.71it/s]
  3%|▎         | 9572/371472 [46:16<27:31:12,  3.65it/s]
  3%|▎         | 9573/371472 [46:17<27:18:04,  3.68it/s]
  3%|▎         | 9574/371472 [46:17<27:13:39,  3.69it/s]
  3%|▎         | 9575/371472 [46:17<27:19:30,  3.68it/s]
  3%|▎         | 9576/371472 [46:17<27:04:31,  3.71it/s]
  3%|▎         | 9577/371472 [46:18<28:21:49,  3.54it/s]
  3%|▎         | 9578/371472 [46:18<29:05:35,  3.46it/s]
  3%|▎         | 9579/371472 [46:18<29:21:52,  3.42it/s]
  3%|▎         | 9580/371472 [46:19<28:13:04,  3.56it/s]
                                                        
{'loss': 4.9941, 'learning_rate': 9.772619535003986e-07, 'epoch': 0.41}

  3%|▎         | 9580/371472 [46:19<28:13:04,  3.56it/s]
  3%|▎         | 9581/371472 [46:19<27:35:16,  3.64it/s]
  3%|▎         | 9582/371472 [46:19<27:31:15,  3.65it/s]
  3%|▎         | 9583/371472 [46:19<27:18:33,  3.68it/s]
  3%|▎         | 9584/371472 [46:20<26:58:01,  3.73it/s]
  3%|▎         | 9585/371472 [46:20<26:54:01,  3.74it/s]
  3%|▎         | 9586/371472 [46:20<27:03:23,  3.72it/s]
  3%|▎         | 9587/371472 [46:21<29:12:19,  3.44it/s]
  3%|▎         | 9588/371472 [46:21<30:14:38,  3.32it/s]
  3%|▎         | 9589/371472 [46:21<29:36:38,  3.39it/s]
  3%|▎         | 9590/371472 [46:21<29:22:41,  3.42it/s]
  3%|▎         | 9591/371472 [46:22<29:52:36,  3.36it/s]
  3%|▎         | 9592/371472 [46:22<30:11:02,  3.33it/s]
  3%|▎         | 9593/371472 [46:22<28:30:01,  3.53it/s]
  3%|▎         | 9594/371472 [46:23<29:08:34,  3.45it/s]
  3%|▎         | 9595/371472 [46:23<28:26:49,  3.53it/s]
  3%|▎         | 9596/371472 [46:23<28:32:07,  3.52it/s]
  3%|▎         | 9597/371472 [46:23<27:51:08,  3.61it/s]
  3%|▎         | 9598/371472 [46:24<27:29:17,  3.66it/s]
  3%|▎         | 9599/371472 [46:24<27:05:40,  3.71it/s]
  3%|▎         | 9600/371472 [46:24<28:22:39,  3.54it/s]
                                                        
{'loss': 5.0495, 'learning_rate': 9.772134715249196e-07, 'epoch': 0.41}

  3%|▎         | 9600/371472 [46:24<28:22:39,  3.54it/s]
  3%|▎         | 9601/371472 [46:25<27:25:29,  3.67it/s]
  3%|▎         | 9602/371472 [46:25<27:27:59,  3.66it/s]
  3%|▎         | 9603/371472 [46:25<27:36:26,  3.64it/s]
  3%|▎         | 9604/371472 [46:25<28:23:25,  3.54it/s]
  3%|▎         | 9605/371472 [46:26<28:19:17,  3.55it/s]
  3%|▎         | 9606/371472 [46:26<30:52:31,  3.26it/s]
  3%|▎         | 9607/371472 [46:26<30:02:27,  3.35it/s]
  3%|▎         | 9608/371472 [46:27<31:42:38,  3.17it/s]
  3%|▎         | 9609/371472 [46:27<31:14:56,  3.22it/s]
  3%|▎         | 9610/371472 [46:27<31:20:49,  3.21it/s]
  3%|▎         | 9611/371472 [46:28<30:10:55,  3.33it/s]
  3%|▎         | 9612/371472 [46:28<29:30:28,  3.41it/s]
  3%|▎         | 9613/371472 [46:28<28:30:07,  3.53it/s]
  3%|▎         | 9614/371472 [46:28<28:08:19,  3.57it/s]
  3%|▎         | 9615/371472 [46:29<27:19:11,  3.68it/s]
  3%|▎         | 9616/371472 [46:29<26:56:37,  3.73it/s]
  3%|▎         | 9617/371472 [46:29<27:18:39,  3.68it/s]
  3%|▎         | 9618/371472 [46:29<27:33:00,  3.65it/s]
  3%|▎         | 9619/371472 [46:30<27:16:57,  3.68it/s]
  3%|▎         | 9620/371472 [46:30<27:39:59,  3.63it/s]
                                                        
{'loss': 4.5602, 'learning_rate': 9.771649895494407e-07, 'epoch': 0.41}

  3%|▎         | 9620/371472 [46:30<27:39:59,  3.63it/s]
  3%|▎         | 9621/371472 [46:30<26:53:45,  3.74it/s]
  3%|▎         | 9622/371472 [46:31<26:55:18,  3.73it/s]
  3%|▎         | 9623/371472 [46:31<26:57:41,  3.73it/s]
  3%|▎         | 9624/371472 [46:31<27:10:56,  3.70it/s]
  3%|▎         | 9625/371472 [46:31<28:37:55,  3.51it/s]
  3%|▎         | 9626/371472 [46:32<29:13:14,  3.44it/s]
  3%|▎         | 9627/371472 [46:32<27:57:37,  3.59it/s]
  3%|▎         | 9628/371472 [46:32<29:56:53,  3.36it/s]
  3%|▎         | 9629/371472 [46:33<29:59:28,  3.35it/s]
  3%|▎         | 9630/371472 [46:33<31:10:11,  3.22it/s]
  3%|▎         | 9631/371472 [46:33<29:38:14,  3.39it/s]
  3%|▎         | 9632/371472 [46:33<29:28:28,  3.41it/s]
  3%|▎         | 9633/371472 [46:34<29:39:56,  3.39it/s]
  3%|▎         | 9634/371472 [46:34<29:26:50,  3.41it/s]
  3%|▎         | 9635/371472 [46:34<29:24:43,  3.42it/s]
  3%|▎         | 9636/371472 [46:35<30:46:14,  3.27it/s]
  3%|▎         | 9637/371472 [46:35<29:18:19,  3.43it/s]
  3%|▎         | 9638/371472 [46:35<28:27:40,  3.53it/s]
  3%|▎         | 9639/371472 [46:35<27:41:29,  3.63it/s]
  3%|▎         | 9640/371472 [46:36<30:15:28,  3.32it/s]
                                                        
{'loss': 5.1274, 'learning_rate': 9.77116507573962e-07, 'epoch': 0.42}

  3%|▎         | 9640/371472 [46:36<30:15:28,  3.32it/s]
  3%|▎         | 9641/371472 [46:36<30:12:26,  3.33it/s]
  3%|▎         | 9642/371472 [46:36<29:00:48,  3.46it/s]
  3%|▎         | 9643/371472 [46:37<28:04:08,  3.58it/s]
  3%|▎         | 9644/371472 [46:37<27:25:13,  3.67it/s]
  3%|▎         | 9645/371472 [46:37<28:53:23,  3.48it/s]
  3%|▎         | 9646/371472 [46:38<29:23:28,  3.42it/s]
  3%|▎         | 9647/371472 [46:38<29:57:57,  3.35it/s]
  3%|▎         | 9648/371472 [46:38<31:21:55,  3.20it/s]
  3%|▎         | 9649/371472 [46:38<30:32:58,  3.29it/s]
  3%|▎         | 9650/371472 [46:39<30:15:21,  3.32it/s]
  3%|▎         | 9651/371472 [46:39<28:20:47,  3.55it/s]
  3%|▎         | 9652/371472 [46:39<27:37:16,  3.64it/s]
  3%|▎         | 9653/371472 [46:40<27:58:08,  3.59it/s]
  3%|▎         | 9654/371472 [46:40<28:44:17,  3.50it/s]
  3%|▎         | 9655/371472 [46:40<28:09:54,  3.57it/s]
  3%|▎         | 9656/371472 [46:40<28:22:49,  3.54it/s]
  3%|▎         | 9657/371472 [46:41<27:50:38,  3.61it/s]
  3%|▎         | 9658/371472 [46:41<27:45:28,  3.62it/s]
  3%|▎         | 9659/371472 [46:41<27:32:57,  3.65it/s]
  3%|▎         | 9660/371472 [46:41<27:36:46,  3.64it/s]
                                                        
{'loss': 5.2212, 'learning_rate': 9.77068025598483e-07, 'epoch': 0.42}

  3%|▎         | 9660/371472 [46:41<27:36:46,  3.64it/s]
  3%|▎         | 9661/371472 [46:42<28:31:07,  3.52it/s]
  3%|▎         | 9662/371472 [46:42<27:52:58,  3.60it/s]
  3%|▎         | 9663/371472 [46:42<28:42:39,  3.50it/s]
  3%|▎         | 9664/371472 [46:43<28:01:24,  3.59it/s]
  3%|▎         | 9665/371472 [46:43<27:11:32,  3.70it/s]
  3%|▎         | 9666/371472 [46:43<31:43:02,  3.17it/s]
  3%|▎         | 9667/371472 [46:44<29:37:44,  3.39it/s]
  3%|▎         | 9668/371472 [46:44<28:47:30,  3.49it/s]
  3%|▎         | 9669/371472 [46:44<29:41:22,  3.39it/s]
  3%|▎         | 9670/371472 [46:44<29:22:04,  3.42it/s]
  3%|▎         | 9671/371472 [46:45<31:12:51,  3.22it/s]
  3%|▎         | 9672/371472 [46:45<30:38:04,  3.28it/s]
  3%|▎         | 9673/371472 [46:45<29:03:04,  3.46it/s]
  3%|▎         | 9674/371472 [46:46<28:40:14,  3.51it/s]
  3%|▎         | 9675/371472 [46:46<28:48:15,  3.49it/s]
  3%|▎         | 9676/371472 [46:46<29:14:39,  3.44it/s]
  3%|▎         | 9677/371472 [46:46<29:49:44,  3.37it/s]
  3%|▎         | 9678/371472 [46:47<29:04:52,  3.46it/s]
  3%|▎         | 9679/371472 [46:47<28:49:22,  3.49it/s]
  3%|▎         | 9680/371472 [46:47<28:11:55,  3.56it/s]
                                                        
{'loss': 4.8636, 'learning_rate': 9.770195436230041e-07, 'epoch': 0.42}

  3%|▎         | 9680/371472 [46:47<28:11:55,  3.56it/s]
  3%|▎         | 9681/371472 [46:48<27:40:20,  3.63it/s]
  3%|▎         | 9682/371472 [46:48<27:07:08,  3.71it/s]
  3%|▎         | 9683/371472 [46:48<26:40:33,  3.77it/s]
  3%|▎         | 9684/371472 [46:48<27:32:13,  3.65it/s]
  3%|▎         | 9685/371472 [46:49<28:19:10,  3.55it/s]
  3%|▎         | 9686/371472 [46:49<28:17:52,  3.55it/s]
  3%|▎         | 9687/371472 [46:49<27:26:18,  3.66it/s]
  3%|▎         | 9688/371472 [46:49<27:28:13,  3.66it/s]
  3%|▎         | 9689/371472 [46:50<27:34:08,  3.65it/s]
  3%|▎         | 9690/371472 [46:50<27:19:34,  3.68it/s]
  3%|▎         | 9691/371472 [46:50<26:59:11,  3.72it/s]
  3%|▎         | 9692/371472 [46:51<27:40:56,  3.63it/s]
  3%|▎         | 9693/371472 [46:51<27:27:30,  3.66it/s]
  3%|▎         | 9694/371472 [46:51<27:27:02,  3.66it/s]
  3%|▎         | 9695/371472 [46:51<27:17:59,  3.68it/s]
  3%|▎         | 9696/371472 [46:52<27:35:15,  3.64it/s]
  3%|▎         | 9697/371472 [46:52<32:06:00,  3.13it/s]
  3%|▎         | 9698/371472 [46:52<30:03:44,  3.34it/s]
  3%|▎         | 9699/371472 [46:53<30:16:46,  3.32it/s]
  3%|▎         | 9700/371472 [46:53<29:10:13,  3.45it/s]
                                                        
{'loss': 5.0909, 'learning_rate': 9.769710616475252e-07, 'epoch': 0.42}

  3%|▎         | 9700/371472 [46:53<29:10:13,  3.45it/s]
  3%|▎         | 9701/371472 [46:53<28:52:02,  3.48it/s]
  3%|▎         | 9702/371472 [46:53<28:06:39,  3.57it/s]
  3%|▎         | 9703/371472 [46:54<27:22:09,  3.67it/s]
  3%|▎         | 9704/371472 [46:54<27:24:17,  3.67it/s]
  3%|▎         | 9705/371472 [46:54<28:41:08,  3.50it/s]
  3%|▎         | 9706/371472 [46:55<28:03:13,  3.58it/s]
  3%|▎         | 9707/371472 [46:55<27:21:07,  3.67it/s]
  3%|▎         | 9708/371472 [46:55<29:42:32,  3.38it/s]
  3%|▎         | 9709/371472 [46:55<28:52:07,  3.48it/s]
  3%|▎         | 9710/371472 [46:56<28:13:52,  3.56it/s]
  3%|▎         | 9711/371472 [46:56<29:27:46,  3.41it/s]
  3%|▎         | 9712/371472 [46:56<28:51:29,  3.48it/s]
  3%|▎         | 9713/371472 [46:57<28:45:30,  3.49it/s]
  3%|▎         | 9714/371472 [46:57<29:21:16,  3.42it/s]
  3%|▎         | 9715/371472 [46:57<29:17:24,  3.43it/s]
  3%|▎         | 9716/371472 [46:57<28:47:59,  3.49it/s]
  3%|▎         | 9717/371472 [46:58<28:43:36,  3.50it/s]
  3%|▎         | 9718/371472 [46:58<28:39:47,  3.51it/s]
  3%|▎         | 9719/371472 [46:58<27:42:31,  3.63it/s]
  3%|▎         | 9720/371472 [46:59<27:18:56,  3.68it/s]
                                                        
{'loss': 5.0281, 'learning_rate': 9.769225796720463e-07, 'epoch': 0.42}

  3%|▎         | 9720/371472 [46:59<27:18:56,  3.68it/s]
  3%|▎         | 9721/371472 [46:59<26:59:31,  3.72it/s]
  3%|▎         | 9722/371472 [46:59<26:31:44,  3.79it/s]
  3%|▎         | 9723/371472 [46:59<26:38:53,  3.77it/s]
  3%|▎         | 9724/371472 [47:00<30:20:21,  3.31it/s]
  3%|▎         | 9725/371472 [47:00<30:27:12,  3.30it/s]
  3%|▎         | 9726/371472 [47:00<33:04:59,  3.04it/s]
  3%|▎         | 9727/371472 [47:01<32:24:48,  3.10it/s]
  3%|▎         | 9728/371472 [47:01<30:36:12,  3.28it/s]
  3%|▎         | 9729/371472 [47:01<30:07:49,  3.33it/s]
  3%|▎         | 9730/371472 [47:02<29:14:26,  3.44it/s]
  3%|▎         | 9731/371472 [47:02<32:36:07,  3.08it/s]
  3%|▎         | 9732/371472 [47:02<31:28:08,  3.19it/s]
  3%|▎         | 9733/371472 [47:02<29:47:43,  3.37it/s]
  3%|▎         | 9734/371472 [47:03<28:49:46,  3.49it/s]
  3%|▎         | 9735/371472 [47:03<29:41:07,  3.38it/s]
  3%|▎         | 9736/371472 [47:03<29:24:03,  3.42it/s]
  3%|▎         | 9737/371472 [47:04<31:24:34,  3.20it/s]
  3%|▎         | 9738/371472 [47:04<31:22:13,  3.20it/s]
  3%|▎         | 9739/371472 [47:04<30:51:48,  3.26it/s]
  3%|▎         | 9740/371472 [47:05<30:02:08,  3.35it/s]
                                                        
{'loss': 4.9283, 'learning_rate': 9.768740976965676e-07, 'epoch': 0.42}

  3%|▎         | 9740/371472 [47:05<30:02:08,  3.35it/s]
  3%|▎         | 9741/371472 [47:05<29:09:44,  3.45it/s]
  3%|▎         | 9742/371472 [47:05<28:58:19,  3.47it/s]
  3%|▎         | 9743/371472 [47:05<28:53:39,  3.48it/s]
  3%|▎         | 9744/371472 [47:06<28:01:26,  3.59it/s]
  3%|▎         | 9745/371472 [47:06<28:53:13,  3.48it/s]
  3%|▎         | 9746/371472 [47:06<27:24:18,  3.67it/s]
  3%|▎         | 9747/371472 [47:07<29:21:05,  3.42it/s]
  3%|▎         | 9748/371472 [47:07<29:01:21,  3.46it/s]
  3%|▎         | 9749/371472 [47:07<28:22:17,  3.54it/s]
  3%|▎         | 9750/371472 [47:07<28:40:30,  3.50it/s]
  3%|▎         | 9751/371472 [47:08<28:37:58,  3.51it/s]
  3%|▎         | 9752/371472 [47:08<28:38:47,  3.51it/s]
  3%|▎         | 9753/371472 [47:08<27:47:21,  3.62it/s]
  3%|▎         | 9754/371472 [47:08<27:26:03,  3.66it/s]
  3%|▎         | 9755/371472 [47:09<26:38:54,  3.77it/s]
  3%|▎         | 9756/371472 [47:09<27:32:28,  3.65it/s]
  3%|▎         | 9757/371472 [47:09<29:10:43,  3.44it/s]
  3%|▎         | 9758/371472 [47:10<28:32:09,  3.52it/s]
  3%|▎         | 9759/371472 [47:10<29:05:24,  3.45it/s]
  3%|▎         | 9760/371472 [47:10<29:05:43,  3.45it/s]
                                                        
{'loss': 4.6899, 'learning_rate': 9.768256157210884e-07, 'epoch': 0.42}

  3%|▎         | 9760/371472 [47:10<29:05:43,  3.45it/s]
  3%|▎         | 9761/371472 [47:11<32:47:44,  3.06it/s]
  3%|▎         | 9762/371472 [47:11<30:26:59,  3.30it/s]
  3%|▎         | 9763/371472 [47:11<29:34:44,  3.40it/s]
  3%|▎         | 9764/371472 [47:11<29:11:58,  3.44it/s]
  3%|▎         | 9765/371472 [47:12<30:33:09,  3.29it/s]
  3%|▎         | 9766/371472 [47:12<29:08:25,  3.45it/s]
  3%|▎         | 9767/371472 [47:12<27:47:56,  3.61it/s]
  3%|▎         | 9768/371472 [47:13<28:33:52,  3.52it/s]
  3%|▎         | 9769/371472 [47:13<31:21:15,  3.20it/s]
  3%|▎         | 9770/371472 [47:13<29:54:50,  3.36it/s]
  3%|▎         | 9771/371472 [47:14<29:17:08,  3.43it/s]
  3%|▎         | 9772/371472 [47:14<28:16:52,  3.55it/s]
  3%|▎         | 9773/371472 [47:14<28:35:21,  3.51it/s]
  3%|▎         | 9774/371472 [47:14<29:45:18,  3.38it/s]
  3%|▎         | 9775/371472 [47:15<28:57:30,  3.47it/s]
  3%|▎         | 9776/371472 [47:15<28:44:42,  3.50it/s]
  3%|▎         | 9777/371472 [47:15<28:46:55,  3.49it/s]
  3%|▎         | 9778/371472 [47:15<27:22:38,  3.67it/s]
  3%|▎         | 9779/371472 [47:16<27:37:31,  3.64it/s]
  3%|▎         | 9780/371472 [47:16<30:06:02,  3.34it/s]
                                                        
{'loss': 5.1294, 'learning_rate': 9.767771337456097e-07, 'epoch': 0.42}

  3%|▎         | 9780/371472 [47:16<30:06:02,  3.34it/s]
  3%|▎         | 9781/371472 [47:16<28:58:52,  3.47it/s]
  3%|▎         | 9782/371472 [47:17<31:01:28,  3.24it/s]
  3%|▎         | 9783/371472 [47:17<32:29:48,  3.09it/s]
  3%|▎         | 9784/371472 [47:17<32:30:37,  3.09it/s]
  3%|▎         | 9785/371472 [47:18<30:15:54,  3.32it/s]
  3%|▎         | 9786/371472 [47:18<29:01:10,  3.46it/s]
  3%|▎         | 9787/371472 [47:18<29:19:12,  3.43it/s]
  3%|▎         | 9788/371472 [47:18<28:59:15,  3.47it/s]
  3%|▎         | 9789/371472 [47:19<28:00:33,  3.59it/s]
  3%|▎         | 9790/371472 [47:19<28:03:43,  3.58it/s]
  3%|▎         | 9791/371472 [47:19<28:40:11,  3.50it/s]
  3%|▎         | 9792/371472 [47:20<29:45:01,  3.38it/s]
  3%|▎         | 9793/371472 [47:20<31:31:08,  3.19it/s]
  3%|▎         | 9794/371472 [47:20<29:59:47,  3.35it/s]
  3%|▎         | 9795/371472 [47:21<28:25:58,  3.53it/s]
  3%|▎         | 9796/371472 [47:21<27:54:41,  3.60it/s]
  3%|▎         | 9797/371472 [47:21<28:16:44,  3.55it/s]
  3%|▎         | 9798/371472 [47:21<28:26:12,  3.53it/s]
  3%|▎         | 9799/371472 [47:22<28:28:35,  3.53it/s]
  3%|▎         | 9800/371472 [47:22<29:53:54,  3.36it/s]
                                                        
{'loss': 5.0745, 'learning_rate': 9.767286517701308e-07, 'epoch': 0.42}

  3%|▎         | 9800/371472 [47:22<29:53:54,  3.36it/s]
  3%|▎         | 9801/371472 [47:22<29:33:27,  3.40it/s]
  3%|▎         | 9802/371472 [47:22<28:21:47,  3.54it/s]
  3%|▎         | 9803/371472 [47:23<28:02:24,  3.58it/s]
  3%|▎         | 9804/371472 [47:23<29:12:12,  3.44it/s]
  3%|▎         | 9805/371472 [47:23<28:58:23,  3.47it/s]
  3%|▎         | 9806/371472 [47:24<29:00:41,  3.46it/s]
  3%|▎         | 9807/371472 [47:24<29:07:23,  3.45it/s]
  3%|▎         | 9808/371472 [47:24<29:01:11,  3.46it/s]
  3%|▎         | 9809/371472 [47:25<28:25:10,  3.53it/s]
  3%|▎         | 9810/371472 [47:25<27:53:38,  3.60it/s]
  3%|▎         | 9811/371472 [47:25<28:57:39,  3.47it/s]
  3%|▎         | 9812/371472 [47:25<29:44:02,  3.38it/s]
  3%|▎         | 9813/371472 [47:26<28:57:55,  3.47it/s]
  3%|▎         | 9814/371472 [47:26<28:52:46,  3.48it/s]
  3%|▎         | 9815/371472 [47:26<28:28:16,  3.53it/s]
  3%|▎         | 9816/371472 [47:26<27:51:18,  3.61it/s]
  3%|▎         | 9817/371472 [47:27<29:05:41,  3.45it/s]
  3%|▎         | 9818/371472 [47:27<28:01:02,  3.59it/s]
  3%|▎         | 9819/371472 [47:27<27:57:24,  3.59it/s]
  3%|▎         | 9820/371472 [47:28<28:01:43,  3.58it/s]
                                                        
{'loss': 5.1475, 'learning_rate': 9.766801697946519e-07, 'epoch': 0.42}

  3%|▎         | 9820/371472 [47:28<28:01:43,  3.58it/s]
  3%|▎         | 9821/371472 [47:28<28:47:05,  3.49it/s]
  3%|▎         | 9822/371472 [47:28<28:08:13,  3.57it/s]
  3%|▎         | 9823/371472 [47:28<27:51:18,  3.61it/s]
  3%|▎         | 9824/371472 [47:29<28:54:13,  3.48it/s]
  3%|▎         | 9825/371472 [47:29<28:01:21,  3.58it/s]
  3%|▎         | 9826/371472 [47:29<30:58:56,  3.24it/s]
  3%|▎         | 9827/371472 [47:30<30:41:34,  3.27it/s]
  3%|▎         | 9828/371472 [47:30<30:33:47,  3.29it/s]
  3%|▎         | 9829/371472 [47:30<30:27:04,  3.30it/s]
  3%|▎         | 9830/371472 [47:31<29:06:18,  3.45it/s]
  3%|▎         | 9831/371472 [47:31<28:36:16,  3.51it/s]
  3%|▎         | 9832/371472 [47:31<28:46:07,  3.49it/s]
  3%|▎         | 9833/371472 [47:31<28:49:59,  3.48it/s]
  3%|▎         | 9834/371472 [47:32<28:00:19,  3.59it/s]
  3%|▎         | 9835/371472 [47:32<27:57:51,  3.59it/s]
  3%|▎         | 9836/371472 [47:32<28:48:21,  3.49it/s]
  3%|▎         | 9837/371472 [47:33<28:08:51,  3.57it/s]
  3%|▎         | 9838/371472 [47:33<27:37:34,  3.64it/s]
  3%|▎         | 9839/371472 [47:33<27:37:52,  3.64it/s]
  3%|▎         | 9840/371472 [47:33<28:25:33,  3.53it/s]
                                                        
{'loss': 4.9102, 'learning_rate': 9.76631687819173e-07, 'epoch': 0.42}

  3%|▎         | 9840/371472 [47:33<28:25:33,  3.53it/s]
  3%|▎         | 9841/371472 [47:34<28:54:37,  3.47it/s]
  3%|▎         | 9842/371472 [47:34<28:01:52,  3.58it/s]
  3%|▎         | 9843/371472 [47:34<31:02:14,  3.24it/s]
  3%|▎         | 9844/371472 [47:35<30:13:50,  3.32it/s]
  3%|▎         | 9845/371472 [47:35<28:43:26,  3.50it/s]
  3%|▎         | 9846/371472 [47:35<30:24:24,  3.30it/s]
  3%|▎         | 9847/371472 [47:35<29:35:43,  3.39it/s]
  3%|▎         | 9848/371472 [47:36<29:20:08,  3.42it/s]
  3%|▎         | 9849/371472 [47:36<29:23:41,  3.42it/s]
  3%|▎         | 9850/371472 [47:36<28:40:26,  3.50it/s]
  3%|▎         | 9851/371472 [47:37<28:26:40,  3.53it/s]
  3%|▎         | 9852/371472 [47:37<28:58:38,  3.47it/s]
  3%|▎         | 9853/371472 [47:37<28:10:47,  3.56it/s]
  3%|▎         | 9854/371472 [47:37<27:59:18,  3.59it/s]
  3%|▎         | 9855/371472 [47:38<28:10:21,  3.57it/s]
  3%|▎         | 9856/371472 [47:38<28:02:06,  3.58it/s]
  3%|▎         | 9857/371472 [47:38<28:09:46,  3.57it/s]
  3%|▎         | 9858/371472 [47:39<27:19:14,  3.68it/s]
  3%|▎         | 9859/371472 [47:39<27:21:23,  3.67it/s]
  3%|▎         | 9860/371472 [47:39<27:19:09,  3.68it/s]
                                                        
{'loss': 4.8146, 'learning_rate': 9.76583205843694e-07, 'epoch': 0.42}

  3%|▎         | 9860/371472 [47:39<27:19:09,  3.68it/s]
  3%|▎         | 9861/371472 [47:39<27:17:55,  3.68it/s]
  3%|▎         | 9862/371472 [47:40<28:04:34,  3.58it/s]
  3%|▎         | 9863/371472 [47:40<27:51:06,  3.61it/s]
  3%|▎         | 9864/371472 [47:40<27:32:57,  3.65it/s]
  3%|▎         | 9865/371472 [47:40<27:20:24,  3.67it/s]
  3%|▎         | 9866/371472 [47:41<27:51:49,  3.60it/s]
  3%|▎         | 9867/371472 [47:41<27:18:11,  3.68it/s]
  3%|▎         | 9868/371472 [47:41<27:05:15,  3.71it/s]
  3%|▎         | 9869/371472 [47:42<28:17:22,  3.55it/s]
  3%|▎         | 9870/371472 [47:42<28:19:53,  3.55it/s]
  3%|▎         | 9871/371472 [47:42<28:05:38,  3.58it/s]
  3%|▎         | 9872/371472 [47:42<27:57:13,  3.59it/s]
  3%|▎         | 9873/371472 [47:43<27:34:57,  3.64it/s]
  3%|▎         | 9874/371472 [47:43<27:04:57,  3.71it/s]
  3%|▎         | 9875/371472 [47:43<27:54:59,  3.60it/s]
  3%|▎         | 9876/371472 [47:43<27:53:39,  3.60it/s]
  3%|▎         | 9877/371472 [47:44<28:53:00,  3.48it/s]
  3%|▎         | 9878/371472 [47:44<29:17:27,  3.43it/s]
  3%|▎         | 9879/371472 [47:44<29:46:48,  3.37it/s]
  3%|▎         | 9880/371472 [47:45<29:31:00,  3.40it/s]
                                                        
{'loss': 4.8416, 'learning_rate': 9.765347238682153e-07, 'epoch': 0.43}

  3%|▎         | 9880/371472 [47:45<29:31:00,  3.40it/s]
  3%|▎         | 9881/371472 [47:45<29:06:50,  3.45it/s]
  3%|▎         | 9882/371472 [47:45<30:57:34,  3.24it/s]
  3%|▎         | 9883/371472 [47:46<30:14:21,  3.32it/s]
  3%|▎         | 9884/371472 [47:46<30:12:33,  3.32it/s]
  3%|▎         | 9885/371472 [47:46<31:54:35,  3.15it/s]
  3%|▎         | 9886/371472 [47:47<30:01:12,  3.35it/s]
  3%|▎         | 9887/371472 [47:47<29:51:59,  3.36it/s]
  3%|▎         | 9888/371472 [47:47<29:16:46,  3.43it/s]
  3%|▎         | 9889/371472 [47:47<28:33:33,  3.52it/s]
  3%|▎         | 9890/371472 [47:48<29:19:25,  3.43it/s]
  3%|▎         | 9891/371472 [47:48<28:42:04,  3.50it/s]
  3%|▎         | 9892/371472 [47:48<28:56:14,  3.47it/s]
  3%|▎         | 9893/371472 [47:49<28:09:10,  3.57it/s]
  3%|▎         | 9894/371472 [47:49<29:28:06,  3.41it/s]
  3%|▎         | 9895/371472 [47:49<28:28:57,  3.53it/s]
  3%|▎         | 9896/371472 [47:49<29:30:26,  3.40it/s]
  3%|▎         | 9897/371472 [47:50<29:05:58,  3.45it/s]
  3%|▎         | 9898/371472 [47:50<28:15:56,  3.55it/s]
  3%|▎         | 9899/371472 [47:50<27:43:15,  3.62it/s]
  3%|▎         | 9900/371472 [47:50<27:51:50,  3.60it/s]
                                                        
{'loss': 4.9126, 'learning_rate': 9.764862418927361e-07, 'epoch': 0.43}

  3%|▎         | 9900/371472 [47:50<27:51:50,  3.60it/s]
  3%|▎         | 9901/371472 [47:51<29:25:09,  3.41it/s]
  3%|▎         | 9902/371472 [47:51<28:12:40,  3.56it/s]
  3%|▎         | 9903/371472 [47:51<27:46:27,  3.62it/s]
  3%|▎         | 9904/371472 [47:52<28:09:25,  3.57it/s]
  3%|▎         | 9905/371472 [47:52<29:35:36,  3.39it/s]
  3%|▎         | 9906/371472 [47:52<28:53:20,  3.48it/s]
  3%|▎         | 9907/371472 [47:53<29:33:15,  3.40it/s]
  3%|▎         | 9908/371472 [47:53<31:38:46,  3.17it/s]
  3%|▎         | 9909/371472 [47:53<32:00:38,  3.14it/s]
  3%|▎         | 9910/371472 [47:54<31:57:02,  3.14it/s]
  3%|▎         | 9911/371472 [47:54<31:33:37,  3.18it/s]
  3%|▎         | 9912/371472 [47:54<31:54:24,  3.15it/s]
  3%|▎         | 9913/371472 [47:54<30:15:50,  3.32it/s]
  3%|▎         | 9914/371472 [47:55<28:50:56,  3.48it/s]
  3%|▎         | 9915/371472 [47:55<31:15:32,  3.21it/s]
  3%|▎         | 9916/371472 [47:55<34:25:50,  2.92it/s]
  3%|▎         | 9917/371472 [47:56<33:01:34,  3.04it/s]
  3%|▎         | 9918/371472 [47:56<31:08:29,  3.23it/s]
  3%|▎         | 9919/371472 [47:56<31:09:57,  3.22it/s]
  3%|▎         | 9920/371472 [47:57<29:42:29,  3.38it/s]
                                                        
{'loss': 4.7237, 'learning_rate': 9.764377599172574e-07, 'epoch': 0.43}

  3%|▎         | 9920/371472 [47:57<29:42:29,  3.38it/s]
  3%|▎         | 9921/371472 [47:57<28:57:11,  3.47it/s]
  3%|▎         | 9922/371472 [47:57<28:35:30,  3.51it/s]
  3%|▎         | 9923/371472 [47:57<28:17:28,  3.55it/s]
  3%|▎         | 9924/371472 [47:58<28:10:32,  3.56it/s]
  3%|▎         | 9925/371472 [47:58<27:38:50,  3.63it/s]
  3%|▎         | 9926/371472 [47:58<28:47:57,  3.49it/s]
  3%|▎         | 9927/371472 [47:59<28:01:07,  3.58it/s]
  3%|▎         | 9928/371472 [47:59<28:08:55,  3.57it/s]
  3%|▎         | 9929/371472 [47:59<28:26:15,  3.53it/s]
  3%|▎         | 9930/371472 [47:59<28:29:04,  3.53it/s]
  3%|▎         | 9931/371472 [48:00<32:03:55,  3.13it/s]
  3%|▎         | 9932/371472 [48:00<33:21:42,  3.01it/s]
  3%|▎         | 9933/371472 [48:00<31:46:34,  3.16it/s]
  3%|▎         | 9934/371472 [48:01<29:42:25,  3.38it/s]
  3%|▎         | 9935/371472 [48:01<29:42:53,  3.38it/s]
  3%|▎         | 9936/371472 [48:01<29:42:52,  3.38it/s]
  3%|▎         | 9937/371472 [48:02<29:46:58,  3.37it/s]
  3%|▎         | 9938/371472 [48:02<29:47:52,  3.37it/s]
  3%|▎         | 9939/371472 [48:02<30:02:54,  3.34it/s]
  3%|▎         | 9940/371472 [48:03<30:58:29,  3.24it/s]
                                                        
{'loss': 4.93, 'learning_rate': 9.763892779417783e-07, 'epoch': 0.43}

  3%|▎         | 9940/371472 [48:03<30:58:29,  3.24it/s]
  3%|▎         | 9941/371472 [48:03<30:08:00,  3.33it/s]
  3%|▎         | 9942/371472 [48:03<29:01:34,  3.46it/s]
  3%|▎         | 9943/371472 [48:03<30:15:37,  3.32it/s]
  3%|▎         | 9944/371472 [48:04<30:16:34,  3.32it/s]
  3%|▎         | 9945/371472 [48:04<29:18:23,  3.43it/s]
  3%|▎         | 9946/371472 [48:04<30:12:00,  3.33it/s]
  3%|▎         | 9947/371472 [48:05<28:57:34,  3.47it/s]
  3%|▎         | 9948/371472 [48:05<29:10:56,  3.44it/s]
  3%|▎         | 9949/371472 [48:05<29:25:37,  3.41it/s]
  3%|▎         | 9950/371472 [48:05<31:01:44,  3.24it/s]
  3%|▎         | 9951/371472 [48:06<29:28:47,  3.41it/s]
  3%|▎         | 9952/371472 [48:06<28:27:38,  3.53it/s]
  3%|▎         | 9953/371472 [48:06<29:00:09,  3.46it/s]
  3%|▎         | 9954/371472 [48:07<29:03:41,  3.46it/s]
  3%|▎         | 9955/371472 [48:07<28:14:40,  3.56it/s]
  3%|▎         | 9956/371472 [48:07<29:30:05,  3.40it/s]
  3%|▎         | 9957/371472 [48:07<29:23:05,  3.42it/s]
  3%|▎         | 9958/371472 [48:08<27:49:11,  3.61it/s]
  3%|▎         | 9959/371472 [48:08<27:06:56,  3.70it/s]
  3%|▎         | 9960/371472 [48:08<26:59:42,  3.72it/s]
                                                        
{'loss': 4.8873, 'learning_rate': 9.763407959662996e-07, 'epoch': 0.43}

  3%|▎         | 9960/371472 [48:08<26:59:42,  3.72it/s]
  3%|▎         | 9961/371472 [48:09<27:07:13,  3.70it/s]
  3%|▎         | 9962/371472 [48:09<27:23:34,  3.67it/s]
  3%|▎         | 9963/371472 [48:09<26:43:31,  3.76it/s]
  3%|▎         | 9964/371472 [48:09<28:23:09,  3.54it/s]
  3%|▎         | 9965/371472 [48:10<27:51:51,  3.60it/s]
  3%|▎         | 9966/371472 [48:10<27:19:43,  3.67it/s]
  3%|▎         | 9967/371472 [48:10<27:22:21,  3.67it/s]
  3%|▎         | 9968/371472 [48:11<29:56:25,  3.35it/s]
  3%|▎         | 9969/371472 [48:11<29:42:16,  3.38it/s]
  3%|▎         | 9970/371472 [48:11<28:25:53,  3.53it/s]
  3%|▎         | 9971/371472 [48:11<27:59:49,  3.59it/s]
  3%|▎         | 9972/371472 [48:12<28:10:02,  3.57it/s]
  3%|▎         | 9973/371472 [48:12<27:51:55,  3.60it/s]
  3%|▎         | 9974/371472 [48:12<28:48:43,  3.49it/s]
  3%|▎         | 9975/371472 [48:13<29:36:02,  3.39it/s]
  3%|▎         | 9976/371472 [48:13<28:25:57,  3.53it/s]
  3%|▎         | 9977/371472 [48:13<29:14:23,  3.43it/s]
  3%|▎         | 9978/371472 [48:13<28:49:55,  3.48it/s]
  3%|▎         | 9979/371472 [48:14<29:35:37,  3.39it/s]
  3%|▎         | 9980/371472 [48:14<29:42:50,  3.38it/s]
                                                        
{'loss': 4.7226, 'learning_rate': 9.762923139908206e-07, 'epoch': 0.43}

  3%|▎         | 9980/371472 [48:14<29:42:50,  3.38it/s]
  3%|▎         | 9981/371472 [48:14<30:57:23,  3.24it/s]
  3%|▎         | 9982/371472 [48:15<30:10:30,  3.33it/s]
  3%|▎         | 9983/371472 [48:15<30:44:58,  3.27it/s]
  3%|▎         | 9984/371472 [48:15<29:24:09,  3.42it/s]
  3%|▎         | 9985/371472 [48:16<32:32:26,  3.09it/s]
  3%|▎         | 9986/371472 [48:16<31:06:41,  3.23it/s]
  3%|▎         | 9987/371472 [48:16<29:43:02,  3.38it/s]
  3%|▎         | 9988/371472 [48:16<29:43:57,  3.38it/s]
  3%|▎         | 9989/371472 [48:17<31:52:12,  3.15it/s]
  3%|▎         | 9990/371472 [48:17<31:00:47,  3.24it/s]
  3%|▎         | 9991/371472 [48:17<29:54:19,  3.36it/s]
  3%|▎         | 9992/371472 [48:18<31:45:56,  3.16it/s]
  3%|▎         | 9993/371472 [48:18<31:05:05,  3.23it/s]
  3%|▎         | 9994/371472 [48:18<30:57:03,  3.24it/s]
  3%|▎         | 9995/371472 [48:19<29:25:06,  3.41it/s]
  3%|▎         | 9996/371472 [48:19<30:31:05,  3.29it/s]
  3%|▎         | 9997/371472 [48:19<28:58:14,  3.47it/s]
  3%|▎         | 9998/371472 [48:19<29:33:57,  3.40it/s]
  3%|▎         | 9999/371472 [48:20<29:54:31,  3.36it/s]
  3%|▎         | 10000/371472 [48:20<29:28:45,  3.41it/s]
                                                         
{'loss': 5.0115, 'learning_rate': 9.762438320153417e-07, 'epoch': 0.43}

  3%|▎         | 10000/371472 [48:20<29:28:45,  3.41it/s]
  3%|▎         | 10001/371472 [48:20<28:49:11,  3.48it/s]
  3%|▎         | 10002/371472 [48:21<30:23:10,  3.30it/s]
  3%|▎         | 10003/371472 [48:21<29:43:09,  3.38it/s]
  3%|▎         | 10004/371472 [48:21<29:50:22,  3.36it/s]
  3%|▎         | 10005/371472 [48:21<29:18:24,  3.43it/s]
  3%|▎         | 10006/371472 [48:22<28:41:38,  3.50it/s]
  3%|▎         | 10007/371472 [48:22<27:47:37,  3.61it/s]
  3%|▎         | 10008/371472 [48:22<29:02:59,  3.46it/s]
  3%|▎         | 10009/371472 [48:23<28:05:37,  3.57it/s]
  3%|▎         | 10010/371472 [48:23<29:15:28,  3.43it/s]
  3%|▎         | 10011/371472 [48:23<28:56:52,  3.47it/s]
  3%|▎         | 10012/371472 [48:23<28:59:48,  3.46it/s]
  3%|▎         | 10013/371472 [48:24<28:00:20,  3.59it/s]
  3%|▎         | 10014/371472 [48:24<27:33:28,  3.64it/s]
  3%|▎         | 10015/371472 [48:24<28:08:25,  3.57it/s]
  3%|▎         | 10016/371472 [48:25<30:18:14,  3.31it/s]
  3%|▎         | 10017/371472 [48:25<28:45:43,  3.49it/s]
  3%|▎         | 10018/371472 [48:25<27:40:00,  3.63it/s]
  3%|▎         | 10019/371472 [48:25<27:33:35,  3.64it/s]
  3%|▎         | 10020/371472 [48:26<26:42:04,  3.76it/s]
                                                         
{'loss': 4.9169, 'learning_rate': 9.76195350039863e-07, 'epoch': 0.43}

  3%|▎         | 10020/371472 [48:26<26:42:04,  3.76it/s]
  3%|▎         | 10021/371472 [48:26<30:36:53,  3.28it/s]
  3%|▎         | 10022/371472 [48:26<28:47:04,  3.49it/s]
  3%|▎         | 10023/371472 [48:27<28:12:50,  3.56it/s]
  3%|▎         | 10024/371472 [48:27<27:01:04,  3.72it/s]
  3%|▎         | 10025/371472 [48:27<30:30:56,  3.29it/s]
  3%|▎         | 10026/371472 [48:27<29:58:15,  3.35it/s]
  3%|▎         | 10027/371472 [48:28<28:30:39,  3.52it/s]
  3%|▎         | 10028/371472 [48:28<29:47:11,  3.37it/s]
  3%|▎         | 10029/371472 [48:28<29:46:45,  3.37it/s]
  3%|▎         | 10030/371472 [48:29<29:33:27,  3.40it/s]
  3%|▎         | 10031/371472 [48:29<28:52:17,  3.48it/s]
  3%|▎         | 10032/371472 [48:29<28:11:28,  3.56it/s]
  3%|▎         | 10033/371472 [48:29<29:05:19,  3.45it/s]
  3%|▎         | 10034/371472 [48:30<28:36:05,  3.51it/s]
  3%|▎         | 10035/371472 [48:30<30:22:21,  3.31it/s]
  3%|▎         | 10036/371472 [48:30<32:09:41,  3.12it/s]
  3%|▎         | 10037/371472 [48:31<30:46:01,  3.26it/s]
  3%|▎         | 10038/371472 [48:31<30:06:49,  3.33it/s]
  3%|▎         | 10039/371472 [48:31<30:51:23,  3.25it/s]
  3%|▎         | 10040/371472 [48:32<30:45:22,  3.26it/s]
                                                         
{'loss': 4.9183, 'learning_rate': 9.76146868064384e-07, 'epoch': 0.43}

  3%|▎         | 10040/371472 [48:32<30:45:22,  3.26it/s]
  3%|▎         | 10041/371472 [48:32<30:18:13,  3.31it/s]
  3%|▎         | 10042/371472 [48:32<30:08:19,  3.33it/s]
  3%|▎         | 10043/371472 [48:33<28:48:07,  3.49it/s]
  3%|▎         | 10044/371472 [48:33<28:39:31,  3.50it/s]
  3%|▎         | 10045/371472 [48:33<28:41:40,  3.50it/s]
  3%|▎         | 10046/371472 [48:33<30:40:13,  3.27it/s]
  3%|▎         | 10047/371472 [48:34<29:18:10,  3.43it/s]
  3%|▎         | 10048/371472 [48:34<28:34:33,  3.51it/s]
  3%|▎         | 10049/371472 [48:34<28:50:09,  3.48it/s]
  3%|▎         | 10050/371472 [48:35<28:37:39,  3.51it/s]
  3%|▎         | 10051/371472 [48:35<28:35:32,  3.51it/s]
  3%|▎         | 10052/371472 [48:35<29:50:55,  3.36it/s]
  3%|▎         | 10053/371472 [48:35<28:37:27,  3.51it/s]
  3%|▎         | 10054/371472 [48:36<27:52:10,  3.60it/s]
  3%|▎         | 10055/371472 [48:36<27:31:33,  3.65it/s]
  3%|▎         | 10056/371472 [48:36<27:42:32,  3.62it/s]
  3%|▎         | 10057/371472 [48:36<27:02:51,  3.71it/s]
  3%|▎         | 10058/371472 [48:37<28:25:14,  3.53it/s]
  3%|▎         | 10059/371472 [48:37<30:35:24,  3.28it/s]
  3%|▎         | 10060/371472 [48:37<29:02:04,  3.46it/s]
                                                         
{'loss': 4.8978, 'learning_rate': 9.760983860889051e-07, 'epoch': 0.43}

  3%|▎         | 10060/371472 [48:37<29:02:04,  3.46it/s]
  3%|▎         | 10061/371472 [48:38<28:24:15,  3.53it/s]
  3%|▎         | 10062/371472 [48:38<27:40:44,  3.63it/s]
  3%|▎         | 10063/371472 [48:38<26:54:57,  3.73it/s]
  3%|▎         | 10064/371472 [48:38<26:53:08,  3.73it/s]
  3%|▎         | 10065/371472 [48:39<26:55:49,  3.73it/s]
  3%|▎         | 10066/371472 [48:39<26:22:10,  3.81it/s]
  3%|▎         | 10067/371472 [48:39<26:46:08,  3.75it/s]
  3%|▎         | 10068/371472 [48:40<27:51:01,  3.60it/s]
  3%|▎         | 10069/371472 [48:40<29:16:11,  3.43it/s]
  3%|▎         | 10070/371472 [48:40<29:31:51,  3.40it/s]
  3%|▎         | 10071/371472 [48:40<28:42:55,  3.50it/s]
  3%|▎         | 10072/371472 [48:41<27:29:08,  3.65it/s]
  3%|▎         | 10073/371472 [48:41<31:10:18,  3.22it/s]
  3%|▎         | 10074/371472 [48:42<36:22:58,  2.76it/s]
  3%|▎         | 10075/371472 [48:42<34:16:13,  2.93it/s]
  3%|▎         | 10076/371472 [48:42<33:56:17,  2.96it/s]
  3%|▎         | 10077/371472 [48:43<34:52:45,  2.88it/s]
  3%|▎         | 10078/371472 [48:43<32:49:05,  3.06it/s]
  3%|▎         | 10079/371472 [48:43<32:04:26,  3.13it/s]
  3%|▎         | 10080/371472 [48:43<32:23:33,  3.10it/s]
                                                         
{'loss': 4.6671, 'learning_rate': 9.760499041134262e-07, 'epoch': 0.43}

  3%|▎         | 10080/371472 [48:43<32:23:33,  3.10it/s]
  3%|▎         | 10081/371472 [48:44<30:34:32,  3.28it/s]
  3%|▎         | 10082/371472 [48:44<30:18:01,  3.31it/s]
  3%|▎         | 10083/371472 [48:44<30:34:11,  3.28it/s]
  3%|▎         | 10084/371472 [48:45<30:02:45,  3.34it/s]
  3%|▎         | 10085/371472 [48:45<29:42:18,  3.38it/s]
  3%|▎         | 10086/371472 [48:45<29:16:01,  3.43it/s]
  3%|▎         | 10087/371472 [48:45<28:15:48,  3.55it/s]
  3%|▎         | 10088/371472 [48:46<27:06:34,  3.70it/s]
  3%|▎         | 10089/371472 [48:46<26:36:57,  3.77it/s]
  3%|▎         | 10090/371472 [48:46<26:44:52,  3.75it/s]
  3%|▎         | 10091/371472 [48:46<27:42:03,  3.62it/s]
  3%|▎         | 10092/371472 [48:47<27:50:10,  3.61it/s]
  3%|▎         | 10093/371472 [48:47<27:44:22,  3.62it/s]
  3%|▎         | 10094/371472 [48:47<28:48:01,  3.49it/s]
  3%|▎         | 10095/371472 [48:48<29:00:39,  3.46it/s]
  3%|▎         | 10096/371472 [48:48<28:41:54,  3.50it/s]
  3%|▎         | 10097/371472 [48:48<28:50:32,  3.48it/s]
  3%|▎         | 10098/371472 [48:48<28:08:51,  3.57it/s]
  3%|▎         | 10099/371472 [48:49<28:12:59,  3.56it/s]
  3%|▎         | 10100/371472 [48:49<31:24:50,  3.20it/s]
                                                         
{'loss': 4.9651, 'learning_rate': 9.760014221379473e-07, 'epoch': 0.44}

  3%|▎         | 10100/371472 [48:49<31:24:50,  3.20it/s]
  3%|▎         | 10101/371472 [48:49<30:26:00,  3.30it/s]
  3%|▎         | 10102/371472 [48:50<29:15:07,  3.43it/s]
  3%|▎         | 10103/371472 [48:50<34:17:08,  2.93it/s]
  3%|▎         | 10104/371472 [48:50<32:43:17,  3.07it/s]
  3%|▎         | 10105/371472 [48:51<31:55:59,  3.14it/s]
  3%|▎         | 10106/371472 [48:51<30:03:44,  3.34it/s]
  3%|▎         | 10107/371472 [48:51<30:06:55,  3.33it/s]
  3%|▎         | 10108/371472 [48:52<29:55:08,  3.36it/s]
  3%|▎         | 10109/371472 [48:52<29:12:53,  3.44it/s]
  3%|▎         | 10110/371472 [48:52<28:24:21,  3.53it/s]
  3%|▎         | 10111/371472 [48:52<30:10:54,  3.33it/s]
  3%|▎         | 10112/371472 [48:53<31:44:16,  3.16it/s]
  3%|▎         | 10113/371472 [48:53<30:53:13,  3.25it/s]
  3%|▎         | 10114/371472 [48:53<30:12:43,  3.32it/s]
  3%|▎         | 10115/371472 [48:54<30:53:52,  3.25it/s]
  3%|▎         | 10116/371472 [48:54<29:13:41,  3.43it/s]
  3%|▎         | 10117/371472 [48:54<29:06:04,  3.45it/s]
  3%|▎         | 10118/371472 [48:55<29:25:47,  3.41it/s]
  3%|▎         | 10119/371472 [48:55<28:44:58,  3.49it/s]
  3%|▎         | 10120/371472 [48:55<27:53:22,  3.60it/s]
                                                         
{'loss': 4.8849, 'learning_rate': 9.759529401624686e-07, 'epoch': 0.44}

  3%|▎         | 10120/371472 [48:55<27:53:22,  3.60it/s]
  3%|▎         | 10121/371472 [48:55<27:14:59,  3.68it/s]
  3%|▎         | 10122/371472 [48:56<27:08:12,  3.70it/s]
  3%|▎         | 10123/371472 [48:56<28:05:55,  3.57it/s]
  3%|▎         | 10124/371472 [48:56<28:34:55,  3.51it/s]
  3%|▎         | 10125/371472 [48:57<28:55:28,  3.47it/s]
  3%|▎         | 10126/371472 [48:57<29:35:24,  3.39it/s]
  3%|▎         | 10127/371472 [48:57<28:51:54,  3.48it/s]
  3%|▎         | 10128/371472 [48:57<31:59:09,  3.14it/s]
  3%|▎         | 10129/371472 [48:58<30:07:01,  3.33it/s]
  3%|▎         | 10130/371472 [48:58<30:19:00,  3.31it/s]
  3%|▎         | 10131/371472 [48:58<28:57:05,  3.47it/s]
  3%|▎         | 10132/371472 [48:59<28:42:03,  3.50it/s]
  3%|▎         | 10133/371472 [48:59<30:02:08,  3.34it/s]
  3%|▎         | 10134/371472 [48:59<31:05:03,  3.23it/s]
  3%|▎         | 10135/371472 [49:00<30:13:47,  3.32it/s]
  3%|▎         | 10136/371472 [49:00<29:00:03,  3.46it/s]
  3%|▎         | 10137/371472 [49:00<33:45:38,  2.97it/s]
  3%|▎         | 10138/371472 [49:01<34:53:27,  2.88it/s]
  3%|▎         | 10139/371472 [49:01<33:33:13,  2.99it/s]
  3%|▎         | 10140/371472 [49:01<32:36:58,  3.08it/s]
                                                         
{'loss': 4.7284, 'learning_rate': 9.759044581869894e-07, 'epoch': 0.44}

  3%|▎         | 10140/371472 [49:01<32:36:58,  3.08it/s]
  3%|▎         | 10141/371472 [49:01<30:54:35,  3.25it/s]
  3%|▎         | 10142/371472 [49:02<29:41:39,  3.38it/s]
  3%|▎         | 10143/371472 [49:02<29:05:07,  3.45it/s]
  3%|▎         | 10144/371472 [49:02<31:03:41,  3.23it/s]
  3%|▎         | 10145/371472 [49:03<30:20:25,  3.31it/s]
  3%|▎         | 10146/371472 [49:03<28:50:23,  3.48it/s]
  3%|▎         | 10147/371472 [49:03<28:36:56,  3.51it/s]
  3%|▎         | 10148/371472 [49:03<27:43:39,  3.62it/s]
  3%|▎         | 10149/371472 [49:04<26:53:25,  3.73it/s]
  3%|▎         | 10150/371472 [49:04<27:04:33,  3.71it/s]
  3%|▎         | 10151/371472 [49:04<28:08:40,  3.57it/s]
  3%|▎         | 10152/371472 [49:05<28:19:28,  3.54it/s]
  3%|▎         | 10153/371472 [49:05<28:52:43,  3.48it/s]
  3%|▎         | 10154/371472 [49:05<29:21:46,  3.42it/s]
  3%|▎         | 10155/371472 [49:05<29:01:46,  3.46it/s]
  3%|▎         | 10156/371472 [49:06<29:10:46,  3.44it/s]
  3%|▎         | 10157/371472 [49:06<29:00:18,  3.46it/s]
  3%|▎         | 10158/371472 [49:06<30:27:37,  3.29it/s]
  3%|▎         | 10159/371472 [49:07<29:49:59,  3.36it/s]
  3%|▎         | 10160/371472 [49:07<31:36:29,  3.18it/s]
                                                         
{'loss': 4.8962, 'learning_rate': 9.758559762115107e-07, 'epoch': 0.44}

  3%|▎         | 10160/371472 [49:07<31:36:29,  3.18it/s]
  3%|▎         | 10161/371472 [49:07<30:05:39,  3.33it/s]
  3%|▎         | 10162/371472 [49:08<29:10:12,  3.44it/s]
  3%|▎         | 10163/371472 [49:08<27:49:58,  3.61it/s]
  3%|▎         | 10164/371472 [49:08<27:50:53,  3.60it/s]
  3%|▎         | 10165/371472 [49:08<27:08:47,  3.70it/s]
  3%|▎         | 10166/371472 [49:09<28:20:50,  3.54it/s]
  3%|▎         | 10167/371472 [49:09<27:52:23,  3.60it/s]
  3%|▎         | 10168/371472 [49:09<28:40:58,  3.50it/s]
  3%|▎         | 10169/371472 [49:09<28:52:59,  3.47it/s]
  3%|▎         | 10170/371472 [49:10<29:17:03,  3.43it/s]
  3%|▎         | 10171/371472 [49:10<27:43:59,  3.62it/s]
  3%|▎         | 10172/371472 [49:10<31:26:59,  3.19it/s]
  3%|▎         | 10173/371472 [49:11<29:22:11,  3.42it/s]
  3%|▎         | 10174/371472 [49:11<28:15:03,  3.55it/s]
  3%|▎         | 10175/371472 [49:11<27:43:01,  3.62it/s]
  3%|▎         | 10176/371472 [49:11<27:20:50,  3.67it/s]
  3%|▎         | 10177/371472 [49:12<28:14:24,  3.55it/s]
  3%|▎         | 10178/371472 [49:12<28:35:00,  3.51it/s]
  3%|▎         | 10179/371472 [49:12<27:55:45,  3.59it/s]
  3%|▎         | 10180/371472 [49:13<27:59:57,  3.58it/s]
                                                         
{'loss': 5.2482, 'learning_rate': 9.758074942360318e-07, 'epoch': 0.44}

  3%|▎         | 10180/371472 [49:13<27:59:57,  3.58it/s]
  3%|▎         | 10181/371472 [49:13<27:12:26,  3.69it/s]
  3%|▎         | 10182/371472 [49:13<28:06:31,  3.57it/s]
  3%|▎         | 10183/371472 [49:13<28:00:00,  3.58it/s]
  3%|▎         | 10184/371472 [49:14<28:50:51,  3.48it/s]
  3%|▎         | 10185/371472 [49:14<28:00:58,  3.58it/s]
  3%|▎         | 10186/371472 [49:14<28:08:44,  3.57it/s]
  3%|▎         | 10187/371472 [49:15<28:55:15,  3.47it/s]
  3%|▎         | 10188/371472 [49:15<28:25:33,  3.53it/s]
  3%|▎         | 10189/371472 [49:15<27:53:17,  3.60it/s]
  3%|▎         | 10190/371472 [49:15<30:07:37,  3.33it/s]
  3%|▎         | 10191/371472 [49:16<29:36:26,  3.39it/s]
  3%|▎         | 10192/371472 [49:16<28:06:53,  3.57it/s]
  3%|▎         | 10193/371472 [49:16<27:55:54,  3.59it/s]
  3%|▎         | 10194/371472 [49:17<29:09:51,  3.44it/s]
  3%|▎         | 10195/371472 [49:17<29:55:03,  3.35it/s]
  3%|▎         | 10196/371472 [49:17<28:29:16,  3.52it/s]
  3%|▎         | 10197/371472 [49:17<28:08:58,  3.57it/s]
  3%|▎         | 10198/371472 [49:18<27:38:23,  3.63it/s]
  3%|▎         | 10199/371472 [49:18<27:34:28,  3.64it/s]
  3%|▎         | 10200/371472 [49:18<28:01:18,  3.58it/s]
                                                         
{'loss': 4.751, 'learning_rate': 9.757590122605529e-07, 'epoch': 0.44}

  3%|▎         | 10200/371472 [49:18<28:01:18,  3.58it/s]
  3%|▎         | 10201/371472 [49:19<28:08:25,  3.57it/s]
  3%|▎         | 10202/371472 [49:19<28:18:20,  3.55it/s]
  3%|▎         | 10203/371472 [49:19<28:31:58,  3.52it/s]
  3%|▎         | 10204/371472 [49:19<27:57:42,  3.59it/s]
  3%|▎         | 10205/371472 [49:20<28:57:15,  3.47it/s]
  3%|▎         | 10206/371472 [49:20<28:20:03,  3.54it/s]
  3%|▎         | 10207/371472 [49:20<27:53:06,  3.60it/s]
  3%|▎         | 10208/371472 [49:21<30:23:18,  3.30it/s]
  3%|▎         | 10209/371472 [49:21<29:26:52,  3.41it/s]
  3%|▎         | 10210/371472 [49:21<28:30:29,  3.52it/s]
  3%|▎         | 10211/371472 [49:21<27:37:41,  3.63it/s]
  3%|▎         | 10212/371472 [49:22<27:05:52,  3.70it/s]
  3%|▎         | 10213/371472 [49:22<28:02:49,  3.58it/s]
  3%|▎         | 10214/371472 [49:22<27:07:57,  3.70it/s]
  3%|▎         | 10215/371472 [49:23<30:20:30,  3.31it/s]
  3%|▎         | 10216/371472 [49:23<30:02:18,  3.34it/s]
  3%|▎         | 10217/371472 [49:23<29:48:00,  3.37it/s]
  3%|▎         | 10218/371472 [49:23<30:55:13,  3.25it/s]
  3%|▎         | 10219/371472 [49:24<29:32:27,  3.40it/s]
  3%|▎         | 10220/371472 [49:24<30:15:52,  3.32it/s]
                                                         
{'loss': 4.873, 'learning_rate': 9.75710530285074e-07, 'epoch': 0.44}

  3%|▎         | 10220/371472 [49:24<30:15:52,  3.32it/s]
  3%|▎         | 10221/371472 [49:24<29:03:36,  3.45it/s]
  3%|▎         | 10222/371472 [49:25<29:47:22,  3.37it/s]
  3%|▎         | 10223/371472 [49:25<28:55:08,  3.47it/s]
  3%|▎         | 10224/371472 [49:25<29:42:49,  3.38it/s]
  3%|▎         | 10225/371472 [49:26<29:02:22,  3.46it/s]
  3%|▎         | 10226/371472 [49:26<28:50:18,  3.48it/s]
  3%|▎         | 10227/371472 [49:26<27:38:34,  3.63it/s]
  3%|▎         | 10228/371472 [49:26<27:53:17,  3.60it/s]
  3%|▎         | 10229/371472 [49:27<28:49:44,  3.48it/s]
  3%|▎         | 10230/371472 [49:27<28:08:53,  3.56it/s]
  3%|▎         | 10231/371472 [49:27<28:09:23,  3.56it/s]
  3%|▎         | 10232/371472 [49:28<32:54:57,  3.05it/s]
  3%|▎         | 10233/371472 [49:28<31:32:47,  3.18it/s]
  3%|▎         | 10234/371472 [49:28<31:02:38,  3.23it/s]
  3%|▎         | 10235/371472 [49:28<30:02:49,  3.34it/s]
  3%|▎         | 10236/371472 [49:29<29:39:31,  3.38it/s]
  3%|▎         | 10237/371472 [49:29<30:56:34,  3.24it/s]
  3%|▎         | 10238/371472 [49:29<29:36:03,  3.39it/s]
  3%|▎         | 10239/371472 [49:30<29:48:28,  3.37it/s]
  3%|▎         | 10240/371472 [49:30<28:27:16,  3.53it/s]
                                                         
{'loss': 4.8341, 'learning_rate': 9.75662048309595e-07, 'epoch': 0.44}

  3%|▎         | 10240/371472 [49:30<28:27:16,  3.53it/s]
  3%|▎         | 10241/371472 [49:30<30:26:54,  3.30it/s]
  3%|▎         | 10242/371472 [49:31<29:25:48,  3.41it/s]
  3%|▎         | 10243/371472 [49:31<29:46:34,  3.37it/s]
  3%|▎         | 10244/371472 [49:31<30:06:34,  3.33it/s]
  3%|▎         | 10245/371472 [49:31<30:30:09,  3.29it/s]
  3%|▎         | 10246/371472 [49:32<29:06:55,  3.45it/s]
  3%|▎         | 10247/371472 [49:32<29:30:47,  3.40it/s]
  3%|▎         | 10248/371472 [49:32<28:54:18,  3.47it/s]
  3%|▎         | 10249/371472 [49:33<27:56:36,  3.59it/s]
  3%|▎         | 10250/371472 [49:33<28:26:01,  3.53it/s]
  3%|▎         | 10251/371472 [49:33<28:23:57,  3.53it/s]
  3%|▎         | 10252/371472 [49:33<29:22:40,  3.42it/s]
  3%|▎         | 10253/371472 [49:34<28:46:57,  3.49it/s]
  3%|▎         | 10254/371472 [49:34<30:29:11,  3.29it/s]
  3%|▎         | 10255/371472 [49:34<29:27:09,  3.41it/s]
  3%|▎         | 10256/371472 [49:35<29:29:21,  3.40it/s]
  3%|▎         | 10257/371472 [49:35<28:13:01,  3.56it/s]
  3%|▎         | 10258/371472 [49:35<28:44:14,  3.49it/s]
  3%|▎         | 10259/371472 [49:35<27:59:08,  3.59it/s]
  3%|▎         | 10260/371472 [49:36<27:33:04,  3.64it/s]
                                                         
{'loss': 4.8262, 'learning_rate': 9.756135663341163e-07, 'epoch': 0.44}

  3%|▎         | 10260/371472 [49:36<27:33:04,  3.64it/s]
  3%|▎         | 10261/371472 [49:36<29:01:27,  3.46it/s]
  3%|▎         | 10262/371472 [49:36<30:26:46,  3.30it/s]
  3%|▎         | 10263/371472 [49:37<30:04:17,  3.34it/s]
  3%|▎         | 10264/371472 [49:37<28:52:32,  3.47it/s]
  3%|▎         | 10265/371472 [49:37<27:42:47,  3.62it/s]
  3%|▎         | 10266/371472 [49:37<29:36:27,  3.39it/s]
  3%|▎         | 10267/371472 [49:38<28:32:08,  3.52it/s]
  3%|▎         | 10268/371472 [49:38<28:23:46,  3.53it/s]
  3%|▎         | 10269/371472 [49:38<27:45:53,  3.61it/s]
  3%|▎         | 10270/371472 [49:39<27:44:22,  3.62it/s]
  3%|▎         | 10271/371472 [49:39<29:25:59,  3.41it/s]
  3%|▎         | 10272/371472 [49:39<28:52:11,  3.48it/s]
  3%|▎         | 10273/371472 [49:39<29:04:54,  3.45it/s]
  3%|▎         | 10274/371472 [49:40<29:21:48,  3.42it/s]
  3%|▎         | 10275/371472 [49:40<28:53:34,  3.47it/s]
  3%|▎         | 10276/371472 [49:40<28:14:39,  3.55it/s]
  3%|▎         | 10277/371472 [49:41<30:12:18,  3.32it/s]
  3%|▎         | 10278/371472 [49:41<30:36:05,  3.28it/s]
  3%|▎         | 10279/371472 [49:41<30:31:49,  3.29it/s]
  3%|▎         | 10280/371472 [49:42<28:52:35,  3.47it/s]
                                                         
{'loss': 5.131, 'learning_rate': 9.755650843586374e-07, 'epoch': 0.44}

  3%|▎         | 10280/371472 [49:42<28:52:35,  3.47it/s]
  3%|▎         | 10281/371472 [49:42<29:00:44,  3.46it/s]
  3%|▎         | 10282/371472 [49:42<28:09:58,  3.56it/s]
  3%|▎         | 10283/371472 [49:42<28:01:55,  3.58it/s]
  3%|▎         | 10284/371472 [49:43<29:54:53,  3.35it/s]
  3%|▎         | 10285/371472 [49:43<30:00:39,  3.34it/s]
  3%|▎         | 10286/371472 [49:43<29:39:35,  3.38it/s]
  3%|▎         | 10287/371472 [49:44<32:38:50,  3.07it/s]
  3%|▎         | 10288/371472 [49:44<31:22:45,  3.20it/s]
  3%|▎         | 10289/371472 [49:44<31:36:55,  3.17it/s]
  3%|▎         | 10290/371472 [49:45<31:27:17,  3.19it/s]
  3%|▎         | 10291/371472 [49:45<30:18:21,  3.31it/s]
  3%|▎         | 10292/371472 [49:45<29:26:57,  3.41it/s]
  3%|▎         | 10293/371472 [49:45<28:52:58,  3.47it/s]
  3%|▎         | 10294/371472 [49:46<28:12:12,  3.56it/s]
  3%|▎         | 10295/371472 [49:46<27:40:57,  3.62it/s]
  3%|▎         | 10296/371472 [49:46<29:10:26,  3.44it/s]
  3%|▎         | 10297/371472 [49:47<29:20:41,  3.42it/s]
  3%|▎         | 10298/371472 [49:47<28:56:42,  3.47it/s]
  3%|▎         | 10299/371472 [49:47<29:58:15,  3.35it/s]
  3%|▎         | 10300/371472 [49:47<29:06:48,  3.45it/s]
                                                         
{'loss': 5.0421, 'learning_rate': 9.755166023831584e-07, 'epoch': 0.44}

  3%|▎         | 10300/371472 [49:47<29:06:48,  3.45it/s]
  3%|▎         | 10301/371472 [49:48<28:07:59,  3.57it/s]
  3%|▎         | 10302/371472 [49:48<27:20:48,  3.67it/s]
  3%|▎         | 10303/371472 [49:48<27:23:51,  3.66it/s]
  3%|▎         | 10304/371472 [49:48<27:08:24,  3.70it/s]
  3%|▎         | 10305/371472 [49:49<26:12:59,  3.83it/s]
  3%|▎         | 10306/371472 [49:49<26:21:02,  3.81it/s]
  3%|▎         | 10307/371472 [49:49<30:43:28,  3.27it/s]
  3%|▎         | 10308/371472 [49:50<30:14:51,  3.32it/s]
  3%|▎         | 10309/371472 [49:50<30:15:45,  3.32it/s]
  3%|▎         | 10310/371472 [49:50<34:47:14,  2.88it/s]
  3%|▎         | 10311/371472 [49:51<33:18:50,  3.01it/s]
  3%|▎         | 10312/371472 [49:51<32:46:57,  3.06it/s]
  3%|▎         | 10313/371472 [49:51<31:57:02,  3.14it/s]
  3%|▎         | 10314/371472 [49:52<30:17:28,  3.31it/s]
  3%|▎         | 10315/371472 [49:52<30:39:54,  3.27it/s]
  3%|▎         | 10316/371472 [49:52<29:25:15,  3.41it/s]
  3%|▎         | 10317/371472 [49:53<29:59:16,  3.35it/s]
  3%|▎         | 10318/371472 [49:53<29:10:39,  3.44it/s]
  3%|▎         | 10319/371472 [49:53<29:45:06,  3.37it/s]
  3%|▎         | 10320/371472 [49:53<29:42:19,  3.38it/s]
                                                         
{'loss': 4.9971, 'learning_rate': 9.754681204076795e-07, 'epoch': 0.44}

  3%|▎         | 10320/371472 [49:53<29:42:19,  3.38it/s]
  3%|▎         | 10321/371472 [49:54<29:43:16,  3.38it/s]
  3%|▎         | 10322/371472 [49:54<29:29:32,  3.40it/s]
  3%|▎         | 10323/371472 [49:54<29:32:55,  3.40it/s]
  3%|▎         | 10324/371472 [49:55<30:15:30,  3.32it/s]
  3%|▎         | 10325/371472 [49:55<29:55:25,  3.35it/s]
  3%|▎         | 10326/371472 [49:55<29:09:22,  3.44it/s]
  3%|▎         | 10327/371472 [49:55<28:15:23,  3.55it/s]
  3%|▎         | 10328/371472 [49:56<28:08:30,  3.56it/s]
  3%|▎         | 10329/371472 [49:56<30:59:51,  3.24it/s]
  3%|▎         | 10330/371472 [49:56<30:48:30,  3.26it/s]
  3%|▎         | 10331/371472 [49:57<35:20:01,  2.84it/s]
  3%|▎         | 10332/371472 [49:57<34:29:30,  2.91it/s]
  3%|▎         | 10333/371472 [49:57<31:55:36,  3.14it/s]
  3%|▎         | 10334/371472 [49:58<30:08:49,  3.33it/s]
  3%|▎         | 10335/371472 [49:58<29:40:55,  3.38it/s]
  3%|▎         | 10336/371472 [49:58<29:44:47,  3.37it/s]
  3%|▎         | 10337/371472 [49:59<29:14:18,  3.43it/s]
  3%|▎         | 10338/371472 [49:59<28:12:39,  3.56it/s]
  3%|▎         | 10339/371472 [49:59<28:28:31,  3.52it/s]
  3%|▎         | 10340/371472 [49:59<28:26:35,  3.53it/s]
                                                         
{'loss': 5.0195, 'learning_rate': 9.754196384322006e-07, 'epoch': 0.45}

  3%|▎         | 10340/371472 [49:59<28:26:35,  3.53it/s]
  3%|▎         | 10341/371472 [50:00<29:12:50,  3.43it/s]
  3%|▎         | 10342/371472 [50:00<29:27:13,  3.41it/s]
  3%|▎         | 10343/371472 [50:00<29:01:22,  3.46it/s]
  3%|▎         | 10344/371472 [50:01<27:58:52,  3.59it/s]
  3%|▎         | 10345/371472 [50:01<27:31:37,  3.64it/s]
  3%|▎         | 10346/371472 [50:01<26:59:10,  3.72it/s]
  3%|▎         | 10347/371472 [50:01<28:06:38,  3.57it/s]
  3%|▎         | 10348/371472 [50:02<32:24:06,  3.10it/s]
  3%|▎         | 10349/371472 [50:02<32:38:31,  3.07it/s]
  3%|▎         | 10350/371472 [50:02<30:32:33,  3.28it/s]
  3%|▎         | 10351/371472 [50:03<30:17:28,  3.31it/s]
  3%|▎         | 10352/371472 [50:03<28:56:19,  3.47it/s]
  3%|▎         | 10353/371472 [50:03<28:37:37,  3.50it/s]
  3%|▎         | 10354/371472 [50:03<28:16:22,  3.55it/s]
  3%|▎         | 10355/371472 [50:04<27:24:54,  3.66it/s]
  3%|▎         | 10356/371472 [50:04<28:15:45,  3.55it/s]
  3%|▎         | 10357/371472 [50:04<27:21:41,  3.67it/s]
  3%|▎         | 10358/371472 [50:05<27:09:55,  3.69it/s]
  3%|▎         | 10359/371472 [50:05<27:13:40,  3.68it/s]
  3%|▎         | 10360/371472 [50:05<29:18:36,  3.42it/s]
                                                         
{'loss': 4.7907, 'learning_rate': 9.753711564567218e-07, 'epoch': 0.45}

  3%|▎         | 10360/371472 [50:05<29:18:36,  3.42it/s]
  3%|▎         | 10361/371472 [50:05<29:03:19,  3.45it/s]
  3%|▎         | 10362/371472 [50:06<28:22:56,  3.53it/s]
  3%|▎         | 10363/371472 [50:06<28:02:01,  3.58it/s]
  3%|▎         | 10364/371472 [50:06<28:09:05,  3.56it/s]
  3%|▎         | 10365/371472 [50:07<27:40:10,  3.63it/s]
  3%|▎         | 10366/371472 [50:07<28:23:05,  3.53it/s]
  3%|▎         | 10367/371472 [50:07<29:05:16,  3.45it/s]
  3%|▎         | 10368/371472 [50:07<28:39:40,  3.50it/s]
  3%|▎         | 10369/371472 [50:08<28:24:27,  3.53it/s]
  3%|▎         | 10370/371472 [50:08<28:50:22,  3.48it/s]
  3%|▎         | 10371/371472 [50:08<29:08:23,  3.44it/s]
  3%|▎         | 10372/371472 [50:09<28:20:31,  3.54it/s]
  3%|▎         | 10373/371472 [50:09<28:09:56,  3.56it/s]
  3%|▎         | 10374/371472 [50:09<28:43:19,  3.49it/s]
  3%|▎         | 10375/371472 [50:09<27:48:27,  3.61it/s]
  3%|▎         | 10376/371472 [50:10<29:10:12,  3.44it/s]
  3%|▎         | 10377/371472 [50:10<29:36:27,  3.39it/s]
  3%|▎         | 10378/371472 [50:10<29:39:04,  3.38it/s]
  3%|▎         | 10379/371472 [50:11<29:02:42,  3.45it/s]
  3%|▎         | 10380/371472 [50:11<28:57:50,  3.46it/s]
                                                         
{'loss': 4.9427, 'learning_rate': 9.753226744812427e-07, 'epoch': 0.45}

  3%|▎         | 10380/371472 [50:11<28:57:50,  3.46it/s]
  3%|▎         | 10381/371472 [50:11<31:21:54,  3.20it/s]
  3%|▎         | 10382/371472 [50:12<31:07:31,  3.22it/s]
  3%|▎         | 10383/371472 [50:12<29:37:59,  3.38it/s]
  3%|▎         | 10384/371472 [50:12<28:50:28,  3.48it/s]
  3%|▎         | 10385/371472 [50:12<28:36:58,  3.51it/s]
  3%|▎         | 10386/371472 [50:13<29:55:09,  3.35it/s]
  3%|▎         | 10387/371472 [50:13<30:13:18,  3.32it/s]
  3%|▎         | 10388/371472 [50:13<29:03:38,  3.45it/s]
  3%|▎         | 10389/371472 [50:14<28:30:33,  3.52it/s]
  3%|▎         | 10390/371472 [50:14<28:42:53,  3.49it/s]
  3%|▎         | 10391/371472 [50:14<29:04:58,  3.45it/s]
  3%|▎         | 10392/371472 [50:14<31:44:39,  3.16it/s]
  3%|▎         | 10393/371472 [50:15<29:40:01,  3.38it/s]
  3%|▎         | 10394/371472 [50:15<30:21:14,  3.30it/s]
  3%|▎         | 10395/371472 [50:15<29:48:27,  3.36it/s]
  3%|▎         | 10396/371472 [50:16<28:32:33,  3.51it/s]
  3%|▎         | 10397/371472 [50:16<28:21:52,  3.54it/s]
  3%|▎         | 10398/371472 [50:16<27:59:18,  3.58it/s]
  3%|▎         | 10399/371472 [50:16<29:31:44,  3.40it/s]
  3%|▎         | 10400/371472 [50:17<28:15:38,  3.55it/s]
                                                         
{'loss': 4.9174, 'learning_rate': 9.75274192505764e-07, 'epoch': 0.45}

  3%|▎         | 10400/371472 [50:17<28:15:38,  3.55it/s]
  3%|▎         | 10401/371472 [50:17<30:19:20,  3.31it/s]
  3%|▎         | 10402/371472 [50:17<29:45:39,  3.37it/s]
  3%|▎         | 10403/371472 [50:18<29:54:08,  3.35it/s]
  3%|▎         | 10404/371472 [50:18<29:20:07,  3.42it/s]
  3%|▎         | 10405/371472 [50:18<28:47:32,  3.48it/s]
  3%|▎         | 10406/371472 [50:18<28:09:11,  3.56it/s]
  3%|▎         | 10407/371472 [50:19<27:31:58,  3.64it/s]
  3%|▎         | 10408/371472 [50:19<26:32:06,  3.78it/s]
  3%|▎         | 10409/371472 [50:19<27:21:37,  3.67it/s]
  3%|▎         | 10410/371472 [50:20<26:42:11,  3.76it/s]
  3%|▎         | 10411/371472 [50:20<28:05:45,  3.57it/s]
  3%|▎         | 10412/371472 [50:20<28:10:57,  3.56it/s]
  3%|▎         | 10413/371472 [50:20<27:48:56,  3.61it/s]
  3%|▎         | 10414/371472 [50:21<27:15:53,  3.68it/s]
  3%|▎         | 10415/371472 [50:21<28:45:48,  3.49it/s]
  3%|▎         | 10416/371472 [50:21<29:25:17,  3.41it/s]
  3%|▎         | 10417/371472 [50:22<29:19:33,  3.42it/s]
  3%|▎         | 10418/371472 [50:22<28:20:18,  3.54it/s]
  3%|▎         | 10419/371472 [50:22<27:46:39,  3.61it/s]
  3%|▎         | 10420/371472 [50:22<29:31:51,  3.40it/s]
                                                         
{'loss': 5.0763, 'learning_rate': 9.75225710530285e-07, 'epoch': 0.45}

  3%|▎         | 10420/371472 [50:22<29:31:51,  3.40it/s]
  3%|▎         | 10421/371472 [50:23<29:19:13,  3.42it/s]
  3%|▎         | 10422/371472 [50:23<29:24:41,  3.41it/s]
  3%|▎         | 10423/371472 [50:23<29:19:10,  3.42it/s]
  3%|▎         | 10424/371472 [50:24<28:51:33,  3.48it/s]
  3%|▎         | 10425/371472 [50:24<28:50:33,  3.48it/s]
  3%|▎         | 10426/371472 [50:24<30:37:59,  3.27it/s]
  3%|▎         | 10427/371472 [50:24<29:26:23,  3.41it/s]
  3%|▎         | 10428/371472 [50:25<29:39:49,  3.38it/s]
  3%|▎         | 10429/371472 [50:25<29:52:46,  3.36it/s]
  3%|▎         | 10430/371472 [50:25<30:54:34,  3.24it/s]
  3%|▎         | 10431/371472 [50:26<29:49:57,  3.36it/s]
  3%|▎         | 10432/371472 [50:26<29:03:35,  3.45it/s]
  3%|▎         | 10433/371472 [50:26<28:33:09,  3.51it/s]
  3%|▎         | 10434/371472 [50:26<27:52:00,  3.60it/s]
  3%|▎         | 10435/371472 [50:27<27:39:28,  3.63it/s]
  3%|▎         | 10436/371472 [50:27<27:53:22,  3.60it/s]
  3%|▎         | 10437/371472 [50:27<27:50:28,  3.60it/s]
  3%|▎         | 10438/371472 [50:28<28:15:03,  3.55it/s]
  3%|▎         | 10439/371472 [50:28<28:08:36,  3.56it/s]
  3%|▎         | 10440/371472 [50:28<29:47:47,  3.37it/s]
                                                         
{'loss': 4.8748, 'learning_rate': 9.751772285548061e-07, 'epoch': 0.45}

  3%|▎         | 10440/371472 [50:28<29:47:47,  3.37it/s]
  3%|▎         | 10441/371472 [50:28<28:26:14,  3.53it/s]
  3%|▎         | 10442/371472 [50:29<28:13:24,  3.55it/s]
  3%|▎         | 10443/371472 [50:29<27:08:00,  3.70it/s]
  3%|▎         | 10444/371472 [50:29<28:04:25,  3.57it/s]
  3%|▎         | 10445/371472 [50:30<28:50:12,  3.48it/s]
  3%|▎         | 10446/371472 [50:30<30:24:05,  3.30it/s]
  3%|▎         | 10447/371472 [50:30<29:18:20,  3.42it/s]
  3%|▎         | 10448/371472 [50:30<28:13:40,  3.55it/s]
  3%|▎         | 10449/371472 [50:31<29:21:31,  3.42it/s]
  3%|▎         | 10450/371472 [50:31<28:29:35,  3.52it/s]
  3%|▎         | 10451/371472 [50:31<28:55:32,  3.47it/s]
  3%|▎         | 10452/371472 [50:32<27:57:33,  3.59it/s]
  3%|▎         | 10453/371472 [50:32<28:23:50,  3.53it/s]
  3%|▎         | 10454/371472 [50:32<28:42:57,  3.49it/s]
  3%|▎         | 10455/371472 [50:32<27:33:16,  3.64it/s]
  3%|▎         | 10456/371472 [50:33<27:18:01,  3.67it/s]
  3%|▎         | 10457/371472 [50:33<26:50:19,  3.74it/s]
  3%|▎         | 10458/371472 [50:33<29:55:03,  3.35it/s]
  3%|▎         | 10459/371472 [50:34<30:20:24,  3.31it/s]
  3%|▎         | 10460/371472 [50:34<31:10:02,  3.22it/s]
                                                         
{'loss': 4.9506, 'learning_rate': 9.751287465793272e-07, 'epoch': 0.45}

  3%|▎         | 10460/371472 [50:34<31:10:02,  3.22it/s]
  3%|▎         | 10461/371472 [50:34<29:49:39,  3.36it/s]
  3%|▎         | 10462/371472 [50:34<29:00:04,  3.46it/s]
  3%|▎         | 10463/371472 [50:35<27:42:45,  3.62it/s]
  3%|▎         | 10464/371472 [50:35<26:56:52,  3.72it/s]
  3%|▎         | 10465/371472 [50:35<28:52:54,  3.47it/s]
  3%|▎         | 10466/371472 [50:36<29:27:41,  3.40it/s]
  3%|▎         | 10467/371472 [50:36<29:39:50,  3.38it/s]
  3%|▎         | 10468/371472 [50:36<29:25:52,  3.41it/s]
  3%|▎         | 10469/371472 [50:37<29:09:35,  3.44it/s]
  3%|▎         | 10470/371472 [50:37<28:26:18,  3.53it/s]
  3%|▎         | 10471/371472 [50:37<29:09:26,  3.44it/s]
  3%|▎         | 10472/371472 [50:37<28:57:59,  3.46it/s]
  3%|▎         | 10473/371472 [50:38<28:12:35,  3.55it/s]
  3%|▎         | 10474/371472 [50:38<27:49:25,  3.60it/s]
  3%|▎         | 10475/371472 [50:38<27:03:25,  3.71it/s]
  3%|▎         | 10476/371472 [50:38<27:47:57,  3.61it/s]
  3%|▎         | 10477/371472 [50:39<29:13:38,  3.43it/s]
  3%|▎         | 10478/371472 [50:39<28:46:35,  3.48it/s]
  3%|▎         | 10479/371472 [50:39<28:10:32,  3.56it/s]
  3%|▎         | 10480/371472 [50:40<28:05:33,  3.57it/s]
                                                         
{'loss': 4.6341, 'learning_rate': 9.750802646038483e-07, 'epoch': 0.45}

  3%|▎         | 10480/371472 [50:40<28:05:33,  3.57it/s]
  3%|▎         | 10481/371472 [50:40<28:28:24,  3.52it/s]
  3%|▎         | 10482/371472 [50:40<29:34:16,  3.39it/s]
  3%|▎         | 10483/371472 [50:41<29:47:03,  3.37it/s]
  3%|▎         | 10484/371472 [50:41<28:32:38,  3.51it/s]
  3%|▎         | 10485/371472 [50:41<28:55:10,  3.47it/s]
  3%|▎         | 10486/371472 [50:41<29:04:16,  3.45it/s]
  3%|▎         | 10487/371472 [50:42<28:04:45,  3.57it/s]
  3%|▎         | 10488/371472 [50:42<28:11:43,  3.56it/s]
  3%|▎         | 10489/371472 [50:42<29:10:34,  3.44it/s]
  3%|▎         | 10490/371472 [50:42<28:51:29,  3.47it/s]
  3%|▎         | 10491/371472 [50:43<28:18:23,  3.54it/s]
  3%|▎         | 10492/371472 [50:43<29:45:15,  3.37it/s]
  3%|▎         | 10493/371472 [50:43<29:39:01,  3.38it/s]
  3%|▎         | 10494/371472 [50:44<29:24:58,  3.41it/s]
  3%|▎         | 10495/371472 [50:44<29:10:53,  3.44it/s]
  3%|▎         | 10496/371472 [50:44<28:17:48,  3.54it/s]
  3%|▎         | 10497/371472 [50:45<28:59:11,  3.46it/s]
  3%|▎         | 10498/371472 [50:45<29:57:44,  3.35it/s]
  3%|▎         | 10499/371472 [50:45<30:14:12,  3.32it/s]
  3%|▎         | 10500/371472 [50:45<29:35:29,  3.39it/s]
                                                         
{'loss': 4.7974, 'learning_rate': 9.750317826283696e-07, 'epoch': 0.45}

  3%|▎         | 10500/371472 [50:45<29:35:29,  3.39it/s]
  3%|▎         | 10501/371472 [50:46<28:52:44,  3.47it/s]
  3%|▎         | 10502/371472 [50:46<28:25:57,  3.53it/s]
  3%|▎         | 10503/371472 [50:46<28:41:41,  3.49it/s]
  3%|▎         | 10504/371472 [50:47<28:39:45,  3.50it/s]
  3%|▎         | 10505/371472 [50:47<28:21:27,  3.54it/s]
  3%|▎         | 10506/371472 [50:47<28:04:53,  3.57it/s]
  3%|▎         | 10507/371472 [50:47<28:18:18,  3.54it/s]
  3%|▎         | 10508/371472 [50:48<28:31:51,  3.51it/s]
  3%|▎         | 10509/371472 [50:48<28:05:21,  3.57it/s]
  3%|▎         | 10510/371472 [50:48<28:05:55,  3.57it/s]
  3%|▎         | 10511/371472 [50:49<30:07:44,  3.33it/s]
  3%|▎         | 10512/371472 [50:49<30:00:28,  3.34it/s]
  3%|▎         | 10513/371472 [50:49<29:00:42,  3.46it/s]
  3%|▎         | 10514/371472 [50:49<28:51:00,  3.48it/s]
  3%|▎         | 10515/371472 [50:50<28:43:08,  3.49it/s]
  3%|▎         | 10516/371472 [50:50<29:35:33,  3.39it/s]
  3%|▎         | 10517/371472 [50:50<30:30:05,  3.29it/s]
  3%|▎         | 10518/371472 [50:51<29:33:15,  3.39it/s]
  3%|▎         | 10519/371472 [50:51<30:29:07,  3.29it/s]
  3%|▎         | 10520/371472 [50:51<29:36:40,  3.39it/s]
                                                         
{'loss': 4.8822, 'learning_rate': 9.749833006528904e-07, 'epoch': 0.45}

  3%|▎         | 10520/371472 [50:51<29:36:40,  3.39it/s]
  3%|▎         | 10521/371472 [50:51<28:28:15,  3.52it/s]
  3%|▎         | 10522/371472 [50:52<31:00:16,  3.23it/s]
  3%|▎         | 10523/371472 [50:52<30:02:35,  3.34it/s]
  3%|▎         | 10524/371472 [50:52<29:21:50,  3.41it/s]
  3%|▎         | 10525/371472 [50:53<29:19:44,  3.42it/s]
  3%|▎         | 10526/371472 [50:53<29:44:02,  3.37it/s]
  3%|▎         | 10527/371472 [50:53<30:29:33,  3.29it/s]
  3%|▎         | 10528/371472 [50:54<30:26:47,  3.29it/s]
  3%|▎         | 10529/371472 [50:54<29:09:11,  3.44it/s]
  3%|▎         | 10530/371472 [50:54<29:52:01,  3.36it/s]
  3%|▎         | 10531/371472 [50:55<30:19:08,  3.31it/s]
  3%|▎         | 10532/371472 [50:55<34:35:05,  2.90it/s]
  3%|▎         | 10533/371472 [50:55<35:39:25,  2.81it/s]
  3%|▎         | 10534/371472 [50:56<33:56:15,  2.95it/s]
  3%|▎         | 10535/371472 [50:56<32:53:46,  3.05it/s]
  3%|▎         | 10536/371472 [50:56<31:30:42,  3.18it/s]
  3%|▎         | 10537/371472 [50:57<30:37:57,  3.27it/s]
  3%|▎         | 10538/371472 [50:57<30:27:15,  3.29it/s]
  3%|▎         | 10539/371472 [50:57<31:23:45,  3.19it/s]
  3%|▎         | 10540/371472 [50:57<30:05:09,  3.33it/s]
                                                         
{'loss': 4.7732, 'learning_rate': 9.749348186774117e-07, 'epoch': 0.45}

  3%|▎         | 10540/371472 [50:57<30:05:09,  3.33it/s]
  3%|▎         | 10541/371472 [50:58<29:54:09,  3.35it/s]
  3%|▎         | 10542/371472 [50:58<28:51:12,  3.47it/s]
  3%|▎         | 10543/371472 [50:58<29:15:40,  3.43it/s]
  3%|▎         | 10544/371472 [50:59<28:34:14,  3.51it/s]
  3%|▎         | 10545/371472 [50:59<28:55:49,  3.47it/s]
  3%|▎         | 10546/371472 [50:59<28:26:43,  3.52it/s]
  3%|▎         | 10547/371472 [50:59<27:39:47,  3.62it/s]
  3%|▎         | 10548/371472 [51:00<26:59:28,  3.71it/s]
  3%|▎         | 10549/371472 [51:00<26:56:35,  3.72it/s]
  3%|▎         | 10550/371472 [51:00<26:49:41,  3.74it/s]
  3%|▎         | 10551/371472 [51:00<26:34:18,  3.77it/s]
  3%|▎         | 10552/371472 [51:01<30:12:44,  3.32it/s]
  3%|▎         | 10553/371472 [51:01<28:33:09,  3.51it/s]
  3%|▎         | 10554/371472 [51:01<28:17:28,  3.54it/s]
  3%|▎         | 10555/371472 [51:02<27:44:14,  3.61it/s]
  3%|▎         | 10556/371472 [51:02<28:05:55,  3.57it/s]
  3%|▎         | 10557/371472 [51:02<27:44:17,  3.61it/s]
  3%|▎         | 10558/371472 [51:02<27:34:01,  3.64it/s]
  3%|▎         | 10559/371472 [51:03<28:18:09,  3.54it/s]
  3%|▎         | 10560/371472 [51:03<28:17:50,  3.54it/s]
                                                         
{'loss': 5.0418, 'learning_rate': 9.748863367019328e-07, 'epoch': 0.45}

  3%|▎         | 10560/371472 [51:03<28:17:50,  3.54it/s]
  3%|▎         | 10561/371472 [51:03<27:55:33,  3.59it/s]
  3%|▎         | 10562/371472 [51:04<28:48:37,  3.48it/s]
  3%|▎         | 10563/371472 [51:04<28:41:51,  3.49it/s]
  3%|▎         | 10564/371472 [51:04<27:48:05,  3.61it/s]
  3%|▎         | 10565/371472 [51:04<28:05:45,  3.57it/s]
  3%|▎         | 10566/371472 [51:05<27:23:42,  3.66it/s]
  3%|▎         | 10567/371472 [51:05<30:01:38,  3.34it/s]
  3%|▎         | 10568/371472 [51:05<28:06:53,  3.57it/s]
  3%|▎         | 10569/371472 [51:06<28:24:31,  3.53it/s]
  3%|▎         | 10570/371472 [51:06<28:17:29,  3.54it/s]
  3%|▎         | 10571/371472 [51:06<29:00:29,  3.46it/s]
  3%|▎         | 10572/371472 [51:06<28:54:42,  3.47it/s]
  3%|▎         | 10573/371472 [51:07<27:44:40,  3.61it/s]
  3%|▎         | 10574/371472 [51:07<28:24:40,  3.53it/s]
  3%|▎         | 10575/371472 [51:07<28:39:42,  3.50it/s]
  3%|▎         | 10576/371472 [51:08<27:51:30,  3.60it/s]
  3%|▎         | 10577/371472 [51:08<28:08:44,  3.56it/s]
  3%|▎         | 10578/371472 [51:08<27:44:27,  3.61it/s]
  3%|▎         | 10579/371472 [51:08<27:50:36,  3.60it/s]
  3%|▎         | 10580/371472 [51:09<27:48:32,  3.60it/s]
                                                         
{'loss': 5.0333, 'learning_rate': 9.748378547264538e-07, 'epoch': 0.46}

  3%|▎         | 10580/371472 [51:09<27:48:32,  3.60it/s]
  3%|▎         | 10581/371472 [51:09<27:33:30,  3.64it/s]
  3%|▎         | 10582/371472 [51:09<26:32:21,  3.78it/s]
  3%|▎         | 10583/371472 [51:09<27:36:50,  3.63it/s]
  3%|▎         | 10584/371472 [51:10<26:56:43,  3.72it/s]
  3%|▎         | 10585/371472 [51:10<27:53:43,  3.59it/s]
  3%|▎         | 10586/371472 [51:10<28:26:04,  3.53it/s]
  3%|▎         | 10587/371472 [51:11<29:11:18,  3.43it/s]
  3%|▎         | 10588/371472 [51:11<28:54:03,  3.47it/s]
  3%|▎         | 10589/371472 [51:11<28:40:51,  3.50it/s]
  3%|▎         | 10590/371472 [51:11<29:35:24,  3.39it/s]
  3%|▎         | 10591/371472 [51:12<28:54:40,  3.47it/s]
  3%|▎         | 10592/371472 [51:12<28:12:47,  3.55it/s]
  3%|▎         | 10593/371472 [51:12<27:56:51,  3.59it/s]
  3%|▎         | 10594/371472 [51:13<28:15:24,  3.55it/s]
  3%|▎         | 10595/371472 [51:13<28:58:04,  3.46it/s]
  3%|▎         | 10596/371472 [51:13<32:17:32,  3.10it/s]
  3%|▎         | 10597/371472 [51:14<31:45:27,  3.16it/s]
  3%|▎         | 10598/371472 [51:14<30:13:19,  3.32it/s]
  3%|▎         | 10599/371472 [51:14<29:15:22,  3.43it/s]
  3%|▎         | 10600/371472 [51:14<30:41:11,  3.27it/s]
                                                         
{'loss': 4.7601, 'learning_rate': 9.74789372750975e-07, 'epoch': 0.46}

  3%|▎         | 10600/371472 [51:14<30:41:11,  3.27it/s]
  3%|▎         | 10601/371472 [51:15<31:14:48,  3.21it/s]
  3%|▎         | 10602/371472 [51:15<29:48:47,  3.36it/s]
  3%|▎         | 10603/371472 [51:15<31:05:53,  3.22it/s]
  3%|▎         | 10604/371472 [51:16<29:14:43,  3.43it/s]
  3%|▎         | 10605/371472 [51:16<30:39:21,  3.27it/s]
  3%|▎         | 10606/371472 [51:16<29:12:59,  3.43it/s]
  3%|▎         | 10607/371472 [51:17<29:04:19,  3.45it/s]
  3%|▎         | 10608/371472 [51:17<28:13:46,  3.55it/s]
  3%|▎         | 10609/371472 [51:17<29:55:11,  3.35it/s]
  3%|▎         | 10610/371472 [51:17<29:49:22,  3.36it/s]
  3%|▎         | 10611/371472 [51:18<34:44:47,  2.88it/s]
  3%|▎         | 10612/371472 [51:18<33:01:15,  3.04it/s]
  3%|▎         | 10613/371472 [51:18<30:51:56,  3.25it/s]
  3%|▎         | 10614/371472 [51:19<29:57:17,  3.35it/s]
  3%|▎         | 10615/371472 [51:19<30:54:12,  3.24it/s]
  3%|▎         | 10616/371472 [51:19<33:27:30,  3.00it/s]
  3%|▎         | 10617/371472 [51:20<31:20:02,  3.20it/s]
  3%|▎         | 10618/371472 [51:20<30:52:58,  3.25it/s]
  3%|▎         | 10619/371472 [51:20<29:09:06,  3.44it/s]
  3%|▎         | 10620/371472 [51:21<28:29:11,  3.52it/s]
                                                         
{'loss': 4.8413, 'learning_rate': 9.74740890775496e-07, 'epoch': 0.46}

  3%|▎         | 10620/371472 [51:21<28:29:11,  3.52it/s]
  3%|▎         | 10621/371472 [51:21<28:25:48,  3.53it/s]
  3%|▎         | 10622/371472 [51:21<28:05:18,  3.57it/s]
  3%|▎         | 10623/371472 [51:21<28:27:10,  3.52it/s]
  3%|▎         | 10624/371472 [51:22<30:47:13,  3.26it/s]
  3%|▎         | 10625/371472 [51:22<30:06:43,  3.33it/s]
  3%|▎         | 10626/371472 [51:22<28:32:05,  3.51it/s]
  3%|▎         | 10627/371472 [51:23<27:45:58,  3.61it/s]
  3%|▎         | 10628/371472 [51:23<28:23:52,  3.53it/s]
  3%|▎         | 10629/371472 [51:23<27:44:28,  3.61it/s]
  3%|▎         | 10630/371472 [51:23<28:10:48,  3.56it/s]
  3%|▎         | 10631/371472 [51:24<28:55:21,  3.47it/s]
  3%|▎         | 10632/371472 [51:24<28:10:02,  3.56it/s]
  3%|▎         | 10633/371472 [51:24<28:32:58,  3.51it/s]
  3%|▎         | 10634/371472 [51:25<28:53:01,  3.47it/s]
  3%|▎         | 10635/371472 [51:25<29:02:24,  3.45it/s]
  3%|▎         | 10636/371472 [51:25<34:18:34,  2.92it/s]
  3%|▎         | 10637/371472 [51:26<32:24:09,  3.09it/s]
  3%|▎         | 10638/371472 [51:26<33:54:16,  2.96it/s]
  3%|▎         | 10639/371472 [51:26<32:47:23,  3.06it/s]
  3%|▎         | 10640/371472 [51:27<31:55:55,  3.14it/s]
                                                         
{'loss': 4.8576, 'learning_rate': 9.746924088000173e-07, 'epoch': 0.46}

  3%|▎         | 10640/371472 [51:27<31:55:55,  3.14it/s]
  3%|▎         | 10641/371472 [51:27<31:43:03,  3.16it/s]
  3%|▎         | 10642/371472 [51:27<31:04:38,  3.23it/s]
  3%|▎         | 10643/371472 [51:27<28:50:36,  3.47it/s]
  3%|▎         | 10644/371472 [51:28<28:36:42,  3.50it/s]
  3%|▎         | 10645/371472 [51:28<28:21:04,  3.54it/s]
  3%|▎         | 10646/371472 [51:28<28:24:49,  3.53it/s]
  3%|▎         | 10647/371472 [51:28<28:25:33,  3.53it/s]
  3%|▎         | 10648/371472 [51:29<28:43:31,  3.49it/s]
  3%|▎         | 10649/371472 [51:29<29:00:27,  3.46it/s]
  3%|▎         | 10650/371472 [51:29<29:02:51,  3.45it/s]
  3%|▎         | 10651/371472 [51:30<28:35:25,  3.51it/s]
  3%|▎         | 10652/371472 [51:30<29:08:19,  3.44it/s]
  3%|▎         | 10653/371472 [51:30<29:25:19,  3.41it/s]
  3%|▎         | 10654/371472 [51:30<27:58:27,  3.58it/s]
  3%|▎         | 10655/371472 [51:31<31:05:44,  3.22it/s]
  3%|▎         | 10656/371472 [51:31<29:08:56,  3.44it/s]
  3%|▎         | 10657/371472 [51:31<28:39:59,  3.50it/s]
  3%|▎         | 10658/371472 [51:32<29:32:52,  3.39it/s]
  3%|▎         | 10659/371472 [51:32<28:50:59,  3.47it/s]
  3%|▎         | 10660/371472 [51:32<27:38:00,  3.63it/s]
                                                         
{'loss': 4.9137, 'learning_rate': 9.746439268245383e-07, 'epoch': 0.46}

  3%|▎         | 10660/371472 [51:32<27:38:00,  3.63it/s]
  3%|▎         | 10661/371472 [51:33<27:48:56,  3.60it/s]
  3%|▎         | 10662/371472 [51:33<29:53:43,  3.35it/s]
  3%|▎         | 10663/371472 [51:33<29:35:55,  3.39it/s]
  3%|▎         | 10664/371472 [51:33<29:27:06,  3.40it/s]
  3%|▎         | 10665/371472 [51:34<28:36:23,  3.50it/s]
  3%|▎         | 10666/371472 [51:34<27:48:53,  3.60it/s]
  3%|▎         | 10667/371472 [51:34<28:13:12,  3.55it/s]
  3%|▎         | 10668/371472 [51:35<28:16:31,  3.54it/s]
  3%|▎         | 10669/371472 [51:35<30:52:16,  3.25it/s]
  3%|▎         | 10670/371472 [51:35<30:41:14,  3.27it/s]
  3%|▎         | 10671/371472 [51:36<30:11:21,  3.32it/s]
  3%|▎         | 10672/371472 [51:36<31:16:30,  3.20it/s]
  3%|▎         | 10673/371472 [51:36<31:13:50,  3.21it/s]
  3%|▎         | 10674/371472 [51:36<29:59:02,  3.34it/s]
  3%|▎         | 10675/371472 [51:37<28:51:31,  3.47it/s]
  3%|▎         | 10676/371472 [51:37<28:14:37,  3.55it/s]
  3%|▎         | 10677/371472 [51:37<28:06:55,  3.56it/s]
  3%|▎         | 10678/371472 [51:38<28:56:46,  3.46it/s]
  3%|▎         | 10679/371472 [51:38<28:11:58,  3.55it/s]
  3%|▎         | 10680/371472 [51:38<27:21:04,  3.66it/s]
                                                         
{'loss': 4.7917, 'learning_rate': 9.745954448490594e-07, 'epoch': 0.46}

  3%|▎         | 10680/371472 [51:38<27:21:04,  3.66it/s]
  3%|▎         | 10681/371472 [51:38<27:25:25,  3.65it/s]
  3%|▎         | 10682/371472 [51:39<28:19:25,  3.54it/s]
  3%|▎         | 10683/371472 [51:39<27:28:55,  3.65it/s]
  3%|▎         | 10684/371472 [51:39<27:04:17,  3.70it/s]
  3%|▎         | 10685/371472 [51:39<28:16:56,  3.54it/s]
  3%|▎         | 10686/371472 [51:40<28:39:17,  3.50it/s]
  3%|▎         | 10687/371472 [51:40<28:12:50,  3.55it/s]
  3%|▎         | 10688/371472 [51:40<28:43:45,  3.49it/s]
  3%|▎         | 10689/371472 [51:41<29:13:02,  3.43it/s]
  3%|▎         | 10690/371472 [51:41<29:43:43,  3.37it/s]
  3%|▎         | 10691/371472 [51:41<28:44:21,  3.49it/s]
  3%|▎         | 10692/371472 [51:41<28:31:40,  3.51it/s]
  3%|▎         | 10693/371472 [51:42<29:23:19,  3.41it/s]
  3%|▎         | 10694/371472 [51:42<28:35:42,  3.50it/s]
  3%|▎         | 10695/371472 [51:42<30:54:25,  3.24it/s]
  3%|▎         | 10696/371472 [51:43<29:27:23,  3.40it/s]
  3%|▎         | 10697/371472 [51:43<28:03:18,  3.57it/s]
  3%|▎         | 10698/371472 [51:43<31:37:42,  3.17it/s]
  3%|▎         | 10699/371472 [51:44<31:31:23,  3.18it/s]
  3%|▎         | 10700/371472 [51:44<29:51:14,  3.36it/s]
                                                         
{'loss': 5.0347, 'learning_rate': 9.745469628735805e-07, 'epoch': 0.46}

  3%|▎         | 10700/371472 [51:44<29:51:14,  3.36it/s]
  3%|▎         | 10701/371472 [51:44<28:10:22,  3.56it/s]
  3%|▎         | 10702/371472 [51:44<27:10:15,  3.69it/s]
  3%|▎         | 10703/371472 [51:45<27:11:03,  3.69it/s]
  3%|▎         | 10704/371472 [51:45<27:13:47,  3.68it/s]
  3%|▎         | 10705/371472 [51:45<26:53:38,  3.73it/s]
  3%|▎         | 10706/371472 [51:45<26:35:45,  3.77it/s]
  3%|▎         | 10707/371472 [51:46<27:34:21,  3.63it/s]
  3%|▎         | 10708/371472 [51:46<27:30:20,  3.64it/s]
  3%|▎         | 10709/371472 [51:46<28:15:07,  3.55it/s]
  3%|▎         | 10710/371472 [51:47<27:30:04,  3.64it/s]
  3%|▎         | 10711/371472 [51:47<27:06:52,  3.70it/s]
  3%|▎         | 10712/371472 [51:47<26:53:58,  3.73it/s]
  3%|▎         | 10713/371472 [51:47<30:16:41,  3.31it/s]
  3%|▎         | 10714/371472 [51:48<29:13:49,  3.43it/s]
  3%|▎         | 10715/371472 [51:48<29:10:48,  3.43it/s]
  3%|▎         | 10716/371472 [51:48<28:47:48,  3.48it/s]
  3%|▎         | 10717/371472 [51:49<29:00:31,  3.45it/s]
  3%|▎         | 10718/371472 [51:49<28:16:32,  3.54it/s]
  3%|▎         | 10719/371472 [51:49<27:49:33,  3.60it/s]
  3%|▎         | 10720/371472 [51:49<26:58:41,  3.71it/s]
                                                         
{'loss': 5.0721, 'learning_rate': 9.744984808981016e-07, 'epoch': 0.46}

  3%|▎         | 10720/371472 [51:49<26:58:41,  3.71it/s]
  3%|▎         | 10721/371472 [51:50<27:15:11,  3.68it/s]
  3%|▎         | 10722/371472 [51:50<27:10:00,  3.69it/s]
  3%|▎         | 10723/371472 [51:50<27:29:22,  3.65it/s]
  3%|▎         | 10724/371472 [51:50<27:22:59,  3.66it/s]
  3%|▎         | 10725/371472 [51:51<28:12:22,  3.55it/s]
  3%|▎         | 10726/371472 [51:51<28:38:26,  3.50it/s]
  3%|▎         | 10727/371472 [51:51<29:49:21,  3.36it/s]
  3%|▎         | 10728/371472 [51:52<29:45:59,  3.37it/s]
  3%|▎         | 10729/371472 [51:52<31:11:32,  3.21it/s]
  3%|▎         | 10730/371472 [51:52<33:14:36,  3.01it/s]
  3%|▎         | 10731/371472 [51:53<31:51:33,  3.15it/s]
  3%|▎         | 10732/371472 [51:53<30:54:32,  3.24it/s]
  3%|▎         | 10733/371472 [51:53<30:16:09,  3.31it/s]
  3%|▎         | 10734/371472 [51:54<31:56:43,  3.14it/s]
  3%|▎         | 10735/371472 [51:54<30:27:43,  3.29it/s]
  3%|▎         | 10736/371472 [51:54<29:25:43,  3.40it/s]
  3%|▎         | 10737/371472 [51:54<29:11:57,  3.43it/s]
  3%|▎         | 10738/371472 [51:55<27:42:15,  3.62it/s]
  3%|▎         | 10739/371472 [51:55<27:18:27,  3.67it/s]
  3%|▎         | 10740/371472 [51:55<27:12:11,  3.68it/s]
                                                         
{'loss': 5.223, 'learning_rate': 9.744499989226228e-07, 'epoch': 0.46}

  3%|▎         | 10740/371472 [51:55<27:12:11,  3.68it/s]
  3%|▎         | 10741/371472 [51:56<28:55:03,  3.47it/s]
  3%|▎         | 10742/371472 [51:56<29:39:48,  3.38it/s]
  3%|▎         | 10743/371472 [51:56<30:41:00,  3.27it/s]
  3%|▎         | 10744/371472 [51:56<28:55:05,  3.47it/s]
  3%|▎         | 10745/371472 [51:57<29:07:36,  3.44it/s]
  3%|▎         | 10746/371472 [51:57<30:17:25,  3.31it/s]
  3%|▎         | 10747/371472 [51:57<30:31:11,  3.28it/s]
  3%|▎         | 10748/371472 [51:58<30:05:03,  3.33it/s]
  3%|▎         | 10749/371472 [51:58<30:15:23,  3.31it/s]
  3%|▎         | 10750/371472 [51:58<30:12:58,  3.32it/s]
  3%|▎         | 10751/371472 [51:59<29:10:29,  3.43it/s]
  3%|▎         | 10752/371472 [51:59<28:32:45,  3.51it/s]
  3%|▎         | 10753/371472 [51:59<29:51:32,  3.36it/s]
  3%|▎         | 10754/371472 [51:59<29:44:49,  3.37it/s]
  3%|▎         | 10755/371472 [52:00<31:57:49,  3.13it/s]
  3%|▎         | 10756/371472 [52:00<31:09:58,  3.21it/s]
  3%|▎         | 10757/371472 [52:00<29:20:25,  3.42it/s]
  3%|▎         | 10758/371472 [52:01<29:12:34,  3.43it/s]
  3%|▎         | 10759/371472 [52:01<28:59:26,  3.46it/s]
  3%|▎         | 10760/371472 [52:01<29:31:44,  3.39it/s]
                                                         
{'loss': 4.7617, 'learning_rate': 9.744015169471437e-07, 'epoch': 0.46}

  3%|▎         | 10760/371472 [52:01<29:31:44,  3.39it/s]
  3%|▎         | 10761/371472 [52:02<29:45:41,  3.37it/s]
  3%|▎         | 10762/371472 [52:02<30:18:37,  3.31it/s]
  3%|▎         | 10763/371472 [52:02<30:52:42,  3.24it/s]
  3%|▎         | 10764/371472 [52:02<29:26:14,  3.40it/s]
  3%|▎         | 10765/371472 [52:03<27:55:03,  3.59it/s]
  3%|▎         | 10766/371472 [52:03<27:29:50,  3.64it/s]
  3%|▎         | 10767/371472 [52:03<28:08:36,  3.56it/s]
  3%|▎         | 10768/371472 [52:04<28:48:33,  3.48it/s]
  3%|▎         | 10769/371472 [52:04<30:23:45,  3.30it/s]
  3%|▎         | 10770/371472 [52:04<30:52:35,  3.25it/s]
  3%|▎         | 10771/371472 [52:05<30:29:44,  3.29it/s]
  3%|▎         | 10772/371472 [52:05<30:09:30,  3.32it/s]
  3%|▎         | 10773/371472 [52:05<29:08:32,  3.44it/s]
  3%|▎         | 10774/371472 [52:05<28:01:20,  3.58it/s]
  3%|▎         | 10775/371472 [52:06<30:53:30,  3.24it/s]
  3%|▎         | 10776/371472 [52:06<29:58:16,  3.34it/s]
  3%|▎         | 10777/371472 [52:06<29:02:09,  3.45it/s]
  3%|▎         | 10778/371472 [52:07<28:21:31,  3.53it/s]
  3%|▎         | 10779/371472 [52:07<27:35:01,  3.63it/s]
  3%|▎         | 10780/371472 [52:07<27:19:54,  3.67it/s]
                                                         
{'loss': 4.7315, 'learning_rate': 9.74353034971665e-07, 'epoch': 0.46}

  3%|▎         | 10780/371472 [52:07<27:19:54,  3.67it/s]
  3%|▎         | 10781/371472 [52:07<27:48:10,  3.60it/s]
  3%|▎         | 10782/371472 [52:08<27:16:45,  3.67it/s]
  3%|▎         | 10783/371472 [52:08<27:54:53,  3.59it/s]
  3%|▎         | 10784/371472 [52:08<27:57:25,  3.58it/s]
  3%|▎         | 10785/371472 [52:08<27:28:22,  3.65it/s]
  3%|▎         | 10786/371472 [52:09<26:38:05,  3.76it/s]
  3%|▎         | 10787/371472 [52:09<27:23:33,  3.66it/s]
  3%|▎         | 10788/371472 [52:09<28:07:38,  3.56it/s]
  3%|▎         | 10789/371472 [52:10<27:22:03,  3.66it/s]
  3%|▎         | 10790/371472 [52:10<27:18:35,  3.67it/s]
  3%|▎         | 10791/371472 [52:10<27:24:59,  3.65it/s]
  3%|▎         | 10792/371472 [52:10<28:12:54,  3.55it/s]
  3%|▎         | 10793/371472 [52:11<28:14:04,  3.55it/s]
  3%|▎         | 10794/371472 [52:11<28:21:08,  3.53it/s]
  3%|▎         | 10795/371472 [52:11<27:25:17,  3.65it/s]
  3%|▎         | 10796/371472 [52:11<27:45:08,  3.61it/s]
  3%|▎         | 10797/371472 [52:12<29:04:38,  3.45it/s]
  3%|▎         | 10798/371472 [52:12<29:11:18,  3.43it/s]
  3%|▎         | 10799/371472 [52:12<30:54:35,  3.24it/s]
  3%|▎         | 10800/371472 [52:13<30:15:26,  3.31it/s]
                                                         
{'loss': 5.0133, 'learning_rate': 9.74304552996186e-07, 'epoch': 0.47}

  3%|▎         | 10800/371472 [52:13<30:15:26,  3.31it/s]
  3%|▎         | 10801/371472 [52:13<31:08:44,  3.22it/s]
  3%|▎         | 10802/371472 [52:13<30:59:08,  3.23it/s]
  3%|▎         | 10803/371472 [52:14<31:45:01,  3.16it/s]
  3%|▎         | 10804/371472 [52:14<30:54:46,  3.24it/s]
  3%|▎         | 10805/371472 [52:14<29:20:09,  3.42it/s]
  3%|▎         | 10806/371472 [52:15<29:30:15,  3.40it/s]
  3%|▎         | 10807/371472 [52:15<29:19:12,  3.42it/s]
  3%|▎         | 10808/371472 [52:15<30:00:22,  3.34it/s]
  3%|▎         | 10809/371472 [52:15<29:45:15,  3.37it/s]
  3%|▎         | 10810/371472 [52:16<28:01:35,  3.57it/s]
  3%|▎         | 10811/371472 [52:16<27:37:37,  3.63it/s]
  3%|▎         | 10812/371472 [52:16<26:55:22,  3.72it/s]
  3%|▎         | 10813/371472 [52:17<29:30:21,  3.40it/s]
  3%|▎         | 10814/371472 [52:17<28:32:15,  3.51it/s]
  3%|▎         | 10815/371472 [52:17<29:39:16,  3.38it/s]
  3%|▎         | 10816/371472 [52:17<30:06:40,  3.33it/s]
  3%|▎         | 10817/371472 [52:18<29:25:43,  3.40it/s]
  3%|▎         | 10818/371472 [52:18<28:31:32,  3.51it/s]
  3%|▎         | 10819/371472 [52:18<27:39:37,  3.62it/s]
  3%|▎         | 10820/371472 [52:19<27:40:50,  3.62it/s]
                                                         
{'loss': 4.5951, 'learning_rate': 9.742560710207071e-07, 'epoch': 0.47}

  3%|▎         | 10820/371472 [52:19<27:40:50,  3.62it/s]
  3%|▎         | 10821/371472 [52:19<27:11:02,  3.69it/s]
  3%|▎         | 10822/371472 [52:19<27:01:14,  3.71it/s]
  3%|▎         | 10823/371472 [52:19<26:44:46,  3.75it/s]
  3%|▎         | 10824/371472 [52:20<26:23:25,  3.80it/s]
  3%|▎         | 10825/371472 [52:20<26:54:52,  3.72it/s]
  3%|▎         | 10826/371472 [52:20<26:34:19,  3.77it/s]
  3%|▎         | 10827/371472 [52:20<26:31:05,  3.78it/s]
  3%|▎         | 10828/371472 [52:21<27:31:02,  3.64it/s]
  3%|▎         | 10829/371472 [52:21<28:17:10,  3.54it/s]
  3%|▎         | 10830/371472 [52:21<27:33:17,  3.64it/s]
  3%|▎         | 10831/371472 [52:21<26:44:41,  3.75it/s]
  3%|▎         | 10832/371472 [52:22<27:00:45,  3.71it/s]
  3%|▎         | 10833/371472 [52:22<27:53:11,  3.59it/s]
  3%|▎         | 10834/371472 [52:22<31:08:11,  3.22it/s]
  3%|▎         | 10835/371472 [52:23<30:40:11,  3.27it/s]
  3%|▎         | 10836/371472 [52:23<30:52:49,  3.24it/s]
  3%|▎         | 10837/371472 [52:23<30:26:13,  3.29it/s]
  3%|▎         | 10838/371472 [52:24<29:35:32,  3.39it/s]
  3%|▎         | 10839/371472 [52:24<28:06:14,  3.56it/s]
  3%|▎         | 10840/371472 [52:24<29:24:36,  3.41it/s]
                                                         
{'loss': 5.0109, 'learning_rate': 9.742075890452282e-07, 'epoch': 0.47}

  3%|▎         | 10840/371472 [52:24<29:24:36,  3.41it/s]
  3%|▎         | 10841/371472 [52:24<28:23:30,  3.53it/s]
  3%|▎         | 10842/371472 [52:25<27:12:21,  3.68it/s]
  3%|▎         | 10843/371472 [52:25<27:43:09,  3.61it/s]
  3%|▎         | 10844/371472 [52:25<27:57:28,  3.58it/s]
  3%|▎         | 10845/371472 [52:26<27:38:38,  3.62it/s]
  3%|▎         | 10846/371472 [52:26<28:20:07,  3.54it/s]
  3%|▎         | 10847/371472 [52:26<28:25:21,  3.52it/s]
  3%|▎         | 10848/371472 [52:26<28:46:38,  3.48it/s]
  3%|▎         | 10849/371472 [52:27<28:10:32,  3.56it/s]
  3%|▎         | 10850/371472 [52:27<27:56:34,  3.58it/s]
  3%|▎         | 10851/371472 [52:27<27:59:06,  3.58it/s]
  3%|▎         | 10852/371472 [52:28<29:38:05,  3.38it/s]
  3%|▎         | 10853/371472 [52:28<28:45:30,  3.48it/s]
  3%|▎         | 10854/371472 [52:28<29:23:46,  3.41it/s]
  3%|▎         | 10855/371472 [52:28<29:07:10,  3.44it/s]
  3%|▎         | 10856/371472 [52:29<28:52:21,  3.47it/s]
  3%|▎         | 10857/371472 [52:29<28:22:21,  3.53it/s]
  3%|▎         | 10858/371472 [52:29<28:04:28,  3.57it/s]
  3%|▎         | 10859/371472 [52:30<29:27:24,  3.40it/s]
  3%|▎         | 10860/371472 [52:30<29:54:06,  3.35it/s]
                                                         
{'loss': 4.7951, 'learning_rate': 9.741591070697493e-07, 'epoch': 0.47}

  3%|▎         | 10860/371472 [52:30<29:54:06,  3.35it/s]
  3%|▎         | 10861/371472 [52:30<29:46:58,  3.36it/s]
  3%|▎         | 10862/371472 [52:30<29:02:23,  3.45it/s]
  3%|▎         | 10863/371472 [52:31<29:34:48,  3.39it/s]
  3%|▎         | 10864/371472 [52:31<28:55:01,  3.46it/s]
  3%|▎         | 10865/371472 [52:31<28:27:43,  3.52it/s]
  3%|▎         | 10866/371472 [52:32<27:49:52,  3.60it/s]
  3%|▎         | 10867/371472 [52:32<27:38:15,  3.62it/s]
  3%|▎         | 10868/371472 [52:32<28:46:06,  3.48it/s]
  3%|▎         | 10869/371472 [52:32<28:43:57,  3.49it/s]
  3%|▎         | 10870/371472 [52:33<28:23:19,  3.53it/s]
  3%|▎         | 10871/371472 [52:33<31:26:23,  3.19it/s]
  3%|▎         | 10872/371472 [52:33<30:03:13,  3.33it/s]
  3%|▎         | 10873/371472 [52:34<30:46:27,  3.25it/s]
  3%|▎         | 10874/371472 [52:34<29:53:06,  3.35it/s]
  3%|▎         | 10875/371472 [52:34<29:32:36,  3.39it/s]
  3%|▎         | 10876/371472 [52:34<28:08:44,  3.56it/s]
  3%|▎         | 10877/371472 [52:35<28:12:17,  3.55it/s]
  3%|▎         | 10878/371472 [52:35<29:50:23,  3.36it/s]
  3%|▎         | 10879/371472 [52:35<30:28:39,  3.29it/s]
  3%|▎         | 10880/371472 [52:36<29:49:12,  3.36it/s]
                                                         
{'loss': 4.9083, 'learning_rate': 9.741106250942706e-07, 'epoch': 0.47}

  3%|▎         | 10880/371472 [52:36<29:49:12,  3.36it/s]
  3%|▎         | 10881/371472 [52:36<30:10:40,  3.32it/s]
  3%|▎         | 10882/371472 [52:36<28:49:18,  3.48it/s]
  3%|▎         | 10883/371472 [52:37<28:10:32,  3.55it/s]
  3%|▎         | 10884/371472 [52:37<28:36:02,  3.50it/s]
  3%|▎         | 10885/371472 [52:37<28:04:54,  3.57it/s]
  3%|▎         | 10886/371472 [52:37<28:13:04,  3.55it/s]
  3%|▎         | 10887/371472 [52:38<28:03:40,  3.57it/s]
  3%|▎         | 10888/371472 [52:38<28:15:05,  3.55it/s]
  3%|▎         | 10889/371472 [52:38<28:44:10,  3.49it/s]
  3%|▎         | 10890/371472 [52:39<28:24:48,  3.53it/s]
  3%|▎         | 10891/371472 [52:39<28:26:20,  3.52it/s]
  3%|▎         | 10892/371472 [52:39<27:50:39,  3.60it/s]
  3%|▎         | 10893/371472 [52:39<27:13:14,  3.68it/s]
  3%|▎         | 10894/371472 [52:40<27:34:23,  3.63it/s]
  3%|▎         | 10895/371472 [52:40<28:11:12,  3.55it/s]
  3%|▎         | 10896/371472 [52:40<27:44:29,  3.61it/s]
  3%|▎         | 10897/371472 [52:40<27:19:27,  3.67it/s]
  3%|▎         | 10898/371472 [52:41<26:38:14,  3.76it/s]
  3%|▎         | 10899/371472 [52:41<26:38:31,  3.76it/s]
  3%|▎         | 10900/371472 [52:41<26:55:35,  3.72it/s]
                                                         
{'loss': 5.0881, 'learning_rate': 9.740621431187916e-07, 'epoch': 0.47}

  3%|▎         | 10900/371472 [52:41<26:55:35,  3.72it/s]
  3%|▎         | 10901/371472 [52:41<26:36:57,  3.76it/s]
  3%|▎         | 10902/371472 [52:42<26:54:13,  3.72it/s]
  3%|▎         | 10903/371472 [52:42<27:24:19,  3.65it/s]
  3%|▎         | 10904/371472 [52:42<28:36:12,  3.50it/s]
  3%|▎         | 10905/371472 [52:43<28:56:01,  3.46it/s]
  3%|▎         | 10906/371472 [52:43<28:30:31,  3.51it/s]
  3%|▎         | 10907/371472 [52:43<28:55:48,  3.46it/s]
  3%|▎         | 10908/371472 [52:44<29:50:53,  3.36it/s]
  3%|▎         | 10909/371472 [52:44<28:45:17,  3.48it/s]
  3%|▎         | 10910/371472 [52:44<28:08:08,  3.56it/s]
  3%|▎         | 10911/371472 [52:44<28:43:29,  3.49it/s]
  3%|▎         | 10912/371472 [52:45<27:52:15,  3.59it/s]
  3%|▎         | 10913/371472 [52:45<29:07:03,  3.44it/s]
  3%|▎         | 10914/371472 [52:45<32:39:31,  3.07it/s]
  3%|▎         | 10915/371472 [52:46<31:12:25,  3.21it/s]
  3%|▎         | 10916/371472 [52:46<30:16:00,  3.31it/s]
  3%|▎         | 10917/371472 [52:46<31:15:46,  3.20it/s]
  3%|▎         | 10918/371472 [52:47<29:26:28,  3.40it/s]
  3%|▎         | 10919/371472 [52:47<29:08:15,  3.44it/s]
  3%|▎         | 10920/371472 [52:47<31:14:03,  3.21it/s]
                                                         
{'loss': 4.9049, 'learning_rate': 9.740136611433127e-07, 'epoch': 0.47}

  3%|▎         | 10920/371472 [52:47<31:14:03,  3.21it/s]
  3%|▎         | 10921/371472 [52:47<30:30:35,  3.28it/s]
  3%|▎         | 10922/371472 [52:48<30:01:18,  3.34it/s]
  3%|▎         | 10923/371472 [52:48<29:08:05,  3.44it/s]
  3%|▎         | 10924/371472 [52:48<31:44:22,  3.16it/s]
  3%|▎         | 10925/371472 [52:49<29:39:08,  3.38it/s]
  3%|▎         | 10926/371472 [52:49<29:04:45,  3.44it/s]
  3%|▎         | 10927/371472 [52:49<28:00:14,  3.58it/s]
  3%|▎         | 10928/371472 [52:49<27:29:52,  3.64it/s]
  3%|▎         | 10929/371472 [52:50<27:01:49,  3.71it/s]
  3%|▎         | 10930/371472 [52:50<26:13:32,  3.82it/s]
  3%|▎         | 10931/371472 [52:50<28:04:17,  3.57it/s]
  3%|▎         | 10932/371472 [52:51<27:38:44,  3.62it/s]
  3%|▎         | 10933/371472 [52:51<26:52:04,  3.73it/s]
  3%|▎         | 10934/371472 [52:51<26:47:05,  3.74it/s]
  3%|▎         | 10935/371472 [52:51<27:29:38,  3.64it/s]
  3%|▎         | 10936/371472 [52:52<27:19:00,  3.67it/s]
  3%|▎         | 10937/371472 [52:52<29:27:49,  3.40it/s]
  3%|▎         | 10938/371472 [52:52<30:16:19,  3.31it/s]
  3%|▎         | 10939/371472 [52:53<29:32:10,  3.39it/s]
  3%|▎         | 10940/371472 [52:53<29:47:08,  3.36it/s]
                                                         
{'loss': 5.0503, 'learning_rate': 9.73965179167834e-07, 'epoch': 0.47}

  3%|▎         | 10940/371472 [52:53<29:47:08,  3.36it/s]
  3%|▎         | 10941/371472 [52:53<31:12:31,  3.21it/s]
  3%|▎         | 10942/371472 [52:53<29:15:34,  3.42it/s]
  3%|▎         | 10943/371472 [52:54<29:20:11,  3.41it/s]
  3%|▎         | 10944/371472 [52:54<29:05:15,  3.44it/s]
  3%|▎         | 10945/371472 [52:54<27:40:14,  3.62it/s]
  3%|▎         | 10946/371472 [52:55<27:50:01,  3.60it/s]
  3%|▎         | 10947/371472 [52:55<27:43:14,  3.61it/s]
  3%|▎         | 10948/371472 [52:55<27:26:02,  3.65it/s]
  3%|▎         | 10949/371472 [52:55<28:01:21,  3.57it/s]
  3%|▎         | 10950/371472 [52:56<29:29:27,  3.40it/s]
  3%|▎         | 10951/371472 [52:56<30:26:51,  3.29it/s]
  3%|▎         | 10952/371472 [52:56<29:16:21,  3.42it/s]
  3%|▎         | 10953/371472 [52:57<29:57:51,  3.34it/s]
  3%|▎         | 10954/371472 [52:57<29:23:47,  3.41it/s]
  3%|▎         | 10955/371472 [52:57<29:52:56,  3.35it/s]
  3%|▎         | 10956/371472 [52:57<29:26:19,  3.40it/s]
  3%|▎         | 10957/371472 [52:58<28:49:19,  3.47it/s]
  3%|▎         | 10958/371472 [52:58<29:44:35,  3.37it/s]
  3%|▎         | 10959/371472 [52:58<28:25:36,  3.52it/s]
  3%|▎         | 10960/371472 [52:59<29:36:16,  3.38it/s]
                                                         
{'loss': 5.1389, 'learning_rate': 9.739166971923548e-07, 'epoch': 0.47}

  3%|▎         | 10960/371472 [52:59<29:36:16,  3.38it/s]
  3%|▎         | 10961/371472 [52:59<30:12:16,  3.32it/s]
  3%|▎         | 10962/371472 [52:59<29:51:12,  3.35it/s]
  3%|▎         | 10963/371472 [53:00<29:48:42,  3.36it/s]
  3%|▎         | 10964/371472 [53:00<28:56:26,  3.46it/s]
  3%|▎         | 10965/371472 [53:00<27:33:49,  3.63it/s]
  3%|▎         | 10966/371472 [53:00<27:42:02,  3.62it/s]
  3%|▎         | 10967/371472 [53:01<28:23:31,  3.53it/s]
  3%|▎         | 10968/371472 [53:01<28:10:15,  3.55it/s]
  3%|▎         | 10969/371472 [53:01<27:46:06,  3.61it/s]
  3%|▎         | 10970/371472 [53:01<28:01:37,  3.57it/s]
  3%|▎         | 10971/371472 [53:02<27:46:28,  3.61it/s]
  3%|▎         | 10972/371472 [53:02<27:46:24,  3.61it/s]
  3%|▎         | 10973/371472 [53:02<27:43:25,  3.61it/s]
  3%|▎         | 10974/371472 [53:03<27:55:13,  3.59it/s]
  3%|▎         | 10975/371472 [53:03<27:03:04,  3.70it/s]
  3%|▎         | 10976/371472 [53:03<28:38:48,  3.50it/s]
  3%|▎         | 10977/371472 [53:03<28:25:44,  3.52it/s]
  3%|▎         | 10978/371472 [53:04<28:18:55,  3.54it/s]
  3%|▎         | 10979/371472 [53:04<29:18:43,  3.42it/s]
  3%|▎         | 10980/371472 [53:04<29:11:38,  3.43it/s]
                                                         
{'loss': 4.6824, 'learning_rate': 9.73868215216876e-07, 'epoch': 0.47}

  3%|▎         | 10980/371472 [53:04<29:11:38,  3.43it/s]
  3%|▎         | 10981/371472 [53:05<29:34:24,  3.39it/s]
  3%|▎         | 10982/371472 [53:05<30:49:17,  3.25it/s]
  3%|▎         | 10983/371472 [53:05<29:30:30,  3.39it/s]
  3%|▎         | 10984/371472 [53:06<28:54:12,  3.46it/s]
  3%|▎         | 10985/371472 [53:06<28:18:54,  3.54it/s]
  3%|▎         | 10986/371472 [53:06<28:27:35,  3.52it/s]
  3%|▎         | 10987/371472 [53:06<28:21:25,  3.53it/s]
  3%|▎         | 10988/371472 [53:07<29:07:19,  3.44it/s]
  3%|▎         | 10989/371472 [53:07<28:38:19,  3.50it/s]
  3%|▎         | 10990/371472 [53:07<28:44:57,  3.48it/s]
  3%|▎         | 10991/371472 [53:07<27:55:28,  3.59it/s]
  3%|▎         | 10992/371472 [53:08<28:30:06,  3.51it/s]
  3%|▎         | 10993/371472 [53:08<28:26:37,  3.52it/s]
  3%|▎         | 10994/371472 [53:08<28:31:12,  3.51it/s]
  3%|▎         | 10995/371472 [53:09<28:27:48,  3.52it/s]
  3%|▎         | 10996/371472 [53:09<27:39:01,  3.62it/s]
  3%|▎         | 10997/371472 [53:09<28:42:00,  3.49it/s]
  3%|▎         | 10998/371472 [53:09<28:24:16,  3.53it/s]
  3%|▎         | 10999/371472 [53:10<27:39:05,  3.62it/s]
  3%|▎         | 11000/371472 [53:10<28:14:21,  3.55it/s]
                                                         
{'loss': 5.0677, 'learning_rate': 9.73819733241397e-07, 'epoch': 0.47}

  3%|▎         | 11000/371472 [53:10<28:14:21,  3.55it/s]
  3%|▎         | 11001/371472 [53:10<28:03:59,  3.57it/s]
  3%|▎         | 11002/371472 [53:11<29:50:22,  3.36it/s]
  3%|▎         | 11003/371472 [53:11<29:05:09,  3.44it/s]
  3%|▎         | 11004/371472 [53:11<28:21:57,  3.53it/s]
  3%|▎         | 11005/371472 [53:11<29:11:32,  3.43it/s]
  3%|▎         | 11006/371472 [53:12<28:43:54,  3.48it/s]
  3%|▎         | 11007/371472 [53:12<27:35:54,  3.63it/s]
  3%|▎         | 11008/371472 [53:12<27:36:37,  3.63it/s]
  3%|▎         | 11009/371472 [53:13<28:16:38,  3.54it/s]
  3%|▎         | 11010/371472 [53:13<28:09:43,  3.56it/s]
  3%|▎         | 11011/371472 [53:13<30:24:58,  3.29it/s]
  3%|▎         | 11012/371472 [53:13<29:36:12,  3.38it/s]
  3%|▎         | 11013/371472 [53:14<29:29:53,  3.39it/s]
  3%|▎         | 11014/371472 [53:14<28:16:17,  3.54it/s]
  3%|▎         | 11015/371472 [53:14<28:30:35,  3.51it/s]
  3%|▎         | 11016/371472 [53:15<30:11:05,  3.32it/s]
  3%|▎         | 11017/371472 [53:15<29:49:51,  3.36it/s]
  3%|▎         | 11018/371472 [53:15<29:33:39,  3.39it/s]
  3%|▎         | 11019/371472 [53:16<29:42:31,  3.37it/s]
  3%|▎         | 11020/371472 [53:16<29:31:05,  3.39it/s]
                                                         
{'loss': 4.8373, 'learning_rate': 9.737712512659183e-07, 'epoch': 0.47}

  3%|▎         | 11020/371472 [53:16<29:31:05,  3.39it/s]
  3%|▎         | 11021/371472 [53:16<29:51:35,  3.35it/s]
  3%|▎         | 11022/371472 [53:17<32:11:44,  3.11it/s]
  3%|▎         | 11023/371472 [53:17<30:54:11,  3.24it/s]
  3%|▎         | 11024/371472 [53:17<29:34:16,  3.39it/s]
  3%|▎         | 11025/371472 [53:17<32:53:06,  3.04it/s]
  3%|▎         | 11026/371472 [53:18<34:13:07,  2.93it/s]
  3%|▎         | 11027/371472 [53:18<32:51:24,  3.05it/s]
  3%|▎         | 11028/371472 [53:18<30:39:30,  3.27it/s]
  3%|▎         | 11029/371472 [53:19<33:47:26,  2.96it/s]
  3%|▎         | 11030/371472 [53:19<32:38:59,  3.07it/s]
  3%|▎         | 11031/371472 [53:19<31:43:23,  3.16it/s]
  3%|▎         | 11032/371472 [53:20<30:55:28,  3.24it/s]
  3%|▎         | 11033/371472 [53:20<29:59:11,  3.34it/s]
  3%|▎         | 11034/371472 [53:20<30:13:31,  3.31it/s]
  3%|▎         | 11035/371472 [53:21<29:20:56,  3.41it/s]
  3%|▎         | 11036/371472 [53:21<28:45:10,  3.48it/s]
  3%|▎         | 11037/371472 [53:21<31:22:16,  3.19it/s]
  3%|▎         | 11038/371472 [53:21<29:30:58,  3.39it/s]
  3%|▎         | 11039/371472 [53:22<29:06:02,  3.44it/s]
  3%|▎         | 11040/371472 [53:22<28:29:53,  3.51it/s]
                                                         
{'loss': 4.7048, 'learning_rate': 9.737227692904393e-07, 'epoch': 0.48}

  3%|▎         | 11040/371472 [53:22<28:29:53,  3.51it/s]
  3%|▎         | 11041/371472 [53:22<28:52:40,  3.47it/s]
  3%|▎         | 11042/371472 [53:23<30:04:40,  3.33it/s]
  3%|▎         | 11043/371472 [53:23<29:38:17,  3.38it/s]
  3%|▎         | 11044/371472 [53:23<28:58:47,  3.45it/s]
  3%|▎         | 11045/371472 [53:23<29:11:30,  3.43it/s]
  3%|▎         | 11046/371472 [53:24<31:13:49,  3.21it/s]
  3%|▎         | 11047/371472 [53:24<30:12:03,  3.32it/s]
  3%|▎         | 11048/371472 [53:24<30:08:44,  3.32it/s]
  3%|▎         | 11049/371472 [53:25<30:46:34,  3.25it/s]
  3%|▎         | 11050/371472 [53:25<30:39:35,  3.27it/s]
  3%|▎         | 11051/371472 [53:25<29:37:32,  3.38it/s]
  3%|▎         | 11052/371472 [53:26<29:25:48,  3.40it/s]
  3%|▎         | 11053/371472 [53:26<28:16:18,  3.54it/s]
  3%|▎         | 11054/371472 [53:26<28:04:46,  3.57it/s]
  3%|▎         | 11055/371472 [53:26<29:48:18,  3.36it/s]
  3%|▎         | 11056/371472 [53:27<29:08:28,  3.44it/s]
  3%|▎         | 11057/371472 [53:27<30:14:47,  3.31it/s]
  3%|▎         | 11058/371472 [53:27<29:38:02,  3.38it/s]
  3%|▎         | 11059/371472 [53:28<28:58:30,  3.46it/s]
  3%|▎         | 11060/371472 [53:28<28:31:52,  3.51it/s]
                                                         
{'loss': 4.7661, 'learning_rate': 9.736742873149604e-07, 'epoch': 0.48}

  3%|▎         | 11060/371472 [53:28<28:31:52,  3.51it/s]
  3%|▎         | 11061/371472 [53:28<31:06:14,  3.22it/s]
  3%|▎         | 11062/371472 [53:29<32:11:11,  3.11it/s]
  3%|▎         | 11063/371472 [53:29<30:59:00,  3.23it/s]
  3%|▎         | 11064/371472 [53:29<29:55:01,  3.35it/s]
  3%|▎         | 11065/371472 [53:29<28:52:35,  3.47it/s]
  3%|▎         | 11066/371472 [53:30<29:18:27,  3.42it/s]
  3%|▎         | 11067/371472 [53:30<30:14:07,  3.31it/s]
  3%|▎         | 11068/371472 [53:30<29:51:37,  3.35it/s]
  3%|▎         | 11069/371472 [53:31<30:54:22,  3.24it/s]
  3%|▎         | 11070/371472 [53:31<30:37:43,  3.27it/s]
  3%|▎         | 11071/371472 [53:31<29:58:59,  3.34it/s]
  3%|▎         | 11072/371472 [53:32<29:14:53,  3.42it/s]
  3%|▎         | 11073/371472 [53:32<37:50:30,  2.65it/s]
  3%|▎         | 11074/371472 [53:32<36:04:19,  2.78it/s]
  3%|▎         | 11075/371472 [53:33<33:27:55,  2.99it/s]
  3%|▎         | 11076/371472 [53:33<32:41:19,  3.06it/s]
  3%|▎         | 11077/371472 [53:33<31:39:14,  3.16it/s]
  3%|▎         | 11078/371472 [53:34<30:21:45,  3.30it/s]
  3%|▎         | 11079/371472 [53:34<30:42:00,  3.26it/s]
  3%|▎         | 11080/371472 [53:34<30:32:14,  3.28it/s]
                                                         
{'loss': 4.5163, 'learning_rate': 9.736258053394815e-07, 'epoch': 0.48}

  3%|▎         | 11080/371472 [53:34<30:32:14,  3.28it/s]
  3%|▎         | 11081/371472 [53:35<31:06:54,  3.22it/s]
  3%|▎         | 11082/371472 [53:35<29:22:06,  3.41it/s]
  3%|▎         | 11083/371472 [53:35<28:21:54,  3.53it/s]
  3%|▎         | 11084/371472 [53:35<27:51:36,  3.59it/s]
  3%|▎         | 11085/371472 [53:36<27:54:27,  3.59it/s]
  3%|▎         | 11086/371472 [53:36<27:32:52,  3.63it/s]
  3%|▎         | 11087/371472 [53:36<28:39:34,  3.49it/s]
  3%|▎         | 11088/371472 [53:36<28:31:49,  3.51it/s]
  3%|▎         | 11089/371472 [53:37<28:24:32,  3.52it/s]
  3%|▎         | 11090/371472 [53:37<28:24:22,  3.52it/s]
  3%|▎         | 11091/371472 [53:37<27:53:39,  3.59it/s]
  3%|▎         | 11092/371472 [53:38<28:59:44,  3.45it/s]
  3%|▎         | 11093/371472 [53:38<32:36:20,  3.07it/s]
  3%|▎         | 11094/371472 [53:38<30:52:22,  3.24it/s]
  3%|▎         | 11095/371472 [53:39<29:56:06,  3.34it/s]
  3%|▎         | 11096/371472 [53:39<29:11:29,  3.43it/s]
  3%|▎         | 11097/371472 [53:39<28:37:00,  3.50it/s]
  3%|▎         | 11098/371472 [53:39<28:07:08,  3.56it/s]
  3%|▎         | 11099/371472 [53:40<27:58:16,  3.58it/s]
  3%|▎         | 11100/371472 [53:40<26:56:26,  3.72it/s]
                                                         
{'loss': 4.8271, 'learning_rate': 9.735773233640026e-07, 'epoch': 0.48}

  3%|▎         | 11100/371472 [53:40<26:56:26,  3.72it/s]
  3%|▎         | 11101/371472 [53:40<26:25:27,  3.79it/s]
  3%|▎         | 11102/371472 [53:40<27:53:39,  3.59it/s]
  3%|▎         | 11103/371472 [53:41<27:02:03,  3.70it/s]
  3%|▎         | 11104/371472 [53:41<27:01:14,  3.70it/s]
  3%|▎         | 11105/371472 [53:41<27:18:12,  3.67it/s]
  3%|▎         | 11106/371472 [53:42<27:09:30,  3.69it/s]
  3%|▎         | 11107/371472 [53:42<26:43:02,  3.75it/s]
  3%|▎         | 11108/371472 [53:42<26:10:30,  3.82it/s]
  3%|▎         | 11109/371472 [53:42<27:04:04,  3.70it/s]
  3%|▎         | 11110/371472 [53:43<28:34:10,  3.50it/s]
  3%|▎         | 11111/371472 [53:43<28:36:07,  3.50it/s]
  3%|▎         | 11112/371472 [53:43<28:21:06,  3.53it/s]
  3%|▎         | 11113/371472 [53:44<28:36:29,  3.50it/s]
  3%|▎         | 11114/371472 [53:44<29:24:37,  3.40it/s]
  3%|▎         | 11115/371472 [53:44<29:55:44,  3.34it/s]
  3%|▎         | 11116/371472 [53:44<28:38:04,  3.50it/s]
  3%|▎         | 11117/371472 [53:45<27:28:22,  3.64it/s]
  3%|▎         | 11118/371472 [53:45<27:47:00,  3.60it/s]
  3%|▎         | 11119/371472 [53:45<27:13:35,  3.68it/s]
  3%|▎         | 11120/371472 [53:45<26:55:29,  3.72it/s]
                                                         
{'loss': 4.9904, 'learning_rate': 9.735288413885238e-07, 'epoch': 0.48}

  3%|▎         | 11120/371472 [53:45<26:55:29,  3.72it/s]
  3%|▎         | 11121/371472 [53:46<26:43:42,  3.74it/s]
  3%|▎         | 11122/371472 [53:46<26:13:44,  3.82it/s]
  3%|▎         | 11123/371472 [53:46<28:03:30,  3.57it/s]
  3%|▎         | 11124/371472 [53:47<29:55:20,  3.35it/s]
  3%|▎         | 11125/371472 [53:47<29:01:53,  3.45it/s]
  3%|▎         | 11126/371472 [53:47<29:08:17,  3.44it/s]
  3%|▎         | 11127/371472 [53:47<28:08:42,  3.56it/s]
  3%|▎         | 11128/371472 [53:48<29:19:04,  3.41it/s]
  3%|▎         | 11129/371472 [53:48<30:02:08,  3.33it/s]
  3%|▎         | 11130/371472 [53:48<30:32:09,  3.28it/s]
  3%|▎         | 11131/371472 [53:49<28:55:12,  3.46it/s]
  3%|▎         | 11132/371472 [53:49<27:51:59,  3.59it/s]
  3%|▎         | 11133/371472 [53:49<27:08:32,  3.69it/s]
  3%|▎         | 11134/371472 [53:49<26:41:22,  3.75it/s]
  3%|▎         | 11135/371472 [53:50<27:11:06,  3.68it/s]
  3%|▎         | 11136/371472 [53:50<27:31:16,  3.64it/s]
  3%|▎         | 11137/371472 [53:50<27:36:18,  3.63it/s]
  3%|▎         | 11138/371472 [53:51<27:33:30,  3.63it/s]
  3%|▎         | 11139/371472 [53:51<28:38:42,  3.49it/s]
  3%|▎         | 11140/371472 [53:51<29:43:30,  3.37it/s]
                                                         
{'loss': 5.1391, 'learning_rate': 9.734803594130447e-07, 'epoch': 0.48}

  3%|▎         | 11140/371472 [53:51<29:43:30,  3.37it/s]
  3%|▎         | 11141/371472 [53:51<29:42:51,  3.37it/s]
  3%|▎         | 11142/371472 [53:52<29:16:31,  3.42it/s]
  3%|▎         | 11143/371472 [53:52<29:31:31,  3.39it/s]
  3%|▎         | 11144/371472 [53:52<28:19:39,  3.53it/s]
  3%|▎         | 11145/371472 [53:53<29:30:43,  3.39it/s]
  3%|▎         | 11146/371472 [53:53<29:00:19,  3.45it/s]
  3%|▎         | 11147/371472 [53:53<28:46:34,  3.48it/s]
  3%|▎         | 11148/371472 [53:53<28:05:53,  3.56it/s]
  3%|▎         | 11149/371472 [53:54<29:46:07,  3.36it/s]
  3%|▎         | 11150/371472 [53:54<28:53:33,  3.46it/s]
  3%|▎         | 11151/371472 [53:54<27:53:11,  3.59it/s]
  3%|▎         | 11152/371472 [53:55<27:15:58,  3.67it/s]
  3%|▎         | 11153/371472 [53:55<26:37:39,  3.76it/s]
  3%|▎         | 11154/371472 [53:55<28:24:02,  3.52it/s]
  3%|▎         | 11155/371472 [53:55<27:38:40,  3.62it/s]
  3%|▎         | 11156/371472 [53:56<28:11:58,  3.55it/s]
  3%|▎         | 11157/371472 [53:56<28:13:05,  3.55it/s]
  3%|▎         | 11158/371472 [53:56<27:16:14,  3.67it/s]
  3%|▎         | 11159/371472 [53:56<26:52:28,  3.72it/s]
  3%|▎         | 11160/371472 [53:57<27:16:48,  3.67it/s]
                                                         
{'loss': 4.9359, 'learning_rate': 9.73431877437566e-07, 'epoch': 0.48}

  3%|▎         | 11160/371472 [53:57<27:16:48,  3.67it/s]
  3%|▎         | 11161/371472 [53:57<26:52:09,  3.72it/s]
  3%|▎         | 11162/371472 [53:57<26:36:40,  3.76it/s]
  3%|▎         | 11163/371472 [53:58<26:18:50,  3.80it/s]
  3%|▎         | 11164/371472 [53:58<27:00:24,  3.71it/s]
  3%|▎         | 11165/371472 [53:58<26:42:58,  3.75it/s]
  3%|▎         | 11166/371472 [53:58<28:06:33,  3.56it/s]
  3%|▎         | 11167/371472 [53:59<30:08:34,  3.32it/s]
  3%|▎         | 11168/371472 [53:59<29:31:01,  3.39it/s]
  3%|▎         | 11169/371472 [53:59<29:30:26,  3.39it/s]
  3%|▎         | 11170/371472 [54:00<28:38:51,  3.49it/s]
  3%|▎         | 11171/371472 [54:00<27:47:47,  3.60it/s]
  3%|▎         | 11172/371472 [54:00<29:30:26,  3.39it/s]
  3%|▎         | 11173/371472 [54:00<30:04:01,  3.33it/s]
  3%|▎         | 11174/371472 [54:01<28:56:52,  3.46it/s]
  3%|▎         | 11175/371472 [54:01<28:51:36,  3.47it/s]
  3%|▎         | 11176/371472 [54:01<29:25:41,  3.40it/s]
  3%|▎         | 11177/371472 [54:02<30:17:25,  3.30it/s]
  3%|▎         | 11178/371472 [54:02<30:22:26,  3.29it/s]
  3%|▎         | 11179/371472 [54:02<29:28:53,  3.39it/s]
  3%|▎         | 11180/371472 [54:03<29:00:20,  3.45it/s]
                                                         
{'loss': 4.7196, 'learning_rate': 9.73383395462087e-07, 'epoch': 0.48}

  3%|▎         | 11180/371472 [54:03<29:00:20,  3.45it/s]
  3%|▎         | 11181/371472 [54:03<27:34:34,  3.63it/s]
  3%|▎         | 11182/371472 [54:03<27:45:04,  3.61it/s]
  3%|▎         | 11183/371472 [54:03<29:25:54,  3.40it/s]
  3%|▎         | 11184/371472 [54:04<28:38:56,  3.49it/s]
  3%|▎         | 11185/371472 [54:04<30:19:32,  3.30it/s]
  3%|▎         | 11186/371472 [54:04<29:46:10,  3.36it/s]
  3%|▎         | 11187/371472 [54:05<28:17:19,  3.54it/s]
  3%|▎         | 11188/371472 [54:05<30:17:53,  3.30it/s]
  3%|▎         | 11189/371472 [54:05<31:33:05,  3.17it/s]
  3%|▎         | 11190/371472 [54:06<30:50:28,  3.24it/s]
  3%|▎         | 11191/371472 [54:06<31:54:33,  3.14it/s]
  3%|▎         | 11192/371472 [54:06<31:25:24,  3.18it/s]
  3%|▎         | 11193/371472 [54:06<30:28:37,  3.28it/s]
  3%|▎         | 11194/371472 [54:07<31:17:03,  3.20it/s]
  3%|▎         | 11195/371472 [54:07<29:29:32,  3.39it/s]
  3%|▎         | 11196/371472 [54:07<31:58:52,  3.13it/s]
  3%|▎         | 11197/371472 [54:08<30:31:40,  3.28it/s]
  3%|▎         | 11198/371472 [54:08<31:46:24,  3.15it/s]
  3%|▎         | 11199/371472 [54:08<30:17:57,  3.30it/s]
  3%|▎         | 11200/371472 [54:09<29:44:38,  3.36it/s]
                                                         
{'loss': 4.8989, 'learning_rate': 9.733349134866081e-07, 'epoch': 0.48}

  3%|▎         | 11200/371472 [54:09<29:44:38,  3.36it/s]
  3%|▎         | 11201/371472 [54:09<28:23:08,  3.53it/s]
  3%|▎         | 11202/371472 [54:09<28:47:51,  3.48it/s]
  3%|▎         | 11203/371472 [54:09<28:51:05,  3.47it/s]
  3%|▎         | 11204/371472 [54:10<28:19:54,  3.53it/s]
  3%|▎         | 11205/371472 [54:10<29:17:05,  3.42it/s]
  3%|▎         | 11206/371472 [54:10<28:13:08,  3.55it/s]
  3%|▎         | 11207/371472 [54:11<27:48:14,  3.60it/s]
  3%|▎         | 11208/371472 [54:11<27:35:21,  3.63it/s]
  3%|▎         | 11209/371472 [54:11<27:49:02,  3.60it/s]
  3%|▎         | 11210/371472 [54:11<27:33:54,  3.63it/s]
  3%|▎         | 11211/371472 [54:12<29:26:42,  3.40it/s]
  3%|▎         | 11212/371472 [54:12<28:13:02,  3.55it/s]
  3%|▎         | 11213/371472 [54:12<29:12:53,  3.43it/s]
  3%|▎         | 11214/371472 [54:13<28:58:27,  3.45it/s]
  3%|▎         | 11215/371472 [54:13<28:00:41,  3.57it/s]
  3%|▎         | 11216/371472 [54:13<27:51:31,  3.59it/s]
  3%|▎         | 11217/371472 [54:13<28:32:53,  3.51it/s]
  3%|▎         | 11218/371472 [54:14<29:18:18,  3.41it/s]
  3%|▎         | 11219/371472 [54:14<27:58:32,  3.58it/s]
  3%|▎         | 11220/371472 [54:14<29:49:39,  3.35it/s]
                                                         
{'loss': 4.5728, 'learning_rate': 9.732864315111292e-07, 'epoch': 0.48}

  3%|▎         | 11220/371472 [54:14<29:49:39,  3.35it/s]
  3%|▎         | 11221/371472 [54:15<30:10:20,  3.32it/s]
  3%|▎         | 11222/371472 [54:15<29:46:06,  3.36it/s]
  3%|▎         | 11223/371472 [54:15<28:09:57,  3.55it/s]
  3%|▎         | 11224/371472 [54:15<27:51:46,  3.59it/s]
  3%|▎         | 11225/371472 [54:16<27:31:40,  3.64it/s]
  3%|▎         | 11226/371472 [54:16<28:15:45,  3.54it/s]
  3%|▎         | 11227/371472 [54:16<28:05:43,  3.56it/s]
  3%|▎         | 11228/371472 [54:17<28:45:32,  3.48it/s]
  3%|▎         | 11229/371472 [54:17<28:17:17,  3.54it/s]
  3%|▎         | 11230/371472 [54:17<28:33:53,  3.50it/s]
  3%|▎         | 11231/371472 [54:17<28:52:49,  3.46it/s]
  3%|▎         | 11232/371472 [54:18<29:03:56,  3.44it/s]
  3%|▎         | 11233/371472 [54:18<29:37:25,  3.38it/s]
  3%|▎         | 11234/371472 [54:18<30:39:35,  3.26it/s]
  3%|▎         | 11235/371472 [54:19<30:23:49,  3.29it/s]
  3%|▎         | 11236/371472 [54:19<29:40:17,  3.37it/s]
  3%|▎         | 11237/371472 [54:19<29:18:50,  3.41it/s]
  3%|▎         | 11238/371472 [54:19<29:10:30,  3.43it/s]
  3%|▎         | 11239/371472 [54:20<27:57:40,  3.58it/s]
  3%|▎         | 11240/371472 [54:20<27:23:05,  3.65it/s]
                                                         
{'loss': 4.8242, 'learning_rate': 9.732379495356503e-07, 'epoch': 0.48}

  3%|▎         | 11240/371472 [54:20<27:23:05,  3.65it/s]
  3%|▎         | 11241/371472 [54:20<27:26:54,  3.65it/s]
  3%|▎         | 11242/371472 [54:21<28:06:44,  3.56it/s]
  3%|▎         | 11243/371472 [54:21<27:29:57,  3.64it/s]
  3%|▎         | 11244/371472 [54:21<27:16:13,  3.67it/s]
  3%|▎         | 11245/371472 [54:21<26:53:03,  3.72it/s]
  3%|▎         | 11246/371472 [54:22<27:21:57,  3.66it/s]
  3%|▎         | 11247/371472 [54:22<27:16:07,  3.67it/s]
  3%|▎         | 11248/371472 [54:22<27:31:24,  3.64it/s]
  3%|▎         | 11249/371472 [54:22<27:15:37,  3.67it/s]
  3%|▎         | 11250/371472 [54:23<27:05:41,  3.69it/s]
  3%|▎         | 11251/371472 [54:23<26:35:21,  3.76it/s]
  3%|▎         | 11252/371472 [54:23<27:50:30,  3.59it/s]
  3%|▎         | 11253/371472 [54:24<27:17:25,  3.67it/s]
  3%|▎         | 11254/371472 [54:24<27:03:55,  3.70it/s]
  3%|▎         | 11255/371472 [54:24<28:11:00,  3.55it/s]
  3%|▎         | 11256/371472 [54:24<28:18:37,  3.53it/s]
  3%|▎         | 11257/371472 [54:25<27:51:11,  3.59it/s]
  3%|▎         | 11258/371472 [54:25<27:54:37,  3.59it/s]
  3%|▎         | 11259/371472 [54:25<29:04:17,  3.44it/s]
  3%|▎         | 11260/371472 [54:26<30:29:56,  3.28it/s]
                                                         
{'loss': 4.9628, 'learning_rate': 9.731894675601715e-07, 'epoch': 0.48}

  3%|▎         | 11260/371472 [54:26<30:29:56,  3.28it/s]
  3%|▎         | 11261/371472 [54:26<29:04:42,  3.44it/s]
  3%|▎         | 11262/371472 [54:26<29:35:54,  3.38it/s]
  3%|▎         | 11263/371472 [54:26<28:31:02,  3.51it/s]
  3%|▎         | 11264/371472 [54:27<28:30:17,  3.51it/s]
  3%|▎         | 11265/371472 [54:27<27:37:37,  3.62it/s]
  3%|▎         | 11266/371472 [54:27<29:09:40,  3.43it/s]
  3%|▎         | 11267/371472 [54:28<29:03:01,  3.44it/s]
  3%|▎         | 11268/371472 [54:28<28:08:00,  3.56it/s]
  3%|▎         | 11269/371472 [54:28<29:16:26,  3.42it/s]
  3%|▎         | 11270/371472 [54:28<27:49:36,  3.60it/s]
  3%|▎         | 11271/371472 [54:29<27:52:38,  3.59it/s]
  3%|▎         | 11272/371472 [54:29<26:37:31,  3.76it/s]
  3%|▎         | 11273/371472 [54:29<28:09:12,  3.55it/s]
  3%|▎         | 11274/371472 [54:29<27:19:02,  3.66it/s]
  3%|▎         | 11275/371472 [54:30<28:05:34,  3.56it/s]
  3%|▎         | 11276/371472 [54:30<27:37:24,  3.62it/s]
  3%|▎         | 11277/371472 [54:30<27:31:55,  3.63it/s]
  3%|▎         | 11278/371472 [54:31<26:53:30,  3.72it/s]
  3%|▎         | 11279/371472 [54:31<26:53:11,  3.72it/s]
  3%|▎         | 11280/371472 [54:31<27:44:04,  3.61it/s]
                                                         
{'loss': 4.9849, 'learning_rate': 9.731409855846926e-07, 'epoch': 0.49}

  3%|▎         | 11280/371472 [54:31<27:44:04,  3.61it/s]
  3%|▎         | 11281/371472 [54:31<27:24:34,  3.65it/s]
  3%|▎         | 11282/371472 [54:32<28:09:01,  3.55it/s]
  3%|▎         | 11283/371472 [54:32<27:24:30,  3.65it/s]
  3%|▎         | 11284/371472 [54:32<27:42:42,  3.61it/s]
  3%|▎         | 11285/371472 [54:33<27:50:08,  3.59it/s]
  3%|▎         | 11286/371472 [54:33<27:21:56,  3.66it/s]
  3%|▎         | 11287/371472 [54:33<30:11:57,  3.31it/s]
  3%|▎         | 11288/371472 [54:34<31:17:30,  3.20it/s]
  3%|▎         | 11289/371472 [54:34<33:12:15,  3.01it/s]
  3%|▎         | 11290/371472 [54:34<32:07:42,  3.11it/s]
  3%|▎         | 11291/371472 [54:35<32:16:05,  3.10it/s]
  3%|▎         | 11292/371472 [54:35<30:50:04,  3.24it/s]
  3%|▎         | 11293/371472 [54:35<29:33:43,  3.38it/s]
  3%|▎         | 11294/371472 [54:35<29:18:23,  3.41it/s]
  3%|▎         | 11295/371472 [54:36<29:53:09,  3.35it/s]
  3%|▎         | 11296/371472 [54:36<30:00:56,  3.33it/s]
  3%|▎         | 11297/371472 [54:36<28:08:35,  3.55it/s]
  3%|▎         | 11298/371472 [54:36<28:12:55,  3.55it/s]
  3%|▎         | 11299/371472 [54:37<27:16:26,  3.67it/s]
  3%|▎         | 11300/371472 [54:37<27:03:28,  3.70it/s]
                                                         
{'loss': 4.7428, 'learning_rate': 9.730925036092137e-07, 'epoch': 0.49}

  3%|▎         | 11300/371472 [54:37<27:03:28,  3.70it/s]
  3%|▎         | 11301/371472 [54:37<28:59:14,  3.45it/s]
  3%|▎         | 11302/371472 [54:38<28:20:29,  3.53it/s]
  3%|▎         | 11303/371472 [54:38<29:05:01,  3.44it/s]
  3%|▎         | 11304/371472 [54:38<28:28:04,  3.51it/s]
  3%|▎         | 11305/371472 [54:38<28:26:57,  3.52it/s]
  3%|▎         | 11306/371472 [54:39<28:50:27,  3.47it/s]
  3%|▎         | 11307/371472 [54:39<28:25:09,  3.52it/s]
  3%|▎         | 11308/371472 [54:39<30:49:58,  3.24it/s]
  3%|▎         | 11309/371472 [54:40<31:46:34,  3.15it/s]
  3%|▎         | 11310/371472 [54:40<29:48:39,  3.36it/s]
  3%|▎         | 11311/371472 [54:40<29:10:27,  3.43it/s]
  3%|▎         | 11312/371472 [54:41<28:16:41,  3.54it/s]
  3%|▎         | 11313/371472 [54:41<28:39:40,  3.49it/s]
  3%|▎         | 11314/371472 [54:41<27:48:47,  3.60it/s]
  3%|▎         | 11315/371472 [54:41<27:18:37,  3.66it/s]
  3%|▎         | 11316/371472 [54:42<28:53:52,  3.46it/s]
  3%|▎         | 11317/371472 [54:42<28:15:39,  3.54it/s]
  3%|▎         | 11318/371472 [54:42<27:49:30,  3.60it/s]
  3%|▎         | 11319/371472 [54:42<27:51:37,  3.59it/s]
  3%|▎         | 11320/371472 [54:43<27:55:44,  3.58it/s]
                                                         
{'loss': 4.84, 'learning_rate': 9.73044021633735e-07, 'epoch': 0.49}

  3%|▎         | 11320/371472 [54:43<27:55:44,  3.58it/s]
  3%|▎         | 11321/371472 [54:43<31:40:00,  3.16it/s]
  3%|▎         | 11322/371472 [54:43<30:55:01,  3.24it/s]
  3%|▎         | 11323/371472 [54:44<30:21:33,  3.30it/s]
  3%|▎         | 11324/371472 [54:44<29:12:05,  3.43it/s]
  3%|▎         | 11325/371472 [54:44<28:15:48,  3.54it/s]
  3%|▎         | 11326/371472 [54:45<28:06:17,  3.56it/s]
  3%|▎         | 11327/371472 [54:45<28:04:24,  3.56it/s]
  3%|▎         | 11328/371472 [54:45<27:47:18,  3.60it/s]
  3%|▎         | 11329/371472 [54:45<26:51:43,  3.72it/s]
  3%|▎         | 11330/371472 [54:46<27:05:37,  3.69it/s]
  3%|▎         | 11331/371472 [54:46<27:26:07,  3.65it/s]
  3%|▎         | 11332/371472 [54:46<27:47:52,  3.60it/s]
  3%|▎         | 11333/371472 [54:46<27:55:35,  3.58it/s]
  3%|▎         | 11334/371472 [54:47<28:36:17,  3.50it/s]
  3%|▎         | 11335/371472 [54:47<29:41:05,  3.37it/s]
  3%|▎         | 11336/371472 [54:47<30:39:18,  3.26it/s]
  3%|▎         | 11337/371472 [54:48<30:33:30,  3.27it/s]
  3%|▎         | 11338/371472 [54:48<29:09:44,  3.43it/s]
  3%|▎         | 11339/371472 [54:48<28:25:44,  3.52it/s]
  3%|▎         | 11340/371472 [54:49<28:32:19,  3.51it/s]
                                                         
{'loss': 4.8301, 'learning_rate': 9.729955396582558e-07, 'epoch': 0.49}

  3%|▎         | 11340/371472 [54:49<28:32:19,  3.51it/s]
  3%|▎         | 11341/371472 [54:49<29:43:47,  3.36it/s]
  3%|▎         | 11342/371472 [54:49<29:05:21,  3.44it/s]
  3%|▎         | 11343/371472 [54:49<29:24:16,  3.40it/s]
  3%|▎         | 11344/371472 [54:50<28:21:17,  3.53it/s]
  3%|▎         | 11345/371472 [54:50<29:54:27,  3.34it/s]
  3%|▎         | 11346/371472 [54:50<29:03:31,  3.44it/s]
  3%|▎         | 11347/371472 [54:51<28:08:48,  3.55it/s]
  3%|▎         | 11348/371472 [54:51<27:48:40,  3.60it/s]
  3%|▎         | 11349/371472 [54:51<28:06:35,  3.56it/s]
  3%|▎         | 11350/371472 [54:51<27:39:02,  3.62it/s]
  3%|▎         | 11351/371472 [54:52<27:07:37,  3.69it/s]
  3%|▎         | 11352/371472 [54:52<26:41:17,  3.75it/s]
  3%|▎         | 11353/371472 [54:52<27:37:55,  3.62it/s]
  3%|▎         | 11354/371472 [54:52<26:55:52,  3.71it/s]
  3%|▎         | 11355/371472 [54:53<26:47:01,  3.73it/s]
  3%|▎         | 11356/371472 [54:53<27:52:40,  3.59it/s]
  3%|▎         | 11357/371472 [54:53<28:47:01,  3.48it/s]
  3%|▎         | 11358/371472 [54:54<28:19:47,  3.53it/s]
  3%|▎         | 11359/371472 [54:54<28:45:48,  3.48it/s]
  3%|▎         | 11360/371472 [54:54<28:07:49,  3.56it/s]
                                                         
{'loss': 4.8208, 'learning_rate': 9.729470576827771e-07, 'epoch': 0.49}

  3%|▎         | 11360/371472 [54:54<28:07:49,  3.56it/s]
  3%|▎         | 11361/371472 [54:54<27:49:59,  3.59it/s]
  3%|▎         | 11362/371472 [54:55<29:08:35,  3.43it/s]
  3%|▎         | 11363/371472 [54:55<29:28:38,  3.39it/s]
  3%|▎         | 11364/371472 [54:55<29:17:28,  3.42it/s]
  3%|▎         | 11365/371472 [54:56<28:56:04,  3.46it/s]
  3%|▎         | 11366/371472 [54:56<29:25:49,  3.40it/s]
  3%|▎         | 11367/371472 [54:56<28:31:12,  3.51it/s]
  3%|▎         | 11368/371472 [54:56<28:29:03,  3.51it/s]
  3%|▎         | 11369/371472 [54:57<28:02:34,  3.57it/s]
  3%|▎         | 11370/371472 [54:57<27:49:29,  3.59it/s]
  3%|▎         | 11371/371472 [54:57<27:31:08,  3.63it/s]
  3%|▎         | 11372/371472 [54:58<28:53:45,  3.46it/s]
  3%|▎         | 11373/371472 [54:58<28:34:29,  3.50it/s]
  3%|▎         | 11374/371472 [54:58<27:55:40,  3.58it/s]
  3%|▎         | 11375/371472 [54:58<28:11:32,  3.55it/s]
  3%|▎         | 11376/371472 [54:59<26:58:31,  3.71it/s]
  3%|▎         | 11377/371472 [54:59<28:21:47,  3.53it/s]
  3%|▎         | 11378/371472 [54:59<28:52:14,  3.46it/s]
  3%|▎         | 11379/371472 [55:00<27:57:50,  3.58it/s]
  3%|▎         | 11380/371472 [55:00<27:27:13,  3.64it/s]
                                                         
{'loss': 4.799, 'learning_rate': 9.72898575707298e-07, 'epoch': 0.49}

  3%|▎         | 11380/371472 [55:00<27:27:13,  3.64it/s]
  3%|▎         | 11381/371472 [55:00<28:18:57,  3.53it/s]
  3%|▎         | 11382/371472 [55:00<29:09:43,  3.43it/s]
  3%|▎         | 11383/371472 [55:01<28:56:42,  3.46it/s]
  3%|▎         | 11384/371472 [55:01<29:35:45,  3.38it/s]
  3%|▎         | 11385/371472 [55:01<29:15:42,  3.42it/s]
  3%|▎         | 11386/371472 [55:02<29:51:24,  3.35it/s]
  3%|▎         | 11387/371472 [55:02<28:53:55,  3.46it/s]
  3%|▎         | 11388/371472 [55:02<28:15:46,  3.54it/s]
  3%|▎         | 11389/371472 [55:02<27:49:01,  3.60it/s]
  3%|▎         | 11390/371472 [55:03<29:14:19,  3.42it/s]
  3%|▎         | 11391/371472 [55:03<28:41:36,  3.49it/s]
  3%|▎         | 11392/371472 [55:03<29:02:05,  3.44it/s]
  3%|▎         | 11393/371472 [55:04<28:13:06,  3.54it/s]
  3%|▎         | 11394/371472 [55:04<27:30:28,  3.64it/s]
  3%|▎         | 11395/371472 [55:04<27:54:58,  3.58it/s]
  3%|▎         | 11396/371472 [55:04<27:54:21,  3.58it/s]
  3%|▎         | 11397/371472 [55:05<28:34:35,  3.50it/s]
  3%|▎         | 11398/371472 [55:05<28:32:41,  3.50it/s]
  3%|▎         | 11399/371472 [55:05<27:52:40,  3.59it/s]
  3%|▎         | 11400/371472 [55:06<31:55:32,  3.13it/s]
                                                         
{'loss': 4.8384, 'learning_rate': 9.728500937318193e-07, 'epoch': 0.49}

  3%|▎         | 11400/371472 [55:06<31:55:32,  3.13it/s]
  3%|▎         | 11401/371472 [55:06<31:07:10,  3.21it/s]
  3%|▎         | 11402/371472 [55:06<29:52:05,  3.35it/s]
  3%|▎         | 11403/371472 [55:07<28:29:18,  3.51it/s]
  3%|▎         | 11404/371472 [55:07<29:52:14,  3.35it/s]
  3%|▎         | 11405/371472 [55:07<29:12:13,  3.42it/s]
  3%|▎         | 11406/371472 [55:07<28:52:13,  3.46it/s]
  3%|▎         | 11407/371472 [55:08<29:12:40,  3.42it/s]
  3%|▎         | 11408/371472 [55:08<29:34:03,  3.38it/s]
  3%|▎         | 11409/371472 [55:08<28:30:33,  3.51it/s]
  3%|▎         | 11410/371472 [55:09<28:36:05,  3.50it/s]
  3%|▎         | 11411/371472 [55:09<31:10:01,  3.21it/s]
  3%|▎         | 11412/371472 [55:09<30:50:12,  3.24it/s]
  3%|▎         | 11413/371472 [55:10<30:36:06,  3.27it/s]
  3%|▎         | 11414/371472 [55:10<29:18:06,  3.41it/s]
  3%|▎         | 11415/371472 [55:10<29:13:49,  3.42it/s]
  3%|▎         | 11416/371472 [55:10<28:44:00,  3.48it/s]
  3%|▎         | 11417/371472 [55:11<27:43:30,  3.61it/s]
  3%|▎         | 11418/371472 [55:11<27:30:03,  3.64it/s]
  3%|▎         | 11419/371472 [55:11<28:08:04,  3.55it/s]
  3%|▎         | 11420/371472 [55:11<27:26:35,  3.64it/s]
                                                         
{'loss': 4.8149, 'learning_rate': 9.728016117563403e-07, 'epoch': 0.49}

  3%|▎         | 11420/371472 [55:11<27:26:35,  3.64it/s]
  3%|▎         | 11421/371472 [55:12<27:50:03,  3.59it/s]
  3%|▎         | 11422/371472 [55:12<27:22:48,  3.65it/s]
  3%|▎         | 11423/371472 [55:12<27:23:33,  3.65it/s]
  3%|▎         | 11424/371472 [55:13<27:22:49,  3.65it/s]
  3%|▎         | 11425/371472 [55:13<27:40:52,  3.61it/s]
  3%|▎         | 11426/371472 [55:13<26:53:48,  3.72it/s]
  3%|▎         | 11427/371472 [55:13<27:47:52,  3.60it/s]
  3%|▎         | 11428/371472 [55:14<27:53:40,  3.59it/s]
  3%|▎         | 11429/371472 [55:14<27:38:57,  3.62it/s]
  3%|▎         | 11430/371472 [55:14<28:38:44,  3.49it/s]
  3%|▎         | 11431/371472 [55:14<28:16:15,  3.54it/s]
  3%|▎         | 11432/371472 [55:15<28:14:41,  3.54it/s]
  3%|▎         | 11433/371472 [55:15<27:59:07,  3.57it/s]
  3%|▎         | 11434/371472 [55:15<27:12:41,  3.68it/s]
  3%|▎         | 11435/371472 [55:16<27:04:57,  3.69it/s]
  3%|▎         | 11436/371472 [55:16<26:38:24,  3.75it/s]
  3%|▎         | 11437/371472 [55:16<26:19:35,  3.80it/s]
  3%|▎         | 11438/371472 [55:16<26:27:21,  3.78it/s]
  3%|▎         | 11439/371472 [55:17<26:44:43,  3.74it/s]
  3%|▎         | 11440/371472 [55:17<27:06:43,  3.69it/s]
                                                         
{'loss': 5.0723, 'learning_rate': 9.727531297808614e-07, 'epoch': 0.49}

  3%|▎         | 11440/371472 [55:17<27:06:43,  3.69it/s]
  3%|▎         | 11441/371472 [55:17<27:36:28,  3.62it/s]
  3%|▎         | 11442/371472 [55:17<27:33:19,  3.63it/s]
  3%|▎         | 11443/371472 [55:18<29:01:07,  3.45it/s]
  3%|▎         | 11444/371472 [55:18<29:35:02,  3.38it/s]
  3%|▎         | 11445/371472 [55:18<28:16:37,  3.54it/s]
  3%|▎         | 11446/371472 [55:19<28:35:58,  3.50it/s]
  3%|▎         | 11447/371472 [55:19<27:59:38,  3.57it/s]
  3%|▎         | 11448/371472 [55:19<29:05:11,  3.44it/s]
  3%|▎         | 11449/371472 [55:19<27:41:21,  3.61it/s]
  3%|▎         | 11450/371472 [55:20<28:48:25,  3.47it/s]
  3%|▎         | 11451/371472 [55:20<28:38:07,  3.49it/s]
  3%|▎         | 11452/371472 [55:20<29:54:53,  3.34it/s]
  3%|▎         | 11453/371472 [55:21<29:37:25,  3.38it/s]
  3%|▎         | 11454/371472 [55:21<28:54:21,  3.46it/s]
  3%|▎         | 11455/371472 [55:21<28:53:25,  3.46it/s]
  3%|▎         | 11456/371472 [55:22<29:10:17,  3.43it/s]
  3%|▎         | 11457/371472 [55:22<27:38:06,  3.62it/s]
  3%|▎         | 11458/371472 [55:22<28:17:56,  3.53it/s]
  3%|▎         | 11459/371472 [55:22<29:47:28,  3.36it/s]
  3%|▎         | 11460/371472 [55:23<28:59:55,  3.45it/s]
                                                         
{'loss': 4.8349, 'learning_rate': 9.727046478053825e-07, 'epoch': 0.49}

  3%|▎         | 11460/371472 [55:23<28:59:55,  3.45it/s]
  3%|▎         | 11461/371472 [55:23<27:57:43,  3.58it/s]
  3%|▎         | 11462/371472 [55:23<28:36:38,  3.50it/s]
  3%|▎         | 11463/371472 [55:24<28:46:31,  3.48it/s]
  3%|▎         | 11464/371472 [55:24<29:21:27,  3.41it/s]
  3%|▎         | 11465/371472 [55:24<31:04:46,  3.22it/s]
  3%|▎         | 11466/371472 [55:24<30:12:29,  3.31it/s]
  3%|▎         | 11467/371472 [55:25<32:49:30,  3.05it/s]
  3%|▎         | 11468/371472 [55:25<32:59:19,  3.03it/s]
  3%|▎         | 11469/371472 [55:25<31:04:51,  3.22it/s]
  3%|▎         | 11470/371472 [55:26<30:20:59,  3.29it/s]
  3%|▎         | 11471/371472 [55:26<29:33:58,  3.38it/s]
  3%|▎         | 11472/371472 [55:26<28:35:12,  3.50it/s]
  3%|▎         | 11473/371472 [55:27<28:36:43,  3.50it/s]
  3%|▎         | 11474/371472 [55:27<28:07:02,  3.56it/s]
  3%|▎         | 11475/371472 [55:27<27:53:37,  3.59it/s]
  3%|▎         | 11476/371472 [55:27<26:58:58,  3.71it/s]
  3%|▎         | 11477/371472 [55:28<26:37:26,  3.76it/s]
  3%|▎         | 11478/371472 [55:28<27:09:55,  3.68it/s]
  3%|▎         | 11479/371472 [55:28<27:19:50,  3.66it/s]
  3%|▎         | 11480/371472 [55:29<29:37:45,  3.37it/s]
                                                         
{'loss': 4.8027, 'learning_rate': 9.726561658299035e-07, 'epoch': 0.49}

  3%|▎         | 11480/371472 [55:29<29:37:45,  3.37it/s]
  3%|▎         | 11481/371472 [55:29<28:12:02,  3.55it/s]
  3%|▎         | 11482/371472 [55:29<29:01:22,  3.45it/s]
  3%|▎         | 11483/371472 [55:29<28:47:28,  3.47it/s]
  3%|▎         | 11484/371472 [55:30<29:33:17,  3.38it/s]
  3%|▎         | 11485/371472 [55:30<29:21:20,  3.41it/s]
  3%|▎         | 11486/371472 [55:30<28:48:12,  3.47it/s]
  3%|▎         | 11487/371472 [55:31<29:50:28,  3.35it/s]
  3%|▎         | 11488/371472 [55:31<28:57:25,  3.45it/s]
  3%|▎         | 11489/371472 [55:31<29:58:24,  3.34it/s]
  3%|▎         | 11490/371472 [55:31<29:58:06,  3.34it/s]
  3%|▎         | 11491/371472 [55:32<31:59:56,  3.12it/s]
  3%|▎         | 11492/371472 [55:32<30:14:48,  3.31it/s]
  3%|▎         | 11493/371472 [55:32<29:39:04,  3.37it/s]
  3%|▎         | 11494/371472 [55:33<29:37:47,  3.37it/s]
  3%|▎         | 11495/371472 [55:33<28:36:43,  3.49it/s]
  3%|▎         | 11496/371472 [55:33<29:12:18,  3.42it/s]
  3%|▎         | 11497/371472 [55:34<28:49:07,  3.47it/s]
  3%|▎         | 11498/371472 [55:34<29:26:45,  3.40it/s]
  3%|▎         | 11499/371472 [55:34<30:06:44,  3.32it/s]
  3%|▎         | 11500/371472 [55:34<29:22:15,  3.40it/s]
                                                         
{'loss': 4.4655, 'learning_rate': 9.726076838544248e-07, 'epoch': 0.5}

  3%|▎         | 11500/371472 [55:34<29:22:15,  3.40it/s]
  3%|▎         | 11501/371472 [55:35<28:44:19,  3.48it/s]
  3%|▎         | 11502/371472 [55:35<28:24:50,  3.52it/s]
  3%|▎         | 11503/371472 [55:35<30:09:31,  3.32it/s]
  3%|▎         | 11504/371472 [55:36<29:11:50,  3.42it/s]
  3%|▎         | 11505/371472 [55:36<28:37:59,  3.49it/s]
  3%|▎         | 11506/371472 [55:36<29:03:23,  3.44it/s]
  3%|▎         | 11507/371472 [55:36<28:43:34,  3.48it/s]
  3%|▎         | 11508/371472 [55:37<29:12:14,  3.42it/s]
  3%|▎         | 11509/371472 [55:37<30:32:58,  3.27it/s]
  3%|▎         | 11510/371472 [55:37<30:39:08,  3.26it/s]
  3%|▎         | 11511/371472 [55:38<31:58:42,  3.13it/s]
  3%|▎         | 11512/371472 [55:38<30:58:06,  3.23it/s]
  3%|▎         | 11513/371472 [55:38<29:34:44,  3.38it/s]
  3%|▎         | 11514/371472 [55:39<30:14:58,  3.31it/s]
  3%|▎         | 11515/371472 [55:39<30:28:35,  3.28it/s]
  3%|▎         | 11516/371472 [55:39<29:56:10,  3.34it/s]
  3%|▎         | 11517/371472 [55:39<29:00:52,  3.45it/s]
  3%|▎         | 11518/371472 [55:40<29:45:40,  3.36it/s]
  3%|▎         | 11519/371472 [55:40<29:09:34,  3.43it/s]
  3%|▎         | 11520/371472 [55:40<28:50:55,  3.47it/s]
                                                         
{'loss': 4.6683, 'learning_rate': 9.725592018789457e-07, 'epoch': 0.5}

  3%|▎         | 11520/371472 [55:40<28:50:55,  3.47it/s]
  3%|▎         | 11521/371472 [55:41<28:29:32,  3.51it/s]
  3%|▎         | 11522/371472 [55:41<29:09:19,  3.43it/s]
  3%|▎         | 11523/371472 [55:41<32:30:04,  3.08it/s]
  3%|▎         | 11524/371472 [55:42<30:23:58,  3.29it/s]
  3%|▎         | 11525/371472 [55:42<29:43:43,  3.36it/s]
  3%|▎         | 11526/371472 [55:42<29:09:51,  3.43it/s]
  3%|▎         | 11527/371472 [55:42<28:31:47,  3.50it/s]
  3%|▎         | 11528/371472 [55:43<28:21:56,  3.52it/s]
  3%|▎         | 11529/371472 [55:43<27:50:29,  3.59it/s]
  3%|▎         | 11530/371472 [55:43<27:36:17,  3.62it/s]
  3%|▎         | 11531/371472 [55:44<28:02:53,  3.56it/s]
  3%|▎         | 11532/371472 [55:44<29:07:50,  3.43it/s]
  3%|▎         | 11533/371472 [55:44<29:10:14,  3.43it/s]
  3%|▎         | 11534/371472 [55:44<29:47:10,  3.36it/s]
  3%|▎         | 11535/371472 [55:45<36:48:52,  2.72it/s]
  3%|▎         | 11536/371472 [55:45<35:20:04,  2.83it/s]
  3%|▎         | 11537/371472 [55:46<32:23:10,  3.09it/s]
  3%|▎         | 11538/371472 [55:46<31:29:48,  3.17it/s]
  3%|▎         | 11539/371472 [55:46<30:57:16,  3.23it/s]
  3%|▎         | 11540/371472 [55:46<30:17:04,  3.30it/s]
                                                         
{'loss': 4.3801, 'learning_rate': 9.72510719903467e-07, 'epoch': 0.5}

  3%|▎         | 11540/371472 [55:46<30:17:04,  3.30it/s]
  3%|▎         | 11541/371472 [55:47<28:58:48,  3.45it/s]
  3%|▎         | 11542/371472 [55:47<28:10:13,  3.55it/s]
  3%|▎         | 11543/371472 [55:47<28:01:47,  3.57it/s]
  3%|▎         | 11544/371472 [55:48<28:27:39,  3.51it/s]
  3%|▎         | 11545/371472 [55:48<27:59:06,  3.57it/s]
  3%|▎         | 11546/371472 [55:48<28:25:44,  3.52it/s]
  3%|▎         | 11547/371472 [55:48<27:29:56,  3.64it/s]
  3%|▎         | 11548/371472 [55:49<29:31:21,  3.39it/s]
  3%|▎         | 11549/371472 [55:49<29:41:56,  3.37it/s]
  3%|▎         | 11550/371472 [55:49<27:59:03,  3.57it/s]
  3%|▎         | 11551/371472 [55:49<27:01:43,  3.70it/s]
  3%|▎         | 11552/371472 [55:50<27:16:48,  3.66it/s]
  3%|▎         | 11553/371472 [55:50<28:22:54,  3.52it/s]
  3%|▎         | 11554/371472 [55:50<28:42:48,  3.48it/s]
  3%|▎         | 11555/371472 [55:51<29:28:26,  3.39it/s]
  3%|▎         | 11556/371472 [55:51<30:28:04,  3.28it/s]
  3%|▎         | 11557/371472 [55:51<30:27:44,  3.28it/s]
  3%|▎         | 11558/371472 [55:52<32:06:35,  3.11it/s]
  3%|▎         | 11559/371472 [55:52<31:52:59,  3.14it/s]
  3%|▎         | 11560/371472 [55:52<30:03:31,  3.33it/s]
                                                         
{'loss': 4.8508, 'learning_rate': 9.72462237927988e-07, 'epoch': 0.5}

  3%|▎         | 11560/371472 [55:52<30:03:31,  3.33it/s]
  3%|▎         | 11561/371472 [55:53<35:38:25,  2.81it/s]
  3%|▎         | 11562/371472 [55:53<32:46:26,  3.05it/s]
  3%|▎         | 11563/371472 [55:53<31:49:54,  3.14it/s]
  3%|▎         | 11564/371472 [55:54<31:47:47,  3.14it/s]
  3%|▎         | 11565/371472 [55:54<30:17:59,  3.30it/s]
  3%|▎         | 11566/371472 [55:54<30:01:58,  3.33it/s]
  3%|▎         | 11567/371472 [55:54<28:40:22,  3.49it/s]
  3%|▎         | 11568/371472 [55:55<28:19:24,  3.53it/s]
  3%|▎         | 11569/371472 [55:55<29:09:09,  3.43it/s]
  3%|▎         | 11570/371472 [55:55<28:35:32,  3.50it/s]
  3%|▎         | 11571/371472 [55:56<27:40:07,  3.61it/s]
  3%|▎         | 11572/371472 [55:56<27:20:49,  3.66it/s]
  3%|▎         | 11573/371472 [55:56<28:47:06,  3.47it/s]
  3%|▎         | 11574/371472 [55:56<28:15:45,  3.54it/s]
  3%|▎         | 11575/371472 [55:57<27:26:22,  3.64it/s]
  3%|▎         | 11576/371472 [55:57<27:17:20,  3.66it/s]
  3%|▎         | 11577/371472 [55:57<27:32:01,  3.63it/s]
  3%|▎         | 11578/371472 [55:58<28:33:52,  3.50it/s]
  3%|▎         | 11579/371472 [55:58<30:08:19,  3.32it/s]
  3%|▎         | 11580/371472 [55:58<31:11:26,  3.21it/s]
                                                         
{'loss': 4.8787, 'learning_rate': 9.724137559525091e-07, 'epoch': 0.5}

  3%|▎         | 11580/371472 [55:58<31:11:26,  3.21it/s]
  3%|▎         | 11581/371472 [55:58<31:18:16,  3.19it/s]
  3%|▎         | 11582/371472 [55:59<29:51:06,  3.35it/s]
  3%|▎         | 11583/371472 [55:59<30:52:27,  3.24it/s]
  3%|▎         | 11584/371472 [55:59<29:45:35,  3.36it/s]
  3%|▎         | 11585/371472 [56:00<28:50:33,  3.47it/s]
  3%|▎         | 11586/371472 [56:00<28:30:44,  3.51it/s]
  3%|▎         | 11587/371472 [56:00<28:06:48,  3.56it/s]
  3%|▎         | 11588/371472 [56:00<28:05:13,  3.56it/s]
  3%|▎         | 11589/371472 [56:01<29:23:35,  3.40it/s]
  3%|▎         | 11590/371472 [56:01<30:01:44,  3.33it/s]
  3%|▎         | 11591/371472 [56:01<29:23:41,  3.40it/s]
  3%|▎         | 11592/371472 [56:02<29:26:52,  3.39it/s]
  3%|▎         | 11593/371472 [56:02<30:41:07,  3.26it/s]
  3%|▎         | 11594/371472 [56:02<29:37:55,  3.37it/s]
  3%|▎         | 11595/371472 [56:03<32:56:42,  3.03it/s]
  3%|▎         | 11596/371472 [56:03<31:00:18,  3.22it/s]
  3%|▎         | 11597/371472 [56:03<29:33:05,  3.38it/s]
  3%|▎         | 11598/371472 [56:03<28:49:44,  3.47it/s]
  3%|▎         | 11599/371472 [56:04<29:09:47,  3.43it/s]
  3%|▎         | 11600/371472 [56:04<30:44:41,  3.25it/s]
                                                         
{'loss': 4.9498, 'learning_rate': 9.723652739770302e-07, 'epoch': 0.5}

  3%|▎         | 11600/371472 [56:04<30:44:41,  3.25it/s]
  3%|▎         | 11601/371472 [56:04<29:36:19,  3.38it/s]
  3%|▎         | 11602/371472 [56:05<29:09:11,  3.43it/s]
  3%|▎         | 11603/371472 [56:05<28:52:16,  3.46it/s]
  3%|▎         | 11604/371472 [56:05<28:24:25,  3.52it/s]
  3%|▎         | 11605/371472 [56:06<29:00:48,  3.45it/s]
  3%|▎         | 11606/371472 [56:06<30:03:48,  3.33it/s]
  3%|▎         | 11607/371472 [56:06<29:09:06,  3.43it/s]
  3%|▎         | 11608/371472 [56:06<28:59:37,  3.45it/s]
  3%|▎         | 11609/371472 [56:07<27:51:06,  3.59it/s]
  3%|▎         | 11610/371472 [56:07<27:22:03,  3.65it/s]
  3%|▎         | 11611/371472 [56:07<26:49:53,  3.73it/s]
  3%|▎         | 11612/371472 [56:07<26:49:26,  3.73it/s]
  3%|▎         | 11613/371472 [56:08<28:01:31,  3.57it/s]
  3%|▎         | 11614/371472 [56:08<29:18:10,  3.41it/s]
  3%|▎         | 11615/371472 [56:08<28:50:21,  3.47it/s]
  3%|▎         | 11616/371472 [56:09<28:24:47,  3.52it/s]
  3%|▎         | 11617/371472 [56:09<28:31:40,  3.50it/s]
  3%|▎         | 11618/371472 [56:09<27:53:01,  3.58it/s]
  3%|▎         | 11619/371472 [56:09<28:30:20,  3.51it/s]
  3%|▎         | 11620/371472 [56:10<29:14:04,  3.42it/s]
                                                         
{'loss': 5.0344, 'learning_rate': 9.723167920015513e-07, 'epoch': 0.5}

  3%|▎         | 11620/371472 [56:10<29:14:04,  3.42it/s]
  3%|▎         | 11621/371472 [56:10<28:18:07,  3.53it/s]
  3%|▎         | 11622/371472 [56:10<27:14:50,  3.67it/s]
  3%|▎         | 11623/371472 [56:11<28:07:53,  3.55it/s]
  3%|▎         | 11624/371472 [56:11<28:09:14,  3.55it/s]
  3%|▎         | 11625/371472 [56:11<27:58:06,  3.57it/s]
  3%|▎         | 11626/371472 [56:11<28:23:36,  3.52it/s]
  3%|▎         | 11627/371472 [56:12<28:38:19,  3.49it/s]
  3%|▎         | 11628/371472 [56:12<28:03:37,  3.56it/s]
  3%|▎         | 11629/371472 [56:12<27:21:40,  3.65it/s]
  3%|▎         | 11630/371472 [56:13<27:40:54,  3.61it/s]
  3%|▎         | 11631/371472 [56:13<28:23:55,  3.52it/s]
  3%|▎         | 11632/371472 [56:13<27:48:28,  3.59it/s]
  3%|▎         | 11633/371472 [56:13<28:59:14,  3.45it/s]
  3%|▎         | 11634/371472 [56:14<28:16:01,  3.54it/s]
  3%|▎         | 11635/371472 [56:14<27:47:33,  3.60it/s]
  3%|▎         | 11636/371472 [56:14<28:04:16,  3.56it/s]
  3%|▎         | 11637/371472 [56:15<27:14:08,  3.67it/s]
  3%|▎         | 11638/371472 [56:15<27:30:34,  3.63it/s]
  3%|▎         | 11639/371472 [56:15<26:38:48,  3.75it/s]
  3%|▎         | 11640/371472 [56:15<27:07:02,  3.69it/s]
                                                         
{'loss': 5.0325, 'learning_rate': 9.722683100260725e-07, 'epoch': 0.5}

  3%|▎         | 11640/371472 [56:15<27:07:02,  3.69it/s]
  3%|▎         | 11641/371472 [56:16<27:38:22,  3.62it/s]
  3%|▎         | 11642/371472 [56:16<28:42:55,  3.48it/s]
  3%|▎         | 11643/371472 [56:16<28:26:56,  3.51it/s]
  3%|▎         | 11644/371472 [56:16<28:13:41,  3.54it/s]
  3%|▎         | 11645/371472 [56:17<29:09:44,  3.43it/s]
  3%|▎         | 11646/371472 [56:17<28:17:01,  3.53it/s]
  3%|▎         | 11647/371472 [56:17<28:06:54,  3.56it/s]
  3%|▎         | 11648/371472 [56:18<27:07:40,  3.68it/s]
  3%|▎         | 11649/371472 [56:18<26:38:56,  3.75it/s]
  3%|▎         | 11650/371472 [56:18<27:38:53,  3.62it/s]
  3%|▎         | 11651/371472 [56:18<26:56:54,  3.71it/s]
  3%|▎         | 11652/371472 [56:19<26:31:30,  3.77it/s]
  3%|▎         | 11653/371472 [56:19<27:13:33,  3.67it/s]
  3%|▎         | 11654/371472 [56:19<28:38:45,  3.49it/s]
  3%|▎         | 11655/371472 [56:20<28:32:18,  3.50it/s]
  3%|▎         | 11656/371472 [56:20<28:26:31,  3.51it/s]
  3%|▎         | 11657/371472 [56:20<28:07:05,  3.55it/s]
  3%|▎         | 11658/371472 [56:21<33:52:03,  2.95it/s]
  3%|▎         | 11659/371472 [56:21<34:01:45,  2.94it/s]
  3%|▎         | 11660/371472 [56:21<31:58:07,  3.13it/s]
                                                         
{'loss': 4.8234, 'learning_rate': 9.722198280505936e-07, 'epoch': 0.5}

  3%|▎         | 11660/371472 [56:21<31:58:07,  3.13it/s]
  3%|▎         | 11661/371472 [56:21<30:14:14,  3.31it/s]
  3%|▎         | 11662/371472 [56:22<29:07:53,  3.43it/s]
  3%|▎         | 11663/371472 [56:22<28:30:32,  3.51it/s]
  3%|▎         | 11664/371472 [56:22<28:11:02,  3.55it/s]
  3%|▎         | 11665/371472 [56:23<27:43:30,  3.60it/s]
  3%|▎         | 11666/371472 [56:23<27:43:21,  3.61it/s]
  3%|▎         | 11667/371472 [56:23<28:11:25,  3.55it/s]
  3%|▎         | 11668/371472 [56:23<28:41:15,  3.48it/s]
  3%|▎         | 11669/371472 [56:24<32:31:36,  3.07it/s]
  3%|▎         | 11670/371472 [56:24<30:59:05,  3.23it/s]
  3%|▎         | 11671/371472 [56:25<34:40:32,  2.88it/s]
  3%|▎         | 11672/371472 [56:25<32:53:49,  3.04it/s]
  3%|▎         | 11673/371472 [56:25<32:14:04,  3.10it/s]
  3%|▎         | 11674/371472 [56:25<31:56:24,  3.13it/s]
  3%|▎         | 11675/371472 [56:26<30:49:32,  3.24it/s]
  3%|▎         | 11676/371472 [56:26<30:02:17,  3.33it/s]
  3%|▎         | 11677/371472 [56:26<30:58:22,  3.23it/s]
  3%|▎         | 11678/371472 [56:27<29:47:33,  3.35it/s]
  3%|▎         | 11679/371472 [56:27<28:32:30,  3.50it/s]
  3%|▎         | 11680/371472 [56:27<28:29:48,  3.51it/s]
                                                         
{'loss': 4.5882, 'learning_rate': 9.721713460751147e-07, 'epoch': 0.5}

  3%|▎         | 11680/371472 [56:27<28:29:48,  3.51it/s]
  3%|▎         | 11681/371472 [56:27<27:36:01,  3.62it/s]
  3%|▎         | 11682/371472 [56:28<27:07:26,  3.68it/s]
  3%|▎         | 11683/371472 [56:28<27:13:59,  3.67it/s]
  3%|▎         | 11684/371472 [56:28<26:43:22,  3.74it/s]
  3%|▎         | 11685/371472 [56:28<26:52:44,  3.72it/s]
  3%|▎         | 11686/371472 [56:29<29:13:15,  3.42it/s]
  3%|▎         | 11687/371472 [56:29<28:42:18,  3.48it/s]
  3%|▎         | 11688/371472 [56:29<27:43:18,  3.61it/s]
  3%|▎         | 11689/371472 [56:30<27:30:18,  3.63it/s]
  3%|▎         | 11690/371472 [56:30<27:14:45,  3.67it/s]
  3%|▎         | 11691/371472 [56:30<28:01:24,  3.57it/s]
  3%|▎         | 11692/371472 [56:30<27:12:19,  3.67it/s]
  3%|▎         | 11693/371472 [56:31<27:53:24,  3.58it/s]
  3%|▎         | 11694/371472 [56:31<27:22:07,  3.65it/s]
  3%|▎         | 11695/371472 [56:31<27:44:39,  3.60it/s]
  3%|▎         | 11696/371472 [56:32<27:52:20,  3.59it/s]
  3%|▎         | 11697/371472 [56:32<27:53:09,  3.58it/s]
  3%|▎         | 11698/371472 [56:32<29:12:32,  3.42it/s]
  3%|▎         | 11699/371472 [56:32<29:00:17,  3.45it/s]
  3%|▎         | 11700/371472 [56:33<28:47:28,  3.47it/s]
                                                         
{'loss': 4.864, 'learning_rate': 9.72122864099636e-07, 'epoch': 0.5}

  3%|▎         | 11700/371472 [56:33<28:47:28,  3.47it/s]
  3%|▎         | 11701/371472 [56:33<28:55:05,  3.46it/s]
  3%|▎         | 11702/371472 [56:33<28:23:52,  3.52it/s]
  3%|▎         | 11703/371472 [56:34<28:24:07,  3.52it/s]
  3%|▎         | 11704/371472 [56:34<30:12:08,  3.31it/s]
  3%|▎         | 11705/371472 [56:34<30:06:38,  3.32it/s]
  3%|▎         | 11706/371472 [56:35<30:57:40,  3.23it/s]
  3%|▎         | 11707/371472 [56:35<30:03:33,  3.32it/s]
  3%|▎         | 11708/371472 [56:35<30:59:02,  3.23it/s]
  3%|▎         | 11709/371472 [56:35<30:18:05,  3.30it/s]
  3%|▎         | 11710/371472 [56:36<28:47:24,  3.47it/s]
  3%|▎         | 11711/371472 [56:36<29:17:54,  3.41it/s]
  3%|▎         | 11712/371472 [56:36<29:25:43,  3.40it/s]
  3%|▎         | 11713/371472 [56:37<28:00:43,  3.57it/s]
  3%|▎         | 11714/371472 [56:37<27:39:33,  3.61it/s]
  3%|▎         | 11715/371472 [56:37<27:19:49,  3.66it/s]
  3%|▎         | 11716/371472 [56:37<27:13:46,  3.67it/s]
  3%|▎         | 11717/371472 [56:38<28:21:21,  3.52it/s]
  3%|▎         | 11718/371472 [56:38<28:09:04,  3.55it/s]
  3%|▎         | 11719/371472 [56:38<31:12:49,  3.20it/s]
  3%|▎         | 11720/371472 [56:39<30:09:13,  3.31it/s]
                                                         
{'loss': 4.8641, 'learning_rate': 9.720743821241568e-07, 'epoch': 0.5}

  3%|▎         | 11720/371472 [56:39<30:09:13,  3.31it/s]
  3%|▎         | 11721/371472 [56:39<29:58:12,  3.33it/s]
  3%|▎         | 11722/371472 [56:39<29:24:47,  3.40it/s]
  3%|▎         | 11723/371472 [56:39<29:25:36,  3.40it/s]
  3%|▎         | 11724/371472 [56:40<30:26:49,  3.28it/s]
  3%|▎         | 11725/371472 [56:40<30:52:31,  3.24it/s]
  3%|▎         | 11726/371472 [56:40<29:52:59,  3.34it/s]
  3%|▎         | 11727/371472 [56:41<29:13:08,  3.42it/s]
  3%|▎         | 11728/371472 [56:41<28:15:16,  3.54it/s]
  3%|▎         | 11729/371472 [56:41<29:07:18,  3.43it/s]
  3%|▎         | 11730/371472 [56:42<29:21:27,  3.40it/s]
  3%|▎         | 11731/371472 [56:42<27:57:07,  3.57it/s]
  3%|▎         | 11732/371472 [56:42<27:50:57,  3.59it/s]
  3%|▎         | 11733/371472 [56:42<29:21:11,  3.40it/s]
  3%|▎         | 11734/371472 [56:43<29:10:52,  3.42it/s]
  3%|▎         | 11735/371472 [56:43<28:15:21,  3.54it/s]
  3%|▎         | 11736/371472 [56:43<28:20:24,  3.53it/s]
  3%|▎         | 11737/371472 [56:44<28:02:49,  3.56it/s]
  3%|▎         | 11738/371472 [56:44<27:21:16,  3.65it/s]
  3%|▎         | 11739/371472 [56:44<27:57:41,  3.57it/s]
  3%|▎         | 11740/371472 [56:44<27:27:45,  3.64it/s]
                                                         
{'loss': 4.8875, 'learning_rate': 9.720259001486781e-07, 'epoch': 0.51}

  3%|▎         | 11740/371472 [56:44<27:27:45,  3.64it/s]
  3%|▎         | 11741/371472 [56:45<26:57:01,  3.71it/s]
  3%|▎         | 11742/371472 [56:45<26:57:31,  3.71it/s]
  3%|▎         | 11743/371472 [56:45<26:55:21,  3.71it/s]
  3%|▎         | 11744/371472 [56:45<27:20:01,  3.66it/s]
  3%|▎         | 11745/371472 [56:46<29:17:51,  3.41it/s]
  3%|▎         | 11746/371472 [56:46<28:36:27,  3.49it/s]
  3%|▎         | 11747/371472 [56:46<27:37:02,  3.62it/s]
  3%|▎         | 11748/371472 [56:47<29:54:53,  3.34it/s]
  3%|▎         | 11749/371472 [56:47<28:59:22,  3.45it/s]
  3%|▎         | 11750/371472 [56:47<30:57:33,  3.23it/s]
  3%|▎         | 11751/371472 [56:48<29:58:57,  3.33it/s]
  3%|▎         | 11752/371472 [56:48<29:20:40,  3.41it/s]
  3%|▎         | 11753/371472 [56:48<33:23:27,  2.99it/s]
  3%|▎         | 11754/371472 [56:48<30:56:03,  3.23it/s]
  3%|▎         | 11755/371472 [56:49<29:14:38,  3.42it/s]
  3%|▎         | 11756/371472 [56:49<28:29:46,  3.51it/s]
  3%|▎         | 11757/371472 [56:49<28:48:52,  3.47it/s]
  3%|▎         | 11758/371472 [56:50<29:10:24,  3.43it/s]
  3%|▎         | 11759/371472 [56:50<29:09:27,  3.43it/s]
  3%|▎         | 11760/371472 [56:50<28:32:20,  3.50it/s]
                                                         
{'loss': 5.13, 'learning_rate': 9.71977418173199e-07, 'epoch': 0.51}

  3%|▎         | 11760/371472 [56:50<28:32:20,  3.50it/s]
  3%|▎         | 11761/371472 [56:50<28:19:12,  3.53it/s]
  3%|▎         | 11762/371472 [56:51<28:01:28,  3.57it/s]
  3%|▎         | 11763/371472 [56:51<27:43:24,  3.60it/s]
  3%|▎         | 11764/371472 [56:51<28:09:04,  3.55it/s]
  3%|▎         | 11765/371472 [56:52<27:56:07,  3.58it/s]
  3%|▎         | 11766/371472 [56:52<28:11:40,  3.54it/s]
  3%|▎         | 11767/371472 [56:52<27:52:31,  3.58it/s]
  3%|▎         | 11768/371472 [56:52<27:51:14,  3.59it/s]
  3%|▎         | 11769/371472 [56:53<27:22:28,  3.65it/s]
  3%|▎         | 11770/371472 [56:53<28:43:19,  3.48it/s]
  3%|▎         | 11771/371472 [56:53<28:17:09,  3.53it/s]
  3%|▎         | 11772/371472 [56:54<29:46:46,  3.36it/s]
  3%|▎         | 11773/371472 [56:54<29:19:34,  3.41it/s]
  3%|▎         | 11774/371472 [56:54<29:46:45,  3.36it/s]
  3%|▎         | 11775/371472 [56:54<29:36:20,  3.37it/s]
  3%|▎         | 11776/371472 [56:55<28:48:44,  3.47it/s]
  3%|▎         | 11777/371472 [56:55<28:39:22,  3.49it/s]
  3%|▎         | 11778/371472 [56:55<30:09:12,  3.31it/s]
  3%|▎         | 11779/371472 [56:56<29:10:34,  3.42it/s]
  3%|▎         | 11780/371472 [56:56<28:02:29,  3.56it/s]
                                                         
{'loss': 4.8252, 'learning_rate': 9.719289361977203e-07, 'epoch': 0.51}

  3%|▎         | 11780/371472 [56:56<28:02:29,  3.56it/s]
  3%|▎         | 11781/371472 [56:56<28:36:38,  3.49it/s]
  3%|▎         | 11782/371472 [56:56<29:13:17,  3.42it/s]
  3%|▎         | 11783/371472 [56:57<28:10:45,  3.55it/s]
  3%|▎         | 11784/371472 [56:57<29:01:22,  3.44it/s]
  3%|▎         | 11785/371472 [56:57<27:49:33,  3.59it/s]
  3%|▎         | 11786/371472 [56:58<28:56:24,  3.45it/s]
  3%|▎         | 11787/371472 [56:58<28:43:48,  3.48it/s]
  3%|▎         | 11788/371472 [56:58<27:39:54,  3.61it/s]
  3%|▎         | 11789/371472 [56:58<28:01:51,  3.56it/s]
  3%|▎         | 11790/371472 [56:59<27:44:09,  3.60it/s]
  3%|▎         | 11791/371472 [56:59<27:11:23,  3.67it/s]
  3%|▎         | 11792/371472 [56:59<28:19:11,  3.53it/s]
  3%|▎         | 11793/371472 [57:00<28:28:14,  3.51it/s]
  3%|▎         | 11794/371472 [57:00<28:11:18,  3.54it/s]
  3%|▎         | 11795/371472 [57:00<27:38:13,  3.62it/s]
  3%|▎         | 11796/371472 [57:00<29:53:16,  3.34it/s]
  3%|▎         | 11797/371472 [57:01<29:04:20,  3.44it/s]
  3%|▎         | 11798/371472 [57:01<27:50:07,  3.59it/s]
  3%|▎         | 11799/371472 [57:01<28:11:49,  3.54it/s]
  3%|▎         | 11800/371472 [57:02<28:24:49,  3.52it/s]
                                                         
{'loss': 4.9937, 'learning_rate': 9.718804542222413e-07, 'epoch': 0.51}

  3%|▎         | 11800/371472 [57:02<28:24:49,  3.52it/s]
  3%|▎         | 11801/371472 [57:02<27:57:12,  3.57it/s]
  3%|▎         | 11802/371472 [57:02<27:43:46,  3.60it/s]
  3%|▎         | 11803/371472 [57:02<27:25:34,  3.64it/s]
  3%|▎         | 11804/371472 [57:03<28:16:17,  3.53it/s]
  3%|▎         | 11805/371472 [57:03<28:25:38,  3.51it/s]
  3%|▎         | 11806/371472 [57:03<28:30:46,  3.50it/s]
  3%|▎         | 11807/371472 [57:03<27:46:13,  3.60it/s]
  3%|▎         | 11808/371472 [57:04<27:47:27,  3.59it/s]
  3%|▎         | 11809/371472 [57:04<26:59:57,  3.70it/s]
  3%|▎         | 11810/371472 [57:04<26:30:12,  3.77it/s]
  3%|▎         | 11811/371472 [57:05<26:04:45,  3.83it/s]
  3%|▎         | 11812/371472 [57:05<25:57:20,  3.85it/s]
  3%|▎         | 11813/371472 [57:05<25:39:12,  3.89it/s]
  3%|▎         | 11814/371472 [57:05<25:53:49,  3.86it/s]
  3%|▎         | 11815/371472 [57:06<25:36:41,  3.90it/s]
  3%|▎         | 11816/371472 [57:06<28:26:12,  3.51it/s]
  3%|▎         | 11817/371472 [57:06<27:51:51,  3.59it/s]
  3%|▎         | 11818/371472 [57:06<27:22:35,  3.65it/s]
  3%|▎         | 11819/371472 [57:07<27:14:48,  3.67it/s]
  3%|▎         | 11820/371472 [57:07<29:30:09,  3.39it/s]
                                                         
{'loss': 4.9656, 'learning_rate': 9.718319722467624e-07, 'epoch': 0.51}

  3%|▎         | 11820/371472 [57:07<29:30:09,  3.39it/s]
  3%|▎         | 11821/371472 [57:07<29:01:25,  3.44it/s]
  3%|▎         | 11822/371472 [57:08<28:57:43,  3.45it/s]
  3%|▎         | 11823/371472 [57:08<29:03:25,  3.44it/s]
  3%|▎         | 11824/371472 [57:08<29:57:05,  3.34it/s]
  3%|▎         | 11825/371472 [57:08<28:39:21,  3.49it/s]
  3%|▎         | 11826/371472 [57:09<28:11:57,  3.54it/s]
  3%|▎         | 11827/371472 [57:09<28:02:33,  3.56it/s]
  3%|▎         | 11828/371472 [57:09<29:57:25,  3.33it/s]
  3%|▎         | 11829/371472 [57:10<29:07:39,  3.43it/s]
  3%|▎         | 11830/371472 [57:10<29:38:17,  3.37it/s]
  3%|▎         | 11831/371472 [57:10<29:41:07,  3.37it/s]
  3%|▎         | 11832/371472 [57:11<30:50:28,  3.24it/s]
  3%|▎         | 11833/371472 [57:11<29:36:12,  3.37it/s]
  3%|▎         | 11834/371472 [57:11<29:42:59,  3.36it/s]
  3%|▎         | 11835/371472 [57:11<28:56:47,  3.45it/s]
  3%|▎         | 11836/371472 [57:12<28:25:12,  3.52it/s]
  3%|▎         | 11837/371472 [57:12<27:10:51,  3.68it/s]
  3%|▎         | 11838/371472 [57:12<27:21:06,  3.65it/s]
  3%|▎         | 11839/371472 [57:13<31:13:58,  3.20it/s]
  3%|▎         | 11840/371472 [57:13<29:28:46,  3.39it/s]
                                                         
{'loss': 4.8202, 'learning_rate': 9.717834902712837e-07, 'epoch': 0.51}

  3%|▎         | 11840/371472 [57:13<29:28:46,  3.39it/s]
  3%|▎         | 11841/371472 [57:13<29:38:27,  3.37it/s]
  3%|▎         | 11842/371472 [57:13<29:00:13,  3.44it/s]
  3%|▎         | 11843/371472 [57:14<29:43:40,  3.36it/s]
  3%|▎         | 11844/371472 [57:14<29:04:48,  3.44it/s]
  3%|▎         | 11845/371472 [57:14<28:17:03,  3.53it/s]
  3%|▎         | 11846/371472 [57:15<28:24:48,  3.52it/s]
  3%|▎         | 11847/371472 [57:15<28:10:33,  3.55it/s]
  3%|▎         | 11848/371472 [57:15<28:23:59,  3.52it/s]
  3%|▎         | 11849/371472 [57:15<27:50:48,  3.59it/s]
  3%|▎         | 11850/371472 [57:16<27:39:02,  3.61it/s]
  3%|▎         | 11851/371472 [57:16<27:18:21,  3.66it/s]
  3%|▎         | 11852/371472 [57:16<26:51:29,  3.72it/s]
  3%|▎         | 11853/371472 [57:16<26:32:29,  3.76it/s]
  3%|▎         | 11854/371472 [57:17<27:32:05,  3.63it/s]
  3%|▎         | 11855/371472 [57:17<27:55:23,  3.58it/s]
  3%|▎         | 11856/371472 [57:17<27:28:17,  3.64it/s]
  3%|▎         | 11857/371472 [57:18<28:39:07,  3.49it/s]
  3%|▎         | 11858/371472 [57:18<27:49:02,  3.59it/s]
  3%|▎         | 11859/371472 [57:18<27:38:07,  3.61it/s]
  3%|▎         | 11860/371472 [57:18<27:35:42,  3.62it/s]
                                                         
{'loss': 4.8806, 'learning_rate': 9.717350082958045e-07, 'epoch': 0.51}

  3%|▎         | 11860/371472 [57:18<27:35:42,  3.62it/s]
  3%|▎         | 11861/371472 [57:19<28:49:18,  3.47it/s]
  3%|▎         | 11862/371472 [57:19<29:30:47,  3.38it/s]
  3%|▎         | 11863/371472 [57:19<28:35:33,  3.49it/s]
  3%|▎         | 11864/371472 [57:20<27:20:03,  3.65it/s]
  3%|▎         | 11865/371472 [57:20<26:55:02,  3.71it/s]
  3%|▎         | 11866/371472 [57:20<26:38:15,  3.75it/s]
  3%|▎         | 11867/371472 [57:20<26:34:13,  3.76it/s]
  3%|▎         | 11868/371472 [57:21<26:13:28,  3.81it/s]
  3%|▎         | 11869/371472 [57:21<26:32:52,  3.76it/s]
  3%|▎         | 11870/371472 [57:21<26:18:37,  3.80it/s]
  3%|▎         | 11871/371472 [57:21<27:00:21,  3.70it/s]
  3%|▎         | 11872/371472 [57:22<28:37:17,  3.49it/s]
  3%|▎         | 11873/371472 [57:22<27:45:52,  3.60it/s]
  3%|▎         | 11874/371472 [57:22<27:37:19,  3.62it/s]
  3%|▎         | 11875/371472 [57:23<28:09:17,  3.55it/s]
  3%|▎         | 11876/371472 [57:23<29:29:35,  3.39it/s]
  3%|▎         | 11877/371472 [57:23<29:31:40,  3.38it/s]
  3%|▎         | 11878/371472 [57:24<32:16:45,  3.09it/s]
  3%|▎         | 11879/371472 [57:24<30:13:47,  3.30it/s]
  3%|▎         | 11880/371472 [57:24<30:28:31,  3.28it/s]
                                                         
{'loss': 4.7003, 'learning_rate': 9.716865263203258e-07, 'epoch': 0.51}

  3%|▎         | 11880/371472 [57:24<30:28:31,  3.28it/s]
  3%|▎         | 11881/371472 [57:24<28:53:06,  3.46it/s]
  3%|▎         | 11882/371472 [57:25<27:24:00,  3.65it/s]
  3%|▎         | 11883/371472 [57:25<28:24:34,  3.52it/s]
  3%|▎         | 11884/371472 [57:25<27:46:44,  3.60it/s]
  3%|▎         | 11885/371472 [57:26<27:51:21,  3.59it/s]
  3%|▎         | 11886/371472 [57:26<27:37:09,  3.62it/s]
  3%|▎         | 11887/371472 [57:26<28:55:35,  3.45it/s]
  3%|▎         | 11888/371472 [57:26<28:38:54,  3.49it/s]
  3%|▎         | 11889/371472 [57:27<28:03:55,  3.56it/s]
  3%|▎         | 11890/371472 [57:27<28:02:21,  3.56it/s]
  3%|▎         | 11891/371472 [57:27<27:44:07,  3.60it/s]
  3%|▎         | 11892/371472 [57:27<27:46:59,  3.60it/s]
  3%|▎         | 11893/371472 [57:28<27:37:59,  3.61it/s]
  3%|▎         | 11894/371472 [57:28<27:15:11,  3.66it/s]
  3%|▎         | 11895/371472 [57:28<28:28:04,  3.51it/s]
  3%|▎         | 11896/371472 [57:29<27:34:08,  3.62it/s]
  3%|▎         | 11897/371472 [57:29<28:42:03,  3.48it/s]
  3%|▎         | 11898/371472 [57:29<28:53:26,  3.46it/s]
  3%|▎         | 11899/371472 [57:29<28:18:02,  3.53it/s]
  3%|▎         | 11900/371472 [57:30<27:57:20,  3.57it/s]
                                                         
{'loss': 4.9151, 'learning_rate': 9.71638044344847e-07, 'epoch': 0.51}

  3%|▎         | 11900/371472 [57:30<27:57:20,  3.57it/s]
  3%|▎         | 11901/371472 [57:30<29:54:55,  3.34it/s]
  3%|▎         | 11902/371472 [57:30<29:32:48,  3.38it/s]
  3%|▎         | 11903/371472 [57:31<28:56:23,  3.45it/s]
  3%|▎         | 11904/371472 [57:31<28:01:34,  3.56it/s]
  3%|▎         | 11905/371472 [57:31<27:14:03,  3.67it/s]
  3%|▎         | 11906/371472 [57:31<27:03:55,  3.69it/s]
  3%|▎         | 11907/371472 [57:32<27:25:21,  3.64it/s]
  3%|▎         | 11908/371472 [57:32<26:38:57,  3.75it/s]
  3%|▎         | 11909/371472 [57:32<30:08:19,  3.31it/s]
  3%|▎         | 11910/371472 [57:33<33:08:12,  3.01it/s]
  3%|▎         | 11911/371472 [57:33<31:58:45,  3.12it/s]
  3%|▎         | 11912/371472 [57:33<30:48:03,  3.24it/s]
  3%|▎         | 11913/371472 [57:34<32:01:11,  3.12it/s]
  3%|▎         | 11914/371472 [57:34<30:48:01,  3.24it/s]
  3%|▎         | 11915/371472 [57:34<29:36:13,  3.37it/s]
  3%|▎         | 11916/371472 [57:34<28:52:20,  3.46it/s]
  3%|▎         | 11917/371472 [57:35<28:41:04,  3.48it/s]
  3%|▎         | 11918/371472 [57:35<28:15:28,  3.53it/s]
  3%|▎         | 11919/371472 [57:35<30:21:20,  3.29it/s]
  3%|▎         | 11920/371472 [57:36<31:35:36,  3.16it/s]
                                                         
{'loss': 4.7234, 'learning_rate': 9.71589562369368e-07, 'epoch': 0.51}

  3%|▎         | 11920/371472 [57:36<31:35:36,  3.16it/s]
  3%|▎         | 11921/371472 [57:36<32:48:45,  3.04it/s]
  3%|▎         | 11922/371472 [57:36<31:49:52,  3.14it/s]
  3%|▎         | 11923/371472 [57:37<31:11:20,  3.20it/s]
  3%|▎         | 11924/371472 [57:37<29:06:38,  3.43it/s]
  3%|▎         | 11925/371472 [57:37<33:08:20,  3.01it/s]
  3%|▎         | 11926/371472 [57:38<36:36:17,  2.73it/s]
  3%|▎         | 11927/371472 [57:38<35:26:34,  2.82it/s]
  3%|▎         | 11928/371472 [57:38<32:18:54,  3.09it/s]
  3%|▎         | 11929/371472 [57:39<30:09:37,  3.31it/s]
  3%|▎         | 11930/371472 [57:39<28:47:36,  3.47it/s]
  3%|▎         | 11931/371472 [57:39<27:35:04,  3.62it/s]
  3%|▎         | 11932/371472 [57:39<29:21:02,  3.40it/s]
  3%|▎         | 11933/371472 [57:40<29:54:51,  3.34it/s]
  3%|▎         | 11934/371472 [57:40<30:37:29,  3.26it/s]
  3%|▎         | 11935/371472 [57:40<29:17:27,  3.41it/s]
  3%|▎         | 11936/371472 [57:41<30:29:20,  3.28it/s]
  3%|▎         | 11937/371472 [57:41<30:16:04,  3.30it/s]
  3%|▎         | 11938/371472 [57:41<29:34:12,  3.38it/s]
  3%|▎         | 11939/371472 [57:42<28:50:55,  3.46it/s]
  3%|▎         | 11940/371472 [57:42<28:20:06,  3.52it/s]
                                                         
{'loss': 4.8458, 'learning_rate': 9.715410803938892e-07, 'epoch': 0.51}

  3%|▎         | 11940/371472 [57:42<28:20:06,  3.52it/s]
  3%|▎         | 11941/371472 [57:42<29:57:38,  3.33it/s]
  3%|▎         | 11942/371472 [57:42<29:40:41,  3.37it/s]
  3%|▎         | 11943/371472 [57:43<30:39:10,  3.26it/s]
  3%|▎         | 11944/371472 [57:43<29:19:36,  3.41it/s]
  3%|▎         | 11945/371472 [57:43<29:01:34,  3.44it/s]
  3%|▎         | 11946/371472 [57:44<28:14:25,  3.54it/s]
  3%|▎         | 11947/371472 [57:44<27:25:41,  3.64it/s]
  3%|▎         | 11948/371472 [57:44<27:16:46,  3.66it/s]
  3%|▎         | 11949/371472 [57:44<27:09:18,  3.68it/s]
  3%|▎         | 11950/371472 [57:45<27:54:21,  3.58it/s]
  3%|▎         | 11951/371472 [57:45<27:07:25,  3.68it/s]
  3%|▎         | 11952/371472 [57:45<27:12:50,  3.67it/s]
  3%|▎         | 11953/371472 [57:46<29:13:04,  3.42it/s]
  3%|▎         | 11954/371472 [57:46<29:56:06,  3.34it/s]
  3%|▎         | 11955/371472 [57:46<29:53:21,  3.34it/s]
  3%|▎         | 11956/371472 [57:46<28:04:52,  3.56it/s]
  3%|▎         | 11957/371472 [57:47<27:57:15,  3.57it/s]
  3%|▎         | 11958/371472 [57:47<28:52:43,  3.46it/s]
  3%|▎         | 11959/371472 [57:47<29:00:47,  3.44it/s]
  3%|▎         | 11960/371472 [57:48<29:37:14,  3.37it/s]
                                                         
{'loss': 4.7352, 'learning_rate': 9.714925984184101e-07, 'epoch': 0.52}

  3%|▎         | 11960/371472 [57:48<29:37:14,  3.37it/s]
  3%|▎         | 11961/371472 [57:48<29:26:51,  3.39it/s]
  3%|▎         | 11962/371472 [57:48<29:31:44,  3.38it/s]
  3%|▎         | 11963/371472 [57:49<31:38:52,  3.16it/s]
  3%|▎         | 11964/371472 [57:49<33:41:57,  2.96it/s]
  3%|▎         | 11965/371472 [57:49<31:12:45,  3.20it/s]
  3%|▎         | 11966/371472 [57:49<30:08:32,  3.31it/s]
  3%|▎         | 11967/371472 [57:50<28:54:53,  3.45it/s]
  3%|▎         | 11968/371472 [57:50<28:54:21,  3.45it/s]
  3%|▎         | 11969/371472 [57:50<27:59:37,  3.57it/s]
  3%|▎         | 11970/371472 [57:51<27:52:19,  3.58it/s]
  3%|▎         | 11971/371472 [57:51<29:30:33,  3.38it/s]
  3%|▎         | 11972/371472 [57:51<29:51:28,  3.34it/s]
  3%|▎         | 11973/371472 [57:52<29:43:20,  3.36it/s]
  3%|▎         | 11974/371472 [57:52<28:33:38,  3.50it/s]
  3%|▎         | 11975/371472 [57:52<28:29:56,  3.50it/s]
  3%|▎         | 11976/371472 [57:52<28:23:46,  3.52it/s]
  3%|▎         | 11977/371472 [57:53<27:46:41,  3.59it/s]
  3%|▎         | 11978/371472 [57:53<27:01:23,  3.70it/s]
  3%|▎         | 11979/371472 [57:53<27:43:21,  3.60it/s]
  3%|▎         | 11980/371472 [57:53<28:24:56,  3.51it/s]
                                                         
{'loss': 5.0708, 'learning_rate': 9.714441164429314e-07, 'epoch': 0.52}

  3%|▎         | 11980/371472 [57:53<28:24:56,  3.51it/s]
  3%|▎         | 11981/371472 [57:54<27:34:02,  3.62it/s]
  3%|▎         | 11982/371472 [57:54<27:55:11,  3.58it/s]
  3%|▎         | 11983/371472 [57:54<28:58:46,  3.45it/s]
  3%|▎         | 11984/371472 [57:55<28:05:57,  3.55it/s]
  3%|▎         | 11985/371472 [57:55<31:08:52,  3.21it/s]
  3%|▎         | 11986/371472 [57:55<30:08:14,  3.31it/s]
  3%|▎         | 11987/371472 [57:56<33:02:06,  3.02it/s]
  3%|▎         | 11988/371472 [57:56<30:58:29,  3.22it/s]
  3%|▎         | 11989/371472 [57:56<29:56:19,  3.34it/s]
  3%|▎         | 11990/371472 [57:56<29:10:25,  3.42it/s]
  3%|▎         | 11991/371472 [57:57<29:20:09,  3.40it/s]
  3%|▎         | 11992/371472 [57:57<28:07:06,  3.55it/s]
  3%|▎         | 11993/371472 [57:57<28:47:48,  3.47it/s]
  3%|▎         | 11994/371472 [57:58<28:51:39,  3.46it/s]
  3%|▎         | 11995/371472 [57:58<28:21:32,  3.52it/s]
  3%|▎         | 11996/371472 [57:58<28:29:12,  3.51it/s]
  3%|▎         | 11997/371472 [57:58<29:56:15,  3.34it/s]
  3%|▎         | 11998/371472 [57:59<29:54:17,  3.34it/s]
  3%|▎         | 11999/371472 [57:59<31:21:37,  3.18it/s]
  3%|▎         | 12000/371472 [57:59<29:49:05,  3.35it/s]
                                                         
{'loss': 4.8615, 'learning_rate': 9.713956344674523e-07, 'epoch': 0.52}

  3%|▎         | 12000/371472 [57:59<29:49:05,  3.35it/s]
  3%|▎         | 12001/371472 [58:00<30:16:20,  3.30it/s]
  3%|▎         | 12002/371472 [58:00<29:12:59,  3.42it/s]
  3%|▎         | 12003/371472 [58:00<28:36:39,  3.49it/s]
  3%|▎         | 12004/371472 [58:00<27:27:49,  3.64it/s]
  3%|▎         | 12005/371472 [58:01<28:49:30,  3.46it/s]
  3%|▎         | 12006/371472 [58:01<30:13:09,  3.30it/s]
  3%|▎         | 12007/371472 [58:01<30:06:07,  3.32it/s]
  3%|▎         | 12008/371472 [58:02<29:32:56,  3.38it/s]
  3%|▎         | 12009/371472 [58:02<29:58:57,  3.33it/s]
  3%|▎         | 12010/371472 [58:02<30:31:49,  3.27it/s]
  3%|▎         | 12011/371472 [58:03<29:46:07,  3.35it/s]
  3%|▎         | 12012/371472 [58:03<28:35:40,  3.49it/s]
  3%|▎         | 12013/371472 [58:03<28:15:46,  3.53it/s]
  3%|▎         | 12014/371472 [58:03<29:02:22,  3.44it/s]
  3%|▎         | 12015/371472 [58:04<28:50:14,  3.46it/s]
  3%|▎         | 12016/371472 [58:04<30:27:21,  3.28it/s]
  3%|▎         | 12017/371472 [58:04<29:08:07,  3.43it/s]
  3%|▎         | 12018/371472 [58:05<28:46:56,  3.47it/s]
  3%|▎         | 12019/371472 [58:05<28:59:02,  3.44it/s]
  3%|▎         | 12020/371472 [58:05<28:10:10,  3.54it/s]
                                                         
{'loss': 4.8537, 'learning_rate': 9.713471524919735e-07, 'epoch': 0.52}

  3%|▎         | 12020/371472 [58:05<28:10:10,  3.54it/s]
  3%|▎         | 12021/371472 [58:05<27:56:37,  3.57it/s]
  3%|▎         | 12022/371472 [58:06<27:16:33,  3.66it/s]
  3%|▎         | 12023/371472 [58:06<27:24:32,  3.64it/s]
  3%|▎         | 12024/371472 [58:06<27:50:17,  3.59it/s]
  3%|▎         | 12025/371472 [58:07<28:29:05,  3.51it/s]
  3%|▎         | 12026/371472 [58:07<28:01:34,  3.56it/s]
  3%|▎         | 12027/371472 [58:07<29:31:59,  3.38it/s]
  3%|▎         | 12028/371472 [58:07<28:32:08,  3.50it/s]
  3%|▎         | 12029/371472 [58:08<30:42:48,  3.25it/s]
  3%|▎         | 12030/371472 [58:08<29:55:35,  3.34it/s]
  3%|▎         | 12031/371472 [58:08<30:09:11,  3.31it/s]
  3%|▎         | 12032/371472 [58:09<28:47:18,  3.47it/s]
  3%|▎         | 12033/371472 [58:09<27:52:37,  3.58it/s]
  3%|▎         | 12034/371472 [58:09<27:25:53,  3.64it/s]
  3%|▎         | 12035/371472 [58:09<27:10:10,  3.67it/s]
  3%|▎         | 12036/371472 [58:10<27:00:43,  3.70it/s]
  3%|▎         | 12037/371472 [58:10<27:05:58,  3.68it/s]
  3%|▎         | 12038/371472 [58:10<28:12:14,  3.54it/s]
  3%|▎         | 12039/371472 [58:11<28:49:54,  3.46it/s]
  3%|▎         | 12040/371472 [58:11<28:23:19,  3.52it/s]
                                                         
{'loss': 4.6005, 'learning_rate': 9.712986705164946e-07, 'epoch': 0.52}

  3%|▎         | 12040/371472 [58:11<28:23:19,  3.52it/s]
  3%|▎         | 12041/371472 [58:11<30:36:35,  3.26it/s]
  3%|▎         | 12042/371472 [58:12<29:42:27,  3.36it/s]
  3%|▎         | 12043/371472 [58:12<29:38:14,  3.37it/s]
  3%|▎         | 12044/371472 [58:12<28:34:22,  3.49it/s]
  3%|▎         | 12045/371472 [58:12<28:49:59,  3.46it/s]
  3%|▎         | 12046/371472 [58:13<30:02:32,  3.32it/s]
  3%|▎         | 12047/371472 [58:13<29:06:14,  3.43it/s]
  3%|▎         | 12048/371472 [58:13<29:38:28,  3.37it/s]
  3%|▎         | 12049/371472 [58:14<29:16:01,  3.41it/s]
  3%|▎         | 12050/371472 [58:14<28:28:36,  3.51it/s]
  3%|▎         | 12051/371472 [58:14<29:49:52,  3.35it/s]
  3%|▎         | 12052/371472 [58:14<28:54:03,  3.45it/s]
  3%|▎         | 12053/371472 [58:15<27:49:44,  3.59it/s]
  3%|▎         | 12054/371472 [58:15<27:21:26,  3.65it/s]
  3%|▎         | 12055/371472 [58:15<28:31:12,  3.50it/s]
  3%|▎         | 12056/371472 [58:16<27:51:45,  3.58it/s]
  3%|▎         | 12057/371472 [58:16<28:25:17,  3.51it/s]
  3%|▎         | 12058/371472 [58:16<27:59:20,  3.57it/s]
  3%|▎         | 12059/371472 [58:16<27:56:19,  3.57it/s]
  3%|▎         | 12060/371472 [58:17<27:53:32,  3.58it/s]
                                                         
{'loss': 4.7112, 'learning_rate': 9.712501885410157e-07, 'epoch': 0.52}

  3%|▎         | 12060/371472 [58:17<27:53:32,  3.58it/s]
  3%|▎         | 12061/371472 [58:17<27:06:07,  3.68it/s]
  3%|▎         | 12062/371472 [58:17<29:19:14,  3.40it/s]
  3%|▎         | 12063/371472 [58:18<30:06:54,  3.32it/s]
  3%|▎         | 12064/371472 [58:18<29:32:23,  3.38it/s]
  3%|▎         | 12065/371472 [58:18<29:04:15,  3.43it/s]
  3%|▎         | 12066/371472 [58:18<29:20:17,  3.40it/s]
  3%|▎         | 12067/371472 [58:19<28:08:41,  3.55it/s]
  3%|▎         | 12068/371472 [58:19<27:35:22,  3.62it/s]
  3%|▎         | 12069/371472 [58:19<26:58:20,  3.70it/s]
  3%|▎         | 12070/371472 [58:20<27:53:38,  3.58it/s]
  3%|▎         | 12071/371472 [58:20<27:38:45,  3.61it/s]
  3%|▎         | 12072/371472 [58:20<26:57:43,  3.70it/s]
  3%|▎         | 12073/371472 [58:20<29:00:38,  3.44it/s]
  3%|▎         | 12074/371472 [58:21<30:38:13,  3.26it/s]
  3%|▎         | 12075/371472 [58:21<29:42:24,  3.36it/s]
  3%|▎         | 12076/371472 [58:21<29:15:12,  3.41it/s]
  3%|▎         | 12077/371472 [58:22<29:08:48,  3.43it/s]
  3%|▎         | 12078/371472 [58:22<28:14:58,  3.53it/s]
  3%|▎         | 12079/371472 [58:22<28:11:12,  3.54it/s]
  3%|▎         | 12080/371472 [58:22<28:51:38,  3.46it/s]
                                                         
{'loss': 4.7967, 'learning_rate': 9.71201706565537e-07, 'epoch': 0.52}

  3%|▎         | 12080/371472 [58:22<28:51:38,  3.46it/s]
  3%|▎         | 12081/371472 [58:23<28:34:13,  3.49it/s]
  3%|▎         | 12082/371472 [58:23<28:42:33,  3.48it/s]
  3%|▎         | 12083/371472 [58:23<28:29:11,  3.50it/s]
  3%|▎         | 12084/371472 [58:24<29:31:06,  3.38it/s]
  3%|▎         | 12085/371472 [58:24<29:01:42,  3.44it/s]
  3%|▎         | 12086/371472 [58:24<28:48:44,  3.46it/s]
  3%|▎         | 12087/371472 [58:24<28:03:12,  3.56it/s]
  3%|▎         | 12088/371472 [58:25<27:34:26,  3.62it/s]
  3%|▎         | 12089/371472 [58:25<29:00:05,  3.44it/s]
  3%|▎         | 12090/371472 [58:25<28:11:22,  3.54it/s]
  3%|▎         | 12091/371472 [58:26<28:35:01,  3.49it/s]
  3%|▎         | 12092/371472 [58:26<29:06:32,  3.43it/s]
  3%|▎         | 12093/371472 [58:26<29:00:06,  3.44it/s]
  3%|▎         | 12094/371472 [58:26<28:33:09,  3.50it/s]
  3%|▎         | 12095/371472 [58:27<28:55:03,  3.45it/s]
  3%|▎         | 12096/371472 [58:27<28:59:25,  3.44it/s]
  3%|▎         | 12097/371472 [58:27<29:01:34,  3.44it/s]
  3%|▎         | 12098/371472 [58:28<32:05:44,  3.11it/s]
  3%|▎         | 12099/371472 [58:28<32:39:23,  3.06it/s]
  3%|▎         | 12100/371472 [58:28<31:54:13,  3.13it/s]
                                                         
{'loss': 4.8298, 'learning_rate': 9.711532245900578e-07, 'epoch': 0.52}

  3%|▎         | 12100/371472 [58:28<31:54:13,  3.13it/s]
  3%|▎         | 12101/371472 [58:29<31:19:27,  3.19it/s]
  3%|▎         | 12102/371472 [58:29<29:13:22,  3.42it/s]
  3%|▎         | 12103/371472 [58:29<28:41:08,  3.48it/s]
  3%|▎         | 12104/371472 [58:29<28:02:55,  3.56it/s]
  3%|▎         | 12105/371472 [58:30<29:34:16,  3.38it/s]
  3%|▎         | 12106/371472 [58:30<30:06:46,  3.31it/s]
  3%|▎         | 12107/371472 [58:30<29:11:50,  3.42it/s]
  3%|▎         | 12108/371472 [58:31<28:00:54,  3.56it/s]
  3%|▎         | 12109/371472 [58:31<28:10:39,  3.54it/s]
  3%|▎         | 12110/371472 [58:31<29:14:11,  3.41it/s]
  3%|▎         | 12111/371472 [58:31<28:41:00,  3.48it/s]
  3%|▎         | 12112/371472 [58:32<28:07:39,  3.55it/s]
  3%|▎         | 12113/371472 [58:32<28:46:39,  3.47it/s]
  3%|▎         | 12114/371472 [58:32<28:11:14,  3.54it/s]
  3%|▎         | 12115/371472 [58:33<29:26:32,  3.39it/s]
  3%|▎         | 12116/371472 [58:33<28:40:34,  3.48it/s]
  3%|▎         | 12117/371472 [58:33<27:54:32,  3.58it/s]
  3%|▎         | 12118/371472 [58:33<29:08:50,  3.42it/s]
  3%|▎         | 12119/371472 [58:34<28:30:33,  3.50it/s]
  3%|▎         | 12120/371472 [58:34<29:12:56,  3.42it/s]
                                                         
{'loss': 4.527, 'learning_rate': 9.71104742614579e-07, 'epoch': 0.52}

  3%|▎         | 12120/371472 [58:34<29:12:56,  3.42it/s]
  3%|▎         | 12121/371472 [58:34<28:44:57,  3.47it/s]
  3%|▎         | 12122/371472 [58:35<30:46:37,  3.24it/s]
  3%|▎         | 12123/371472 [58:35<29:51:26,  3.34it/s]
  3%|▎         | 12124/371472 [58:35<29:16:47,  3.41it/s]
  3%|▎         | 12125/371472 [58:36<31:30:46,  3.17it/s]
  3%|▎         | 12126/371472 [58:36<31:02:26,  3.22it/s]
  3%|▎         | 12127/371472 [58:36<30:11:37,  3.31it/s]
  3%|▎         | 12128/371472 [58:36<29:31:50,  3.38it/s]
  3%|▎         | 12129/371472 [58:37<28:46:50,  3.47it/s]
  3%|▎         | 12130/371472 [58:37<28:15:19,  3.53it/s]
  3%|▎         | 12131/371472 [58:37<27:46:28,  3.59it/s]
  3%|▎         | 12132/371472 [58:38<26:55:17,  3.71it/s]
  3%|▎         | 12133/371472 [58:38<27:44:30,  3.60it/s]
  3%|▎         | 12134/371472 [58:38<27:50:02,  3.59it/s]
  3%|▎         | 12135/371472 [58:38<30:40:34,  3.25it/s]
  3%|▎         | 12136/371472 [58:39<28:55:25,  3.45it/s]
  3%|▎         | 12137/371472 [58:39<28:11:07,  3.54it/s]
  3%|▎         | 12138/371472 [58:39<28:11:56,  3.54it/s]
  3%|▎         | 12139/371472 [58:40<28:18:33,  3.53it/s]
  3%|▎         | 12140/371472 [58:40<27:43:42,  3.60it/s]
                                                         
{'loss': 4.7663, 'learning_rate': 9.710562606391e-07, 'epoch': 0.52}

  3%|▎         | 12140/371472 [58:40<27:43:42,  3.60it/s]
  3%|▎         | 12141/371472 [58:40<28:52:58,  3.46it/s]
  3%|▎         | 12142/371472 [58:40<28:35:21,  3.49it/s]
  3%|▎         | 12143/371472 [58:41<29:23:41,  3.40it/s]
  3%|▎         | 12144/371472 [58:41<29:33:43,  3.38it/s]
  3%|▎         | 12145/371472 [58:41<30:04:58,  3.32it/s]
  3%|▎         | 12146/371472 [58:42<32:33:52,  3.07it/s]
  3%|▎         | 12147/371472 [58:42<31:22:41,  3.18it/s]
  3%|▎         | 12148/371472 [58:42<30:16:33,  3.30it/s]
  3%|▎         | 12149/371472 [58:43<29:13:58,  3.41it/s]
  3%|▎         | 12150/371472 [58:43<29:07:06,  3.43it/s]
  3%|▎         | 12151/371472 [58:43<29:47:47,  3.35it/s]
  3%|▎         | 12152/371472 [58:43<28:52:53,  3.46it/s]
  3%|▎         | 12153/371472 [58:44<27:42:47,  3.60it/s]
  3%|▎         | 12154/371472 [58:44<26:58:52,  3.70it/s]
  3%|▎         | 12155/371472 [58:44<28:24:27,  3.51it/s]
  3%|▎         | 12156/371472 [58:45<28:24:35,  3.51it/s]
  3%|▎         | 12157/371472 [58:45<28:37:43,  3.49it/s]
  3%|▎         | 12158/371472 [58:45<28:03:30,  3.56it/s]
  3%|▎         | 12159/371472 [58:45<27:30:06,  3.63it/s]
  3%|▎         | 12160/371472 [58:46<31:07:04,  3.21it/s]
                                                         
{'loss': 4.8853, 'learning_rate': 9.710077786636212e-07, 'epoch': 0.52}

  3%|▎         | 12160/371472 [58:46<31:07:04,  3.21it/s]
  3%|▎         | 12161/371472 [58:46<29:33:17,  3.38it/s]
  3%|▎         | 12162/371472 [58:46<29:18:31,  3.41it/s]
  3%|▎         | 12163/371472 [58:47<28:37:09,  3.49it/s]
  3%|▎         | 12164/371472 [58:47<29:26:52,  3.39it/s]
  3%|▎         | 12165/371472 [58:47<28:34:38,  3.49it/s]
  3%|▎         | 12166/371472 [58:47<27:33:51,  3.62it/s]
  3%|▎         | 12167/371472 [58:48<27:05:48,  3.68it/s]
  3%|▎         | 12168/371472 [58:48<27:33:37,  3.62it/s]
  3%|▎         | 12169/371472 [58:48<27:37:21,  3.61it/s]
  3%|▎         | 12170/371472 [58:49<29:34:29,  3.37it/s]
  3%|▎         | 12171/371472 [58:49<28:48:03,  3.47it/s]
  3%|▎         | 12172/371472 [58:49<27:43:04,  3.60it/s]
  3%|▎         | 12173/371472 [58:49<27:30:22,  3.63it/s]
  3%|▎         | 12174/371472 [58:50<26:48:54,  3.72it/s]
  3%|▎         | 12175/371472 [58:50<27:02:40,  3.69it/s]
  3%|▎         | 12176/371472 [58:50<27:20:15,  3.65it/s]
  3%|▎         | 12177/371472 [58:50<26:47:10,  3.73it/s]
  3%|▎         | 12178/371472 [58:51<27:24:48,  3.64it/s]
  3%|▎         | 12179/371472 [58:51<27:28:46,  3.63it/s]
  3%|▎         | 12180/371472 [58:51<27:39:25,  3.61it/s]
                                                         
{'loss': 4.6954, 'learning_rate': 9.709592966881423e-07, 'epoch': 0.52}

  3%|▎         | 12180/371472 [58:51<27:39:25,  3.61it/s]
  3%|▎         | 12181/371472 [58:52<28:08:56,  3.55it/s]
  3%|▎         | 12182/371472 [58:52<27:21:13,  3.65it/s]
  3%|▎         | 12183/371472 [58:52<26:25:36,  3.78it/s]
  3%|▎         | 12184/371472 [58:52<27:52:37,  3.58it/s]
  3%|▎         | 12185/371472 [58:53<28:39:54,  3.48it/s]
  3%|▎         | 12186/371472 [58:53<29:39:59,  3.36it/s]
  3%|▎         | 12187/371472 [58:53<31:26:34,  3.17it/s]
  3%|▎         | 12188/371472 [58:54<29:52:25,  3.34it/s]
  3%|▎         | 12189/371472 [58:54<30:07:01,  3.31it/s]
  3%|▎         | 12190/371472 [58:54<30:27:37,  3.28it/s]
  3%|▎         | 12191/371472 [58:55<30:39:09,  3.26it/s]
  3%|▎         | 12192/371472 [58:55<29:28:49,  3.39it/s]
  3%|▎         | 12193/371472 [58:55<28:31:41,  3.50it/s]
  3%|▎         | 12194/371472 [58:55<28:26:38,  3.51it/s]
  3%|▎         | 12195/371472 [58:56<28:54:31,  3.45it/s]
  3%|▎         | 12196/371472 [58:56<30:01:31,  3.32it/s]
  3%|▎         | 12197/371472 [58:56<30:35:59,  3.26it/s]
  3%|▎         | 12198/371472 [58:57<30:37:10,  3.26it/s]
  3%|▎         | 12199/371472 [58:57<30:09:02,  3.31it/s]
  3%|▎         | 12200/371472 [58:57<29:16:13,  3.41it/s]
                                                         
{'loss': 4.7645, 'learning_rate': 9.709108147126634e-07, 'epoch': 0.53}

  3%|▎         | 12200/371472 [58:57<29:16:13,  3.41it/s]
  3%|▎         | 12201/371472 [58:57<28:27:17,  3.51it/s]
  3%|▎         | 12202/371472 [58:58<30:11:40,  3.31it/s]
  3%|▎         | 12203/371472 [58:58<29:40:23,  3.36it/s]
  3%|▎         | 12204/371472 [58:59<32:48:16,  3.04it/s]
  3%|▎         | 12205/371472 [58:59<33:11:30,  3.01it/s]
  3%|▎         | 12206/371472 [58:59<31:33:00,  3.16it/s]
  3%|▎         | 12207/371472 [58:59<32:56:43,  3.03it/s]
  3%|▎         | 12208/371472 [59:00<32:51:29,  3.04it/s]
  3%|▎         | 12209/371472 [59:00<31:24:58,  3.18it/s]
  3%|▎         | 12210/371472 [59:00<32:26:16,  3.08it/s]
  3%|▎         | 12211/371472 [59:01<32:11:49,  3.10it/s]
  3%|▎         | 12212/371472 [59:01<30:41:18,  3.25it/s]
  3%|▎         | 12213/371472 [59:01<29:39:07,  3.37it/s]
  3%|▎         | 12214/371472 [59:02<31:40:52,  3.15it/s]
  3%|▎         | 12215/371472 [59:02<30:44:05,  3.25it/s]
  3%|▎         | 12216/371472 [59:02<30:24:50,  3.28it/s]
  3%|▎         | 12217/371472 [59:03<30:07:21,  3.31it/s]
  3%|▎         | 12218/371472 [59:03<28:52:40,  3.46it/s]
  3%|▎         | 12219/371472 [59:03<28:51:22,  3.46it/s]
  3%|▎         | 12220/371472 [59:03<29:38:03,  3.37it/s]
                                                         
{'loss': 4.6727, 'learning_rate': 9.708623327371847e-07, 'epoch': 0.53}

  3%|▎         | 12220/371472 [59:03<29:38:03,  3.37it/s]
  3%|▎         | 12221/371472 [59:04<29:25:27,  3.39it/s]
  3%|▎         | 12222/371472 [59:04<30:32:34,  3.27it/s]
  3%|▎         | 12223/371472 [59:04<29:28:02,  3.39it/s]
  3%|▎         | 12224/371472 [59:05<28:46:45,  3.47it/s]
  3%|▎         | 12225/371472 [59:05<28:30:10,  3.50it/s]
  3%|▎         | 12226/371472 [59:05<27:33:38,  3.62it/s]
  3%|▎         | 12227/371472 [59:05<27:01:03,  3.69it/s]
  3%|▎         | 12228/371472 [59:06<27:54:52,  3.57it/s]
  3%|▎         | 12229/371472 [59:06<29:32:11,  3.38it/s]
  3%|▎         | 12230/371472 [59:06<32:14:12,  3.10it/s]
  3%|▎         | 12231/371472 [59:07<34:34:42,  2.89it/s]
  3%|▎         | 12232/371472 [59:07<32:46:47,  3.04it/s]
  3%|▎         | 12233/371472 [59:07<31:01:05,  3.22it/s]
  3%|▎         | 12234/371472 [59:08<30:44:40,  3.25it/s]
  3%|▎         | 12235/371472 [59:08<29:13:22,  3.41it/s]
  3%|▎         | 12236/371472 [59:08<28:59:20,  3.44it/s]
  3%|▎         | 12237/371472 [59:08<29:04:43,  3.43it/s]
  3%|▎         | 12238/371472 [59:09<29:19:07,  3.40it/s]
  3%|▎         | 12239/371472 [59:09<29:01:41,  3.44it/s]
  3%|▎         | 12240/371472 [59:09<27:52:36,  3.58it/s]
                                                         
{'loss': 4.5477, 'learning_rate': 9.708138507617055e-07, 'epoch': 0.53}

  3%|▎         | 12240/371472 [59:09<27:52:36,  3.58it/s]
  3%|▎         | 12241/371472 [59:10<28:13:37,  3.54it/s]
  3%|▎         | 12242/371472 [59:10<28:47:35,  3.47it/s]
  3%|▎         | 12243/371472 [59:10<30:52:19,  3.23it/s]
  3%|▎         | 12244/371472 [59:11<31:50:52,  3.13it/s]
  3%|▎         | 12245/371472 [59:11<30:57:27,  3.22it/s]
  3%|▎         | 12246/371472 [59:11<30:00:41,  3.32it/s]
  3%|▎         | 12247/371472 [59:11<29:55:40,  3.33it/s]
  3%|▎         | 12248/371472 [59:12<30:21:27,  3.29it/s]
  3%|▎         | 12249/371472 [59:12<29:14:23,  3.41it/s]
  3%|▎         | 12250/371472 [59:12<28:52:47,  3.46it/s]
  3%|▎         | 12251/371472 [59:13<28:20:59,  3.52it/s]
  3%|▎         | 12252/371472 [59:13<28:23:35,  3.51it/s]
  3%|▎         | 12253/371472 [59:13<28:42:37,  3.48it/s]
  3%|▎         | 12254/371472 [59:13<27:48:58,  3.59it/s]
  3%|▎         | 12255/371472 [59:14<28:11:29,  3.54it/s]
  3%|▎         | 12256/371472 [59:14<28:25:48,  3.51it/s]
  3%|▎         | 12257/371472 [59:14<28:13:15,  3.54it/s]
  3%|▎         | 12258/371472 [59:15<28:03:03,  3.56it/s]
  3%|▎         | 12259/371472 [59:15<27:56:55,  3.57it/s]
  3%|▎         | 12260/371472 [59:15<28:21:05,  3.52it/s]
                                                         
{'loss': 4.6893, 'learning_rate': 9.707653687862268e-07, 'epoch': 0.53}

  3%|▎         | 12260/371472 [59:15<28:21:05,  3.52it/s]
  3%|▎         | 12261/371472 [59:15<28:25:13,  3.51it/s]
  3%|▎         | 12262/371472 [59:16<28:01:21,  3.56it/s]
  3%|▎         | 12263/371472 [59:16<30:56:27,  3.22it/s]
  3%|▎         | 12264/371472 [59:16<30:22:26,  3.29it/s]
  3%|▎         | 12265/371472 [59:17<30:43:33,  3.25it/s]
  3%|▎         | 12266/371472 [59:17<30:35:20,  3.26it/s]
  3%|▎         | 12267/371472 [59:17<31:05:21,  3.21it/s]
  3%|▎         | 12268/371472 [59:18<31:28:58,  3.17it/s]
  3%|▎         | 12269/371472 [59:18<30:11:29,  3.30it/s]
  3%|▎         | 12270/371472 [59:18<29:08:23,  3.42it/s]
  3%|▎         | 12271/371472 [59:18<28:29:47,  3.50it/s]
  3%|▎         | 12272/371472 [59:19<30:25:04,  3.28it/s]
  3%|▎         | 12273/371472 [59:19<29:49:34,  3.35it/s]
  3%|▎         | 12274/371472 [59:19<28:57:02,  3.45it/s]
  3%|▎         | 12275/371472 [59:20<28:41:28,  3.48it/s]
  3%|▎         | 12276/371472 [59:20<28:21:13,  3.52it/s]
  3%|▎         | 12277/371472 [59:20<28:49:18,  3.46it/s]
  3%|▎         | 12278/371472 [59:20<27:36:16,  3.61it/s]
  3%|▎         | 12279/371472 [59:21<29:46:46,  3.35it/s]
  3%|▎         | 12280/371472 [59:21<28:18:50,  3.52it/s]
                                                         
{'loss': 4.8461, 'learning_rate': 9.707168868107479e-07, 'epoch': 0.53}

  3%|▎         | 12280/371472 [59:21<28:18:50,  3.52it/s]
  3%|▎         | 12281/371472 [59:21<29:55:55,  3.33it/s]
  3%|▎         | 12282/371472 [59:22<28:01:26,  3.56it/s]
  3%|▎         | 12283/371472 [59:22<27:40:45,  3.60it/s]
  3%|▎         | 12284/371472 [59:22<27:57:15,  3.57it/s]
  3%|▎         | 12285/371472 [59:23<28:41:11,  3.48it/s]
  3%|▎         | 12286/371472 [59:23<28:49:33,  3.46it/s]
  3%|▎         | 12287/371472 [59:23<27:55:30,  3.57it/s]
  3%|▎         | 12288/371472 [59:23<27:45:51,  3.59it/s]
  3%|▎         | 12289/371472 [59:24<29:02:44,  3.44it/s]
  3%|▎         | 12290/371472 [59:24<28:52:43,  3.45it/s]
  3%|▎         | 12291/371472 [59:24<27:52:05,  3.58it/s]
  3%|▎         | 12292/371472 [59:25<29:14:19,  3.41it/s]
  3%|▎         | 12293/371472 [59:25<28:29:48,  3.50it/s]
  3%|▎         | 12294/371472 [59:25<27:50:35,  3.58it/s]
  3%|▎         | 12295/371472 [59:25<29:00:34,  3.44it/s]
  3%|▎         | 12296/371472 [59:26<28:11:32,  3.54it/s]
  3%|▎         | 12297/371472 [59:26<27:43:45,  3.60it/s]
  3%|▎         | 12298/371472 [59:26<28:36:08,  3.49it/s]
  3%|▎         | 12299/371472 [59:27<31:04:12,  3.21it/s]
  3%|▎         | 12300/371472 [59:27<29:58:03,  3.33it/s]
                                                         
{'loss': 4.5713, 'learning_rate': 9.70668404835269e-07, 'epoch': 0.53}

  3%|▎         | 12300/371472 [59:27<29:58:03,  3.33it/s]
  3%|▎         | 12301/371472 [59:27<29:57:45,  3.33it/s]
  3%|▎         | 12302/371472 [59:28<33:24:57,  2.99it/s]
  3%|▎         | 12303/371472 [59:28<30:56:34,  3.22it/s]
  3%|▎         | 12304/371472 [59:28<30:59:49,  3.22it/s]
  3%|▎         | 12305/371472 [59:28<29:41:01,  3.36it/s]
  3%|▎         | 12306/371472 [59:29<28:29:20,  3.50it/s]
  3%|▎         | 12307/371472 [59:29<32:10:57,  3.10it/s]
  3%|▎         | 12308/371472 [59:29<30:31:19,  3.27it/s]
  3%|▎         | 12309/371472 [59:30<31:06:20,  3.21it/s]
  3%|▎         | 12310/371472 [59:30<30:49:02,  3.24it/s]
  3%|▎         | 12311/371472 [59:30<29:22:55,  3.40it/s]
  3%|▎         | 12312/371472 [59:31<30:55:59,  3.23it/s]
  3%|▎         | 12313/371472 [59:31<30:21:12,  3.29it/s]
  3%|▎         | 12314/371472 [59:31<29:47:48,  3.35it/s]
  3%|▎         | 12315/371472 [59:31<30:20:55,  3.29it/s]
  3%|▎         | 12316/371472 [59:32<30:21:57,  3.29it/s]
  3%|▎         | 12317/371472 [59:32<29:26:06,  3.39it/s]
  3%|▎         | 12318/371472 [59:32<29:23:23,  3.39it/s]
  3%|▎         | 12319/371472 [59:33<31:01:46,  3.22it/s]
  3%|▎         | 12320/371472 [59:33<31:59:31,  3.12it/s]
                                                         
{'loss': 4.6324, 'learning_rate': 9.706199228597902e-07, 'epoch': 0.53}

  3%|▎         | 12320/371472 [59:33<31:59:31,  3.12it/s]
  3%|▎         | 12321/371472 [59:33<30:42:35,  3.25it/s]
  3%|▎         | 12322/371472 [59:34<30:23:33,  3.28it/s]
  3%|▎         | 12323/371472 [59:34<29:54:04,  3.34it/s]
  3%|▎         | 12324/371472 [59:34<30:11:16,  3.30it/s]
  3%|▎         | 12325/371472 [59:34<29:45:08,  3.35it/s]
  3%|▎         | 12326/371472 [59:35<29:18:59,  3.40it/s]
  3%|▎         | 12327/371472 [59:35<30:45:42,  3.24it/s]
  3%|▎         | 12328/371472 [59:35<29:49:36,  3.34it/s]
  3%|▎         | 12329/371472 [59:36<29:33:39,  3.37it/s]
  3%|▎         | 12330/371472 [59:36<28:50:25,  3.46it/s]
  3%|▎         | 12331/371472 [59:36<28:06:47,  3.55it/s]
  3%|▎         | 12332/371472 [59:37<28:38:33,  3.48it/s]
  3%|▎         | 12333/371472 [59:37<28:23:53,  3.51it/s]
  3%|▎         | 12334/371472 [59:37<29:06:51,  3.43it/s]
  3%|▎         | 12335/371472 [59:37<28:49:25,  3.46it/s]
  3%|▎         | 12336/371472 [59:38<28:24:04,  3.51it/s]
  3%|▎         | 12337/371472 [59:38<27:33:48,  3.62it/s]
  3%|▎         | 12338/371472 [59:38<27:42:38,  3.60it/s]
  3%|▎         | 12339/371472 [59:39<28:03:28,  3.56it/s]
  3%|▎         | 12340/371472 [59:39<27:08:54,  3.67it/s]
                                                         
{'loss': 4.9228, 'learning_rate': 9.70571440884311e-07, 'epoch': 0.53}

  3%|▎         | 12340/371472 [59:39<27:08:54,  3.67it/s]
  3%|▎         | 12341/371472 [59:39<26:35:13,  3.75it/s]
  3%|▎         | 12342/371472 [59:39<29:57:28,  3.33it/s]
  3%|▎         | 12343/371472 [59:40<29:15:48,  3.41it/s]
  3%|▎         | 12344/371472 [59:40<30:44:10,  3.25it/s]
  3%|▎         | 12345/371472 [59:40<28:52:24,  3.46it/s]
  3%|▎         | 12346/371472 [59:41<27:44:16,  3.60it/s]
  3%|▎         | 12347/371472 [59:41<30:42:10,  3.25it/s]
  3%|▎         | 12348/371472 [59:41<32:39:52,  3.05it/s]
  3%|▎         | 12349/371472 [59:42<30:57:30,  3.22it/s]
  3%|▎         | 12350/371472 [59:42<30:01:27,  3.32it/s]
  3%|▎         | 12351/371472 [59:42<28:50:02,  3.46it/s]
  3%|▎         | 12352/371472 [59:42<29:25:05,  3.39it/s]
  3%|▎         | 12353/371472 [59:43<28:22:57,  3.51it/s]
  3%|▎         | 12354/371472 [59:43<27:51:11,  3.58it/s]
  3%|▎         | 12355/371472 [59:43<27:31:04,  3.63it/s]
  3%|▎         | 12356/371472 [59:43<27:15:03,  3.66it/s]
  3%|▎         | 12357/371472 [59:44<27:00:40,  3.69it/s]
  3%|▎         | 12358/371472 [59:44<27:57:23,  3.57it/s]
  3%|▎         | 12359/371472 [59:44<30:25:24,  3.28it/s]
  3%|▎         | 12360/371472 [59:45<29:36:30,  3.37it/s]
                                                         
{'loss': 4.947, 'learning_rate': 9.705229589088324e-07, 'epoch': 0.53}

  3%|▎         | 12360/371472 [59:45<29:36:30,  3.37it/s]
  3%|▎         | 12361/371472 [59:45<28:46:19,  3.47it/s]
  3%|▎         | 12362/371472 [59:45<30:43:05,  3.25it/s]
  3%|▎         | 12363/371472 [59:46<30:23:29,  3.28it/s]
  3%|▎         | 12364/371472 [59:46<30:28:34,  3.27it/s]
  3%|▎         | 12365/371472 [59:46<29:45:23,  3.35it/s]
  3%|▎         | 12366/371472 [59:46<28:29:10,  3.50it/s]
  3%|▎         | 12367/371472 [59:47<27:45:29,  3.59it/s]
  3%|▎         | 12368/371472 [59:47<27:16:47,  3.66it/s]
  3%|▎         | 12369/371472 [59:47<28:05:35,  3.55it/s]
  3%|▎         | 12370/371472 [59:48<28:47:49,  3.46it/s]
  3%|▎         | 12371/371472 [59:48<29:29:17,  3.38it/s]
  3%|▎         | 12372/371472 [59:48<29:02:38,  3.43it/s]
  3%|▎         | 12373/371472 [59:48<29:49:35,  3.34it/s]
  3%|▎         | 12374/371472 [59:49<30:31:46,  3.27it/s]
  3%|▎         | 12375/371472 [59:49<29:53:43,  3.34it/s]
  3%|▎         | 12376/371472 [59:49<32:14:36,  3.09it/s]
  3%|▎         | 12377/371472 [59:50<30:41:54,  3.25it/s]
  3%|▎         | 12378/371472 [59:50<29:44:11,  3.35it/s]
  3%|▎         | 12379/371472 [59:50<30:20:34,  3.29it/s]
  3%|▎         | 12380/371472 [59:51<30:46:48,  3.24it/s]
                                                         
{'loss': 4.7576, 'learning_rate': 9.704744769333532e-07, 'epoch': 0.53}

  3%|▎         | 12380/371472 [59:51<30:46:48,  3.24it/s]
  3%|▎         | 12381/371472 [59:51<29:08:13,  3.42it/s]
  3%|▎         | 12382/371472 [59:51<31:22:54,  3.18it/s]
  3%|▎         | 12383/371472 [59:52<30:36:43,  3.26it/s]
  3%|▎         | 12384/371472 [59:52<31:08:10,  3.20it/s]
  3%|▎         | 12385/371472 [59:52<31:25:37,  3.17it/s]
  3%|▎         | 12386/371472 [59:52<30:50:10,  3.23it/s]
  3%|▎         | 12387/371472 [59:53<29:23:50,  3.39it/s]
  3%|▎         | 12388/371472 [59:53<30:25:15,  3.28it/s]
  3%|▎         | 12389/371472 [59:53<30:36:54,  3.26it/s]
  3%|▎         | 12390/371472 [59:54<30:54:39,  3.23it/s]
  3%|▎         | 12391/371472 [59:54<31:04:59,  3.21it/s]
  3%|▎         | 12392/371472 [59:54<31:08:06,  3.20it/s]
  3%|▎         | 12393/371472 [59:55<29:36:04,  3.37it/s]
  3%|▎         | 12394/371472 [59:55<30:31:46,  3.27it/s]
  3%|▎         | 12395/371472 [59:55<29:44:32,  3.35it/s]
  3%|▎         | 12396/371472 [59:56<30:27:51,  3.27it/s]
  3%|▎         | 12397/371472 [59:56<29:05:46,  3.43it/s]
  3%|▎         | 12398/371472 [59:56<28:27:57,  3.50it/s]
  3%|▎         | 12399/371472 [59:56<28:47:12,  3.46it/s]
  3%|▎         | 12400/371472 [59:57<29:23:18,  3.39it/s]
                                                         
{'loss': 4.6725, 'learning_rate': 9.704259949578745e-07, 'epoch': 0.53}

  3%|▎         | 12400/371472 [59:57<29:23:18,  3.39it/s]
  3%|▎         | 12401/371472 [59:57<29:15:16,  3.41it/s]
  3%|▎         | 12402/371472 [59:57<29:02:15,  3.43it/s]
  3%|▎         | 12403/371472 [59:57<28:41:46,  3.48it/s]
  3%|▎         | 12404/371472 [59:58<28:21:48,  3.52it/s]
  3%|▎         | 12405/371472 [59:58<28:43:56,  3.47it/s]
  3%|▎         | 12406/371472 [59:58<28:13:41,  3.53it/s]
  3%|▎         | 12407/371472 [59:59<28:24:07,  3.51it/s]
  3%|▎         | 12408/371472 [59:59<27:25:32,  3.64it/s]
  3%|▎         | 12409/371472 [59:59<27:20:25,  3.65it/s]
  3%|▎         | 12410/371472 [59:59<27:04:34,  3.68it/s]
  3%|▎         | 12411/371472 [1:00:00<27:44:10,  3.60it/s]
  3%|▎         | 12412/371472 [1:00:00<27:28:03,  3.63it/s]
  3%|▎         | 12413/371472 [1:00:00<28:10:35,  3.54it/s]
  3%|▎         | 12414/371472 [1:00:01<27:52:18,  3.58it/s]
  3%|▎         | 12415/371472 [1:00:01<27:42:18,  3.60it/s]
  3%|▎         | 12416/371472 [1:00:01<28:03:09,  3.56it/s]
  3%|▎         | 12417/371472 [1:00:01<28:14:24,  3.53it/s]
  3%|▎         | 12418/371472 [1:00:02<29:44:51,  3.35it/s]
  3%|▎         | 12419/371472 [1:00:02<29:50:19,  3.34it/s]
  3%|▎         | 12420/371472 [1:00:02<31:04:18,  3.21it/s]
                                                           
{'loss': 4.677, 'learning_rate': 9.703775129823956e-07, 'epoch': 0.53}

  3%|▎         | 12420/371472 [1:00:02<31:04:18,  3.21it/s]
  3%|▎         | 12421/371472 [1:00:03<29:22:50,  3.39it/s]
  3%|▎         | 12422/371472 [1:00:03<28:28:27,  3.50it/s]
  3%|▎         | 12423/371472 [1:00:03<28:19:30,  3.52it/s]
  3%|▎         | 12424/371472 [1:00:03<28:11:05,  3.54it/s]
  3%|▎         | 12425/371472 [1:00:04<27:52:18,  3.58it/s]
  3%|▎         | 12426/371472 [1:00:04<27:16:42,  3.66it/s]
  3%|▎         | 12427/371472 [1:00:04<27:06:31,  3.68it/s]
  3%|▎         | 12428/371472 [1:00:05<27:07:18,  3.68it/s]
  3%|▎         | 12429/371472 [1:00:05<27:37:00,  3.61it/s]
  3%|▎         | 12430/371472 [1:00:05<30:18:45,  3.29it/s]
  3%|▎         | 12431/371472 [1:00:05<29:15:37,  3.41it/s]
  3%|▎         | 12432/371472 [1:00:06<27:56:51,  3.57it/s]
  3%|▎         | 12433/371472 [1:00:06<27:27:02,  3.63it/s]
  3%|▎         | 12434/371472 [1:00:06<26:51:58,  3.71it/s]
  3%|▎         | 12435/371472 [1:00:06<26:24:18,  3.78it/s]
  3%|▎         | 12436/371472 [1:00:07<27:08:07,  3.68it/s]
  3%|▎         | 12437/371472 [1:00:07<27:01:12,  3.69it/s]
  3%|▎         | 12438/371472 [1:00:07<26:55:57,  3.70it/s]
  3%|▎         | 12439/371472 [1:00:08<27:02:23,  3.69it/s]
  3%|▎         | 12440/371472 [1:00:08<32:20:42,  3.08it/s]
                                                           
{'loss': 4.7095, 'learning_rate': 9.703290310069167e-07, 'epoch': 0.54}

  3%|▎         | 12440/371472 [1:00:08<32:20:42,  3.08it/s]
  3%|▎         | 12441/371472 [1:00:08<30:22:56,  3.28it/s]
  3%|▎         | 12442/371472 [1:00:09<29:22:16,  3.40it/s]
  3%|▎         | 12443/371472 [1:00:09<29:11:08,  3.42it/s]
  3%|▎         | 12444/371472 [1:00:09<28:50:13,  3.46it/s]
  3%|▎         | 12445/371472 [1:00:09<30:41:55,  3.25it/s]
  3%|▎         | 12446/371472 [1:00:10<31:36:01,  3.16it/s]
  3%|▎         | 12447/371472 [1:00:10<33:09:43,  3.01it/s]
  3%|▎         | 12448/371472 [1:00:10<30:41:04,  3.25it/s]
  3%|▎         | 12449/371472 [1:00:11<29:54:58,  3.33it/s]
  3%|▎         | 12450/371472 [1:00:11<29:05:55,  3.43it/s]
  3%|▎         | 12451/371472 [1:00:11<30:54:46,  3.23it/s]
  3%|▎         | 12452/371472 [1:00:12<29:01:25,  3.44it/s]
  3%|▎         | 12453/371472 [1:00:12<28:52:57,  3.45it/s]
  3%|▎         | 12454/371472 [1:00:12<29:26:58,  3.39it/s]
  3%|▎         | 12455/371472 [1:00:12<28:03:41,  3.55it/s]
  3%|▎         | 12456/371472 [1:00:13<28:37:38,  3.48it/s]
  3%|▎         | 12457/371472 [1:00:13<29:08:55,  3.42it/s]
  3%|▎         | 12458/371472 [1:00:13<29:20:05,  3.40it/s]
  3%|▎         | 12459/371472 [1:00:14<28:08:50,  3.54it/s]
  3%|▎         | 12460/371472 [1:00:14<27:55:27,  3.57it/s]
                                                           
{'loss': 4.8679, 'learning_rate': 9.70280549031438e-07, 'epoch': 0.54}

  3%|▎         | 12460/371472 [1:00:14<27:55:27,  3.57it/s]
  3%|▎         | 12461/371472 [1:00:14<27:59:43,  3.56it/s]
  3%|▎         | 12462/371472 [1:00:14<28:02:00,  3.56it/s]
  3%|▎         | 12463/371472 [1:00:15<27:38:11,  3.61it/s]
  3%|▎         | 12464/371472 [1:00:15<27:43:34,  3.60it/s]
  3%|▎         | 12465/371472 [1:00:15<27:07:19,  3.68it/s]
  3%|▎         | 12466/371472 [1:00:15<26:29:26,  3.76it/s]
  3%|▎         | 12467/371472 [1:00:16<29:29:23,  3.38it/s]
  3%|▎         | 12468/371472 [1:00:16<28:17:32,  3.52it/s]
  3%|▎         | 12469/371472 [1:00:16<29:02:47,  3.43it/s]
  3%|▎         | 12470/371472 [1:00:17<28:22:13,  3.52it/s]
  3%|▎         | 12471/371472 [1:00:17<28:35:47,  3.49it/s]
  3%|▎         | 12472/371472 [1:00:17<28:42:11,  3.47it/s]
  3%|▎         | 12473/371472 [1:00:18<28:28:53,  3.50it/s]
  3%|▎         | 12474/371472 [1:00:18<29:24:18,  3.39it/s]
  3%|▎         | 12475/371472 [1:00:18<28:40:06,  3.48it/s]
  3%|▎         | 12476/371472 [1:00:18<29:18:06,  3.40it/s]
  3%|▎         | 12477/371472 [1:00:19<28:34:35,  3.49it/s]
  3%|▎         | 12478/371472 [1:00:19<29:29:28,  3.38it/s]
  3%|▎         | 12479/371472 [1:00:19<28:44:38,  3.47it/s]
  3%|▎         | 12480/371472 [1:00:20<27:54:16,  3.57it/s]
                                                           
{'loss': 4.7676, 'learning_rate': 9.702320670559588e-07, 'epoch': 0.54}

  3%|▎         | 12480/371472 [1:00:20<27:54:16,  3.57it/s]
  3%|▎         | 12481/371472 [1:00:20<27:54:27,  3.57it/s]
  3%|▎         | 12482/371472 [1:00:20<27:07:10,  3.68it/s]
  3%|▎         | 12483/371472 [1:00:20<29:07:52,  3.42it/s]
  3%|▎         | 12484/371472 [1:00:21<29:26:45,  3.39it/s]
  3%|▎         | 12485/371472 [1:00:21<28:27:47,  3.50it/s]
  3%|▎         | 12486/371472 [1:00:21<28:22:52,  3.51it/s]
  3%|▎         | 12487/371472 [1:00:22<27:52:56,  3.58it/s]
  3%|▎         | 12488/371472 [1:00:22<27:44:02,  3.60it/s]
  3%|▎         | 12489/371472 [1:00:22<28:05:15,  3.55it/s]
  3%|▎         | 12490/371472 [1:00:22<28:00:18,  3.56it/s]
  3%|▎         | 12491/371472 [1:00:23<27:07:28,  3.68it/s]
  3%|▎         | 12492/371472 [1:00:23<27:23:11,  3.64it/s]
  3%|▎         | 12493/371472 [1:00:23<28:53:24,  3.45it/s]
  3%|▎         | 12494/371472 [1:00:24<29:33:20,  3.37it/s]
  3%|▎         | 12495/371472 [1:00:24<28:39:32,  3.48it/s]
  3%|▎         | 12496/371472 [1:00:24<28:17:02,  3.53it/s]
  3%|▎         | 12497/371472 [1:00:24<28:19:54,  3.52it/s]
  3%|▎         | 12498/371472 [1:00:25<29:07:31,  3.42it/s]
  3%|▎         | 12499/371472 [1:00:25<29:34:53,  3.37it/s]
  3%|▎         | 12500/371472 [1:00:25<29:20:51,  3.40it/s]
                                                           
{'loss': 4.7246, 'learning_rate': 9.7018358508048e-07, 'epoch': 0.54}

  3%|▎         | 12500/371472 [1:00:25<29:20:51,  3.40it/s]
  3%|▎         | 12501/371472 [1:00:26<28:08:22,  3.54it/s]
  3%|▎         | 12502/371472 [1:00:26<28:18:46,  3.52it/s]
  3%|▎         | 12503/371472 [1:00:26<28:49:19,  3.46it/s]
  3%|▎         | 12504/371472 [1:00:26<28:30:45,  3.50it/s]
  3%|▎         | 12505/371472 [1:00:27<27:41:47,  3.60it/s]
  3%|▎         | 12506/371472 [1:00:27<28:13:42,  3.53it/s]
  3%|▎         | 12507/371472 [1:00:27<27:32:23,  3.62it/s]
  3%|▎         | 12508/371472 [1:00:28<27:39:33,  3.61it/s]
  3%|▎         | 12509/371472 [1:00:28<27:50:14,  3.58it/s]
  3%|▎         | 12510/371472 [1:00:28<28:35:48,  3.49it/s]
  3%|▎         | 12511/371472 [1:00:28<28:13:53,  3.53it/s]
  3%|▎         | 12512/371472 [1:00:29<28:28:52,  3.50it/s]
  3%|▎         | 12513/371472 [1:00:29<29:12:52,  3.41it/s]
  3%|▎         | 12514/371472 [1:00:29<28:25:28,  3.51it/s]
  3%|▎         | 12515/371472 [1:00:30<27:48:17,  3.59it/s]
  3%|▎         | 12516/371472 [1:00:30<27:52:30,  3.58it/s]
  3%|▎         | 12517/371472 [1:00:30<28:07:36,  3.54it/s]
  3%|▎         | 12518/371472 [1:00:30<29:33:19,  3.37it/s]
  3%|▎         | 12519/371472 [1:00:31<28:15:38,  3.53it/s]
  3%|▎         | 12520/371472 [1:00:31<28:00:36,  3.56it/s]
                                                           
{'loss': 4.7469, 'learning_rate': 9.701351031050012e-07, 'epoch': 0.54}

  3%|▎         | 12520/371472 [1:00:31<28:00:36,  3.56it/s]
  3%|▎         | 12521/371472 [1:00:31<27:27:11,  3.63it/s]
  3%|▎         | 12522/371472 [1:00:31<26:23:55,  3.78it/s]
  3%|▎         | 12523/371472 [1:00:32<27:37:17,  3.61it/s]
  3%|▎         | 12524/371472 [1:00:32<28:32:49,  3.49it/s]
  3%|▎         | 12525/371472 [1:00:32<27:47:54,  3.59it/s]
  3%|▎         | 12526/371472 [1:00:33<29:06:23,  3.43it/s]
  3%|▎         | 12527/371472 [1:00:33<27:58:11,  3.56it/s]
  3%|▎         | 12528/371472 [1:00:33<27:55:56,  3.57it/s]
  3%|▎         | 12529/371472 [1:00:33<27:56:17,  3.57it/s]
  3%|▎         | 12530/371472 [1:00:34<27:18:40,  3.65it/s]
  3%|▎         | 12531/371472 [1:00:34<28:16:01,  3.53it/s]
  3%|▎         | 12532/371472 [1:00:34<28:02:00,  3.56it/s]
  3%|▎         | 12533/371472 [1:00:35<28:28:30,  3.50it/s]
  3%|▎         | 12534/371472 [1:00:35<29:06:20,  3.43it/s]
  3%|▎         | 12535/371472 [1:00:35<28:55:07,  3.45it/s]
  3%|▎         | 12536/371472 [1:00:35<29:22:27,  3.39it/s]
  3%|▎         | 12537/371472 [1:00:36<29:42:02,  3.36it/s]
  3%|▎         | 12538/371472 [1:00:36<29:25:42,  3.39it/s]
  3%|▎         | 12539/371472 [1:00:36<29:28:19,  3.38it/s]
  3%|▎         | 12540/371472 [1:00:37<28:22:38,  3.51it/s]
                                                           
{'loss': 4.7057, 'learning_rate': 9.700866211295222e-07, 'epoch': 0.54}

  3%|▎         | 12540/371472 [1:00:37<28:22:38,  3.51it/s]
  3%|▎         | 12541/371472 [1:00:37<28:08:36,  3.54it/s]
  3%|▎         | 12542/371472 [1:00:37<28:11:53,  3.54it/s]
  3%|▎         | 12543/371472 [1:00:37<28:58:52,  3.44it/s]
  3%|▎         | 12544/371472 [1:00:38<29:05:59,  3.43it/s]
  3%|▎         | 12545/371472 [1:00:38<28:06:47,  3.55it/s]
  3%|▎         | 12546/371472 [1:00:38<27:37:30,  3.61it/s]
  3%|▎         | 12547/371472 [1:00:39<27:54:54,  3.57it/s]
  3%|▎         | 12548/371472 [1:00:39<27:57:05,  3.57it/s]
  3%|▎         | 12549/371472 [1:00:39<28:55:50,  3.45it/s]
  3%|▎         | 12550/371472 [1:00:39<27:35:56,  3.61it/s]
  3%|▎         | 12551/371472 [1:00:40<26:57:25,  3.70it/s]
  3%|▎         | 12552/371472 [1:00:40<26:30:12,  3.76it/s]
  3%|▎         | 12553/371472 [1:00:40<26:10:55,  3.81it/s]
  3%|▎         | 12554/371472 [1:00:40<26:54:33,  3.71it/s]
  3%|▎         | 12555/371472 [1:00:41<26:31:49,  3.76it/s]
  3%|▎         | 12556/371472 [1:00:41<28:30:42,  3.50it/s]
  3%|▎         | 12557/371472 [1:00:41<28:36:24,  3.49it/s]
  3%|▎         | 12558/371472 [1:00:42<28:07:59,  3.54it/s]
  3%|▎         | 12559/371472 [1:00:42<28:34:10,  3.49it/s]
  3%|▎         | 12560/371472 [1:00:42<30:42:14,  3.25it/s]
                                                           
{'loss': 4.5612, 'learning_rate': 9.700381391540435e-07, 'epoch': 0.54}

  3%|▎         | 12560/371472 [1:00:42<30:42:14,  3.25it/s]
  3%|▎         | 12561/371472 [1:00:43<29:52:37,  3.34it/s]
  3%|▎         | 12562/371472 [1:00:43<29:25:15,  3.39it/s]
  3%|▎         | 12563/371472 [1:00:43<31:26:53,  3.17it/s]
  3%|▎         | 12564/371472 [1:00:44<30:35:00,  3.26it/s]
  3%|▎         | 12565/371472 [1:00:44<29:54:34,  3.33it/s]
  3%|▎         | 12566/371472 [1:00:44<28:33:17,  3.49it/s]
  3%|▎         | 12567/371472 [1:00:44<27:50:45,  3.58it/s]
  3%|▎         | 12568/371472 [1:00:45<27:24:02,  3.64it/s]
  3%|▎         | 12569/371472 [1:00:45<27:12:10,  3.66it/s]
  3%|▎         | 12570/371472 [1:00:45<27:36:40,  3.61it/s]
  3%|▎         | 12571/371472 [1:00:45<29:47:01,  3.35it/s]
  3%|▎         | 12572/371472 [1:00:46<34:04:57,  2.93it/s]
  3%|▎         | 12573/371472 [1:00:46<31:33:08,  3.16it/s]
  3%|▎         | 12574/371472 [1:00:46<30:00:29,  3.32it/s]
  3%|▎         | 12575/371472 [1:00:47<30:48:16,  3.24it/s]
  3%|▎         | 12576/371472 [1:00:47<32:35:56,  3.06it/s]
  3%|▎         | 12577/371472 [1:00:47<30:50:10,  3.23it/s]
  3%|▎         | 12578/371472 [1:00:48<30:39:34,  3.25it/s]
  3%|▎         | 12579/371472 [1:00:48<29:48:37,  3.34it/s]
  3%|▎         | 12580/371472 [1:00:48<28:59:10,  3.44it/s]
                                                           
{'loss': 4.6163, 'learning_rate': 9.699896571785644e-07, 'epoch': 0.54}

  3%|▎         | 12580/371472 [1:00:48<28:59:10,  3.44it/s]
  3%|▎         | 12581/371472 [1:00:49<29:33:33,  3.37it/s]
  3%|▎         | 12582/371472 [1:00:49<31:20:03,  3.18it/s]
  3%|▎         | 12583/371472 [1:00:49<29:46:21,  3.35it/s]
  3%|▎         | 12584/371472 [1:00:49<28:47:35,  3.46it/s]
  3%|▎         | 12585/371472 [1:00:50<28:38:36,  3.48it/s]
  3%|▎         | 12586/371472 [1:00:50<29:55:30,  3.33it/s]
  3%|▎         | 12587/371472 [1:00:50<29:07:56,  3.42it/s]
  3%|▎         | 12588/371472 [1:00:51<31:20:54,  3.18it/s]
  3%|▎         | 12589/371472 [1:00:51<29:24:18,  3.39it/s]
  3%|▎         | 12590/371472 [1:00:51<30:18:08,  3.29it/s]
  3%|▎         | 12591/371472 [1:00:52<29:19:40,  3.40it/s]
  3%|▎         | 12592/371472 [1:00:52<29:23:41,  3.39it/s]
  3%|▎         | 12593/371472 [1:00:52<29:24:58,  3.39it/s]
  3%|▎         | 12594/371472 [1:00:52<28:24:11,  3.51it/s]
  3%|▎         | 12595/371472 [1:00:53<29:04:09,  3.43it/s]
  3%|▎         | 12596/371472 [1:00:53<28:22:24,  3.51it/s]
  3%|▎         | 12597/371472 [1:00:53<30:12:37,  3.30it/s]
  3%|▎         | 12598/371472 [1:00:54<29:35:09,  3.37it/s]
  3%|▎         | 12599/371472 [1:00:54<28:45:29,  3.47it/s]
  3%|▎         | 12600/371472 [1:00:54<29:53:36,  3.33it/s]
                                                           
{'loss': 4.5884, 'learning_rate': 9.699411752030857e-07, 'epoch': 0.54}

  3%|▎         | 12600/371472 [1:00:54<29:53:36,  3.33it/s]
  3%|▎         | 12601/371472 [1:00:54<28:57:38,  3.44it/s]
  3%|▎         | 12602/371472 [1:00:55<29:34:29,  3.37it/s]
  3%|▎         | 12603/371472 [1:00:55<29:37:33,  3.36it/s]
  3%|▎         | 12604/371472 [1:00:55<29:20:28,  3.40it/s]
  3%|▎         | 12605/371472 [1:00:56<28:07:52,  3.54it/s]
  3%|▎         | 12606/371472 [1:00:56<30:05:23,  3.31it/s]
  3%|▎         | 12607/371472 [1:00:56<29:47:07,  3.35it/s]
  3%|▎         | 12608/371472 [1:00:57<28:34:06,  3.49it/s]
  3%|▎         | 12609/371472 [1:00:57<28:13:56,  3.53it/s]
  3%|▎         | 12610/371472 [1:00:57<28:38:04,  3.48it/s]
  3%|▎         | 12611/371472 [1:00:58<34:30:25,  2.89it/s]
  3%|▎         | 12612/371472 [1:00:58<34:29:35,  2.89it/s]
  3%|▎         | 12613/371472 [1:00:58<33:34:19,  2.97it/s]
  3%|▎         | 12614/371472 [1:00:58<30:53:40,  3.23it/s]
  3%|▎         | 12615/371472 [1:00:59<29:40:34,  3.36it/s]
  3%|▎         | 12616/371472 [1:00:59<28:27:10,  3.50it/s]
  3%|▎         | 12617/371472 [1:00:59<28:38:36,  3.48it/s]
  3%|▎         | 12618/371472 [1:01:00<28:25:46,  3.51it/s]
  3%|▎         | 12619/371472 [1:01:00<28:12:22,  3.53it/s]
  3%|▎         | 12620/371472 [1:01:00<30:33:13,  3.26it/s]
                                                           
{'loss': 4.7224, 'learning_rate': 9.698926932276065e-07, 'epoch': 0.54}

  3%|▎         | 12620/371472 [1:01:00<30:33:13,  3.26it/s]
  3%|▎         | 12621/371472 [1:01:01<31:01:26,  3.21it/s]
  3%|▎         | 12622/371472 [1:01:01<30:53:04,  3.23it/s]
  3%|▎         | 12623/371472 [1:01:01<30:06:58,  3.31it/s]
  3%|▎         | 12624/371472 [1:01:01<29:52:10,  3.34it/s]
  3%|▎         | 12625/371472 [1:01:02<29:31:53,  3.38it/s]
  3%|▎         | 12626/371472 [1:01:02<29:04:43,  3.43it/s]
  3%|▎         | 12627/371472 [1:01:02<27:43:32,  3.60it/s]
  3%|▎         | 12628/371472 [1:01:03<27:22:27,  3.64it/s]
  3%|▎         | 12629/371472 [1:01:03<30:15:47,  3.29it/s]
  3%|▎         | 12630/371472 [1:01:03<29:17:22,  3.40it/s]
  3%|▎         | 12631/371472 [1:01:03<29:29:13,  3.38it/s]
  3%|▎         | 12632/371472 [1:01:04<31:22:20,  3.18it/s]
  3%|▎         | 12633/371472 [1:01:04<30:09:17,  3.31it/s]
  3%|▎         | 12634/371472 [1:01:04<30:22:52,  3.28it/s]
  3%|▎         | 12635/371472 [1:01:05<31:29:19,  3.17it/s]
  3%|▎         | 12636/371472 [1:01:05<32:06:59,  3.10it/s]
  3%|▎         | 12637/371472 [1:01:05<31:31:53,  3.16it/s]
  3%|▎         | 12638/371472 [1:01:06<30:11:35,  3.30it/s]
  3%|▎         | 12639/371472 [1:01:06<29:15:53,  3.41it/s]
  3%|▎         | 12640/371472 [1:01:06<31:18:40,  3.18it/s]
                                                           
{'loss': 4.7125, 'learning_rate': 9.698442112521278e-07, 'epoch': 0.54}

  3%|▎         | 12640/371472 [1:01:06<31:18:40,  3.18it/s]
  3%|▎         | 12641/371472 [1:01:07<30:57:14,  3.22it/s]
  3%|▎         | 12642/371472 [1:01:07<31:43:36,  3.14it/s]
  3%|▎         | 12643/371472 [1:01:07<30:14:02,  3.30it/s]
  3%|▎         | 12644/371472 [1:01:07<29:53:39,  3.33it/s]
  3%|▎         | 12645/371472 [1:01:08<28:46:15,  3.46it/s]
  3%|▎         | 12646/371472 [1:01:08<28:12:45,  3.53it/s]
  3%|▎         | 12647/371472 [1:01:08<28:27:54,  3.50it/s]
  3%|▎         | 12648/371472 [1:01:09<28:12:10,  3.53it/s]
  3%|▎         | 12649/371472 [1:01:09<29:00:02,  3.44it/s]
  3%|▎         | 12650/371472 [1:01:09<28:09:36,  3.54it/s]
  3%|▎         | 12651/371472 [1:01:09<27:23:35,  3.64it/s]
  3%|▎         | 12652/371472 [1:01:10<29:11:21,  3.41it/s]
  3%|▎         | 12653/371472 [1:01:10<28:16:32,  3.53it/s]
  3%|▎         | 12654/371472 [1:01:10<29:13:12,  3.41it/s]
  3%|▎         | 12655/371472 [1:01:11<30:42:36,  3.25it/s]
  3%|▎         | 12656/371472 [1:01:11<34:33:14,  2.88it/s]
  3%|▎         | 12657/371472 [1:01:11<31:51:47,  3.13it/s]
  3%|▎         | 12658/371472 [1:01:12<30:56:44,  3.22it/s]
  3%|▎         | 12659/371472 [1:01:12<29:59:09,  3.32it/s]
  3%|▎         | 12660/371472 [1:01:12<29:34:11,  3.37it/s]
                                                           
{'loss': 4.5919, 'learning_rate': 9.697957292766489e-07, 'epoch': 0.55}

  3%|▎         | 12660/371472 [1:01:12<29:34:11,  3.37it/s]
  3%|▎         | 12661/371472 [1:01:13<30:11:51,  3.30it/s]
  3%|▎         | 12662/371472 [1:01:13<29:11:23,  3.41it/s]
  3%|▎         | 12663/371472 [1:01:13<28:49:07,  3.46it/s]
  3%|▎         | 12664/371472 [1:01:13<28:27:15,  3.50it/s]
  3%|▎         | 12665/371472 [1:01:14<27:22:53,  3.64it/s]
  3%|▎         | 12666/371472 [1:01:14<27:07:43,  3.67it/s]
  3%|▎         | 12667/371472 [1:01:14<27:08:09,  3.67it/s]
  3%|▎         | 12668/371472 [1:01:14<26:42:07,  3.73it/s]
  3%|▎         | 12669/371472 [1:01:15<28:03:48,  3.55it/s]
  3%|▎         | 12670/371472 [1:01:15<27:40:52,  3.60it/s]
  3%|▎         | 12671/371472 [1:01:15<28:20:07,  3.52it/s]
  3%|▎         | 12672/371472 [1:01:16<27:42:37,  3.60it/s]
  3%|▎         | 12673/371472 [1:01:16<27:50:14,  3.58it/s]
  3%|▎         | 12674/371472 [1:01:16<30:46:47,  3.24it/s]
  3%|▎         | 12675/371472 [1:01:17<29:57:26,  3.33it/s]
  3%|▎         | 12676/371472 [1:01:17<29:07:33,  3.42it/s]
  3%|▎         | 12677/371472 [1:01:17<31:09:21,  3.20it/s]
  3%|▎         | 12678/371472 [1:01:17<30:05:00,  3.31it/s]
  3%|▎         | 12679/371472 [1:01:18<29:36:00,  3.37it/s]
  3%|▎         | 12680/371472 [1:01:18<29:08:57,  3.42it/s]
                                                           
{'loss': 4.9423, 'learning_rate': 9.6974724730117e-07, 'epoch': 0.55}

  3%|▎         | 12680/371472 [1:01:18<29:08:57,  3.42it/s]
  3%|▎         | 12681/371472 [1:01:18<28:29:38,  3.50it/s]
  3%|▎         | 12682/371472 [1:01:19<28:19:02,  3.52it/s]
  3%|▎         | 12683/371472 [1:01:19<28:44:17,  3.47it/s]
  3%|▎         | 12684/371472 [1:01:19<28:15:24,  3.53it/s]
  3%|▎         | 12685/371472 [1:01:19<26:59:28,  3.69it/s]
  3%|▎         | 12686/371472 [1:01:20<28:23:39,  3.51it/s]
  3%|▎         | 12687/371472 [1:01:20<29:11:52,  3.41it/s]
  3%|▎         | 12688/371472 [1:01:20<29:02:04,  3.43it/s]
  3%|▎         | 12689/371472 [1:01:21<28:20:19,  3.52it/s]
  3%|▎         | 12690/371472 [1:01:21<28:38:22,  3.48it/s]
  3%|▎         | 12691/371472 [1:01:21<28:41:56,  3.47it/s]
  3%|▎         | 12692/371472 [1:01:21<28:25:04,  3.51it/s]
  3%|▎         | 12693/371472 [1:01:22<28:43:39,  3.47it/s]
  3%|▎         | 12694/371472 [1:01:22<30:26:02,  3.27it/s]
  3%|▎         | 12695/371472 [1:01:22<30:32:55,  3.26it/s]
  3%|▎         | 12696/371472 [1:01:23<29:37:51,  3.36it/s]
  3%|▎         | 12697/371472 [1:01:23<28:57:59,  3.44it/s]
  3%|▎         | 12698/371472 [1:01:23<28:21:36,  3.51it/s]
  3%|▎         | 12699/371472 [1:01:23<27:43:29,  3.59it/s]
  3%|▎         | 12700/371472 [1:01:24<27:41:51,  3.60it/s]
                                                           
{'loss': 4.7632, 'learning_rate': 9.696987653256912e-07, 'epoch': 0.55}

  3%|▎         | 12700/371472 [1:01:24<27:41:51,  3.60it/s]
  3%|▎         | 12701/371472 [1:01:24<28:02:33,  3.55it/s]
  3%|▎         | 12702/371472 [1:01:24<27:43:56,  3.59it/s]
  3%|▎         | 12703/371472 [1:01:25<29:39:07,  3.36it/s]
  3%|▎         | 12704/371472 [1:01:25<29:01:45,  3.43it/s]
  3%|▎         | 12705/371472 [1:01:25<27:53:44,  3.57it/s]
  3%|▎         | 12706/371472 [1:01:25<28:37:26,  3.48it/s]
  3%|▎         | 12707/371472 [1:01:26<27:54:40,  3.57it/s]
  3%|▎         | 12708/371472 [1:01:26<27:49:32,  3.58it/s]
  3%|▎         | 12709/371472 [1:01:26<28:23:48,  3.51it/s]
  3%|▎         | 12710/371472 [1:01:27<28:07:42,  3.54it/s]
  3%|▎         | 12711/371472 [1:01:27<29:03:31,  3.43it/s]
  3%|▎         | 12712/371472 [1:01:27<30:07:15,  3.31it/s]
  3%|▎         | 12713/371472 [1:01:28<30:33:36,  3.26it/s]
  3%|▎         | 12714/371472 [1:01:28<29:17:41,  3.40it/s]
  3%|▎         | 12715/371472 [1:01:28<28:45:21,  3.47it/s]
  3%|▎         | 12716/371472 [1:01:28<28:17:49,  3.52it/s]
  3%|▎         | 12717/371472 [1:01:29<28:08:34,  3.54it/s]
  3%|▎         | 12718/371472 [1:01:29<29:12:34,  3.41it/s]
  3%|▎         | 12719/371472 [1:01:29<28:08:34,  3.54it/s]
  3%|▎         | 12720/371472 [1:01:29<28:03:36,  3.55it/s]
                                                           
{'loss': 4.7262, 'learning_rate': 9.69650283350212e-07, 'epoch': 0.55}

  3%|▎         | 12720/371472 [1:01:29<28:03:36,  3.55it/s]
  3%|▎         | 12721/371472 [1:01:30<27:46:25,  3.59it/s]
  3%|▎         | 12722/371472 [1:01:30<30:13:50,  3.30it/s]
  3%|▎         | 12723/371472 [1:01:30<28:51:41,  3.45it/s]
  3%|▎         | 12724/371472 [1:01:31<27:35:49,  3.61it/s]
  3%|▎         | 12725/371472 [1:01:31<28:49:44,  3.46it/s]
  3%|▎         | 12726/371472 [1:01:31<28:07:09,  3.54it/s]
  3%|▎         | 12727/371472 [1:01:31<28:02:13,  3.55it/s]
  3%|▎         | 12728/371472 [1:01:32<27:32:04,  3.62it/s]
  3%|▎         | 12729/371472 [1:01:32<27:48:56,  3.58it/s]
  3%|▎         | 12730/371472 [1:01:32<27:48:37,  3.58it/s]
  3%|▎         | 12731/371472 [1:01:33<28:32:05,  3.49it/s]
  3%|▎         | 12732/371472 [1:01:33<32:00:22,  3.11it/s]
  3%|▎         | 12733/371472 [1:01:33<31:17:00,  3.19it/s]
  3%|▎         | 12734/371472 [1:01:34<32:25:16,  3.07it/s]
  3%|▎         | 12735/371472 [1:01:34<31:52:56,  3.13it/s]
  3%|▎         | 12736/371472 [1:01:34<30:34:27,  3.26it/s]
  3%|▎         | 12737/371472 [1:01:34<29:26:22,  3.38it/s]
  3%|▎         | 12738/371472 [1:01:35<30:01:47,  3.32it/s]
  3%|▎         | 12739/371472 [1:01:35<30:29:42,  3.27it/s]
  3%|▎         | 12740/371472 [1:01:35<29:00:15,  3.44it/s]
                                                           
{'loss': 4.8491, 'learning_rate': 9.696018013747334e-07, 'epoch': 0.55}

  3%|▎         | 12740/371472 [1:01:35<29:00:15,  3.44it/s]
  3%|▎         | 12741/371472 [1:01:36<28:53:21,  3.45it/s]
  3%|▎         | 12742/371472 [1:01:36<28:57:29,  3.44it/s]
  3%|▎         | 12743/371472 [1:01:36<28:19:34,  3.52it/s]
  3%|▎         | 12744/371472 [1:01:37<28:26:28,  3.50it/s]
  3%|▎         | 12745/371472 [1:01:37<28:18:49,  3.52it/s]
  3%|▎         | 12746/371472 [1:01:37<28:36:52,  3.48it/s]
  3%|▎         | 12747/371472 [1:01:37<28:59:07,  3.44it/s]
  3%|▎         | 12748/371472 [1:01:38<28:31:06,  3.49it/s]
  3%|▎         | 12749/371472 [1:01:38<29:27:05,  3.38it/s]
  3%|▎         | 12750/371472 [1:01:38<29:30:41,  3.38it/s]
  3%|▎         | 12751/371472 [1:01:39<28:25:21,  3.51it/s]
  3%|▎         | 12752/371472 [1:01:39<30:02:15,  3.32it/s]
  3%|▎         | 12753/371472 [1:01:39<28:46:18,  3.46it/s]
  3%|▎         | 12754/371472 [1:01:39<28:27:58,  3.50it/s]
  3%|▎         | 12755/371472 [1:01:40<27:53:53,  3.57it/s]
  3%|▎         | 12756/371472 [1:01:40<28:13:26,  3.53it/s]
  3%|▎         | 12757/371472 [1:01:40<27:21:04,  3.64it/s]
  3%|▎         | 12758/371472 [1:01:41<27:18:51,  3.65it/s]
  3%|▎         | 12759/371472 [1:01:41<26:35:25,  3.75it/s]
  3%|▎         | 12760/371472 [1:01:41<27:01:22,  3.69it/s]
                                                           
{'loss': 4.9667, 'learning_rate': 9.695533193992542e-07, 'epoch': 0.55}

  3%|▎         | 12760/371472 [1:01:41<27:01:22,  3.69it/s]
  3%|▎         | 12761/371472 [1:01:41<27:44:22,  3.59it/s]
  3%|▎         | 12762/371472 [1:01:42<30:27:05,  3.27it/s]
  3%|▎         | 12763/371472 [1:01:42<29:44:29,  3.35it/s]
  3%|▎         | 12764/371472 [1:01:42<29:55:15,  3.33it/s]
  3%|▎         | 12765/371472 [1:01:43<29:00:57,  3.43it/s]
  3%|▎         | 12766/371472 [1:01:43<28:24:41,  3.51it/s]
  3%|▎         | 12767/371472 [1:01:43<28:45:02,  3.47it/s]
  3%|▎         | 12768/371472 [1:01:43<29:20:27,  3.40it/s]
  3%|▎         | 12769/371472 [1:01:44<28:54:41,  3.45it/s]
  3%|▎         | 12770/371472 [1:01:44<28:48:56,  3.46it/s]
  3%|▎         | 12771/371472 [1:01:44<28:02:45,  3.55it/s]
  3%|▎         | 12772/371472 [1:01:45<29:48:29,  3.34it/s]
  3%|▎         | 12773/371472 [1:01:45<28:28:40,  3.50it/s]
  3%|▎         | 12774/371472 [1:01:45<29:56:10,  3.33it/s]
  3%|▎         | 12775/371472 [1:01:45<29:15:22,  3.41it/s]
  3%|▎         | 12776/371472 [1:01:46<30:06:58,  3.31it/s]
  3%|▎         | 12777/371472 [1:01:46<30:05:11,  3.31it/s]
  3%|▎         | 12778/371472 [1:01:46<29:08:24,  3.42it/s]
  3%|▎         | 12779/371472 [1:01:47<27:45:26,  3.59it/s]
  3%|▎         | 12780/371472 [1:01:47<26:59:47,  3.69it/s]
                                                           
{'loss': 4.669, 'learning_rate': 9.695048374237755e-07, 'epoch': 0.55}

  3%|▎         | 12780/371472 [1:01:47<26:59:47,  3.69it/s]
  3%|▎         | 12781/371472 [1:01:47<26:28:05,  3.76it/s]
  3%|▎         | 12782/371472 [1:01:47<28:34:07,  3.49it/s]
  3%|▎         | 12783/371472 [1:01:48<27:51:32,  3.58it/s]
  3%|▎         | 12784/371472 [1:01:48<27:44:24,  3.59it/s]
  3%|▎         | 12785/371472 [1:01:48<27:59:02,  3.56it/s]
  3%|▎         | 12786/371472 [1:01:49<26:48:40,  3.72it/s]
  3%|▎         | 12787/371472 [1:01:49<27:02:00,  3.69it/s]
  3%|▎         | 12788/371472 [1:01:49<27:50:58,  3.58it/s]
  3%|▎         | 12789/371472 [1:01:49<27:26:20,  3.63it/s]
  3%|▎         | 12790/371472 [1:01:50<28:29:01,  3.50it/s]
  3%|▎         | 12791/371472 [1:01:50<27:41:50,  3.60it/s]
  3%|▎         | 12792/371472 [1:01:50<27:24:02,  3.64it/s]
  3%|▎         | 12793/371472 [1:01:51<28:05:52,  3.55it/s]
  3%|▎         | 12794/371472 [1:01:51<27:01:17,  3.69it/s]
  3%|▎         | 12795/371472 [1:01:51<28:07:50,  3.54it/s]
  3%|▎         | 12796/371472 [1:01:51<28:24:40,  3.51it/s]
  3%|▎         | 12797/371472 [1:01:52<28:15:40,  3.53it/s]
  3%|▎         | 12798/371472 [1:01:52<29:48:32,  3.34it/s]
  3%|▎         | 12799/371472 [1:01:52<30:47:17,  3.24it/s]
  3%|▎         | 12800/371472 [1:01:53<29:32:40,  3.37it/s]
                                                           
{'loss': 4.7343, 'learning_rate': 9.694563554482966e-07, 'epoch': 0.55}

  3%|▎         | 12800/371472 [1:01:53<29:32:40,  3.37it/s]
  3%|▎         | 12801/371472 [1:01:53<28:58:17,  3.44it/s]
  3%|▎         | 12802/371472 [1:01:53<29:37:00,  3.36it/s]
  3%|▎         | 12803/371472 [1:01:53<29:51:05,  3.34it/s]
  3%|▎         | 12804/371472 [1:01:54<29:37:26,  3.36it/s]
  3%|▎         | 12805/371472 [1:01:54<32:07:02,  3.10it/s]
  3%|▎         | 12806/371472 [1:01:54<30:25:11,  3.28it/s]
  3%|▎         | 12807/371472 [1:01:55<31:41:05,  3.14it/s]
  3%|▎         | 12808/371472 [1:01:55<31:13:57,  3.19it/s]
  3%|▎         | 12809/371472 [1:01:55<29:45:51,  3.35it/s]
  3%|▎         | 12810/371472 [1:01:56<28:43:34,  3.47it/s]
  3%|▎         | 12811/371472 [1:01:56<28:15:08,  3.53it/s]
  3%|▎         | 12812/371472 [1:01:56<29:16:51,  3.40it/s]
  3%|▎         | 12813/371472 [1:01:56<27:59:30,  3.56it/s]
  3%|▎         | 12814/371472 [1:01:57<27:22:55,  3.64it/s]
  3%|▎         | 12815/371472 [1:01:57<27:17:37,  3.65it/s]
  3%|▎         | 12816/371472 [1:01:57<27:27:30,  3.63it/s]
  3%|▎         | 12817/371472 [1:01:58<28:09:13,  3.54it/s]
  3%|▎         | 12818/371472 [1:01:58<28:15:01,  3.53it/s]
  3%|▎         | 12819/371472 [1:01:58<27:51:43,  3.58it/s]
  3%|▎         | 12820/371472 [1:01:58<29:11:36,  3.41it/s]
                                                           
{'loss': 5.1538, 'learning_rate': 9.694078734728177e-07, 'epoch': 0.55}

  3%|▎         | 12820/371472 [1:01:58<29:11:36,  3.41it/s]
  3%|▎         | 12821/371472 [1:01:59<28:01:06,  3.56it/s]
  3%|▎         | 12822/371472 [1:01:59<28:13:39,  3.53it/s]
  3%|▎         | 12823/371472 [1:01:59<27:49:57,  3.58it/s]
  3%|▎         | 12824/371472 [1:02:00<28:04:08,  3.55it/s]
  3%|▎         | 12825/371472 [1:02:00<31:38:27,  3.15it/s]
  3%|▎         | 12826/371472 [1:02:00<30:34:52,  3.26it/s]
  3%|▎         | 12827/371472 [1:02:00<29:13:38,  3.41it/s]
  3%|▎         | 12828/371472 [1:02:01<29:46:01,  3.35it/s]
  3%|▎         | 12829/371472 [1:02:01<28:14:41,  3.53it/s]
  3%|▎         | 12830/371472 [1:02:01<27:10:43,  3.67it/s]
  3%|▎         | 12831/371472 [1:02:02<28:02:42,  3.55it/s]
  3%|▎         | 12832/371472 [1:02:02<30:05:59,  3.31it/s]
  3%|▎         | 12833/371472 [1:02:02<28:53:45,  3.45it/s]
  3%|▎         | 12834/371472 [1:02:03<30:47:47,  3.23it/s]
  3%|▎         | 12835/371472 [1:02:03<31:30:04,  3.16it/s]
  3%|▎         | 12836/371472 [1:02:03<29:30:52,  3.38it/s]
  3%|▎         | 12837/371472 [1:02:03<29:59:02,  3.32it/s]
  3%|▎         | 12838/371472 [1:02:04<29:24:31,  3.39it/s]
  3%|▎         | 12839/371472 [1:02:04<28:25:25,  3.50it/s]
  3%|▎         | 12840/371472 [1:02:04<27:30:30,  3.62it/s]
                                                           
{'loss': 4.6751, 'learning_rate': 9.69359391497339e-07, 'epoch': 0.55}

  3%|▎         | 12840/371472 [1:02:04<27:30:30,  3.62it/s]
  3%|▎         | 12841/371472 [1:02:04<27:31:45,  3.62it/s]
  3%|▎         | 12842/371472 [1:02:05<26:25:26,  3.77it/s]
  3%|▎         | 12843/371472 [1:02:05<27:37:13,  3.61it/s]
  3%|▎         | 12844/371472 [1:02:05<27:50:02,  3.58it/s]
  3%|▎         | 12845/371472 [1:02:06<27:32:39,  3.62it/s]
  3%|▎         | 12846/371472 [1:02:06<28:02:46,  3.55it/s]
  3%|▎         | 12847/371472 [1:02:06<28:02:18,  3.55it/s]
  3%|▎         | 12848/371472 [1:02:06<27:41:40,  3.60it/s]
  3%|▎         | 12849/371472 [1:02:07<29:10:00,  3.42it/s]
  3%|▎         | 12850/371472 [1:02:07<28:19:40,  3.52it/s]
  3%|▎         | 12851/371472 [1:02:07<28:01:28,  3.55it/s]
  3%|▎         | 12852/371472 [1:02:08<28:28:45,  3.50it/s]
  3%|▎         | 12853/371472 [1:02:08<28:28:21,  3.50it/s]
  3%|▎         | 12854/371472 [1:02:08<30:04:47,  3.31it/s]
  3%|▎         | 12855/371472 [1:02:09<29:39:45,  3.36it/s]
  3%|▎         | 12856/371472 [1:02:09<29:39:30,  3.36it/s]
  3%|▎         | 12857/371472 [1:02:09<30:20:08,  3.28it/s]
  3%|▎         | 12858/371472 [1:02:09<29:20:19,  3.40it/s]
  3%|▎         | 12859/371472 [1:02:10<28:44:47,  3.47it/s]
  3%|▎         | 12860/371472 [1:02:10<28:26:06,  3.50it/s]
                                                           
{'loss': 4.249, 'learning_rate': 9.693109095218598e-07, 'epoch': 0.55}

  3%|▎         | 12860/371472 [1:02:10<28:26:06,  3.50it/s]
  3%|▎         | 12861/371472 [1:02:10<28:28:29,  3.50it/s]
  3%|▎         | 12862/371472 [1:02:11<29:44:37,  3.35it/s]
  3%|▎         | 12863/371472 [1:02:11<30:31:35,  3.26it/s]
  3%|▎         | 12864/371472 [1:02:11<32:45:42,  3.04it/s]
  3%|▎         | 12865/371472 [1:02:12<31:18:17,  3.18it/s]
  3%|▎         | 12866/371472 [1:02:12<29:44:58,  3.35it/s]
  3%|▎         | 12867/371472 [1:02:12<29:27:47,  3.38it/s]
  3%|▎         | 12868/371472 [1:02:12<30:13:57,  3.29it/s]
  3%|▎         | 12869/371472 [1:02:13<29:41:36,  3.35it/s]
  3%|▎         | 12870/371472 [1:02:13<31:01:18,  3.21it/s]
  3%|▎         | 12871/371472 [1:02:13<30:11:24,  3.30it/s]
  3%|▎         | 12872/371472 [1:02:14<31:26:04,  3.17it/s]
  3%|▎         | 12873/371472 [1:02:14<30:11:05,  3.30it/s]
  3%|▎         | 12874/371472 [1:02:14<31:18:46,  3.18it/s]
  3%|▎         | 12875/371472 [1:02:15<32:51:34,  3.03it/s]
  3%|▎         | 12876/371472 [1:02:15<30:31:27,  3.26it/s]
  3%|▎         | 12877/371472 [1:02:15<30:26:56,  3.27it/s]
  3%|▎         | 12878/371472 [1:02:15<28:35:42,  3.48it/s]
  3%|▎         | 12879/371472 [1:02:16<28:15:51,  3.52it/s]
  3%|▎         | 12880/371472 [1:02:16<27:28:19,  3.63it/s]
                                                           
{'loss': 4.5602, 'learning_rate': 9.69262427546381e-07, 'epoch': 0.55}

  3%|▎         | 12880/371472 [1:02:16<27:28:19,  3.63it/s]
  3%|▎         | 12881/371472 [1:02:16<28:59:05,  3.44it/s]
  3%|▎         | 12882/371472 [1:02:17<28:35:57,  3.48it/s]
  3%|▎         | 12883/371472 [1:02:17<27:29:01,  3.62it/s]
  3%|▎         | 12884/371472 [1:02:17<27:05:47,  3.68it/s]
  3%|▎         | 12885/371472 [1:02:17<26:58:24,  3.69it/s]
  3%|▎         | 12886/371472 [1:02:18<28:32:05,  3.49it/s]
  3%|▎         | 12887/371472 [1:02:18<27:41:18,  3.60it/s]
  3%|▎         | 12888/371472 [1:02:18<28:05:02,  3.55it/s]
  3%|▎         | 12889/371472 [1:02:19<28:29:22,  3.50it/s]
  3%|▎         | 12890/371472 [1:02:19<30:49:53,  3.23it/s]
  3%|▎         | 12891/371472 [1:02:19<29:19:59,  3.40it/s]
  3%|▎         | 12892/371472 [1:02:19<28:11:59,  3.53it/s]
  3%|▎         | 12893/371472 [1:02:20<27:21:37,  3.64it/s]
  3%|▎         | 12894/371472 [1:02:20<27:00:09,  3.69it/s]
  3%|▎         | 12895/371472 [1:02:20<26:49:51,  3.71it/s]
  3%|▎         | 12896/371472 [1:02:21<30:11:52,  3.30it/s]
  3%|▎         | 12897/371472 [1:02:21<28:45:36,  3.46it/s]
  3%|▎         | 12898/371472 [1:02:21<28:48:35,  3.46it/s]
  3%|▎         | 12899/371472 [1:02:21<30:40:15,  3.25it/s]
  3%|▎         | 12900/371472 [1:02:22<29:10:38,  3.41it/s]
                                                           
{'loss': 4.7908, 'learning_rate': 9.692139455709022e-07, 'epoch': 0.56}

  3%|▎         | 12900/371472 [1:02:22<29:10:38,  3.41it/s]
  3%|▎         | 12901/371472 [1:02:22<27:54:27,  3.57it/s]
  3%|▎         | 12902/371472 [1:02:22<27:35:47,  3.61it/s]
  3%|▎         | 12903/371472 [1:02:23<27:19:21,  3.65it/s]
  3%|▎         | 12904/371472 [1:02:23<26:31:16,  3.76it/s]
  3%|▎         | 12905/371472 [1:02:23<26:02:50,  3.82it/s]
  3%|▎         | 12906/371472 [1:02:23<26:53:54,  3.70it/s]
  3%|▎         | 12907/371472 [1:02:24<27:09:14,  3.67it/s]
  3%|▎         | 12908/371472 [1:02:24<26:56:47,  3.70it/s]
  3%|▎         | 12909/371472 [1:02:24<27:13:04,  3.66it/s]
  3%|▎         | 12910/371472 [1:02:24<26:59:24,  3.69it/s]
  3%|▎         | 12911/371472 [1:02:25<31:31:19,  3.16it/s]
  3%|▎         | 12912/371472 [1:02:25<30:35:53,  3.26it/s]
  3%|▎         | 12913/371472 [1:02:25<30:59:50,  3.21it/s]
  3%|▎         | 12914/371472 [1:02:26<29:35:51,  3.37it/s]
  3%|▎         | 12915/371472 [1:02:26<30:38:25,  3.25it/s]
  3%|▎         | 12916/371472 [1:02:26<29:03:22,  3.43it/s]
  3%|▎         | 12917/371472 [1:02:27<30:45:24,  3.24it/s]
  3%|▎         | 12918/371472 [1:02:27<30:20:41,  3.28it/s]
  3%|▎         | 12919/371472 [1:02:27<29:45:56,  3.35it/s]
  3%|▎         | 12920/371472 [1:02:28<29:08:56,  3.42it/s]
                                                           
{'loss': 4.8403, 'learning_rate': 9.691654635954232e-07, 'epoch': 0.56}

  3%|▎         | 12920/371472 [1:02:28<29:08:56,  3.42it/s]
  3%|▎         | 12921/371472 [1:02:28<29:17:21,  3.40it/s]
  3%|▎         | 12922/371472 [1:02:28<29:53:50,  3.33it/s]
  3%|▎         | 12923/371472 [1:02:29<32:21:13,  3.08it/s]
  3%|▎         | 12924/371472 [1:02:29<31:05:07,  3.20it/s]
  3%|▎         | 12925/371472 [1:02:29<31:04:33,  3.20it/s]
  3%|▎         | 12926/371472 [1:02:29<29:48:39,  3.34it/s]
  3%|▎         | 12927/371472 [1:02:30<29:04:24,  3.43it/s]
  3%|▎         | 12928/371472 [1:02:30<29:30:39,  3.37it/s]
  3%|▎         | 12929/371472 [1:02:30<30:24:48,  3.27it/s]
  3%|▎         | 12930/371472 [1:02:31<29:41:06,  3.36it/s]
  3%|▎         | 12931/371472 [1:02:31<28:44:39,  3.46it/s]
  3%|▎         | 12932/371472 [1:02:31<28:33:46,  3.49it/s]
  3%|▎         | 12933/371472 [1:02:31<27:49:35,  3.58it/s]
  3%|▎         | 12934/371472 [1:02:32<30:17:03,  3.29it/s]
  3%|▎         | 12935/371472 [1:02:32<28:56:56,  3.44it/s]
  3%|▎         | 12936/371472 [1:02:32<29:20:27,  3.39it/s]
  3%|▎         | 12937/371472 [1:02:33<28:42:02,  3.47it/s]
  3%|▎         | 12938/371472 [1:02:33<28:18:28,  3.52it/s]
  3%|▎         | 12939/371472 [1:02:33<28:59:09,  3.44it/s]
  3%|▎         | 12940/371472 [1:02:33<29:43:35,  3.35it/s]
                                                           
{'loss': 4.654, 'learning_rate': 9.691169816199445e-07, 'epoch': 0.56}

  3%|▎         | 12940/371472 [1:02:33<29:43:35,  3.35it/s]
  3%|▎         | 12941/371472 [1:02:34<29:44:24,  3.35it/s]
  3%|▎         | 12942/371472 [1:02:34<31:05:03,  3.20it/s]
  3%|▎         | 12943/371472 [1:02:34<30:17:23,  3.29it/s]
  3%|▎         | 12944/371472 [1:02:35<29:18:11,  3.40it/s]
  3%|▎         | 12945/371472 [1:02:35<32:00:18,  3.11it/s]
  3%|▎         | 12946/371472 [1:02:35<30:10:59,  3.30it/s]
  3%|▎         | 12947/371472 [1:02:36<30:00:27,  3.32it/s]
  3%|▎         | 12948/371472 [1:02:36<28:18:45,  3.52it/s]
  3%|▎         | 12949/371472 [1:02:36<27:27:32,  3.63it/s]
  3%|▎         | 12950/371472 [1:02:36<28:20:14,  3.51it/s]
  3%|▎         | 12951/371472 [1:02:37<31:53:10,  3.12it/s]
  3%|▎         | 12952/371472 [1:02:37<31:48:09,  3.13it/s]
  3%|▎         | 12953/371472 [1:02:37<31:22:23,  3.17it/s]
  3%|▎         | 12954/371472 [1:02:38<31:11:59,  3.19it/s]
  3%|▎         | 12955/371472 [1:02:38<29:32:59,  3.37it/s]
  3%|▎         | 12956/371472 [1:02:38<28:53:41,  3.45it/s]
  3%|▎         | 12957/371472 [1:02:39<27:52:18,  3.57it/s]
  3%|▎         | 12958/371472 [1:02:39<27:28:46,  3.62it/s]
  3%|▎         | 12959/371472 [1:02:39<27:18:50,  3.65it/s]
  3%|▎         | 12960/371472 [1:02:39<28:41:01,  3.47it/s]
                                                           
{'loss': 4.9628, 'learning_rate': 9.690684996444654e-07, 'epoch': 0.56}

  3%|▎         | 12960/371472 [1:02:39<28:41:01,  3.47it/s]
  3%|▎         | 12961/371472 [1:02:40<28:31:55,  3.49it/s]
  3%|▎         | 12962/371472 [1:02:40<27:39:41,  3.60it/s]
  3%|▎         | 12963/371472 [1:02:40<29:36:52,  3.36it/s]
  3%|▎         | 12964/371472 [1:02:41<28:41:41,  3.47it/s]
  3%|▎         | 12965/371472 [1:02:41<30:12:26,  3.30it/s]
  3%|▎         | 12966/371472 [1:02:41<30:32:21,  3.26it/s]
  3%|▎         | 12967/371472 [1:02:41<29:32:27,  3.37it/s]
  3%|▎         | 12968/371472 [1:02:42<28:48:23,  3.46it/s]
  3%|▎         | 12969/371472 [1:02:42<27:56:04,  3.56it/s]
  3%|▎         | 12970/371472 [1:02:42<27:02:50,  3.68it/s]
  3%|▎         | 12971/371472 [1:02:43<27:33:23,  3.61it/s]
  3%|▎         | 12972/371472 [1:02:43<28:38:33,  3.48it/s]
  3%|▎         | 12973/371472 [1:02:43<28:02:16,  3.55it/s]
  3%|▎         | 12974/371472 [1:02:43<29:25:00,  3.39it/s]
  3%|▎         | 12975/371472 [1:02:44<28:33:35,  3.49it/s]
  3%|▎         | 12976/371472 [1:02:44<28:11:47,  3.53it/s]
  3%|▎         | 12977/371472 [1:02:44<29:19:40,  3.40it/s]
  3%|▎         | 12978/371472 [1:02:45<29:28:59,  3.38it/s]
  3%|▎         | 12979/371472 [1:02:45<29:30:28,  3.37it/s]
  3%|▎         | 12980/371472 [1:02:45<29:58:46,  3.32it/s]
                                                           
{'loss': 4.6785, 'learning_rate': 9.690200176689867e-07, 'epoch': 0.56}

  3%|▎         | 12980/371472 [1:02:45<29:58:46,  3.32it/s]
  3%|▎         | 12981/371472 [1:02:45<28:45:20,  3.46it/s]
  3%|▎         | 12982/371472 [1:02:46<28:42:27,  3.47it/s]
  3%|▎         | 12983/371472 [1:02:46<28:18:46,  3.52it/s]
  3%|▎         | 12984/371472 [1:02:46<27:50:27,  3.58it/s]
  3%|▎         | 12985/371472 [1:02:47<26:58:12,  3.69it/s]
  3%|▎         | 12986/371472 [1:02:47<27:03:14,  3.68it/s]
  3%|▎         | 12987/371472 [1:02:47<27:11:36,  3.66it/s]
  3%|▎         | 12988/371472 [1:02:47<28:11:02,  3.53it/s]
  3%|▎         | 12989/371472 [1:02:48<27:02:21,  3.68it/s]
  3%|▎         | 12990/371472 [1:02:48<26:52:55,  3.70it/s]
  3%|▎         | 12991/371472 [1:02:48<26:14:30,  3.79it/s]
  3%|▎         | 12992/371472 [1:02:48<25:39:25,  3.88it/s]
  3%|▎         | 12993/371472 [1:02:49<25:09:23,  3.96it/s]
  3%|▎         | 12994/371472 [1:02:49<26:25:04,  3.77it/s]
  3%|▎         | 12995/371472 [1:02:49<28:31:33,  3.49it/s]
  3%|▎         | 12996/371472 [1:02:50<28:42:36,  3.47it/s]
  3%|▎         | 12997/371472 [1:02:50<28:04:38,  3.55it/s]
  3%|▎         | 12998/371472 [1:02:50<28:27:45,  3.50it/s]
  3%|▎         | 12999/371472 [1:02:51<31:41:01,  3.14it/s]
  3%|▎         | 13000/371472 [1:02:51<31:39:59,  3.14it/s]
                                                           
{'loss': 4.7578, 'learning_rate': 9.689715356935075e-07, 'epoch': 0.56}

  3%|▎         | 13000/371472 [1:02:51<31:39:59,  3.14it/s]
  3%|▎         | 13001/371472 [1:02:51<30:40:21,  3.25it/s]
  4%|▎         | 13002/371472 [1:02:51<29:33:35,  3.37it/s]
  4%|▎         | 13003/371472 [1:02:52<29:58:57,  3.32it/s]
  4%|▎         | 13004/371472 [1:02:52<30:14:02,  3.29it/s]
  4%|▎         | 13005/371472 [1:02:52<29:31:56,  3.37it/s]
  4%|▎         | 13006/371472 [1:02:53<29:15:04,  3.40it/s]
  4%|▎         | 13007/371472 [1:02:53<29:41:48,  3.35it/s]
  4%|▎         | 13008/371472 [1:02:53<29:10:08,  3.41it/s]
  4%|▎         | 13009/371472 [1:02:54<30:28:31,  3.27it/s]
  4%|▎         | 13010/371472 [1:02:54<29:15:37,  3.40it/s]
  4%|▎         | 13011/371472 [1:02:54<28:40:11,  3.47it/s]
  4%|▎         | 13012/371472 [1:02:54<29:18:56,  3.40it/s]
  4%|▎         | 13013/371472 [1:02:55<28:57:36,  3.44it/s]
  4%|▎         | 13014/371472 [1:02:55<29:13:02,  3.41it/s]
  4%|▎         | 13015/371472 [1:02:55<29:15:46,  3.40it/s]
  4%|▎         | 13016/371472 [1:02:56<28:55:20,  3.44it/s]
  4%|▎         | 13017/371472 [1:02:56<28:01:54,  3.55it/s]
  4%|▎         | 13018/371472 [1:02:56<28:55:45,  3.44it/s]
  4%|▎         | 13019/371472 [1:02:56<30:24:24,  3.27it/s]
  4%|▎         | 13020/371472 [1:02:57<30:36:15,  3.25it/s]
                                                           
{'loss': 4.6124, 'learning_rate': 9.689230537180288e-07, 'epoch': 0.56}

  4%|▎         | 13020/371472 [1:02:57<30:36:15,  3.25it/s]
  4%|▎         | 13021/371472 [1:02:57<29:59:42,  3.32it/s]
  4%|▎         | 13022/371472 [1:02:57<29:11:41,  3.41it/s]
  4%|▎         | 13023/371472 [1:02:58<29:01:11,  3.43it/s]
  4%|▎         | 13024/371472 [1:02:58<31:18:05,  3.18it/s]
  4%|▎         | 13025/371472 [1:02:58<31:45:54,  3.13it/s]
  4%|▎         | 13026/371472 [1:02:59<30:57:35,  3.22it/s]
  4%|▎         | 13027/371472 [1:02:59<30:17:29,  3.29it/s]
  4%|▎         | 13028/371472 [1:02:59<29:52:57,  3.33it/s]
  4%|▎         | 13029/371472 [1:02:59<28:26:27,  3.50it/s]
  4%|▎         | 13030/371472 [1:03:00<28:15:09,  3.52it/s]
  4%|▎         | 13031/371472 [1:03:00<29:45:47,  3.35it/s]
  4%|▎         | 13032/371472 [1:03:00<28:47:27,  3.46it/s]
  4%|▎         | 13033/371472 [1:03:01<28:28:36,  3.50it/s]
  4%|▎         | 13034/371472 [1:03:01<28:33:15,  3.49it/s]
  4%|▎         | 13035/371472 [1:03:01<28:04:14,  3.55it/s]
  4%|▎         | 13036/371472 [1:03:01<27:30:48,  3.62it/s]
  4%|▎         | 13037/371472 [1:03:02<28:35:26,  3.48it/s]
  4%|▎         | 13038/371472 [1:03:02<27:46:03,  3.59it/s]
  4%|▎         | 13039/371472 [1:03:02<27:53:45,  3.57it/s]
  4%|▎         | 13040/371472 [1:03:03<28:05:01,  3.55it/s]
                                                           
{'loss': 4.7457, 'learning_rate': 9.688745717425499e-07, 'epoch': 0.56}

  4%|▎         | 13040/371472 [1:03:03<28:05:01,  3.55it/s]
  4%|▎         | 13041/371472 [1:03:03<27:31:42,  3.62it/s]
  4%|▎         | 13042/371472 [1:03:03<30:37:56,  3.25it/s]
  4%|▎         | 13043/371472 [1:03:04<34:43:57,  2.87it/s]
  4%|▎         | 13044/371472 [1:03:04<32:00:34,  3.11it/s]
  4%|▎         | 13045/371472 [1:03:04<29:32:53,  3.37it/s]
  4%|▎         | 13046/371472 [1:03:04<28:29:01,  3.50it/s]
  4%|▎         | 13047/371472 [1:03:05<27:33:46,  3.61it/s]
  4%|▎         | 13048/371472 [1:03:05<27:29:32,  3.62it/s]
  4%|▎         | 13049/371472 [1:03:05<27:16:55,  3.65it/s]
  4%|▎         | 13050/371472 [1:03:05<26:19:55,  3.78it/s]
  4%|▎         | 13051/371472 [1:03:06<28:34:13,  3.48it/s]
  4%|▎         | 13052/371472 [1:03:06<28:02:41,  3.55it/s]
  4%|▎         | 13053/371472 [1:03:06<27:55:52,  3.56it/s]
  4%|▎         | 13054/371472 [1:03:07<29:20:35,  3.39it/s]
  4%|▎         | 13055/371472 [1:03:07<28:12:46,  3.53it/s]
  4%|▎         | 13056/371472 [1:03:07<32:03:14,  3.11it/s]
  4%|▎         | 13057/371472 [1:03:08<32:40:58,  3.05it/s]
  4%|▎         | 13058/371472 [1:03:08<30:56:48,  3.22it/s]
  4%|▎         | 13059/371472 [1:03:08<29:21:19,  3.39it/s]
  4%|▎         | 13060/371472 [1:03:08<28:07:30,  3.54it/s]
                                                           
{'loss': 4.656, 'learning_rate': 9.68826089767071e-07, 'epoch': 0.56}

  4%|▎         | 13060/371472 [1:03:08<28:07:30,  3.54it/s]
  4%|▎         | 13061/371472 [1:03:09<28:34:03,  3.49it/s]
  4%|▎         | 13062/371472 [1:03:09<29:11:10,  3.41it/s]
  4%|▎         | 13063/371472 [1:03:09<28:51:18,  3.45it/s]
  4%|▎         | 13064/371472 [1:03:10<28:45:02,  3.46it/s]
  4%|▎         | 13065/371472 [1:03:10<28:04:09,  3.55it/s]
  4%|▎         | 13066/371472 [1:03:10<27:54:51,  3.57it/s]
  4%|▎         | 13067/371472 [1:03:10<29:05:32,  3.42it/s]
  4%|▎         | 13068/371472 [1:03:11<28:49:33,  3.45it/s]
  4%|▎         | 13069/371472 [1:03:11<28:53:46,  3.45it/s]
  4%|▎         | 13070/371472 [1:03:11<28:40:31,  3.47it/s]
  4%|▎         | 13071/371472 [1:03:12<27:57:11,  3.56it/s]
  4%|▎         | 13072/371472 [1:03:12<27:54:33,  3.57it/s]
  4%|▎         | 13073/371472 [1:03:12<27:46:29,  3.58it/s]
  4%|▎         | 13074/371472 [1:03:12<27:49:53,  3.58it/s]
  4%|▎         | 13075/371472 [1:03:13<26:50:11,  3.71it/s]
  4%|▎         | 13076/371472 [1:03:13<29:49:17,  3.34it/s]
  4%|▎         | 13077/371472 [1:03:13<31:43:53,  3.14it/s]
  4%|▎         | 13078/371472 [1:03:14<35:12:27,  2.83it/s]
  4%|▎         | 13079/371472 [1:03:14<32:21:37,  3.08it/s]
  4%|▎         | 13080/371472 [1:03:14<31:47:47,  3.13it/s]
                                                           
{'loss': 4.6385, 'learning_rate': 9.687776077915922e-07, 'epoch': 0.56}

  4%|▎         | 13080/371472 [1:03:14<31:47:47,  3.13it/s]
  4%|▎         | 13081/371472 [1:03:15<31:09:33,  3.19it/s]
  4%|▎         | 13082/371472 [1:03:15<29:45:12,  3.35it/s]
  4%|▎         | 13083/371472 [1:03:15<28:46:51,  3.46it/s]
  4%|▎         | 13084/371472 [1:03:16<29:28:25,  3.38it/s]
  4%|▎         | 13085/371472 [1:03:16<28:56:54,  3.44it/s]
  4%|▎         | 13086/371472 [1:03:16<27:45:53,  3.59it/s]
  4%|▎         | 13087/371472 [1:03:16<28:36:59,  3.48it/s]
  4%|▎         | 13088/371472 [1:03:17<27:36:55,  3.60it/s]
  4%|▎         | 13089/371472 [1:03:17<28:03:32,  3.55it/s]
  4%|▎         | 13090/371472 [1:03:17<27:37:47,  3.60it/s]
  4%|▎         | 13091/371472 [1:03:17<27:07:14,  3.67it/s]
  4%|▎         | 13092/371472 [1:03:18<27:25:05,  3.63it/s]
  4%|▎         | 13093/371472 [1:03:18<27:26:30,  3.63it/s]
  4%|▎         | 13094/371472 [1:03:18<27:40:08,  3.60it/s]
  4%|▎         | 13095/371472 [1:03:19<27:36:54,  3.60it/s]
  4%|▎         | 13096/371472 [1:03:19<27:34:21,  3.61it/s]
  4%|▎         | 13097/371472 [1:03:19<26:41:05,  3.73it/s]
  4%|▎         | 13098/371472 [1:03:19<27:12:04,  3.66it/s]
  4%|▎         | 13099/371472 [1:03:20<27:36:40,  3.61it/s]
  4%|▎         | 13100/371472 [1:03:20<27:11:27,  3.66it/s]
                                                           
{'loss': 4.791, 'learning_rate': 9.687291258161133e-07, 'epoch': 0.56}

  4%|▎         | 13100/371472 [1:03:20<27:11:27,  3.66it/s]
  4%|▎         | 13101/371472 [1:03:20<26:47:14,  3.72it/s]
  4%|▎         | 13102/371472 [1:03:20<26:34:26,  3.75it/s]
  4%|▎         | 13103/371472 [1:03:21<27:08:55,  3.67it/s]
  4%|▎         | 13104/371472 [1:03:21<27:07:11,  3.67it/s]
  4%|▎         | 13105/371472 [1:03:21<26:56:06,  3.70it/s]
  4%|▎         | 13106/371472 [1:03:22<27:36:42,  3.61it/s]
  4%|▎         | 13107/371472 [1:03:22<28:41:30,  3.47it/s]
  4%|▎         | 13108/371472 [1:03:22<28:13:01,  3.53it/s]
  4%|▎         | 13109/371472 [1:03:23<29:47:37,  3.34it/s]
  4%|▎         | 13110/371472 [1:03:23<30:31:26,  3.26it/s]
  4%|▎         | 13111/371472 [1:03:23<29:57:51,  3.32it/s]
  4%|▎         | 13112/371472 [1:03:23<28:59:08,  3.43it/s]
  4%|▎         | 13113/371472 [1:03:24<28:29:12,  3.49it/s]
  4%|▎         | 13114/371472 [1:03:24<28:46:48,  3.46it/s]
  4%|▎         | 13115/371472 [1:03:24<30:21:59,  3.28it/s]
  4%|▎         | 13116/371472 [1:03:25<30:05:05,  3.31it/s]
  4%|▎         | 13117/371472 [1:03:25<30:16:59,  3.29it/s]
  4%|▎         | 13118/371472 [1:03:25<29:19:43,  3.39it/s]
  4%|▎         | 13119/371472 [1:03:25<28:46:09,  3.46it/s]
  4%|▎         | 13120/371472 [1:03:26<30:01:45,  3.31it/s]
                                                           
{'loss': 4.6335, 'learning_rate': 9.686806438406344e-07, 'epoch': 0.57}

  4%|▎         | 13120/371472 [1:03:26<30:01:45,  3.31it/s]
  4%|▎         | 13121/371472 [1:03:26<31:41:01,  3.14it/s]
  4%|▎         | 13122/371472 [1:03:26<30:52:14,  3.22it/s]
  4%|▎         | 13123/371472 [1:03:27<29:43:44,  3.35it/s]
  4%|▎         | 13124/371472 [1:03:27<28:37:04,  3.48it/s]
  4%|▎         | 13125/371472 [1:03:27<30:29:25,  3.26it/s]
  4%|▎         | 13126/371472 [1:03:28<29:34:54,  3.36it/s]
  4%|▎         | 13127/371472 [1:03:28<30:44:06,  3.24it/s]
  4%|▎         | 13128/371472 [1:03:28<29:24:15,  3.39it/s]
  4%|▎         | 13129/371472 [1:03:28<29:14:20,  3.40it/s]
  4%|▎         | 13130/371472 [1:03:29<30:04:14,  3.31it/s]
  4%|▎         | 13131/371472 [1:03:29<29:08:47,  3.42it/s]
  4%|▎         | 13132/371472 [1:03:29<28:25:38,  3.50it/s]
  4%|▎         | 13133/371472 [1:03:30<29:20:57,  3.39it/s]
  4%|▎         | 13134/371472 [1:03:30<29:01:28,  3.43it/s]
  4%|▎         | 13135/371472 [1:03:30<28:11:06,  3.53it/s]
  4%|▎         | 13136/371472 [1:03:30<28:19:20,  3.51it/s]
  4%|▎         | 13137/371472 [1:03:31<27:18:39,  3.64it/s]
  4%|▎         | 13138/371472 [1:03:31<28:32:48,  3.49it/s]
  4%|▎         | 13139/371472 [1:03:31<28:10:50,  3.53it/s]
  4%|▎         | 13140/371472 [1:03:32<29:00:13,  3.43it/s]
                                                           
{'loss': 4.9381, 'learning_rate': 9.686321618651552e-07, 'epoch': 0.57}

  4%|▎         | 13140/371472 [1:03:32<29:00:13,  3.43it/s]
  4%|▎         | 13141/371472 [1:03:32<29:03:36,  3.43it/s]
  4%|▎         | 13142/371472 [1:03:32<28:43:41,  3.46it/s]
  4%|▎         | 13143/371472 [1:03:33<31:29:45,  3.16it/s]
  4%|▎         | 13144/371472 [1:03:33<30:05:46,  3.31it/s]
  4%|▎         | 13145/371472 [1:03:33<28:48:27,  3.46it/s]
  4%|▎         | 13146/371472 [1:03:33<29:45:55,  3.34it/s]
  4%|▎         | 13147/371472 [1:03:34<30:20:12,  3.28it/s]
  4%|▎         | 13148/371472 [1:03:34<28:51:38,  3.45it/s]
  4%|▎         | 13149/371472 [1:03:34<29:50:35,  3.34it/s]
  4%|▎         | 13150/371472 [1:03:35<32:06:36,  3.10it/s]
  4%|▎         | 13151/371472 [1:03:35<30:39:03,  3.25it/s]
  4%|▎         | 13152/371472 [1:03:35<29:00:46,  3.43it/s]
  4%|▎         | 13153/371472 [1:03:36<29:00:25,  3.43it/s]
  4%|▎         | 13154/371472 [1:03:36<28:41:24,  3.47it/s]
  4%|▎         | 13155/371472 [1:03:36<28:06:41,  3.54it/s]
  4%|▎         | 13156/371472 [1:03:36<29:13:52,  3.40it/s]
  4%|▎         | 13157/371472 [1:03:37<31:36:25,  3.15it/s]
  4%|▎         | 13158/371472 [1:03:37<30:13:54,  3.29it/s]
  4%|▎         | 13159/371472 [1:03:37<29:48:00,  3.34it/s]
  4%|▎         | 13160/371472 [1:03:38<29:26:31,  3.38it/s]
                                                           
{'loss': 4.5365, 'learning_rate': 9.685836798896765e-07, 'epoch': 0.57}

  4%|▎         | 13160/371472 [1:03:38<29:26:31,  3.38it/s]
  4%|▎         | 13161/371472 [1:03:38<31:46:06,  3.13it/s]
  4%|▎         | 13162/371472 [1:03:38<32:20:48,  3.08it/s]
  4%|▎         | 13163/371472 [1:03:39<30:00:52,  3.32it/s]
  4%|▎         | 13164/371472 [1:03:39<29:36:37,  3.36it/s]
  4%|▎         | 13165/371472 [1:03:39<28:35:26,  3.48it/s]
  4%|▎         | 13166/371472 [1:03:39<30:01:34,  3.31it/s]
  4%|▎         | 13167/371472 [1:03:40<28:42:58,  3.47it/s]
  4%|▎         | 13168/371472 [1:03:40<30:09:50,  3.30it/s]
  4%|▎         | 13169/371472 [1:03:40<31:11:28,  3.19it/s]
  4%|▎         | 13170/371472 [1:03:41<29:58:42,  3.32it/s]
  4%|▎         | 13171/371472 [1:03:41<29:48:44,  3.34it/s]
  4%|▎         | 13172/371472 [1:03:41<29:30:39,  3.37it/s]
  4%|▎         | 13173/371472 [1:03:42<28:14:58,  3.52it/s]
  4%|▎         | 13174/371472 [1:03:42<27:37:08,  3.60it/s]
  4%|▎         | 13175/371472 [1:03:42<28:08:59,  3.54it/s]
  4%|▎         | 13176/371472 [1:03:42<30:01:27,  3.31it/s]
  4%|▎         | 13177/371472 [1:03:43<29:03:44,  3.42it/s]
  4%|▎         | 13178/371472 [1:03:43<28:16:01,  3.52it/s]
  4%|▎         | 13179/371472 [1:03:43<27:47:06,  3.58it/s]
  4%|▎         | 13180/371472 [1:03:44<27:33:33,  3.61it/s]
                                                           
{'loss': 4.7251, 'learning_rate': 9.685351979141976e-07, 'epoch': 0.57}

  4%|▎         | 13180/371472 [1:03:44<27:33:33,  3.61it/s]
  4%|▎         | 13181/371472 [1:03:44<28:40:59,  3.47it/s]
  4%|▎         | 13182/371472 [1:03:44<29:30:32,  3.37it/s]
  4%|▎         | 13183/371472 [1:03:44<29:08:18,  3.42it/s]
  4%|▎         | 13184/371472 [1:03:45<28:05:56,  3.54it/s]
  4%|▎         | 13185/371472 [1:03:45<26:53:28,  3.70it/s]
  4%|▎         | 13186/371472 [1:03:45<27:08:19,  3.67it/s]
  4%|▎         | 13187/371472 [1:03:46<28:14:41,  3.52it/s]
  4%|▎         | 13188/371472 [1:03:46<27:25:54,  3.63it/s]
  4%|▎         | 13189/371472 [1:03:46<26:42:10,  3.73it/s]
  4%|▎         | 13190/371472 [1:03:46<27:08:11,  3.67it/s]
  4%|▎         | 13191/371472 [1:03:47<27:06:37,  3.67it/s]
  4%|▎         | 13192/371472 [1:03:47<27:04:34,  3.68it/s]
  4%|▎         | 13193/371472 [1:03:47<26:44:03,  3.72it/s]
  4%|▎         | 13194/371472 [1:03:47<26:42:47,  3.73it/s]
  4%|▎         | 13195/371472 [1:03:48<27:26:36,  3.63it/s]
  4%|▎         | 13196/371472 [1:03:48<26:50:18,  3.71it/s]
  4%|▎         | 13197/371472 [1:03:48<29:35:37,  3.36it/s]
  4%|▎         | 13198/371472 [1:03:49<29:39:25,  3.36it/s]
  4%|▎         | 13199/371472 [1:03:49<28:58:17,  3.44it/s]
  4%|▎         | 13200/371472 [1:03:49<27:33:12,  3.61it/s]
                                                           
{'loss': 4.6211, 'learning_rate': 9.684867159387187e-07, 'epoch': 0.57}

  4%|▎         | 13200/371472 [1:03:49<27:33:12,  3.61it/s]
  4%|▎         | 13201/371472 [1:03:49<28:14:54,  3.52it/s]
  4%|▎         | 13202/371472 [1:03:50<27:59:38,  3.56it/s]
  4%|▎         | 13203/371472 [1:03:50<31:28:03,  3.16it/s]
  4%|▎         | 13204/371472 [1:03:50<30:07:41,  3.30it/s]
  4%|▎         | 13205/371472 [1:03:51<28:17:45,  3.52it/s]
  4%|▎         | 13206/371472 [1:03:51<28:45:14,  3.46it/s]
  4%|▎         | 13207/371472 [1:03:51<29:06:50,  3.42it/s]
  4%|▎         | 13208/371472 [1:03:51<28:12:55,  3.53it/s]
  4%|▎         | 13209/371472 [1:03:52<28:29:26,  3.49it/s]
  4%|▎         | 13210/371472 [1:03:52<28:23:13,  3.51it/s]
  4%|▎         | 13211/371472 [1:03:52<28:21:56,  3.51it/s]
  4%|▎         | 13212/371472 [1:03:53<27:31:12,  3.62it/s]
  4%|▎         | 13213/371472 [1:03:53<27:36:03,  3.61it/s]
  4%|▎         | 13214/371472 [1:03:53<27:53:20,  3.57it/s]
  4%|▎         | 13215/371472 [1:03:53<27:38:11,  3.60it/s]
  4%|▎         | 13216/371472 [1:03:54<29:11:50,  3.41it/s]
  4%|▎         | 13217/371472 [1:03:54<28:03:07,  3.55it/s]
  4%|▎         | 13218/371472 [1:03:54<27:05:04,  3.67it/s]
  4%|▎         | 13219/371472 [1:03:55<27:30:25,  3.62it/s]
  4%|▎         | 13220/371472 [1:03:55<27:14:35,  3.65it/s]
                                                           
{'loss': 4.8273, 'learning_rate': 9.6843823396324e-07, 'epoch': 0.57}

  4%|▎         | 13220/371472 [1:03:55<27:14:35,  3.65it/s]
  4%|▎         | 13221/371472 [1:03:55<27:00:03,  3.69it/s]
  4%|▎         | 13222/371472 [1:03:55<27:04:45,  3.67it/s]
  4%|▎         | 13223/371472 [1:03:56<26:33:25,  3.75it/s]
  4%|▎         | 13224/371472 [1:03:56<26:05:19,  3.81it/s]
  4%|▎         | 13225/371472 [1:03:56<26:31:15,  3.75it/s]
  4%|▎         | 13226/371472 [1:03:56<27:53:19,  3.57it/s]
  4%|▎         | 13227/371472 [1:03:57<29:05:04,  3.42it/s]
  4%|▎         | 13228/371472 [1:03:57<28:22:45,  3.51it/s]
  4%|▎         | 13229/371472 [1:03:57<27:52:48,  3.57it/s]
  4%|▎         | 13230/371472 [1:03:58<28:58:49,  3.43it/s]
  4%|▎         | 13231/371472 [1:03:58<28:36:19,  3.48it/s]
  4%|▎         | 13232/371472 [1:03:58<27:47:18,  3.58it/s]
  4%|▎         | 13233/371472 [1:03:58<28:49:47,  3.45it/s]
  4%|▎         | 13234/371472 [1:03:59<27:38:34,  3.60it/s]
  4%|▎         | 13235/371472 [1:03:59<27:46:35,  3.58it/s]
  4%|▎         | 13236/371472 [1:03:59<28:35:13,  3.48it/s]
  4%|▎         | 13237/371472 [1:04:00<28:23:13,  3.51it/s]
  4%|▎         | 13238/371472 [1:04:00<28:15:58,  3.52it/s]
  4%|▎         | 13239/371472 [1:04:00<28:18:44,  3.51it/s]
  4%|▎         | 13240/371472 [1:04:00<29:44:57,  3.34it/s]
                                                           
{'loss': 4.8895, 'learning_rate': 9.683897519877608e-07, 'epoch': 0.57}

  4%|▎         | 13240/371472 [1:04:00<29:44:57,  3.34it/s]
  4%|▎         | 13241/371472 [1:04:01<28:42:53,  3.47it/s]
  4%|▎         | 13242/371472 [1:04:01<27:37:33,  3.60it/s]
  4%|▎         | 13243/371472 [1:04:01<27:11:52,  3.66it/s]
  4%|▎         | 13244/371472 [1:04:02<27:02:56,  3.68it/s]
  4%|▎         | 13245/371472 [1:04:02<27:08:51,  3.67it/s]
  4%|▎         | 13246/371472 [1:04:02<32:16:47,  3.08it/s]
  4%|▎         | 13247/371472 [1:04:03<30:52:51,  3.22it/s]
  4%|▎         | 13248/371472 [1:04:03<29:14:12,  3.40it/s]
  4%|▎         | 13249/371472 [1:04:03<28:04:49,  3.54it/s]
  4%|▎         | 13250/371472 [1:04:03<28:37:21,  3.48it/s]
  4%|▎         | 13251/371472 [1:04:04<27:47:11,  3.58it/s]
  4%|▎         | 13252/371472 [1:04:04<27:50:14,  3.57it/s]
  4%|▎         | 13253/371472 [1:04:04<27:37:45,  3.60it/s]
  4%|▎         | 13254/371472 [1:04:04<27:25:59,  3.63it/s]
  4%|▎         | 13255/371472 [1:04:05<26:42:36,  3.73it/s]
  4%|▎         | 13256/371472 [1:04:05<27:15:17,  3.65it/s]
  4%|▎         | 13257/371472 [1:04:05<27:50:04,  3.57it/s]
  4%|▎         | 13258/371472 [1:04:06<28:05:28,  3.54it/s]
  4%|▎         | 13259/371472 [1:04:06<27:54:06,  3.57it/s]
  4%|▎         | 13260/371472 [1:04:06<26:53:16,  3.70it/s]
                                                           
{'loss': 5.1973, 'learning_rate': 9.68341270012282e-07, 'epoch': 0.57}

  4%|▎         | 13260/371472 [1:04:06<26:53:16,  3.70it/s]
  4%|▎         | 13261/371472 [1:04:06<27:03:28,  3.68it/s]
  4%|▎         | 13262/371472 [1:04:07<27:08:37,  3.67it/s]
  4%|▎         | 13263/371472 [1:04:07<28:54:33,  3.44it/s]
  4%|▎         | 13264/371472 [1:04:07<27:47:44,  3.58it/s]
  4%|▎         | 13265/371472 [1:04:08<29:10:57,  3.41it/s]
  4%|▎         | 13266/371472 [1:04:08<29:32:14,  3.37it/s]
  4%|▎         | 13267/371472 [1:04:08<29:38:40,  3.36it/s]
  4%|▎         | 13268/371472 [1:04:08<28:49:34,  3.45it/s]
  4%|▎         | 13269/371472 [1:04:09<27:52:41,  3.57it/s]
  4%|▎         | 13270/371472 [1:04:09<28:12:08,  3.53it/s]
  4%|▎         | 13271/371472 [1:04:09<27:35:45,  3.61it/s]
  4%|▎         | 13272/371472 [1:04:09<27:56:08,  3.56it/s]
  4%|▎         | 13273/371472 [1:04:10<29:09:23,  3.41it/s]
  4%|▎         | 13274/371472 [1:04:10<28:38:46,  3.47it/s]
  4%|▎         | 13275/371472 [1:04:10<27:37:01,  3.60it/s]
  4%|▎         | 13276/371472 [1:04:11<28:01:41,  3.55it/s]
  4%|▎         | 13277/371472 [1:04:11<27:03:01,  3.68it/s]
  4%|▎         | 13278/371472 [1:04:11<27:04:19,  3.68it/s]
  4%|▎         | 13279/371472 [1:04:11<27:08:38,  3.67it/s]
  4%|▎         | 13280/371472 [1:04:12<26:49:10,  3.71it/s]
                                                           
{'loss': 4.7367, 'learning_rate': 9.682927880368032e-07, 'epoch': 0.57}

  4%|▎         | 13280/371472 [1:04:12<26:49:10,  3.71it/s]
  4%|▎         | 13281/371472 [1:04:12<26:27:13,  3.76it/s]
  4%|▎         | 13282/371472 [1:04:12<27:55:05,  3.56it/s]
  4%|▎         | 13283/371472 [1:04:13<28:30:39,  3.49it/s]
  4%|▎         | 13284/371472 [1:04:13<27:37:29,  3.60it/s]
  4%|▎         | 13285/371472 [1:04:13<29:01:16,  3.43it/s]
  4%|▎         | 13286/371472 [1:04:13<29:38:59,  3.36it/s]
  4%|▎         | 13287/371472 [1:04:14<32:31:48,  3.06it/s]
  4%|▎         | 13288/371472 [1:04:14<30:19:54,  3.28it/s]
  4%|▎         | 13289/371472 [1:04:14<29:21:44,  3.39it/s]
  4%|▎         | 13290/371472 [1:04:15<28:32:25,  3.49it/s]
  4%|▎         | 13291/371472 [1:04:15<27:32:20,  3.61it/s]
  4%|▎         | 13292/371472 [1:04:15<27:17:52,  3.64it/s]
  4%|▎         | 13293/371472 [1:04:15<27:23:34,  3.63it/s]
  4%|▎         | 13294/371472 [1:04:16<35:13:23,  2.82it/s]
  4%|▎         | 13295/371472 [1:04:16<33:59:35,  2.93it/s]
  4%|▎         | 13296/371472 [1:04:17<31:44:18,  3.13it/s]
  4%|▎         | 13297/371472 [1:04:17<32:02:11,  3.11it/s]
  4%|▎         | 13298/371472 [1:04:17<29:45:41,  3.34it/s]
  4%|▎         | 13299/371472 [1:04:17<29:35:24,  3.36it/s]
  4%|▎         | 13300/371472 [1:04:18<31:51:48,  3.12it/s]
                                                           
{'loss': 4.807, 'learning_rate': 9.682443060613242e-07, 'epoch': 0.57}

  4%|▎         | 13300/371472 [1:04:18<31:51:48,  3.12it/s]
  4%|▎         | 13301/371472 [1:04:18<30:11:41,  3.30it/s]
  4%|▎         | 13302/371472 [1:04:18<30:12:16,  3.29it/s]
  4%|▎         | 13303/371472 [1:04:19<30:38:31,  3.25it/s]
  4%|▎         | 13304/371472 [1:04:19<29:52:12,  3.33it/s]
  4%|▎         | 13305/371472 [1:04:19<29:26:04,  3.38it/s]
  4%|▎         | 13306/371472 [1:04:20<28:34:28,  3.48it/s]
  4%|▎         | 13307/371472 [1:04:20<27:46:28,  3.58it/s]
  4%|▎         | 13308/371472 [1:04:20<27:17:37,  3.65it/s]
  4%|▎         | 13309/371472 [1:04:20<28:36:32,  3.48it/s]
  4%|▎         | 13310/371472 [1:04:21<28:55:55,  3.44it/s]
  4%|▎         | 13311/371472 [1:04:21<28:25:23,  3.50it/s]
  4%|▎         | 13312/371472 [1:04:21<28:09:37,  3.53it/s]
  4%|▎         | 13313/371472 [1:04:21<27:50:32,  3.57it/s]
  4%|▎         | 13314/371472 [1:04:22<27:22:12,  3.63it/s]
  4%|▎         | 13315/371472 [1:04:22<28:27:46,  3.50it/s]
  4%|▎         | 13316/371472 [1:04:22<31:20:22,  3.17it/s]
  4%|▎         | 13317/371472 [1:04:23<31:01:31,  3.21it/s]
  4%|▎         | 13318/371472 [1:04:23<31:07:36,  3.20it/s]
  4%|▎         | 13319/371472 [1:04:23<30:20:37,  3.28it/s]
  4%|▎         | 13320/371472 [1:04:24<30:17:51,  3.28it/s]
                                                           
{'loss': 4.7434, 'learning_rate': 9.681958240858455e-07, 'epoch': 0.57}

  4%|▎         | 13320/371472 [1:04:24<30:17:51,  3.28it/s]
  4%|▎         | 13321/371472 [1:04:24<30:01:54,  3.31it/s]
  4%|▎         | 13322/371472 [1:04:24<28:55:57,  3.44it/s]
  4%|▎         | 13323/371472 [1:04:25<29:36:27,  3.36it/s]
  4%|▎         | 13324/371472 [1:04:25<28:22:22,  3.51it/s]
  4%|▎         | 13325/371472 [1:04:25<27:38:20,  3.60it/s]
  4%|▎         | 13326/371472 [1:04:25<28:30:04,  3.49it/s]
  4%|▎         | 13327/371472 [1:04:26<29:59:44,  3.32it/s]
  4%|▎         | 13328/371472 [1:04:26<29:34:10,  3.36it/s]
  4%|▎         | 13329/371472 [1:04:26<28:20:15,  3.51it/s]
  4%|▎         | 13330/371472 [1:04:27<29:17:21,  3.40it/s]
  4%|▎         | 13331/371472 [1:04:27<28:12:34,  3.53it/s]
  4%|▎         | 13332/371472 [1:04:27<27:47:58,  3.58it/s]
  4%|▎         | 13333/371472 [1:04:27<27:22:25,  3.63it/s]
  4%|▎         | 13334/371472 [1:04:28<27:25:33,  3.63it/s]
  4%|▎         | 13335/371472 [1:04:28<27:59:25,  3.55it/s]
  4%|▎         | 13336/371472 [1:04:28<28:10:27,  3.53it/s]
  4%|▎         | 13337/371472 [1:04:28<27:55:08,  3.56it/s]
  4%|▎         | 13338/371472 [1:04:29<27:40:55,  3.59it/s]
  4%|▎         | 13339/371472 [1:04:29<27:48:41,  3.58it/s]
  4%|▎         | 13340/371472 [1:04:29<27:11:03,  3.66it/s]
                                                           
{'loss': 4.8386, 'learning_rate': 9.681473421103664e-07, 'epoch': 0.57}

  4%|▎         | 13340/371472 [1:04:29<27:11:03,  3.66it/s]
  4%|▎         | 13341/371472 [1:04:30<27:48:55,  3.58it/s]
  4%|▎         | 13342/371472 [1:04:30<28:21:41,  3.51it/s]
  4%|▎         | 13343/371472 [1:04:30<28:21:58,  3.51it/s]
  4%|▎         | 13344/371472 [1:04:30<27:21:48,  3.64it/s]
  4%|▎         | 13345/371472 [1:04:31<28:35:31,  3.48it/s]
  4%|▎         | 13346/371472 [1:04:31<28:20:23,  3.51it/s]
  4%|▎         | 13347/371472 [1:04:31<27:51:35,  3.57it/s]
  4%|▎         | 13348/371472 [1:04:32<27:19:03,  3.64it/s]
  4%|▎         | 13349/371472 [1:04:32<28:17:20,  3.52it/s]
  4%|▎         | 13350/371472 [1:04:32<28:59:40,  3.43it/s]
  4%|▎         | 13351/371472 [1:04:32<28:17:35,  3.52it/s]
  4%|▎         | 13352/371472 [1:04:33<27:39:57,  3.60it/s]
  4%|▎         | 13353/371472 [1:04:33<27:08:29,  3.67it/s]
  4%|▎         | 13354/371472 [1:04:33<29:46:01,  3.34it/s]
  4%|▎         | 13355/371472 [1:04:34<32:21:16,  3.07it/s]
  4%|▎         | 13356/371472 [1:04:34<31:39:13,  3.14it/s]
  4%|▎         | 13357/371472 [1:04:34<34:35:13,  2.88it/s]
  4%|▎         | 13358/371472 [1:04:35<34:34:19,  2.88it/s]
  4%|▎         | 13359/371472 [1:04:35<35:56:24,  2.77it/s]
  4%|▎         | 13360/371472 [1:04:35<33:07:16,  3.00it/s]
                                                           
{'loss': 4.9904, 'learning_rate': 9.680988601348877e-07, 'epoch': 0.58}

  4%|▎         | 13360/371472 [1:04:35<33:07:16,  3.00it/s]
  4%|▎         | 13361/371472 [1:04:36<31:26:18,  3.16it/s]
  4%|▎         | 13362/371472 [1:04:36<30:40:02,  3.24it/s]
  4%|▎         | 13363/371472 [1:04:36<30:38:10,  3.25it/s]
  4%|▎         | 13364/371472 [1:04:37<30:58:30,  3.21it/s]
  4%|▎         | 13365/371472 [1:04:37<29:11:46,  3.41it/s]
  4%|▎         | 13366/371472 [1:04:37<29:43:51,  3.35it/s]
  4%|▎         | 13367/371472 [1:04:37<28:36:22,  3.48it/s]
  4%|▎         | 13368/371472 [1:04:38<27:31:38,  3.61it/s]
  4%|▎         | 13369/371472 [1:04:38<30:09:42,  3.30it/s]
  4%|▎         | 13370/371472 [1:04:38<29:03:59,  3.42it/s]
  4%|▎         | 13371/371472 [1:04:39<29:15:05,  3.40it/s]
  4%|▎         | 13372/371472 [1:04:39<28:44:44,  3.46it/s]
  4%|▎         | 13373/371472 [1:04:39<28:29:31,  3.49it/s]
  4%|▎         | 13374/371472 [1:04:39<28:05:02,  3.54it/s]
  4%|▎         | 13375/371472 [1:04:40<27:42:35,  3.59it/s]
  4%|▎         | 13376/371472 [1:04:40<27:20:33,  3.64it/s]
  4%|▎         | 13377/371472 [1:04:40<27:50:57,  3.57it/s]
  4%|▎         | 13378/371472 [1:04:41<27:55:06,  3.56it/s]
  4%|▎         | 13379/371472 [1:04:41<26:55:59,  3.69it/s]
  4%|▎         | 13380/371472 [1:04:41<28:11:33,  3.53it/s]
                                                           
{'loss': 4.6482, 'learning_rate': 9.680503781594085e-07, 'epoch': 0.58}

  4%|▎         | 13380/371472 [1:04:41<28:11:33,  3.53it/s]
  4%|▎         | 13381/371472 [1:04:41<27:27:52,  3.62it/s]
  4%|▎         | 13382/371472 [1:04:42<28:28:26,  3.49it/s]
  4%|▎         | 13383/371472 [1:04:42<27:11:16,  3.66it/s]
  4%|▎         | 13384/371472 [1:04:42<26:47:55,  3.71it/s]
  4%|▎         | 13385/371472 [1:04:42<26:51:14,  3.70it/s]
  4%|▎         | 13386/371472 [1:04:43<26:15:10,  3.79it/s]
  4%|▎         | 13387/371472 [1:04:43<26:16:14,  3.79it/s]
  4%|▎         | 13388/371472 [1:04:43<26:13:37,  3.79it/s]
  4%|▎         | 13389/371472 [1:04:44<26:30:15,  3.75it/s]
  4%|▎         | 13390/371472 [1:04:44<25:55:33,  3.84it/s]
  4%|▎         | 13391/371472 [1:04:44<29:15:12,  3.40it/s]
  4%|▎         | 13392/371472 [1:04:44<30:22:41,  3.27it/s]
  4%|▎         | 13393/371472 [1:04:45<29:52:57,  3.33it/s]
  4%|▎         | 13394/371472 [1:04:45<29:08:24,  3.41it/s]
  4%|▎         | 13395/371472 [1:04:45<29:26:47,  3.38it/s]
  4%|▎         | 13396/371472 [1:04:46<28:14:28,  3.52it/s]
  4%|▎         | 13397/371472 [1:04:46<30:14:32,  3.29it/s]
  4%|▎         | 13398/371472 [1:04:46<31:12:37,  3.19it/s]
  4%|▎         | 13399/371472 [1:04:47<30:08:48,  3.30it/s]
  4%|▎         | 13400/371472 [1:04:47<30:06:08,  3.30it/s]
                                                           
{'loss': 4.8677, 'learning_rate': 9.680018961839298e-07, 'epoch': 0.58}

  4%|▎         | 13400/371472 [1:04:47<30:06:08,  3.30it/s]
  4%|▎         | 13401/371472 [1:04:47<30:41:02,  3.24it/s]
  4%|▎         | 13402/371472 [1:04:47<29:41:05,  3.35it/s]
  4%|▎         | 13403/371472 [1:04:48<29:37:39,  3.36it/s]
  4%|▎         | 13404/371472 [1:04:48<29:14:28,  3.40it/s]
  4%|▎         | 13405/371472 [1:04:48<28:27:01,  3.50it/s]
  4%|▎         | 13406/371472 [1:04:49<28:20:42,  3.51it/s]
  4%|▎         | 13407/371472 [1:04:49<28:27:53,  3.49it/s]
  4%|▎         | 13408/371472 [1:04:49<28:14:21,  3.52it/s]
  4%|▎         | 13409/371472 [1:04:49<28:33:08,  3.48it/s]
  4%|▎         | 13410/371472 [1:04:50<27:52:32,  3.57it/s]
  4%|▎         | 13411/371472 [1:04:50<27:29:48,  3.62it/s]
  4%|▎         | 13412/371472 [1:04:50<27:28:19,  3.62it/s]
  4%|▎         | 13413/371472 [1:04:51<28:22:12,  3.51it/s]
  4%|▎         | 13414/371472 [1:04:51<29:06:24,  3.42it/s]
  4%|▎         | 13415/371472 [1:04:51<29:14:36,  3.40it/s]
  4%|▎         | 13416/371472 [1:04:51<28:17:59,  3.51it/s]
  4%|▎         | 13417/371472 [1:04:52<27:52:26,  3.57it/s]
  4%|▎         | 13418/371472 [1:04:52<28:19:25,  3.51it/s]
  4%|▎         | 13419/371472 [1:04:52<30:05:57,  3.30it/s]
  4%|▎         | 13420/371472 [1:04:53<28:53:41,  3.44it/s]
                                                           
{'loss': 4.8015, 'learning_rate': 9.679534142084509e-07, 'epoch': 0.58}

  4%|▎         | 13420/371472 [1:04:53<28:53:41,  3.44it/s]
  4%|▎         | 13421/371472 [1:04:53<28:05:20,  3.54it/s]
  4%|▎         | 13422/371472 [1:04:53<29:40:31,  3.35it/s]
  4%|▎         | 13423/371472 [1:04:53<28:32:09,  3.49it/s]
  4%|▎         | 13424/371472 [1:04:54<27:36:05,  3.60it/s]
  4%|▎         | 13425/371472 [1:04:54<29:37:01,  3.36it/s]
  4%|▎         | 13426/371472 [1:04:54<28:56:07,  3.44it/s]
  4%|▎         | 13427/371472 [1:04:55<27:59:00,  3.55it/s]
  4%|▎         | 13428/371472 [1:04:55<27:59:56,  3.55it/s]
  4%|▎         | 13429/371472 [1:04:55<28:15:45,  3.52it/s]
  4%|▎         | 13430/371472 [1:04:55<27:26:58,  3.62it/s]
  4%|▎         | 13431/371472 [1:04:56<27:30:16,  3.62it/s]
  4%|▎         | 13432/371472 [1:04:56<26:55:37,  3.69it/s]
  4%|▎         | 13433/371472 [1:04:56<28:42:25,  3.46it/s]
  4%|▎         | 13434/371472 [1:04:57<29:46:46,  3.34it/s]
  4%|▎         | 13435/371472 [1:04:57<28:47:22,  3.45it/s]
  4%|▎         | 13436/371472 [1:04:57<27:40:13,  3.59it/s]
  4%|▎         | 13437/371472 [1:04:58<30:07:27,  3.30it/s]
  4%|▎         | 13438/371472 [1:04:58<29:39:25,  3.35it/s]
  4%|▎         | 13439/371472 [1:04:58<31:07:57,  3.19it/s]
  4%|▎         | 13440/371472 [1:04:58<29:41:02,  3.35it/s]
                                                           
{'loss': 4.9403, 'learning_rate': 9.67904932232972e-07, 'epoch': 0.58}

  4%|▎         | 13440/371472 [1:04:58<29:41:02,  3.35it/s]
  4%|▎         | 13441/371472 [1:04:59<30:17:19,  3.28it/s]
  4%|▎         | 13442/371472 [1:04:59<33:48:12,  2.94it/s]
  4%|▎         | 13443/371472 [1:04:59<31:47:15,  3.13it/s]
  4%|▎         | 13444/371472 [1:05:00<32:30:49,  3.06it/s]
  4%|▎         | 13445/371472 [1:05:00<30:14:07,  3.29it/s]
  4%|▎         | 13446/371472 [1:05:00<29:59:40,  3.32it/s]
  4%|▎         | 13447/371472 [1:05:01<29:15:13,  3.40it/s]
  4%|▎         | 13448/371472 [1:05:01<28:56:07,  3.44it/s]
  4%|▎         | 13449/371472 [1:05:01<30:34:33,  3.25it/s]
  4%|▎         | 13450/371472 [1:05:02<31:29:14,  3.16it/s]
  4%|▎         | 13451/371472 [1:05:02<30:29:46,  3.26it/s]
  4%|▎         | 13452/371472 [1:05:02<34:14:22,  2.90it/s]
  4%|▎         | 13453/371472 [1:05:03<32:48:35,  3.03it/s]
  4%|▎         | 13454/371472 [1:05:03<33:44:22,  2.95it/s]
  4%|▎         | 13455/371472 [1:05:03<31:41:19,  3.14it/s]
  4%|▎         | 13456/371472 [1:05:03<30:33:58,  3.25it/s]
  4%|▎         | 13457/371472 [1:05:04<28:47:50,  3.45it/s]
  4%|▎         | 13458/371472 [1:05:04<27:48:56,  3.58it/s]
  4%|▎         | 13459/371472 [1:05:04<27:48:56,  3.58it/s]
  4%|▎         | 13460/371472 [1:05:05<27:55:53,  3.56it/s]
                                                           
{'loss': 4.8006, 'learning_rate': 9.678564502574932e-07, 'epoch': 0.58}

  4%|▎         | 13460/371472 [1:05:05<27:55:53,  3.56it/s]
  4%|▎         | 13461/371472 [1:05:05<28:03:07,  3.55it/s]
  4%|▎         | 13462/371472 [1:05:05<27:59:12,  3.55it/s]
  4%|▎         | 13463/371472 [1:05:05<28:08:00,  3.53it/s]
  4%|▎         | 13464/371472 [1:05:06<29:23:32,  3.38it/s]
  4%|▎         | 13465/371472 [1:05:06<30:23:34,  3.27it/s]
  4%|▎         | 13466/371472 [1:05:06<29:54:19,  3.33it/s]
  4%|▎         | 13467/371472 [1:05:07<28:32:37,  3.48it/s]
  4%|▎         | 13468/371472 [1:05:07<30:28:42,  3.26it/s]
  4%|▎         | 13469/371472 [1:05:07<28:51:35,  3.45it/s]
  4%|▎         | 13470/371472 [1:05:07<29:03:12,  3.42it/s]
  4%|▎         | 13471/371472 [1:05:08<28:03:13,  3.54it/s]
  4%|▎         | 13472/371472 [1:05:08<28:20:10,  3.51it/s]
  4%|▎         | 13473/371472 [1:05:08<28:08:16,  3.53it/s]
  4%|▎         | 13474/371472 [1:05:09<28:15:31,  3.52it/s]
  4%|▎         | 13475/371472 [1:05:09<27:23:54,  3.63it/s]
  4%|▎         | 13476/371472 [1:05:09<28:27:30,  3.49it/s]
  4%|▎         | 13477/371472 [1:05:09<28:21:35,  3.51it/s]
  4%|▎         | 13478/371472 [1:05:10<28:38:26,  3.47it/s]
  4%|▎         | 13479/371472 [1:05:10<28:03:47,  3.54it/s]
  4%|▎         | 13480/371472 [1:05:10<27:20:27,  3.64it/s]
                                                           
{'loss': 4.9156, 'learning_rate': 9.678079682820143e-07, 'epoch': 0.58}

  4%|▎         | 13480/371472 [1:05:10<27:20:27,  3.64it/s]
  4%|▎         | 13481/371472 [1:05:11<29:29:24,  3.37it/s]
  4%|▎         | 13482/371472 [1:05:11<28:31:36,  3.49it/s]
  4%|▎         | 13483/371472 [1:05:11<31:00:27,  3.21it/s]
  4%|▎         | 13484/371472 [1:05:12<29:55:58,  3.32it/s]
  4%|▎         | 13485/371472 [1:05:12<28:25:56,  3.50it/s]
  4%|▎         | 13486/371472 [1:05:12<28:03:56,  3.54it/s]
  4%|▎         | 13487/371472 [1:05:12<27:41:47,  3.59it/s]
  4%|▎         | 13488/371472 [1:05:13<27:16:29,  3.65it/s]
  4%|▎         | 13489/371472 [1:05:13<27:24:01,  3.63it/s]
  4%|▎         | 13490/371472 [1:05:13<27:54:19,  3.56it/s]
  4%|▎         | 13491/371472 [1:05:13<27:17:27,  3.64it/s]
  4%|▎         | 13492/371472 [1:05:14<28:02:31,  3.55it/s]
  4%|▎         | 13493/371472 [1:05:14<28:31:00,  3.49it/s]
  4%|▎         | 13494/371472 [1:05:14<27:38:15,  3.60it/s]
  4%|▎         | 13495/371472 [1:05:15<27:44:21,  3.58it/s]
  4%|▎         | 13496/371472 [1:05:15<27:54:22,  3.56it/s]
  4%|▎         | 13497/371472 [1:05:15<26:38:51,  3.73it/s]
  4%|▎         | 13498/371472 [1:05:15<26:52:51,  3.70it/s]
  4%|▎         | 13499/371472 [1:05:16<27:15:42,  3.65it/s]
  4%|▎         | 13500/371472 [1:05:16<27:44:07,  3.59it/s]
                                                           
{'loss': 4.575, 'learning_rate': 9.677594863065354e-07, 'epoch': 0.58}

  4%|▎         | 13500/371472 [1:05:16<27:44:07,  3.59it/s]
  4%|▎         | 13501/371472 [1:05:16<30:13:54,  3.29it/s]
  4%|▎         | 13502/371472 [1:05:17<29:34:22,  3.36it/s]
  4%|▎         | 13503/371472 [1:05:17<30:24:04,  3.27it/s]
  4%|▎         | 13504/371472 [1:05:17<30:17:34,  3.28it/s]
  4%|▎         | 13505/371472 [1:05:17<29:54:04,  3.33it/s]
  4%|▎         | 13506/371472 [1:05:18<30:07:35,  3.30it/s]
  4%|▎         | 13507/371472 [1:05:18<28:57:45,  3.43it/s]
  4%|▎         | 13508/371472 [1:05:18<29:39:25,  3.35it/s]
  4%|▎         | 13509/371472 [1:05:19<28:39:58,  3.47it/s]
  4%|▎         | 13510/371472 [1:05:19<30:05:23,  3.30it/s]
  4%|▎         | 13511/371472 [1:05:19<31:11:06,  3.19it/s]
  4%|▎         | 13512/371472 [1:05:20<30:35:43,  3.25it/s]
  4%|▎         | 13513/371472 [1:05:20<30:27:35,  3.26it/s]
  4%|▎         | 13514/371472 [1:05:20<29:02:29,  3.42it/s]
  4%|▎         | 13515/371472 [1:05:20<28:10:25,  3.53it/s]
  4%|▎         | 13516/371472 [1:05:21<29:28:46,  3.37it/s]
  4%|▎         | 13517/371472 [1:05:21<30:52:21,  3.22it/s]
  4%|▎         | 13518/371472 [1:05:21<31:32:37,  3.15it/s]
  4%|▎         | 13519/371472 [1:05:22<30:27:41,  3.26it/s]
  4%|▎         | 13520/371472 [1:05:22<29:14:59,  3.40it/s]
                                                           
{'loss': 4.6135, 'learning_rate': 9.677110043310564e-07, 'epoch': 0.58}

  4%|▎         | 13520/371472 [1:05:22<29:14:59,  3.40it/s]
  4%|▎         | 13521/371472 [1:05:22<27:55:45,  3.56it/s]
  4%|▎         | 13522/371472 [1:05:23<27:14:28,  3.65it/s]
  4%|▎         | 13523/371472 [1:05:23<27:41:38,  3.59it/s]
  4%|▎         | 13524/371472 [1:05:23<29:03:10,  3.42it/s]
  4%|▎         | 13525/371472 [1:05:23<30:35:21,  3.25it/s]
  4%|▎         | 13526/371472 [1:05:24<30:56:01,  3.21it/s]
  4%|▎         | 13527/371472 [1:05:24<30:35:06,  3.25it/s]
  4%|▎         | 13528/371472 [1:05:24<29:36:53,  3.36it/s]
  4%|▎         | 13529/371472 [1:05:25<28:08:59,  3.53it/s]
  4%|▎         | 13530/371472 [1:05:25<33:15:38,  2.99it/s]
  4%|▎         | 13531/371472 [1:05:25<33:51:25,  2.94it/s]
  4%|▎         | 13532/371472 [1:05:26<33:49:08,  2.94it/s]
  4%|▎         | 13533/371472 [1:05:26<31:08:01,  3.19it/s]
  4%|▎         | 13534/371472 [1:05:26<29:55:16,  3.32it/s]
  4%|▎         | 13535/371472 [1:05:27<29:44:10,  3.34it/s]
  4%|▎         | 13536/371472 [1:05:27<28:54:48,  3.44it/s]
  4%|▎         | 13537/371472 [1:05:27<28:26:14,  3.50it/s]
  4%|▎         | 13538/371472 [1:05:27<27:34:50,  3.60it/s]
  4%|▎         | 13539/371472 [1:05:28<28:53:50,  3.44it/s]
  4%|▎         | 13540/371472 [1:05:28<27:58:08,  3.55it/s]
                                                           
{'loss': 4.8542, 'learning_rate': 9.676625223555775e-07, 'epoch': 0.58}

  4%|▎         | 13540/371472 [1:05:28<27:58:08,  3.55it/s]
  4%|▎         | 13541/371472 [1:05:28<27:06:01,  3.67it/s]
  4%|▎         | 13542/371472 [1:05:28<26:42:43,  3.72it/s]
  4%|▎         | 13543/371472 [1:05:29<26:44:56,  3.72it/s]
  4%|▎         | 13544/371472 [1:05:29<26:37:13,  3.73it/s]
  4%|▎         | 13545/371472 [1:05:29<27:11:22,  3.66it/s]
  4%|▎         | 13546/371472 [1:05:30<30:48:04,  3.23it/s]
  4%|▎         | 13547/371472 [1:05:30<30:01:14,  3.31it/s]
  4%|▎         | 13548/371472 [1:05:30<29:05:33,  3.42it/s]
  4%|▎         | 13549/371472 [1:05:31<29:46:22,  3.34it/s]
  4%|▎         | 13550/371472 [1:05:31<31:27:34,  3.16it/s]
  4%|▎         | 13551/371472 [1:05:31<29:33:59,  3.36it/s]
  4%|▎         | 13552/371472 [1:05:31<28:43:31,  3.46it/s]
  4%|▎         | 13553/371472 [1:05:32<27:42:01,  3.59it/s]
  4%|▎         | 13554/371472 [1:05:32<28:05:45,  3.54it/s]
  4%|▎         | 13555/371472 [1:05:32<29:11:46,  3.41it/s]
  4%|▎         | 13556/371472 [1:05:33<28:13:17,  3.52it/s]
  4%|▎         | 13557/371472 [1:05:33<29:21:31,  3.39it/s]
  4%|▎         | 13558/371472 [1:05:33<28:15:01,  3.52it/s]
  4%|▎         | 13559/371472 [1:05:33<28:33:10,  3.48it/s]
  4%|▎         | 13560/371472 [1:05:34<28:54:54,  3.44it/s]
                                                           
{'loss': 4.5898, 'learning_rate': 9.676140403800988e-07, 'epoch': 0.58}

  4%|▎         | 13560/371472 [1:05:34<28:54:54,  3.44it/s]
  4%|▎         | 13561/371472 [1:05:34<27:54:44,  3.56it/s]
  4%|▎         | 13562/371472 [1:05:34<27:40:02,  3.59it/s]
  4%|▎         | 13563/371472 [1:05:35<28:14:47,  3.52it/s]
  4%|▎         | 13564/371472 [1:05:35<27:38:18,  3.60it/s]
  4%|▎         | 13565/371472 [1:05:35<27:17:40,  3.64it/s]
  4%|▎         | 13566/371472 [1:05:35<26:48:31,  3.71it/s]
  4%|▎         | 13567/371472 [1:05:36<27:31:42,  3.61it/s]
  4%|▎         | 13568/371472 [1:05:36<28:10:09,  3.53it/s]
  4%|▎         | 13569/371472 [1:05:36<27:40:07,  3.59it/s]
  4%|▎         | 13570/371472 [1:05:36<27:45:55,  3.58it/s]
  4%|▎         | 13571/371472 [1:05:37<27:59:00,  3.55it/s]
  4%|▎         | 13572/371472 [1:05:37<27:14:19,  3.65it/s]
  4%|▎         | 13573/371472 [1:05:37<27:27:27,  3.62it/s]
  4%|▎         | 13574/371472 [1:05:38<27:46:13,  3.58it/s]
  4%|▎         | 13575/371472 [1:05:38<27:51:30,  3.57it/s]
  4%|▎         | 13576/371472 [1:05:38<27:55:26,  3.56it/s]
  4%|▎         | 13577/371472 [1:05:38<27:32:22,  3.61it/s]
  4%|▎         | 13578/371472 [1:05:39<27:07:45,  3.66it/s]
  4%|▎         | 13579/371472 [1:05:39<27:24:14,  3.63it/s]
  4%|▎         | 13580/371472 [1:05:39<27:34:53,  3.60it/s]
                                                           
{'loss': 4.6785, 'learning_rate': 9.675655584046197e-07, 'epoch': 0.58}

  4%|▎         | 13580/371472 [1:05:39<27:34:53,  3.60it/s]
  4%|▎         | 13581/371472 [1:05:40<28:29:23,  3.49it/s]
  4%|▎         | 13582/371472 [1:05:40<28:35:10,  3.48it/s]
  4%|▎         | 13583/371472 [1:05:40<28:28:26,  3.49it/s]
  4%|▎         | 13584/371472 [1:05:40<28:56:18,  3.44it/s]
  4%|▎         | 13585/371472 [1:05:41<29:57:17,  3.32it/s]
  4%|▎         | 13586/371472 [1:05:41<29:26:17,  3.38it/s]
  4%|▎         | 13587/371472 [1:05:41<28:47:56,  3.45it/s]
  4%|▎         | 13588/371472 [1:05:42<28:02:15,  3.55it/s]
  4%|▎         | 13589/371472 [1:05:42<27:14:46,  3.65it/s]
  4%|▎         | 13590/371472 [1:05:42<27:30:54,  3.61it/s]
  4%|▎         | 13591/371472 [1:05:42<26:50:26,  3.70it/s]
  4%|▎         | 13592/371472 [1:05:43<27:49:49,  3.57it/s]
  4%|▎         | 13593/371472 [1:05:43<27:07:00,  3.67it/s]
  4%|▎         | 13594/371472 [1:05:43<28:27:46,  3.49it/s]
  4%|▎         | 13595/371472 [1:05:44<28:21:32,  3.51it/s]
  4%|▎         | 13596/371472 [1:05:44<28:32:58,  3.48it/s]
  4%|▎         | 13597/371472 [1:05:44<27:42:15,  3.59it/s]
  4%|▎         | 13598/371472 [1:05:44<28:53:01,  3.44it/s]
  4%|▎         | 13599/371472 [1:05:45<29:47:07,  3.34it/s]
  4%|▎         | 13600/371472 [1:05:45<30:45:07,  3.23it/s]
                                                           
{'loss': 4.4886, 'learning_rate': 9.67517076429141e-07, 'epoch': 0.59}

  4%|▎         | 13600/371472 [1:05:45<30:45:07,  3.23it/s]
  4%|▎         | 13601/371472 [1:05:45<29:43:11,  3.34it/s]
  4%|▎         | 13602/371472 [1:05:46<29:21:19,  3.39it/s]
  4%|▎         | 13603/371472 [1:05:46<29:00:43,  3.43it/s]
  4%|▎         | 13604/371472 [1:05:46<30:12:41,  3.29it/s]
  4%|▎         | 13605/371472 [1:05:47<29:26:30,  3.38it/s]
  4%|▎         | 13606/371472 [1:05:47<28:32:39,  3.48it/s]
  4%|▎         | 13607/371472 [1:05:47<27:40:28,  3.59it/s]
  4%|▎         | 13608/371472 [1:05:47<28:02:58,  3.54it/s]
  4%|▎         | 13609/371472 [1:05:48<28:20:03,  3.51it/s]
  4%|▎         | 13610/371472 [1:05:48<28:16:58,  3.51it/s]
  4%|▎         | 13611/371472 [1:05:48<27:58:52,  3.55it/s]
  4%|▎         | 13612/371472 [1:05:48<26:54:59,  3.69it/s]
  4%|▎         | 13613/371472 [1:05:49<28:23:08,  3.50it/s]
  4%|▎         | 13614/371472 [1:05:49<27:44:59,  3.58it/s]
  4%|▎         | 13615/371472 [1:05:49<26:51:36,  3.70it/s]
  4%|▎         | 13616/371472 [1:05:50<26:47:15,  3.71it/s]
  4%|▎         | 13617/371472 [1:05:50<26:50:39,  3.70it/s]
  4%|▎         | 13618/371472 [1:05:50<27:46:24,  3.58it/s]
  4%|▎         | 13619/371472 [1:05:50<30:16:31,  3.28it/s]
  4%|▎         | 13620/371472 [1:05:51<30:46:07,  3.23it/s]
                                                           
{'loss': 4.8392, 'learning_rate': 9.67468594453662e-07, 'epoch': 0.59}

  4%|▎         | 13620/371472 [1:05:51<30:46:07,  3.23it/s]
  4%|▎         | 13621/371472 [1:05:51<29:47:33,  3.34it/s]
  4%|▎         | 13622/371472 [1:05:51<28:53:08,  3.44it/s]
  4%|▎         | 13623/371472 [1:05:52<30:04:46,  3.30it/s]
  4%|▎         | 13624/371472 [1:05:52<30:03:54,  3.31it/s]
  4%|▎         | 13625/371472 [1:05:52<29:20:50,  3.39it/s]
  4%|▎         | 13626/371472 [1:05:53<28:22:28,  3.50it/s]
  4%|▎         | 13627/371472 [1:05:53<27:51:48,  3.57it/s]
  4%|▎         | 13628/371472 [1:05:53<27:48:35,  3.57it/s]
  4%|▎         | 13629/371472 [1:05:53<29:03:38,  3.42it/s]
  4%|▎         | 13630/371472 [1:05:54<28:37:57,  3.47it/s]
  4%|▎         | 13631/371472 [1:05:54<27:59:09,  3.55it/s]
  4%|▎         | 13632/371472 [1:05:54<27:55:31,  3.56it/s]
  4%|▎         | 13633/371472 [1:05:54<27:21:05,  3.63it/s]
  4%|▎         | 13634/371472 [1:05:55<27:48:07,  3.58it/s]
  4%|▎         | 13635/371472 [1:05:55<27:15:13,  3.65it/s]
  4%|▎         | 13636/371472 [1:05:55<26:43:58,  3.72it/s]
  4%|▎         | 13637/371472 [1:05:56<26:11:14,  3.80it/s]
  4%|▎         | 13638/371472 [1:05:56<26:10:39,  3.80it/s]
  4%|▎         | 13639/371472 [1:05:56<28:14:40,  3.52it/s]
  4%|▎         | 13640/371472 [1:05:56<27:12:13,  3.65it/s]
                                                           
{'loss': 4.7093, 'learning_rate': 9.67420112478183e-07, 'epoch': 0.59}

  4%|▎         | 13640/371472 [1:05:56<27:12:13,  3.65it/s]
  4%|▎         | 13641/371472 [1:05:57<27:45:46,  3.58it/s]
  4%|▎         | 13642/371472 [1:05:57<28:23:25,  3.50it/s]
  4%|▎         | 13643/371472 [1:05:57<27:59:24,  3.55it/s]
  4%|▎         | 13644/371472 [1:05:57<27:33:20,  3.61it/s]
  4%|▎         | 13645/371472 [1:05:58<27:42:09,  3.59it/s]
  4%|▎         | 13646/371472 [1:05:58<27:36:02,  3.60it/s]
  4%|▎         | 13647/371472 [1:05:58<27:58:14,  3.55it/s]
  4%|▎         | 13648/371472 [1:05:59<27:36:04,  3.60it/s]
  4%|▎         | 13649/371472 [1:05:59<29:20:30,  3.39it/s]
  4%|▎         | 13650/371472 [1:05:59<29:35:25,  3.36it/s]
  4%|▎         | 13651/371472 [1:06:00<28:33:53,  3.48it/s]
  4%|▎         | 13652/371472 [1:06:00<28:57:58,  3.43it/s]
  4%|▎         | 13653/371472 [1:06:00<30:28:28,  3.26it/s]
  4%|▎         | 13654/371472 [1:06:00<30:30:57,  3.26it/s]
  4%|▎         | 13655/371472 [1:06:01<29:51:48,  3.33it/s]
  4%|▎         | 13656/371472 [1:06:01<29:07:55,  3.41it/s]
  4%|▎         | 13657/371472 [1:06:01<28:13:43,  3.52it/s]
  4%|▎         | 13658/371472 [1:06:02<29:07:27,  3.41it/s]
  4%|▎         | 13659/371472 [1:06:02<27:55:22,  3.56it/s]
  4%|▎         | 13660/371472 [1:06:02<26:55:34,  3.69it/s]
                                                           
{'loss': 4.5766, 'learning_rate': 9.673716305027042e-07, 'epoch': 0.59}

  4%|▎         | 13660/371472 [1:06:02<26:55:34,  3.69it/s]
  4%|▎         | 13661/371472 [1:06:02<26:23:35,  3.77it/s]
  4%|▎         | 13662/371472 [1:06:03<27:29:00,  3.62it/s]
  4%|▎         | 13663/371472 [1:06:03<28:09:10,  3.53it/s]
  4%|▎         | 13664/371472 [1:06:03<27:09:35,  3.66it/s]
  4%|▎         | 13665/371472 [1:06:04<28:14:06,  3.52it/s]
  4%|▎         | 13666/371472 [1:06:04<27:57:35,  3.55it/s]
  4%|▎         | 13667/371472 [1:06:04<29:12:01,  3.40it/s]
  4%|▎         | 13668/371472 [1:06:04<28:59:45,  3.43it/s]
  4%|▎         | 13669/371472 [1:06:05<29:19:47,  3.39it/s]
  4%|▎         | 13670/371472 [1:06:05<28:33:11,  3.48it/s]
  4%|▎         | 13671/371472 [1:06:05<28:27:00,  3.49it/s]
  4%|▎         | 13672/371472 [1:06:06<28:41:41,  3.46it/s]
  4%|▎         | 13673/371472 [1:06:06<27:59:12,  3.55it/s]
  4%|▎         | 13674/371472 [1:06:06<29:21:15,  3.39it/s]
  4%|▎         | 13675/371472 [1:06:06<28:46:18,  3.45it/s]
  4%|▎         | 13676/371472 [1:06:07<28:58:45,  3.43it/s]
  4%|▎         | 13677/371472 [1:06:07<27:48:30,  3.57it/s]
  4%|▎         | 13678/371472 [1:06:07<28:58:11,  3.43it/s]
  4%|▎         | 13679/371472 [1:06:08<27:46:16,  3.58it/s]
  4%|▎         | 13680/371472 [1:06:08<26:56:23,  3.69it/s]
                                                           
{'loss': 4.6722, 'learning_rate': 9.673231485272252e-07, 'epoch': 0.59}

  4%|▎         | 13680/371472 [1:06:08<26:56:23,  3.69it/s]
  4%|▎         | 13681/371472 [1:06:08<26:19:28,  3.78it/s]
  4%|▎         | 13682/371472 [1:06:08<27:36:12,  3.60it/s]
  4%|▎         | 13683/371472 [1:06:09<27:37:54,  3.60it/s]
  4%|▎         | 13684/371472 [1:06:09<28:39:12,  3.47it/s]
  4%|▎         | 13685/371472 [1:06:09<28:26:41,  3.49it/s]
  4%|▎         | 13686/371472 [1:06:09<27:52:15,  3.57it/s]
  4%|▎         | 13687/371472 [1:06:10<29:28:56,  3.37it/s]
  4%|▎         | 13688/371472 [1:06:10<28:56:22,  3.43it/s]
  4%|▎         | 13689/371472 [1:06:10<30:34:45,  3.25it/s]
  4%|▎         | 13690/371472 [1:06:11<30:34:45,  3.25it/s]
  4%|▎         | 13691/371472 [1:06:11<30:30:48,  3.26it/s]
  4%|▎         | 13692/371472 [1:06:11<29:56:19,  3.32it/s]
  4%|▎         | 13693/371472 [1:06:12<29:15:05,  3.40it/s]
  4%|▎         | 13694/371472 [1:06:12<28:57:40,  3.43it/s]
  4%|▎         | 13695/371472 [1:06:12<28:22:48,  3.50it/s]
  4%|▎         | 13696/371472 [1:06:12<27:24:07,  3.63it/s]
  4%|▎         | 13697/371472 [1:06:13<26:57:26,  3.69it/s]
  4%|▎         | 13698/371472 [1:06:13<27:58:34,  3.55it/s]
  4%|▎         | 13699/371472 [1:06:13<27:37:19,  3.60it/s]
  4%|▎         | 13700/371472 [1:06:14<28:26:15,  3.49it/s]
                                                           
{'loss': 4.7496, 'learning_rate': 9.672746665517465e-07, 'epoch': 0.59}

  4%|▎         | 13700/371472 [1:06:14<28:26:15,  3.49it/s]
  4%|▎         | 13701/371472 [1:06:14<28:29:34,  3.49it/s]
  4%|▎         | 13702/371472 [1:06:14<27:29:11,  3.62it/s]
  4%|▎         | 13703/371472 [1:06:14<28:05:02,  3.54it/s]
  4%|▎         | 13704/371472 [1:06:15<29:27:00,  3.37it/s]
  4%|▎         | 13705/371472 [1:06:15<28:10:07,  3.53it/s]
  4%|▎         | 13706/371472 [1:06:15<30:46:07,  3.23it/s]
  4%|▎         | 13707/371472 [1:06:16<29:38:32,  3.35it/s]
  4%|▎         | 13708/371472 [1:06:16<29:51:34,  3.33it/s]
  4%|▎         | 13709/371472 [1:06:16<30:14:31,  3.29it/s]
  4%|▎         | 13710/371472 [1:06:17<28:45:44,  3.46it/s]
  4%|▎         | 13711/371472 [1:06:17<27:54:44,  3.56it/s]
  4%|▎         | 13712/371472 [1:06:17<27:18:49,  3.64it/s]
  4%|▎         | 13713/371472 [1:06:17<27:00:11,  3.68it/s]
  4%|▎         | 13714/371472 [1:06:18<29:42:03,  3.35it/s]
  4%|▎         | 13715/371472 [1:06:18<28:55:14,  3.44it/s]
  4%|▎         | 13716/371472 [1:06:18<28:17:22,  3.51it/s]
  4%|▎         | 13717/371472 [1:06:19<29:34:39,  3.36it/s]
  4%|▎         | 13718/371472 [1:06:19<28:29:35,  3.49it/s]
  4%|▎         | 13719/371472 [1:06:19<29:05:04,  3.42it/s]
  4%|▎         | 13720/371472 [1:06:19<28:28:30,  3.49it/s]
                                                           
{'loss': 4.5997, 'learning_rate': 9.672261845762674e-07, 'epoch': 0.59}

  4%|▎         | 13720/371472 [1:06:19<28:28:30,  3.49it/s]
  4%|▎         | 13721/371472 [1:06:20<28:08:53,  3.53it/s]
  4%|▎         | 13722/371472 [1:06:20<28:06:56,  3.53it/s]
  4%|▎         | 13723/371472 [1:06:20<28:00:01,  3.55it/s]
  4%|▎         | 13724/371472 [1:06:20<27:25:28,  3.62it/s]
  4%|▎         | 13725/371472 [1:06:21<30:41:39,  3.24it/s]
  4%|▎         | 13726/371472 [1:06:21<29:48:25,  3.33it/s]
  4%|▎         | 13727/371472 [1:06:21<29:33:11,  3.36it/s]
  4%|▎         | 13728/371472 [1:06:22<28:48:32,  3.45it/s]
  4%|▎         | 13729/371472 [1:06:22<28:07:19,  3.53it/s]
  4%|▎         | 13730/371472 [1:06:22<27:46:59,  3.58it/s]
  4%|▎         | 13731/371472 [1:06:23<27:34:28,  3.60it/s]
  4%|▎         | 13732/371472 [1:06:23<28:10:35,  3.53it/s]
  4%|▎         | 13733/371472 [1:06:23<28:04:47,  3.54it/s]
  4%|▎         | 13734/371472 [1:06:23<28:26:14,  3.49it/s]
  4%|▎         | 13735/371472 [1:06:24<29:56:03,  3.32it/s]
  4%|▎         | 13736/371472 [1:06:24<31:38:10,  3.14it/s]
  4%|▎         | 13737/371472 [1:06:24<31:10:08,  3.19it/s]
  4%|▎         | 13738/371472 [1:06:25<29:25:10,  3.38it/s]
  4%|▎         | 13739/371472 [1:06:25<29:35:36,  3.36it/s]
  4%|▎         | 13740/371472 [1:06:25<28:24:09,  3.50it/s]
                                                           
{'loss': 4.811, 'learning_rate': 9.671777026007886e-07, 'epoch': 0.59}

  4%|▎         | 13740/371472 [1:06:25<28:24:09,  3.50it/s]
  4%|▎         | 13741/371472 [1:06:25<28:44:29,  3.46it/s]
  4%|▎         | 13742/371472 [1:06:26<28:57:35,  3.43it/s]
  4%|▎         | 13743/371472 [1:06:26<27:43:29,  3.58it/s]
  4%|▎         | 13744/371472 [1:06:26<27:12:29,  3.65it/s]
  4%|▎         | 13745/371472 [1:06:27<26:56:34,  3.69it/s]
  4%|▎         | 13746/371472 [1:06:27<28:12:54,  3.52it/s]
  4%|▎         | 13747/371472 [1:06:27<30:45:44,  3.23it/s]
  4%|▎         | 13748/371472 [1:06:28<29:27:27,  3.37it/s]
  4%|▎         | 13749/371472 [1:06:28<31:10:57,  3.19it/s]
  4%|▎         | 13750/371472 [1:06:28<31:11:47,  3.19it/s]
  4%|▎         | 13751/371472 [1:06:28<30:17:38,  3.28it/s]
  4%|▎         | 13752/371472 [1:06:29<28:18:12,  3.51it/s]
  4%|▎         | 13753/371472 [1:06:29<28:52:46,  3.44it/s]
  4%|▎         | 13754/371472 [1:06:29<28:00:05,  3.55it/s]
  4%|▎         | 13755/371472 [1:06:30<27:12:16,  3.65it/s]
  4%|▎         | 13756/371472 [1:06:30<29:16:02,  3.40it/s]
  4%|▎         | 13757/371472 [1:06:30<28:10:56,  3.53it/s]
  4%|▎         | 13758/371472 [1:06:30<30:38:58,  3.24it/s]
  4%|▎         | 13759/371472 [1:06:31<29:56:24,  3.32it/s]
  4%|▎         | 13760/371472 [1:06:31<29:26:01,  3.38it/s]
                                                           
{'loss': 4.7544, 'learning_rate': 9.671292206253095e-07, 'epoch': 0.59}

  4%|▎         | 13760/371472 [1:06:31<29:26:01,  3.38it/s]
  4%|▎         | 13761/371472 [1:06:31<29:18:15,  3.39it/s]
  4%|▎         | 13762/371472 [1:06:32<28:36:10,  3.47it/s]
  4%|▎         | 13763/371472 [1:06:32<28:17:25,  3.51it/s]
  4%|▎         | 13764/371472 [1:06:32<28:34:20,  3.48it/s]
  4%|▎         | 13765/371472 [1:06:32<28:14:50,  3.52it/s]
  4%|▎         | 13766/371472 [1:06:33<28:38:43,  3.47it/s]
  4%|▎         | 13767/371472 [1:06:33<27:35:50,  3.60it/s]
  4%|▎         | 13768/371472 [1:06:33<28:08:15,  3.53it/s]
  4%|▎         | 13769/371472 [1:06:34<28:17:18,  3.51it/s]
  4%|▎         | 13770/371472 [1:06:34<28:06:53,  3.53it/s]
  4%|▎         | 13771/371472 [1:06:34<27:33:35,  3.61it/s]
  4%|▎         | 13772/371472 [1:06:34<27:56:27,  3.56it/s]
  4%|▎         | 13773/371472 [1:06:35<27:01:57,  3.68it/s]
  4%|▎         | 13774/371472 [1:06:35<26:43:31,  3.72it/s]
  4%|▎         | 13775/371472 [1:06:35<26:54:56,  3.69it/s]
  4%|▎         | 13776/371472 [1:06:35<26:49:37,  3.70it/s]
  4%|▎         | 13777/371472 [1:06:36<27:44:20,  3.58it/s]
  4%|▎         | 13778/371472 [1:06:36<28:01:12,  3.55it/s]
  4%|▎         | 13779/371472 [1:06:36<27:16:04,  3.64it/s]
  4%|▎         | 13780/371472 [1:06:37<27:27:27,  3.62it/s]
                                                           
{'loss': 4.872, 'learning_rate': 9.670807386498308e-07, 'epoch': 0.59}

  4%|▎         | 13780/371472 [1:06:37<27:27:27,  3.62it/s]
  4%|▎         | 13781/371472 [1:06:37<27:13:09,  3.65it/s]
  4%|▎         | 13782/371472 [1:06:37<27:53:04,  3.56it/s]
  4%|▎         | 13783/371472 [1:06:38<31:18:12,  3.17it/s]
  4%|▎         | 13784/371472 [1:06:38<30:36:41,  3.25it/s]
  4%|▎         | 13785/371472 [1:06:38<31:22:49,  3.17it/s]
  4%|▎         | 13786/371472 [1:06:39<31:02:18,  3.20it/s]
  4%|▎         | 13787/371472 [1:06:39<29:47:01,  3.34it/s]
  4%|▎         | 13788/371472 [1:06:39<29:15:09,  3.40it/s]
  4%|▎         | 13789/371472 [1:06:39<28:14:41,  3.52it/s]
  4%|▎         | 13790/371472 [1:06:40<27:53:53,  3.56it/s]
  4%|▎         | 13791/371472 [1:06:40<29:19:05,  3.39it/s]
  4%|▎         | 13792/371472 [1:06:40<28:21:50,  3.50it/s]
  4%|▎         | 13793/371472 [1:06:40<27:58:19,  3.55it/s]
  4%|▎         | 13794/371472 [1:06:41<30:36:16,  3.25it/s]
  4%|▎         | 13795/371472 [1:06:41<29:31:26,  3.37it/s]
  4%|▎         | 13796/371472 [1:06:41<30:10:52,  3.29it/s]
  4%|▎         | 13797/371472 [1:06:42<29:27:37,  3.37it/s]
  4%|▎         | 13798/371472 [1:06:42<29:02:39,  3.42it/s]
  4%|▎         | 13799/371472 [1:06:42<27:52:45,  3.56it/s]
  4%|▎         | 13800/371472 [1:06:43<27:37:43,  3.60it/s]
                                                           
{'loss': 4.616, 'learning_rate': 9.670322566743519e-07, 'epoch': 0.59}

  4%|▎         | 13800/371472 [1:06:43<27:37:43,  3.60it/s]
  4%|▎         | 13801/371472 [1:06:43<29:03:48,  3.42it/s]
  4%|▎         | 13802/371472 [1:06:43<28:04:17,  3.54it/s]
  4%|▎         | 13803/371472 [1:06:43<27:58:02,  3.55it/s]
  4%|▎         | 13804/371472 [1:06:44<28:22:04,  3.50it/s]
  4%|▎         | 13805/371472 [1:06:44<27:28:22,  3.62it/s]
  4%|▎         | 13806/371472 [1:06:44<27:02:01,  3.68it/s]
  4%|▎         | 13807/371472 [1:06:45<28:24:00,  3.50it/s]
  4%|▎         | 13808/371472 [1:06:45<30:29:06,  3.26it/s]
  4%|▎         | 13809/371472 [1:06:45<32:14:47,  3.08it/s]
  4%|▎         | 13810/371472 [1:06:46<31:31:50,  3.15it/s]
  4%|▎         | 13811/371472 [1:06:46<29:09:02,  3.41it/s]
  4%|▎         | 13812/371472 [1:06:46<28:28:53,  3.49it/s]
  4%|▎         | 13813/371472 [1:06:46<30:23:41,  3.27it/s]
  4%|▎         | 13814/371472 [1:06:47<30:17:46,  3.28it/s]
  4%|▎         | 13815/371472 [1:06:47<29:20:30,  3.39it/s]
  4%|▎         | 13816/371472 [1:06:47<28:54:22,  3.44it/s]
  4%|▎         | 13817/371472 [1:06:48<28:40:14,  3.47it/s]
  4%|▎         | 13818/371472 [1:06:48<28:09:07,  3.53it/s]
  4%|▎         | 13819/371472 [1:06:48<28:06:12,  3.54it/s]
  4%|▎         | 13820/371472 [1:06:48<30:04:07,  3.30it/s]
                                                           
{'loss': 4.6266, 'learning_rate': 9.66983774698873e-07, 'epoch': 0.6}

  4%|▎         | 13820/371472 [1:06:48<30:04:07,  3.30it/s]
  4%|▎         | 13821/371472 [1:06:49<29:16:11,  3.39it/s]
  4%|▎         | 13822/371472 [1:06:49<31:53:37,  3.11it/s]
  4%|▎         | 13823/371472 [1:06:49<30:52:37,  3.22it/s]
  4%|▎         | 13824/371472 [1:06:50<29:15:39,  3.40it/s]
  4%|▎         | 13825/371472 [1:06:50<28:08:34,  3.53it/s]
  4%|▎         | 13826/371472 [1:06:50<28:20:37,  3.51it/s]
  4%|▎         | 13827/371472 [1:06:50<28:58:05,  3.43it/s]
  4%|▎         | 13828/371472 [1:06:51<28:16:22,  3.51it/s]
  4%|▎         | 13829/371472 [1:06:51<27:26:55,  3.62it/s]
  4%|▎         | 13830/371472 [1:06:51<29:18:34,  3.39it/s]
  4%|▎         | 13831/371472 [1:06:52<32:00:04,  3.10it/s]
  4%|▎         | 13832/371472 [1:06:52<30:34:17,  3.25it/s]
  4%|▎         | 13833/371472 [1:06:52<29:01:57,  3.42it/s]
  4%|▎         | 13834/371472 [1:06:53<28:19:43,  3.51it/s]
  4%|▎         | 13835/371472 [1:06:53<29:06:20,  3.41it/s]
  4%|▎         | 13836/371472 [1:06:53<29:29:08,  3.37it/s]
  4%|▎         | 13837/371472 [1:06:53<28:35:50,  3.47it/s]
  4%|▎         | 13838/371472 [1:06:54<27:34:35,  3.60it/s]
  4%|▎         | 13839/371472 [1:06:54<26:59:53,  3.68it/s]
  4%|▎         | 13840/371472 [1:06:54<26:47:02,  3.71it/s]
                                                           
{'loss': 4.8612, 'learning_rate': 9.669352927233942e-07, 'epoch': 0.6}

  4%|▎         | 13840/371472 [1:06:54<26:47:02,  3.71it/s]
  4%|▎         | 13841/371472 [1:06:54<27:03:35,  3.67it/s]
  4%|▎         | 13842/371472 [1:06:55<27:48:06,  3.57it/s]
  4%|▎         | 13843/371472 [1:06:55<27:51:10,  3.57it/s]
  4%|▎         | 13844/371472 [1:06:55<28:11:32,  3.52it/s]
  4%|▎         | 13845/371472 [1:06:56<29:32:41,  3.36it/s]
  4%|▎         | 13846/371472 [1:06:56<28:17:34,  3.51it/s]
  4%|▎         | 13847/371472 [1:06:56<28:58:55,  3.43it/s]
  4%|▎         | 13848/371472 [1:06:56<28:11:01,  3.52it/s]
  4%|▎         | 13849/371472 [1:06:57<27:43:57,  3.58it/s]
  4%|▎         | 13850/371472 [1:06:57<27:58:02,  3.55it/s]
  4%|▎         | 13851/371472 [1:06:57<29:23:32,  3.38it/s]
  4%|▎         | 13852/371472 [1:06:58<30:19:20,  3.28it/s]
  4%|▎         | 13853/371472 [1:06:58<29:02:45,  3.42it/s]
  4%|▎         | 13854/371472 [1:06:58<28:03:03,  3.54it/s]
  4%|▎         | 13855/371472 [1:06:58<27:02:23,  3.67it/s]
  4%|▎         | 13856/371472 [1:06:59<28:29:47,  3.49it/s]
  4%|▎         | 13857/371472 [1:06:59<27:35:25,  3.60it/s]
  4%|▎         | 13858/371472 [1:06:59<29:40:57,  3.35it/s]
  4%|▎         | 13859/371472 [1:07:00<30:41:50,  3.24it/s]
  4%|▎         | 13860/371472 [1:07:00<29:26:36,  3.37it/s]
                                                           
{'loss': 4.4442, 'learning_rate': 9.668868107479153e-07, 'epoch': 0.6}

  4%|▎         | 13860/371472 [1:07:00<29:26:36,  3.37it/s]
  4%|▎         | 13861/371472 [1:07:00<28:30:27,  3.48it/s]
  4%|▎         | 13862/371472 [1:07:01<28:04:33,  3.54it/s]
  4%|▎         | 13863/371472 [1:07:01<28:59:06,  3.43it/s]
  4%|▎         | 13864/371472 [1:07:01<28:33:23,  3.48it/s]
  4%|▎         | 13865/371472 [1:07:01<27:30:44,  3.61it/s]
  4%|▎         | 13866/371472 [1:07:02<27:10:12,  3.66it/s]
  4%|▎         | 13867/371472 [1:07:02<27:46:47,  3.58it/s]
  4%|▎         | 13868/371472 [1:07:02<27:43:56,  3.58it/s]
  4%|▎         | 13869/371472 [1:07:02<27:01:48,  3.67it/s]
  4%|▎         | 13870/371472 [1:07:03<27:48:16,  3.57it/s]
  4%|▎         | 13871/371472 [1:07:03<29:29:10,  3.37it/s]
  4%|▎         | 13872/371472 [1:07:03<29:42:53,  3.34it/s]
  4%|▎         | 13873/371472 [1:07:04<28:35:31,  3.47it/s]
  4%|▎         | 13874/371472 [1:07:04<27:58:42,  3.55it/s]
  4%|▎         | 13875/371472 [1:07:04<28:17:11,  3.51it/s]
  4%|▎         | 13876/371472 [1:07:05<28:42:13,  3.46it/s]
  4%|▎         | 13877/371472 [1:07:05<27:48:01,  3.57it/s]
  4%|▎         | 13878/371472 [1:07:05<27:37:53,  3.59it/s]
  4%|▎         | 13879/371472 [1:07:05<27:49:11,  3.57it/s]
  4%|▎         | 13880/371472 [1:07:06<28:03:52,  3.54it/s]
                                                           
{'loss': 4.6665, 'learning_rate': 9.668383287724364e-07, 'epoch': 0.6}

  4%|▎         | 13880/371472 [1:07:06<28:03:52,  3.54it/s]
  4%|▎         | 13881/371472 [1:07:06<28:06:17,  3.53it/s]
  4%|▎         | 13882/371472 [1:07:06<27:35:40,  3.60it/s]
  4%|▎         | 13883/371472 [1:07:06<26:51:22,  3.70it/s]
  4%|▎         | 13884/371472 [1:07:07<27:01:17,  3.68it/s]
  4%|▎         | 13885/371472 [1:07:07<27:24:32,  3.62it/s]
  4%|▎         | 13886/371472 [1:07:07<27:12:00,  3.65it/s]
  4%|▎         | 13887/371472 [1:07:08<26:37:49,  3.73it/s]
  4%|▎         | 13888/371472 [1:07:08<27:32:25,  3.61it/s]
  4%|▎         | 13889/371472 [1:07:08<27:46:32,  3.58it/s]
  4%|▎         | 13890/371472 [1:07:08<28:02:53,  3.54it/s]
  4%|▎         | 13891/371472 [1:07:09<27:12:21,  3.65it/s]
  4%|▎         | 13892/371472 [1:07:09<28:53:34,  3.44it/s]
  4%|▎         | 13893/371472 [1:07:09<27:53:08,  3.56it/s]
  4%|▎         | 13894/371472 [1:07:10<27:20:26,  3.63it/s]
  4%|▎         | 13895/371472 [1:07:10<27:16:11,  3.64it/s]
  4%|▎         | 13896/371472 [1:07:10<29:06:27,  3.41it/s]
  4%|▎         | 13897/371472 [1:07:10<29:14:29,  3.40it/s]
  4%|▎         | 13898/371472 [1:07:11<28:45:42,  3.45it/s]
  4%|▎         | 13899/371472 [1:07:11<29:33:23,  3.36it/s]
  4%|▎         | 13900/371472 [1:07:11<28:51:54,  3.44it/s]
                                                           
{'loss': 4.5713, 'learning_rate': 9.667898467969574e-07, 'epoch': 0.6}

  4%|▎         | 13900/371472 [1:07:11<28:51:54,  3.44it/s]
  4%|▎         | 13901/371472 [1:07:12<28:23:55,  3.50it/s]
  4%|▎         | 13902/371472 [1:07:12<28:48:15,  3.45it/s]
  4%|▎         | 13903/371472 [1:07:12<28:16:04,  3.51it/s]
  4%|▎         | 13904/371472 [1:07:12<27:54:56,  3.56it/s]
  4%|▎         | 13905/371472 [1:07:13<26:40:49,  3.72it/s]
  4%|▎         | 13906/371472 [1:07:13<28:50:32,  3.44it/s]
  4%|▎         | 13907/371472 [1:07:13<28:11:32,  3.52it/s]
  4%|▎         | 13908/371472 [1:07:14<27:46:32,  3.58it/s]
  4%|▎         | 13909/371472 [1:07:14<27:41:40,  3.59it/s]
  4%|▎         | 13910/371472 [1:07:14<28:15:56,  3.51it/s]
  4%|▎         | 13911/371472 [1:07:14<27:03:56,  3.67it/s]
  4%|▎         | 13912/371472 [1:07:15<27:19:10,  3.64it/s]
  4%|▎         | 13913/371472 [1:07:15<27:35:36,  3.60it/s]
  4%|▎         | 13914/371472 [1:07:15<28:09:32,  3.53it/s]
  4%|▎         | 13915/371472 [1:07:15<27:15:23,  3.64it/s]
  4%|▎         | 13916/371472 [1:07:16<31:09:18,  3.19it/s]
  4%|▎         | 13917/371472 [1:07:16<30:43:11,  3.23it/s]
  4%|▎         | 13918/371472 [1:07:16<31:24:38,  3.16it/s]
  4%|▎         | 13919/371472 [1:07:17<31:30:16,  3.15it/s]
  4%|▎         | 13920/371472 [1:07:17<29:41:48,  3.34it/s]
                                                           
{'loss': 4.6818, 'learning_rate': 9.667413648214785e-07, 'epoch': 0.6}

  4%|▎         | 13920/371472 [1:07:17<29:41:48,  3.34it/s]
  4%|▎         | 13921/371472 [1:07:17<28:49:47,  3.45it/s]
  4%|▎         | 13922/371472 [1:07:18<28:33:27,  3.48it/s]
  4%|▎         | 13923/371472 [1:07:18<27:54:29,  3.56it/s]
  4%|▎         | 13924/371472 [1:07:18<33:53:06,  2.93it/s]
  4%|▎         | 13925/371472 [1:07:19<31:33:19,  3.15it/s]
  4%|▎         | 13926/371472 [1:07:19<31:12:58,  3.18it/s]
  4%|▎         | 13927/371472 [1:07:19<29:27:10,  3.37it/s]
  4%|▎         | 13928/371472 [1:07:19<28:19:46,  3.51it/s]
  4%|▎         | 13929/371472 [1:07:20<27:27:31,  3.62it/s]
  4%|▎         | 13930/371472 [1:07:20<30:44:43,  3.23it/s]
  4%|▍         | 13931/371472 [1:07:20<29:00:08,  3.42it/s]
  4%|▍         | 13932/371472 [1:07:21<31:15:47,  3.18it/s]
  4%|▍         | 13933/371472 [1:07:21<29:51:35,  3.33it/s]
  4%|▍         | 13934/371472 [1:07:21<30:05:11,  3.30it/s]
  4%|▍         | 13935/371472 [1:07:22<28:53:43,  3.44it/s]
  4%|▍         | 13936/371472 [1:07:22<30:35:37,  3.25it/s]
  4%|▍         | 13937/371472 [1:07:22<30:17:13,  3.28it/s]
  4%|▍         | 13938/371472 [1:07:22<28:55:37,  3.43it/s]
  4%|▍         | 13939/371472 [1:07:23<28:53:49,  3.44it/s]
  4%|▍         | 13940/371472 [1:07:23<30:00:45,  3.31it/s]
                                                           
{'loss': 4.8311, 'learning_rate': 9.666928828459998e-07, 'epoch': 0.6}

  4%|▍         | 13940/371472 [1:07:23<30:00:45,  3.31it/s]
  4%|▍         | 13941/371472 [1:07:23<31:02:28,  3.20it/s]
  4%|▍         | 13942/371472 [1:07:24<29:29:34,  3.37it/s]
  4%|▍         | 13943/371472 [1:07:24<28:56:44,  3.43it/s]
  4%|▍         | 13944/371472 [1:07:24<29:55:25,  3.32it/s]
  4%|▍         | 13945/371472 [1:07:25<28:36:02,  3.47it/s]
  4%|▍         | 13946/371472 [1:07:25<29:09:12,  3.41it/s]
  4%|▍         | 13947/371472 [1:07:25<29:28:19,  3.37it/s]
  4%|▍         | 13948/371472 [1:07:25<28:42:07,  3.46it/s]
  4%|▍         | 13949/371472 [1:07:26<28:01:32,  3.54it/s]
  4%|▍         | 13950/371472 [1:07:26<28:56:16,  3.43it/s]
  4%|▍         | 13951/371472 [1:07:26<31:14:27,  3.18it/s]
  4%|▍         | 13952/371472 [1:07:27<29:33:20,  3.36it/s]
  4%|▍         | 13953/371472 [1:07:27<28:53:25,  3.44it/s]
  4%|▍         | 13954/371472 [1:07:27<28:16:03,  3.51it/s]
  4%|▍         | 13955/371472 [1:07:28<30:09:45,  3.29it/s]
  4%|▍         | 13956/371472 [1:07:28<31:39:43,  3.14it/s]
  4%|▍         | 13957/371472 [1:07:28<31:11:43,  3.18it/s]
  4%|▍         | 13958/371472 [1:07:29<32:57:25,  3.01it/s]
  4%|▍         | 13959/371472 [1:07:29<32:03:51,  3.10it/s]
  4%|▍         | 13960/371472 [1:07:29<32:01:00,  3.10it/s]
                                                           
{'loss': 4.7409, 'learning_rate': 9.666444008705206e-07, 'epoch': 0.6}

  4%|▍         | 13960/371472 [1:07:29<32:01:00,  3.10it/s]
  4%|▍         | 13961/371472 [1:07:29<32:12:35,  3.08it/s]
  4%|▍         | 13962/371472 [1:07:30<30:26:08,  3.26it/s]
  4%|▍         | 13963/371472 [1:07:30<31:14:14,  3.18it/s]
  4%|▍         | 13964/371472 [1:07:30<31:00:39,  3.20it/s]
  4%|▍         | 13965/371472 [1:07:31<29:03:11,  3.42it/s]
  4%|▍         | 13966/371472 [1:07:31<28:24:00,  3.50it/s]
  4%|▍         | 13967/371472 [1:07:31<29:36:30,  3.35it/s]
  4%|▍         | 13968/371472 [1:07:32<29:28:19,  3.37it/s]
  4%|▍         | 13969/371472 [1:07:32<29:07:51,  3.41it/s]
  4%|▍         | 13970/371472 [1:07:32<29:03:00,  3.42it/s]
  4%|▍         | 13971/371472 [1:07:32<29:21:52,  3.38it/s]
  4%|▍         | 13972/371472 [1:07:33<30:54:50,  3.21it/s]
  4%|▍         | 13973/371472 [1:07:33<30:42:28,  3.23it/s]
  4%|▍         | 13974/371472 [1:07:33<30:21:50,  3.27it/s]
  4%|▍         | 13975/371472 [1:07:34<29:30:31,  3.37it/s]
  4%|▍         | 13976/371472 [1:07:34<29:16:22,  3.39it/s]
  4%|▍         | 13977/371472 [1:07:34<29:16:45,  3.39it/s]
  4%|▍         | 13978/371472 [1:07:35<29:37:00,  3.35it/s]
  4%|▍         | 13979/371472 [1:07:35<28:13:02,  3.52it/s]
  4%|▍         | 13980/371472 [1:07:35<27:45:26,  3.58it/s]
                                                           
{'loss': 4.6599, 'learning_rate': 9.66595918895042e-07, 'epoch': 0.6}

  4%|▍         | 13980/371472 [1:07:35<27:45:26,  3.58it/s]
  4%|▍         | 13981/371472 [1:07:35<28:45:29,  3.45it/s]
  4%|▍         | 13982/371472 [1:07:36<29:49:40,  3.33it/s]
  4%|▍         | 13983/371472 [1:07:36<28:09:12,  3.53it/s]
  4%|▍         | 13984/371472 [1:07:36<29:22:04,  3.38it/s]
  4%|▍         | 13985/371472 [1:07:37<28:20:15,  3.50it/s]
  4%|▍         | 13986/371472 [1:07:37<28:37:56,  3.47it/s]
  4%|▍         | 13987/371472 [1:07:37<28:40:48,  3.46it/s]
  4%|▍         | 13988/371472 [1:07:37<27:49:18,  3.57it/s]
  4%|▍         | 13989/371472 [1:07:38<28:33:08,  3.48it/s]
  4%|▍         | 13990/371472 [1:07:38<29:23:21,  3.38it/s]
  4%|▍         | 13991/371472 [1:07:38<31:34:24,  3.15it/s]
  4%|▍         | 13992/371472 [1:07:39<30:17:06,  3.28it/s]
  4%|▍         | 13993/371472 [1:07:39<29:28:11,  3.37it/s]
  4%|▍         | 13994/371472 [1:07:39<30:05:04,  3.30it/s]
  4%|▍         | 13995/371472 [1:07:40<31:00:21,  3.20it/s]
  4%|▍         | 13996/371472 [1:07:40<31:11:09,  3.18it/s]
  4%|▍         | 13997/371472 [1:07:40<30:04:21,  3.30it/s]
  4%|▍         | 13998/371472 [1:07:40<29:25:29,  3.37it/s]
  4%|▍         | 13999/371472 [1:07:41<28:39:44,  3.46it/s]
  4%|▍         | 14000/371472 [1:07:41<28:19:09,  3.51it/s]
                                                           
{'loss': 4.5503, 'learning_rate': 9.66547436919563e-07, 'epoch': 0.6}

  4%|▍         | 14000/371472 [1:07:41<28:19:09,  3.51it/s]
  4%|▍         | 14001/371472 [1:07:41<29:01:09,  3.42it/s]
  4%|▍         | 14002/371472 [1:07:42<27:47:28,  3.57it/s]
  4%|▍         | 14003/371472 [1:07:42<27:29:36,  3.61it/s]
  4%|▍         | 14004/371472 [1:07:42<29:25:04,  3.38it/s]
  4%|▍         | 14005/371472 [1:07:42<29:31:13,  3.36it/s]
  4%|▍         | 14006/371472 [1:07:43<28:33:53,  3.48it/s]
  4%|▍         | 14007/371472 [1:07:43<28:22:46,  3.50it/s]
  4%|▍         | 14008/371472 [1:07:43<27:58:03,  3.55it/s]
  4%|▍         | 14009/371472 [1:07:44<27:40:57,  3.59it/s]
  4%|▍         | 14010/371472 [1:07:44<27:37:31,  3.59it/s]
  4%|▍         | 14011/371472 [1:07:44<27:32:07,  3.61it/s]
  4%|▍         | 14012/371472 [1:07:44<27:18:26,  3.64it/s]
  4%|▍         | 14013/371472 [1:07:45<27:36:54,  3.60it/s]
  4%|▍         | 14014/371472 [1:07:45<27:33:48,  3.60it/s]
  4%|▍         | 14015/371472 [1:07:45<27:43:59,  3.58it/s]
  4%|▍         | 14016/371472 [1:07:46<27:57:27,  3.55it/s]
  4%|▍         | 14017/371472 [1:07:46<28:10:57,  3.52it/s]
  4%|▍         | 14018/371472 [1:07:46<26:58:12,  3.68it/s]
  4%|▍         | 14019/371472 [1:07:46<27:14:58,  3.64it/s]
  4%|▍         | 14020/371472 [1:07:47<27:46:16,  3.58it/s]
                                                           
{'loss': 4.6705, 'learning_rate': 9.66498954944084e-07, 'epoch': 0.6}

  4%|▍         | 14020/371472 [1:07:47<27:46:16,  3.58it/s]
  4%|▍         | 14021/371472 [1:07:47<28:10:55,  3.52it/s]
  4%|▍         | 14022/371472 [1:07:47<28:27:59,  3.49it/s]
  4%|▍         | 14023/371472 [1:07:47<27:25:04,  3.62it/s]
  4%|▍         | 14024/371472 [1:07:48<27:39:39,  3.59it/s]
  4%|▍         | 14025/371472 [1:07:48<29:30:03,  3.37it/s]
  4%|▍         | 14026/371472 [1:07:48<30:58:42,  3.21it/s]
  4%|▍         | 14027/371472 [1:07:49<30:17:55,  3.28it/s]
  4%|▍         | 14028/371472 [1:07:49<29:38:52,  3.35it/s]
  4%|▍         | 14029/371472 [1:07:49<28:44:09,  3.46it/s]
  4%|▍         | 14030/371472 [1:07:50<27:40:09,  3.59it/s]
  4%|▍         | 14031/371472 [1:07:50<30:41:59,  3.23it/s]
  4%|▍         | 14032/371472 [1:07:50<29:24:52,  3.38it/s]
  4%|▍         | 14033/371472 [1:07:50<28:18:06,  3.51it/s]
  4%|▍         | 14034/371472 [1:07:51<29:04:41,  3.41it/s]
  4%|▍         | 14035/371472 [1:07:51<28:37:19,  3.47it/s]
  4%|▍         | 14036/371472 [1:07:51<28:34:59,  3.47it/s]
  4%|▍         | 14037/371472 [1:07:52<27:20:03,  3.63it/s]
  4%|▍         | 14038/371472 [1:07:52<26:34:16,  3.74it/s]
  4%|▍         | 14039/371472 [1:07:52<27:26:00,  3.62it/s]
  4%|▍         | 14040/371472 [1:07:52<28:12:37,  3.52it/s]
                                                           
{'loss': 4.9944, 'learning_rate': 9.664504729686051e-07, 'epoch': 0.6}

  4%|▍         | 14040/371472 [1:07:52<28:12:37,  3.52it/s]
  4%|▍         | 14041/371472 [1:07:53<28:31:40,  3.48it/s]
  4%|▍         | 14042/371472 [1:07:53<28:20:59,  3.50it/s]
  4%|▍         | 14043/371472 [1:07:53<28:41:54,  3.46it/s]
  4%|▍         | 14044/371472 [1:07:54<28:09:38,  3.53it/s]
  4%|▍         | 14045/371472 [1:07:54<27:50:11,  3.57it/s]
  4%|▍         | 14046/371472 [1:07:54<26:47:40,  3.71it/s]
  4%|▍         | 14047/371472 [1:07:54<26:11:14,  3.79it/s]
  4%|▍         | 14048/371472 [1:07:55<27:54:56,  3.56it/s]
  4%|▍         | 14049/371472 [1:07:55<27:46:53,  3.57it/s]
  4%|▍         | 14050/371472 [1:07:55<27:17:52,  3.64it/s]
  4%|▍         | 14051/371472 [1:07:55<26:41:39,  3.72it/s]
  4%|▍         | 14052/371472 [1:07:56<27:23:52,  3.62it/s]
  4%|▍         | 14053/371472 [1:07:56<26:55:42,  3.69it/s]
  4%|▍         | 14054/371472 [1:07:56<26:14:12,  3.78it/s]
  4%|▍         | 14055/371472 [1:07:56<25:42:51,  3.86it/s]
  4%|▍         | 14056/371472 [1:07:57<25:34:40,  3.88it/s]
  4%|▍         | 14057/371472 [1:07:57<26:05:53,  3.80it/s]
  4%|▍         | 14058/371472 [1:07:57<26:04:01,  3.81it/s]
  4%|▍         | 14059/371472 [1:07:58<25:57:23,  3.82it/s]
  4%|▍         | 14060/371472 [1:07:58<25:50:33,  3.84it/s]
                                                           
{'loss': 4.8301, 'learning_rate': 9.664019909931262e-07, 'epoch': 0.61}

  4%|▍         | 14060/371472 [1:07:58<25:50:33,  3.84it/s]
  4%|▍         | 14061/371472 [1:07:58<26:26:33,  3.75it/s]
  4%|▍         | 14062/371472 [1:07:58<26:58:03,  3.68it/s]
  4%|▍         | 14063/371472 [1:07:59<26:37:52,  3.73it/s]
  4%|▍         | 14064/371472 [1:07:59<27:28:15,  3.61it/s]
  4%|▍         | 14065/371472 [1:07:59<27:03:28,  3.67it/s]
  4%|▍         | 14066/371472 [1:07:59<26:22:49,  3.76it/s]
  4%|▍         | 14067/371472 [1:08:00<26:35:31,  3.73it/s]
  4%|▍         | 14068/371472 [1:08:00<28:50:41,  3.44it/s]
  4%|▍         | 14069/371472 [1:08:00<29:02:24,  3.42it/s]
  4%|▍         | 14070/371472 [1:08:01<28:03:19,  3.54it/s]
  4%|▍         | 14071/371472 [1:08:01<27:15:46,  3.64it/s]
  4%|▍         | 14072/371472 [1:08:01<30:56:58,  3.21it/s]
  4%|▍         | 14073/371472 [1:08:02<34:23:08,  2.89it/s]
  4%|▍         | 14074/371472 [1:08:02<31:53:39,  3.11it/s]
  4%|▍         | 14075/371472 [1:08:02<29:52:15,  3.32it/s]
  4%|▍         | 14076/371472 [1:08:02<28:24:10,  3.50it/s]
  4%|▍         | 14077/371472 [1:08:03<27:29:33,  3.61it/s]
  4%|▍         | 14078/371472 [1:08:03<27:19:54,  3.63it/s]
  4%|▍         | 14079/371472 [1:08:03<26:59:15,  3.68it/s]
  4%|▍         | 14080/371472 [1:08:04<28:10:02,  3.52it/s]
                                                           
{'loss': 4.8497, 'learning_rate': 9.663535090176475e-07, 'epoch': 0.61}

  4%|▍         | 14080/371472 [1:08:04<28:10:02,  3.52it/s]
  4%|▍         | 14081/371472 [1:08:04<28:22:09,  3.50it/s]
  4%|▍         | 14082/371472 [1:08:04<29:53:58,  3.32it/s]
  4%|▍         | 14083/371472 [1:08:04<28:19:48,  3.50it/s]
  4%|▍         | 14084/371472 [1:08:05<28:00:58,  3.54it/s]
  4%|▍         | 14085/371472 [1:08:05<26:51:55,  3.70it/s]
  4%|▍         | 14086/371472 [1:08:05<27:12:45,  3.65it/s]
  4%|▍         | 14087/371472 [1:08:05<27:37:02,  3.59it/s]
  4%|▍         | 14088/371472 [1:08:06<28:25:34,  3.49it/s]
  4%|▍         | 14089/371472 [1:08:06<27:05:25,  3.66it/s]
  4%|▍         | 14090/371472 [1:08:06<28:35:15,  3.47it/s]
  4%|▍         | 14091/371472 [1:08:07<30:01:56,  3.31it/s]
  4%|▍         | 14092/371472 [1:08:07<29:18:35,  3.39it/s]
  4%|▍         | 14093/371472 [1:08:07<27:48:40,  3.57it/s]
  4%|▍         | 14094/371472 [1:08:08<29:02:30,  3.42it/s]
  4%|▍         | 14095/371472 [1:08:08<28:22:54,  3.50it/s]
  4%|▍         | 14096/371472 [1:08:08<29:25:28,  3.37it/s]
  4%|▍         | 14097/371472 [1:08:08<28:37:59,  3.47it/s]
  4%|▍         | 14098/371472 [1:08:09<27:18:17,  3.64it/s]
  4%|▍         | 14099/371472 [1:08:09<30:01:21,  3.31it/s]
  4%|▍         | 14100/371472 [1:08:09<29:44:26,  3.34it/s]
                                                           
{'loss': 4.7864, 'learning_rate': 9.663050270421686e-07, 'epoch': 0.61}

  4%|▍         | 14100/371472 [1:08:09<29:44:26,  3.34it/s]
  4%|▍         | 14101/371472 [1:08:10<29:11:42,  3.40it/s]
  4%|▍         | 14102/371472 [1:08:10<28:24:20,  3.49it/s]
  4%|▍         | 14103/371472 [1:08:10<28:28:12,  3.49it/s]
  4%|▍         | 14104/371472 [1:08:10<27:37:00,  3.59it/s]
  4%|▍         | 14105/371472 [1:08:11<29:22:51,  3.38it/s]
  4%|▍         | 14106/371472 [1:08:11<28:39:02,  3.46it/s]
  4%|▍         | 14107/371472 [1:08:11<29:04:53,  3.41it/s]
  4%|▍         | 14108/371472 [1:08:12<29:10:49,  3.40it/s]
  4%|▍         | 14109/371472 [1:08:12<28:09:21,  3.53it/s]
  4%|▍         | 14110/371472 [1:08:12<28:29:25,  3.48it/s]
  4%|▍         | 14111/371472 [1:08:12<28:21:45,  3.50it/s]
  4%|▍         | 14112/371472 [1:08:13<27:31:49,  3.61it/s]
  4%|▍         | 14113/371472 [1:08:13<26:56:18,  3.68it/s]
  4%|▍         | 14114/371472 [1:08:13<26:52:21,  3.69it/s]
  4%|▍         | 14115/371472 [1:08:14<28:48:43,  3.45it/s]
  4%|▍         | 14116/371472 [1:08:14<27:55:40,  3.55it/s]
  4%|▍         | 14117/371472 [1:08:14<27:35:05,  3.60it/s]
  4%|▍         | 14118/371472 [1:08:14<27:19:00,  3.63it/s]
  4%|▍         | 14119/371472 [1:08:15<30:25:53,  3.26it/s]
  4%|▍         | 14120/371472 [1:08:15<29:00:36,  3.42it/s]
                                                           
{'loss': 4.9266, 'learning_rate': 9.662565450666896e-07, 'epoch': 0.61}

  4%|▍         | 14120/371472 [1:08:15<29:00:36,  3.42it/s]
  4%|▍         | 14121/371472 [1:08:15<28:55:47,  3.43it/s]
  4%|▍         | 14122/371472 [1:08:16<33:37:22,  2.95it/s]
  4%|▍         | 14123/371472 [1:08:16<31:18:46,  3.17it/s]
  4%|▍         | 14124/371472 [1:08:16<30:59:39,  3.20it/s]
  4%|▍         | 14125/371472 [1:08:17<30:15:12,  3.28it/s]
  4%|▍         | 14126/371472 [1:08:17<29:55:57,  3.32it/s]
  4%|▍         | 14127/371472 [1:08:17<28:51:34,  3.44it/s]
  4%|▍         | 14128/371472 [1:08:17<29:05:46,  3.41it/s]
  4%|▍         | 14129/371472 [1:08:18<28:22:19,  3.50it/s]
  4%|▍         | 14130/371472 [1:08:18<27:35:59,  3.60it/s]
  4%|▍         | 14131/371472 [1:08:18<27:53:09,  3.56it/s]
  4%|▍         | 14132/371472 [1:08:19<27:07:28,  3.66it/s]
  4%|▍         | 14133/371472 [1:08:19<27:14:27,  3.64it/s]
  4%|▍         | 14134/371472 [1:08:19<28:52:09,  3.44it/s]
  4%|▍         | 14135/371472 [1:08:19<27:54:28,  3.56it/s]
  4%|▍         | 14136/371472 [1:08:20<27:45:54,  3.57it/s]
  4%|▍         | 14137/371472 [1:08:20<26:55:55,  3.69it/s]
  4%|▍         | 14138/371472 [1:08:20<27:02:40,  3.67it/s]
  4%|▍         | 14139/371472 [1:08:20<26:50:48,  3.70it/s]
  4%|▍         | 14140/371472 [1:08:21<27:34:56,  3.60it/s]
                                                           
{'loss': 4.8071, 'learning_rate': 9.662080630912107e-07, 'epoch': 0.61}

  4%|▍         | 14140/371472 [1:08:21<27:34:56,  3.60it/s]
  4%|▍         | 14141/371472 [1:08:21<27:18:35,  3.63it/s]
  4%|▍         | 14142/371472 [1:08:21<28:30:59,  3.48it/s]
  4%|▍         | 14143/371472 [1:08:22<28:09:26,  3.53it/s]
  4%|▍         | 14144/371472 [1:08:22<28:34:10,  3.47it/s]
  4%|▍         | 14145/371472 [1:08:22<28:51:48,  3.44it/s]
  4%|▍         | 14146/371472 [1:08:23<29:10:48,  3.40it/s]
  4%|▍         | 14147/371472 [1:08:23<28:22:40,  3.50it/s]
  4%|▍         | 14148/371472 [1:08:23<28:36:45,  3.47it/s]
  4%|▍         | 14149/371472 [1:08:23<28:08:12,  3.53it/s]
  4%|▍         | 14150/371472 [1:08:24<28:01:03,  3.54it/s]
  4%|▍         | 14151/371472 [1:08:24<27:05:08,  3.66it/s]
  4%|▍         | 14152/371472 [1:08:24<29:17:10,  3.39it/s]
  4%|▍         | 14153/371472 [1:08:25<29:25:55,  3.37it/s]
  4%|▍         | 14154/371472 [1:08:25<28:38:19,  3.47it/s]
  4%|▍         | 14155/371472 [1:08:25<28:28:47,  3.49it/s]
  4%|▍         | 14156/371472 [1:08:25<30:26:47,  3.26it/s]
  4%|▍         | 14157/371472 [1:08:26<29:18:57,  3.39it/s]
  4%|▍         | 14158/371472 [1:08:26<30:22:55,  3.27it/s]
  4%|▍         | 14159/371472 [1:08:26<29:10:42,  3.40it/s]
  4%|▍         | 14160/371472 [1:08:27<30:04:21,  3.30it/s]
                                                           
{'loss': 4.6743, 'learning_rate': 9.661595811157318e-07, 'epoch': 0.61}

  4%|▍         | 14160/371472 [1:08:27<30:04:21,  3.30it/s]
  4%|▍         | 14161/371472 [1:08:27<29:56:25,  3.32it/s]
  4%|▍         | 14162/371472 [1:08:27<30:34:35,  3.25it/s]
  4%|▍         | 14163/371472 [1:08:27<28:58:23,  3.43it/s]
  4%|▍         | 14164/371472 [1:08:28<28:21:05,  3.50it/s]
  4%|▍         | 14165/371472 [1:08:28<29:51:00,  3.33it/s]
  4%|▍         | 14166/371472 [1:08:28<28:30:56,  3.48it/s]
  4%|▍         | 14167/371472 [1:08:29<27:17:34,  3.64it/s]
  4%|▍         | 14168/371472 [1:08:29<26:23:27,  3.76it/s]
  4%|▍         | 14169/371472 [1:08:29<26:20:17,  3.77it/s]
  4%|▍         | 14170/371472 [1:08:29<26:21:03,  3.77it/s]
  4%|▍         | 14171/371472 [1:08:30<26:11:02,  3.79it/s]
  4%|▍         | 14172/371472 [1:08:30<29:58:21,  3.31it/s]
  4%|▍         | 14173/371472 [1:08:30<29:10:56,  3.40it/s]
  4%|▍         | 14174/371472 [1:08:31<28:06:16,  3.53it/s]
  4%|▍         | 14175/371472 [1:08:31<28:11:13,  3.52it/s]
  4%|▍         | 14176/371472 [1:08:31<28:28:42,  3.49it/s]
  4%|▍         | 14177/371472 [1:08:31<30:26:20,  3.26it/s]
  4%|▍         | 14178/371472 [1:08:32<30:58:02,  3.20it/s]
  4%|▍         | 14179/371472 [1:08:32<31:23:11,  3.16it/s]
  4%|▍         | 14180/371472 [1:08:32<29:52:43,  3.32it/s]
                                                           
{'loss': 4.532, 'learning_rate': 9.66111099140253e-07, 'epoch': 0.61}

  4%|▍         | 14180/371472 [1:08:32<29:52:43,  3.32it/s]
  4%|▍         | 14181/371472 [1:08:33<29:07:20,  3.41it/s]
  4%|▍         | 14182/371472 [1:08:33<28:28:15,  3.49it/s]
  4%|▍         | 14183/371472 [1:08:33<30:30:20,  3.25it/s]
  4%|▍         | 14184/371472 [1:08:34<29:46:54,  3.33it/s]
  4%|▍         | 14185/371472 [1:08:34<28:37:30,  3.47it/s]
  4%|▍         | 14186/371472 [1:08:34<28:50:46,  3.44it/s]
  4%|▍         | 14187/371472 [1:08:34<29:31:46,  3.36it/s]
  4%|▍         | 14188/371472 [1:08:35<29:53:45,  3.32it/s]
  4%|▍         | 14189/371472 [1:08:35<29:12:55,  3.40it/s]
  4%|▍         | 14190/371472 [1:08:35<28:11:37,  3.52it/s]
  4%|▍         | 14191/371472 [1:08:36<28:32:15,  3.48it/s]
  4%|▍         | 14192/371472 [1:08:36<28:53:31,  3.44it/s]
  4%|▍         | 14193/371472 [1:08:36<27:50:09,  3.57it/s]
  4%|▍         | 14194/371472 [1:08:36<28:37:26,  3.47it/s]
  4%|▍         | 14195/371472 [1:08:37<27:26:10,  3.62it/s]
  4%|▍         | 14196/371472 [1:08:37<27:29:30,  3.61it/s]
  4%|▍         | 14197/371472 [1:08:37<27:34:36,  3.60it/s]
  4%|▍         | 14198/371472 [1:08:38<28:57:35,  3.43it/s]
  4%|▍         | 14199/371472 [1:08:38<28:41:53,  3.46it/s]
  4%|▍         | 14200/371472 [1:08:38<29:14:00,  3.39it/s]
                                                           
{'loss': 4.9564, 'learning_rate': 9.66062617164774e-07, 'epoch': 0.61}

  4%|▍         | 14200/371472 [1:08:38<29:14:00,  3.39it/s]
  4%|▍         | 14201/371472 [1:08:38<28:10:15,  3.52it/s]
  4%|▍         | 14202/371472 [1:08:39<28:23:07,  3.50it/s]
  4%|▍         | 14203/371472 [1:08:39<28:24:00,  3.49it/s]
  4%|▍         | 14204/371472 [1:08:39<27:34:33,  3.60it/s]
  4%|▍         | 14205/371472 [1:08:40<26:54:58,  3.69it/s]
  4%|▍         | 14206/371472 [1:08:40<26:39:24,  3.72it/s]
  4%|▍         | 14207/371472 [1:08:40<28:23:20,  3.50it/s]
  4%|▍         | 14208/371472 [1:08:40<27:59:49,  3.54it/s]
  4%|▍         | 14209/371472 [1:08:41<27:03:00,  3.67it/s]
  4%|▍         | 14210/371472 [1:08:41<26:44:23,  3.71it/s]
  4%|▍         | 14211/371472 [1:08:41<27:24:07,  3.62it/s]
  4%|▍         | 14212/371472 [1:08:41<27:14:20,  3.64it/s]
  4%|▍         | 14213/371472 [1:08:42<26:42:43,  3.72it/s]
  4%|▍         | 14214/371472 [1:08:42<28:01:48,  3.54it/s]
  4%|▍         | 14215/371472 [1:08:42<28:43:46,  3.45it/s]
  4%|▍         | 14216/371472 [1:08:43<29:49:09,  3.33it/s]
  4%|▍         | 14217/371472 [1:08:43<29:37:57,  3.35it/s]
  4%|▍         | 14218/371472 [1:08:43<31:49:02,  3.12it/s]
  4%|▍         | 14219/371472 [1:08:44<30:00:01,  3.31it/s]
  4%|▍         | 14220/371472 [1:08:44<29:41:24,  3.34it/s]
                                                           
{'loss': 4.8359, 'learning_rate': 9.660141351892952e-07, 'epoch': 0.61}

  4%|▍         | 14220/371472 [1:08:44<29:41:24,  3.34it/s]
  4%|▍         | 14221/371472 [1:08:44<29:08:28,  3.41it/s]
  4%|▍         | 14222/371472 [1:08:44<28:07:59,  3.53it/s]
  4%|▍         | 14223/371472 [1:08:45<29:37:45,  3.35it/s]
  4%|▍         | 14224/371472 [1:08:45<29:08:35,  3.41it/s]
  4%|▍         | 14225/371472 [1:08:45<29:03:39,  3.41it/s]
  4%|▍         | 14226/371472 [1:08:46<28:38:49,  3.46it/s]
  4%|▍         | 14227/371472 [1:08:46<28:02:31,  3.54it/s]
  4%|▍         | 14228/371472 [1:08:46<28:40:47,  3.46it/s]
  4%|▍         | 14229/371472 [1:08:46<27:46:35,  3.57it/s]
  4%|▍         | 14230/371472 [1:08:47<27:36:41,  3.59it/s]
  4%|▍         | 14231/371472 [1:08:47<27:26:19,  3.62it/s]
  4%|▍         | 14232/371472 [1:08:47<28:07:01,  3.53it/s]
  4%|▍         | 14233/371472 [1:08:48<29:41:07,  3.34it/s]
  4%|▍         | 14234/371472 [1:08:48<28:41:18,  3.46it/s]
  4%|▍         | 14235/371472 [1:08:48<29:18:47,  3.39it/s]
  4%|▍         | 14236/371472 [1:08:49<29:09:13,  3.40it/s]
  4%|▍         | 14237/371472 [1:08:49<27:38:47,  3.59it/s]
  4%|▍         | 14238/371472 [1:08:49<29:54:41,  3.32it/s]
  4%|▍         | 14239/371472 [1:08:49<30:18:59,  3.27it/s]
  4%|▍         | 14240/371472 [1:08:50<30:23:04,  3.27it/s]
                                                           
{'loss': 4.7172, 'learning_rate': 9.659656532138163e-07, 'epoch': 0.61}

  4%|▍         | 14240/371472 [1:08:50<30:23:04,  3.27it/s]
  4%|▍         | 14241/371472 [1:08:50<29:45:48,  3.33it/s]
  4%|▍         | 14242/371472 [1:08:50<30:32:54,  3.25it/s]
  4%|▍         | 14243/371472 [1:08:51<30:37:07,  3.24it/s]
  4%|▍         | 14244/371472 [1:08:51<29:08:40,  3.40it/s]
  4%|▍         | 14245/371472 [1:08:51<27:52:00,  3.56it/s]
  4%|▍         | 14246/371472 [1:08:52<29:54:47,  3.32it/s]
  4%|▍         | 14247/371472 [1:08:52<31:46:04,  3.12it/s]
  4%|▍         | 14248/371472 [1:08:52<30:27:46,  3.26it/s]
  4%|▍         | 14249/371472 [1:08:52<29:33:11,  3.36it/s]
  4%|▍         | 14250/371472 [1:08:53<28:59:57,  3.42it/s]
  4%|▍         | 14251/371472 [1:08:53<29:09:41,  3.40it/s]
  4%|▍         | 14252/371472 [1:08:53<29:12:19,  3.40it/s]
  4%|▍         | 14253/371472 [1:08:54<28:51:45,  3.44it/s]
  4%|▍         | 14254/371472 [1:08:54<28:37:34,  3.47it/s]
  4%|▍         | 14255/371472 [1:08:54<34:08:01,  2.91it/s]
  4%|▍         | 14256/371472 [1:08:55<32:04:59,  3.09it/s]
  4%|▍         | 14257/371472 [1:08:55<32:15:29,  3.08it/s]
  4%|▍         | 14258/371472 [1:08:55<31:37:58,  3.14it/s]
  4%|▍         | 14259/371472 [1:08:56<30:04:39,  3.30it/s]
  4%|▍         | 14260/371472 [1:08:56<29:35:04,  3.35it/s]
                                                           
{'loss': 4.8027, 'learning_rate': 9.659171712383374e-07, 'epoch': 0.61}

  4%|▍         | 14260/371472 [1:08:56<29:35:04,  3.35it/s]
  4%|▍         | 14261/371472 [1:08:56<29:24:59,  3.37it/s]
  4%|▍         | 14262/371472 [1:08:56<30:32:10,  3.25it/s]
  4%|▍         | 14263/371472 [1:08:57<30:59:51,  3.20it/s]
  4%|▍         | 14264/371472 [1:08:57<29:38:28,  3.35it/s]
  4%|▍         | 14265/371472 [1:08:57<29:01:18,  3.42it/s]
  4%|▍         | 14266/371472 [1:08:58<28:06:09,  3.53it/s]
  4%|▍         | 14267/371472 [1:08:58<27:50:58,  3.56it/s]
  4%|▍         | 14268/371472 [1:08:58<27:11:52,  3.65it/s]
  4%|▍         | 14269/371472 [1:08:58<27:31:11,  3.61it/s]
  4%|▍         | 14270/371472 [1:08:59<28:14:24,  3.51it/s]
  4%|▍         | 14271/371472 [1:08:59<28:47:42,  3.45it/s]
  4%|▍         | 14272/371472 [1:08:59<29:37:51,  3.35it/s]
  4%|▍         | 14273/371472 [1:09:00<29:19:54,  3.38it/s]
  4%|▍         | 14274/371472 [1:09:00<28:26:11,  3.49it/s]
  4%|▍         | 14275/371472 [1:09:00<27:59:39,  3.54it/s]
  4%|▍         | 14276/371472 [1:09:00<27:36:12,  3.59it/s]
  4%|▍         | 14277/371472 [1:09:01<28:17:18,  3.51it/s]
  4%|▍         | 14278/371472 [1:09:01<31:18:50,  3.17it/s]
  4%|▍         | 14279/371472 [1:09:01<30:56:55,  3.21it/s]
  4%|▍         | 14280/371472 [1:09:02<31:24:55,  3.16it/s]
                                                           
{'loss': 4.5783, 'learning_rate': 9.658686892628584e-07, 'epoch': 0.62}

  4%|▍         | 14280/371472 [1:09:02<31:24:55,  3.16it/s]
  4%|▍         | 14281/371472 [1:09:02<30:20:01,  3.27it/s]
  4%|▍         | 14282/371472 [1:09:02<28:49:10,  3.44it/s]
  4%|▍         | 14283/371472 [1:09:03<29:07:08,  3.41it/s]
  4%|▍         | 14284/371472 [1:09:03<28:40:28,  3.46it/s]
  4%|▍         | 14285/371472 [1:09:03<30:40:03,  3.24it/s]
  4%|▍         | 14286/371472 [1:09:04<30:54:16,  3.21it/s]
  4%|▍         | 14287/371472 [1:09:04<30:00:46,  3.31it/s]
  4%|▍         | 14288/371472 [1:09:04<29:23:25,  3.38it/s]
  4%|▍         | 14289/371472 [1:09:04<29:34:12,  3.36it/s]
  4%|▍         | 14290/371472 [1:09:05<28:55:02,  3.43it/s]
  4%|▍         | 14291/371472 [1:09:05<27:38:34,  3.59it/s]
  4%|▍         | 14292/371472 [1:09:05<27:15:23,  3.64it/s]
  4%|▍         | 14293/371472 [1:09:05<27:31:49,  3.60it/s]
  4%|▍         | 14294/371472 [1:09:06<26:54:07,  3.69it/s]
  4%|▍         | 14295/371472 [1:09:06<28:17:21,  3.51it/s]
  4%|▍         | 14296/371472 [1:09:06<28:00:34,  3.54it/s]
  4%|▍         | 14297/371472 [1:09:07<28:05:51,  3.53it/s]
  4%|▍         | 14298/371472 [1:09:07<27:39:11,  3.59it/s]
  4%|▍         | 14299/371472 [1:09:07<27:04:08,  3.67it/s]
  4%|▍         | 14300/371472 [1:09:07<27:01:39,  3.67it/s]
                                                           
{'loss': 4.7292, 'learning_rate': 9.658202072873795e-07, 'epoch': 0.62}

  4%|▍         | 14300/371472 [1:09:07<27:01:39,  3.67it/s]
  4%|▍         | 14301/371472 [1:09:08<26:53:06,  3.69it/s]
  4%|▍         | 14302/371472 [1:09:08<27:32:16,  3.60it/s]
  4%|▍         | 14303/371472 [1:09:08<26:56:01,  3.68it/s]
  4%|▍         | 14304/371472 [1:09:08<27:38:11,  3.59it/s]
  4%|▍         | 14305/371472 [1:09:09<28:45:18,  3.45it/s]
  4%|▍         | 14306/371472 [1:09:09<29:15:39,  3.39it/s]
  4%|▍         | 14307/371472 [1:09:09<28:38:23,  3.46it/s]
  4%|▍         | 14308/371472 [1:09:10<28:44:16,  3.45it/s]
  4%|▍         | 14309/371472 [1:09:10<28:09:53,  3.52it/s]
  4%|▍         | 14310/371472 [1:09:10<28:16:39,  3.51it/s]
  4%|▍         | 14311/371472 [1:09:11<28:40:01,  3.46it/s]
  4%|▍         | 14312/371472 [1:09:11<27:40:30,  3.58it/s]
  4%|▍         | 14313/371472 [1:09:11<27:29:47,  3.61it/s]
  4%|▍         | 14314/371472 [1:09:11<27:35:41,  3.60it/s]
  4%|▍         | 14315/371472 [1:09:12<26:42:35,  3.71it/s]
  4%|▍         | 14316/371472 [1:09:12<26:59:42,  3.68it/s]
  4%|▍         | 14317/371472 [1:09:12<28:12:17,  3.52it/s]
  4%|▍         | 14318/371472 [1:09:12<28:10:11,  3.52it/s]
  4%|▍         | 14319/371472 [1:09:13<28:30:14,  3.48it/s]
  4%|▍         | 14320/371472 [1:09:13<28:39:38,  3.46it/s]
                                                           
{'loss': 4.5805, 'learning_rate': 9.657717253119008e-07, 'epoch': 0.62}

  4%|▍         | 14320/371472 [1:09:13<28:39:38,  3.46it/s]
  4%|▍         | 14321/371472 [1:09:13<28:48:20,  3.44it/s]
  4%|▍         | 14322/371472 [1:09:14<29:10:16,  3.40it/s]
  4%|▍         | 14323/371472 [1:09:14<30:24:03,  3.26it/s]
  4%|▍         | 14324/371472 [1:09:14<30:42:41,  3.23it/s]
  4%|▍         | 14325/371472 [1:09:15<29:43:41,  3.34it/s]
  4%|▍         | 14326/371472 [1:09:15<29:15:02,  3.39it/s]
  4%|▍         | 14327/371472 [1:09:15<28:27:26,  3.49it/s]
  4%|▍         | 14328/371472 [1:09:15<27:59:10,  3.54it/s]
  4%|▍         | 14329/371472 [1:09:16<28:33:41,  3.47it/s]
  4%|▍         | 14330/371472 [1:09:16<28:13:47,  3.51it/s]
  4%|▍         | 14331/371472 [1:09:16<27:58:09,  3.55it/s]
  4%|▍         | 14332/371472 [1:09:17<28:32:44,  3.48it/s]
  4%|▍         | 14333/371472 [1:09:17<29:57:32,  3.31it/s]
  4%|▍         | 14334/371472 [1:09:17<28:26:23,  3.49it/s]
  4%|▍         | 14335/371472 [1:09:17<28:08:15,  3.53it/s]
  4%|▍         | 14336/371472 [1:09:18<30:41:48,  3.23it/s]
  4%|▍         | 14337/371472 [1:09:18<29:29:45,  3.36it/s]
  4%|▍         | 14338/371472 [1:09:18<28:34:48,  3.47it/s]
  4%|▍         | 14339/371472 [1:09:19<28:17:30,  3.51it/s]
  4%|▍         | 14340/371472 [1:09:19<28:26:30,  3.49it/s]
                                                           
{'loss': 4.6905, 'learning_rate': 9.657232433364216e-07, 'epoch': 0.62}

  4%|▍         | 14340/371472 [1:09:19<28:26:30,  3.49it/s]
  4%|▍         | 14341/371472 [1:09:19<28:00:23,  3.54it/s]
  4%|▍         | 14342/371472 [1:09:19<29:10:47,  3.40it/s]
  4%|▍         | 14343/371472 [1:09:20<27:52:35,  3.56it/s]
  4%|▍         | 14344/371472 [1:09:20<27:55:23,  3.55it/s]
  4%|▍         | 14345/371472 [1:09:20<27:36:11,  3.59it/s]
  4%|▍         | 14346/371472 [1:09:21<27:58:14,  3.55it/s]
  4%|▍         | 14347/371472 [1:09:21<27:24:31,  3.62it/s]
  4%|▍         | 14348/371472 [1:09:21<27:44:02,  3.58it/s]
  4%|▍         | 14349/371472 [1:09:21<27:09:59,  3.65it/s]
  4%|▍         | 14350/371472 [1:09:22<27:18:33,  3.63it/s]
  4%|▍         | 14351/371472 [1:09:22<26:58:35,  3.68it/s]
  4%|▍         | 14352/371472 [1:09:22<26:31:22,  3.74it/s]
  4%|▍         | 14353/371472 [1:09:22<26:05:30,  3.80it/s]
  4%|▍         | 14354/371472 [1:09:23<26:40:00,  3.72it/s]
  4%|▍         | 14355/371472 [1:09:23<26:31:02,  3.74it/s]
  4%|▍         | 14356/371472 [1:09:23<26:24:09,  3.76it/s]
  4%|▍         | 14357/371472 [1:09:23<25:48:26,  3.84it/s]
  4%|▍         | 14358/371472 [1:09:24<26:13:06,  3.78it/s]
  4%|▍         | 14359/371472 [1:09:24<28:36:52,  3.47it/s]
  4%|▍         | 14360/371472 [1:09:24<28:19:59,  3.50it/s]
                                                           
{'loss': 5.0062, 'learning_rate': 9.65674761360943e-07, 'epoch': 0.62}

  4%|▍         | 14360/371472 [1:09:24<28:19:59,  3.50it/s]
  4%|▍         | 14361/371472 [1:09:25<27:26:17,  3.62it/s]
  4%|▍         | 14362/371472 [1:09:25<28:37:31,  3.47it/s]
  4%|▍         | 14363/371472 [1:09:25<28:38:20,  3.46it/s]
  4%|▍         | 14364/371472 [1:09:26<29:43:25,  3.34it/s]
  4%|▍         | 14365/371472 [1:09:26<29:46:38,  3.33it/s]
  4%|▍         | 14366/371472 [1:09:26<28:07:44,  3.53it/s]
  4%|▍         | 14367/371472 [1:09:26<27:26:22,  3.62it/s]
  4%|▍         | 14368/371472 [1:09:27<28:06:05,  3.53it/s]
  4%|▍         | 14369/371472 [1:09:27<29:29:49,  3.36it/s]
  4%|▍         | 14370/371472 [1:09:27<28:04:49,  3.53it/s]
  4%|▍         | 14371/371472 [1:09:28<28:13:34,  3.51it/s]
  4%|▍         | 14372/371472 [1:09:28<29:48:01,  3.33it/s]
  4%|▍         | 14373/371472 [1:09:28<28:32:38,  3.48it/s]
  4%|▍         | 14374/371472 [1:09:28<29:14:37,  3.39it/s]
  4%|▍         | 14375/371472 [1:09:29<28:47:24,  3.45it/s]
  4%|▍         | 14376/371472 [1:09:29<27:59:01,  3.54it/s]
  4%|▍         | 14377/371472 [1:09:29<27:56:36,  3.55it/s]
  4%|▍         | 14378/371472 [1:09:30<28:05:08,  3.53it/s]
  4%|▍         | 14379/371472 [1:09:30<29:24:47,  3.37it/s]
  4%|▍         | 14380/371472 [1:09:30<29:04:45,  3.41it/s]
                                                           
{'loss': 4.5667, 'learning_rate': 9.65626279385464e-07, 'epoch': 0.62}

  4%|▍         | 14380/371472 [1:09:30<29:04:45,  3.41it/s]
  4%|▍         | 14381/371472 [1:09:30<28:23:40,  3.49it/s]
  4%|▍         | 14382/371472 [1:09:31<27:58:27,  3.55it/s]
  4%|▍         | 14383/371472 [1:09:31<27:46:50,  3.57it/s]
  4%|▍         | 14384/371472 [1:09:31<28:29:04,  3.48it/s]
  4%|▍         | 14385/371472 [1:09:32<27:59:26,  3.54it/s]
  4%|▍         | 14386/371472 [1:09:32<28:05:02,  3.53it/s]
  4%|▍         | 14387/371472 [1:09:32<28:22:20,  3.50it/s]
  4%|▍         | 14388/371472 [1:09:33<31:20:42,  3.16it/s]
  4%|▍         | 14389/371472 [1:09:33<30:33:05,  3.25it/s]
  4%|▍         | 14390/371472 [1:09:33<30:49:05,  3.22it/s]
  4%|▍         | 14391/371472 [1:09:33<31:38:38,  3.13it/s]
  4%|▍         | 14392/371472 [1:09:34<31:11:09,  3.18it/s]
  4%|▍         | 14393/371472 [1:09:34<31:41:22,  3.13it/s]
  4%|▍         | 14394/371472 [1:09:34<30:36:29,  3.24it/s]
  4%|▍         | 14395/371472 [1:09:35<30:31:25,  3.25it/s]
  4%|▍         | 14396/371472 [1:09:35<28:42:11,  3.46it/s]
  4%|▍         | 14397/371472 [1:09:35<28:30:24,  3.48it/s]
  4%|▍         | 14398/371472 [1:09:36<27:56:43,  3.55it/s]
  4%|▍         | 14399/371472 [1:09:36<26:42:33,  3.71it/s]
  4%|▍         | 14400/371472 [1:09:36<27:03:34,  3.67it/s]
                                                           
{'loss': 4.7865, 'learning_rate': 9.65577797409985e-07, 'epoch': 0.62}

  4%|▍         | 14400/371472 [1:09:36<27:03:34,  3.67it/s]
  4%|▍         | 14401/371472 [1:09:36<26:10:50,  3.79it/s]
  4%|▍         | 14402/371472 [1:09:37<25:40:34,  3.86it/s]
  4%|▍         | 14403/371472 [1:09:37<25:21:18,  3.91it/s]
  4%|▍         | 14404/371472 [1:09:37<25:25:27,  3.90it/s]
  4%|▍         | 14405/371472 [1:09:37<25:38:51,  3.87it/s]
  4%|▍         | 14406/371472 [1:09:38<27:38:27,  3.59it/s]
  4%|▍         | 14407/371472 [1:09:38<28:35:25,  3.47it/s]
  4%|▍         | 14408/371472 [1:09:38<28:23:47,  3.49it/s]
  4%|▍         | 14409/371472 [1:09:38<27:45:52,  3.57it/s]
  4%|▍         | 14410/371472 [1:09:39<28:29:16,  3.48it/s]
  4%|▍         | 14411/371472 [1:09:39<27:55:57,  3.55it/s]
  4%|▍         | 14412/371472 [1:09:39<27:55:23,  3.55it/s]
  4%|▍         | 14413/371472 [1:09:40<27:51:37,  3.56it/s]
  4%|▍         | 14414/371472 [1:09:40<28:39:05,  3.46it/s]
  4%|▍         | 14415/371472 [1:09:40<28:31:09,  3.48it/s]
  4%|▍         | 14416/371472 [1:09:40<28:35:02,  3.47it/s]
  4%|▍         | 14417/371472 [1:09:41<27:30:27,  3.61it/s]
  4%|▍         | 14418/371472 [1:09:41<27:08:07,  3.66it/s]
  4%|▍         | 14419/371472 [1:09:41<27:45:05,  3.57it/s]
  4%|▍         | 14420/371472 [1:09:42<27:43:33,  3.58it/s]
                                                           
{'loss': 4.8152, 'learning_rate': 9.655293154345061e-07, 'epoch': 0.62}

  4%|▍         | 14420/371472 [1:09:42<27:43:33,  3.58it/s]
  4%|▍         | 14421/371472 [1:09:42<27:42:29,  3.58it/s]
  4%|▍         | 14422/371472 [1:09:42<28:40:13,  3.46it/s]
  4%|▍         | 14423/371472 [1:09:42<28:25:34,  3.49it/s]
  4%|▍         | 14424/371472 [1:09:43<27:13:41,  3.64it/s]
  4%|▍         | 14425/371472 [1:09:43<27:05:37,  3.66it/s]
  4%|▍         | 14426/371472 [1:09:43<26:44:30,  3.71it/s]
  4%|▍         | 14427/371472 [1:09:43<26:17:56,  3.77it/s]
  4%|▍         | 14428/371472 [1:09:44<28:06:18,  3.53it/s]
  4%|▍         | 14429/371472 [1:09:44<28:57:55,  3.42it/s]
  4%|▍         | 14430/371472 [1:09:44<27:43:42,  3.58it/s]
  4%|▍         | 14431/371472 [1:09:45<27:13:36,  3.64it/s]
  4%|▍         | 14432/371472 [1:09:45<29:00:31,  3.42it/s]
  4%|▍         | 14433/371472 [1:09:45<28:39:32,  3.46it/s]
  4%|▍         | 14434/371472 [1:09:46<28:08:08,  3.52it/s]
  4%|▍         | 14435/371472 [1:09:46<28:18:52,  3.50it/s]
  4%|▍         | 14436/371472 [1:09:46<28:30:54,  3.48it/s]
  4%|▍         | 14437/371472 [1:09:46<28:25:43,  3.49it/s]
  4%|▍         | 14438/371472 [1:09:47<28:16:59,  3.51it/s]
  4%|▍         | 14439/371472 [1:09:47<29:27:55,  3.37it/s]
  4%|▍         | 14440/371472 [1:09:47<28:29:00,  3.48it/s]
                                                           
{'loss': 5.001, 'learning_rate': 9.654808334590272e-07, 'epoch': 0.62}

  4%|▍         | 14440/371472 [1:09:47<28:29:00,  3.48it/s]
  4%|▍         | 14441/371472 [1:09:48<28:13:15,  3.51it/s]
  4%|▍         | 14442/371472 [1:09:48<29:39:35,  3.34it/s]
  4%|▍         | 14443/371472 [1:09:48<29:56:09,  3.31it/s]
  4%|▍         | 14444/371472 [1:09:48<28:45:00,  3.45it/s]
  4%|▍         | 14445/371472 [1:09:49<28:17:44,  3.50it/s]
  4%|▍         | 14446/371472 [1:09:49<27:09:19,  3.65it/s]
  4%|▍         | 14447/371472 [1:09:49<28:24:50,  3.49it/s]
  4%|▍         | 14448/371472 [1:09:50<27:14:57,  3.64it/s]
  4%|▍         | 14449/371472 [1:09:50<26:41:35,  3.72it/s]
  4%|▍         | 14450/371472 [1:09:50<27:14:42,  3.64it/s]
  4%|▍         | 14451/371472 [1:09:50<27:56:05,  3.55it/s]
  4%|▍         | 14452/371472 [1:09:51<27:01:14,  3.67it/s]
  4%|▍         | 14453/371472 [1:09:51<28:41:36,  3.46it/s]
  4%|▍         | 14454/371472 [1:09:51<29:03:02,  3.41it/s]
  4%|▍         | 14455/371472 [1:09:52<29:45:40,  3.33it/s]
  4%|▍         | 14456/371472 [1:09:52<29:05:06,  3.41it/s]
  4%|▍         | 14457/371472 [1:09:52<28:35:48,  3.47it/s]
  4%|▍         | 14458/371472 [1:09:52<29:29:18,  3.36it/s]
  4%|▍         | 14459/371472 [1:09:53<28:13:08,  3.51it/s]
  4%|▍         | 14460/371472 [1:09:53<27:04:46,  3.66it/s]
                                                           
{'loss': 4.568, 'learning_rate': 9.654323514835485e-07, 'epoch': 0.62}

  4%|▍         | 14460/371472 [1:09:53<27:04:46,  3.66it/s]
  4%|▍         | 14461/371472 [1:09:53<27:19:10,  3.63it/s]
  4%|▍         | 14462/371472 [1:09:53<27:19:18,  3.63it/s]
  4%|▍         | 14463/371472 [1:09:54<26:41:29,  3.72it/s]
  4%|▍         | 14464/371472 [1:09:54<27:45:23,  3.57it/s]
  4%|▍         | 14465/371472 [1:09:54<27:35:17,  3.59it/s]
  4%|▍         | 14466/371472 [1:09:55<27:04:06,  3.66it/s]
  4%|▍         | 14467/371472 [1:09:55<27:08:25,  3.65it/s]
  4%|▍         | 14468/371472 [1:09:55<27:02:15,  3.67it/s]
  4%|▍         | 14469/371472 [1:09:55<27:40:41,  3.58it/s]
  4%|▍         | 14470/371472 [1:09:56<27:54:28,  3.55it/s]
  4%|▍         | 14471/371472 [1:09:56<27:36:22,  3.59it/s]
  4%|▍         | 14472/371472 [1:09:56<27:03:04,  3.67it/s]
  4%|▍         | 14473/371472 [1:09:57<27:36:26,  3.59it/s]
  4%|▍         | 14474/371472 [1:09:57<27:07:20,  3.66it/s]
  4%|▍         | 14475/371472 [1:09:57<26:58:06,  3.68it/s]
  4%|▍         | 14476/371472 [1:09:57<27:13:44,  3.64it/s]
  4%|▍         | 14477/371472 [1:09:58<27:36:08,  3.59it/s]
  4%|▍         | 14478/371472 [1:09:58<26:53:46,  3.69it/s]
  4%|▍         | 14479/371472 [1:09:58<27:12:35,  3.64it/s]
  4%|▍         | 14480/371472 [1:09:58<28:02:01,  3.54it/s]
                                                           
{'loss': 5.1036, 'learning_rate': 9.653838695080696e-07, 'epoch': 0.62}

  4%|▍         | 14480/371472 [1:09:58<28:02:01,  3.54it/s]
  4%|▍         | 14481/371472 [1:09:59<29:12:53,  3.39it/s]
  4%|▍         | 14482/371472 [1:09:59<27:57:54,  3.55it/s]
  4%|▍         | 14483/371472 [1:09:59<28:07:43,  3.53it/s]
  4%|▍         | 14484/371472 [1:10:00<28:29:14,  3.48it/s]
  4%|▍         | 14485/371472 [1:10:00<28:47:38,  3.44it/s]
  4%|▍         | 14486/371472 [1:10:00<28:52:56,  3.43it/s]
  4%|▍         | 14487/371472 [1:10:01<30:41:15,  3.23it/s]
  4%|▍         | 14488/371472 [1:10:01<29:03:22,  3.41it/s]
  4%|▍         | 14489/371472 [1:10:01<28:21:17,  3.50it/s]
  4%|▍         | 14490/371472 [1:10:01<30:55:39,  3.21it/s]
  4%|▍         | 14491/371472 [1:10:02<29:39:36,  3.34it/s]
  4%|▍         | 14492/371472 [1:10:02<30:15:42,  3.28it/s]
  4%|▍         | 14493/371472 [1:10:02<29:38:46,  3.34it/s]
  4%|▍         | 14494/371472 [1:10:03<28:24:01,  3.49it/s]
  4%|▍         | 14495/371472 [1:10:03<27:27:20,  3.61it/s]
  4%|▍         | 14496/371472 [1:10:03<28:08:13,  3.52it/s]
  4%|▍         | 14497/371472 [1:10:03<27:57:39,  3.55it/s]
  4%|▍         | 14498/371472 [1:10:04<27:47:48,  3.57it/s]
  4%|▍         | 14499/371472 [1:10:04<27:30:14,  3.61it/s]
  4%|▍         | 14500/371472 [1:10:04<28:50:28,  3.44it/s]
                                                           
{'loss': 4.6376, 'learning_rate': 9.653353875325906e-07, 'epoch': 0.62}

  4%|▍         | 14500/371472 [1:10:04<28:50:28,  3.44it/s]
  4%|▍         | 14501/371472 [1:10:05<29:14:06,  3.39it/s]
  4%|▍         | 14502/371472 [1:10:05<28:24:53,  3.49it/s]
  4%|▍         | 14503/371472 [1:10:05<28:01:27,  3.54it/s]
  4%|▍         | 14504/371472 [1:10:06<30:30:23,  3.25it/s]
  4%|▍         | 14505/371472 [1:10:06<30:24:18,  3.26it/s]
  4%|▍         | 14506/371472 [1:10:06<29:21:54,  3.38it/s]
  4%|▍         | 14507/371472 [1:10:06<28:29:32,  3.48it/s]
  4%|▍         | 14508/371472 [1:10:07<28:18:55,  3.50it/s]
  4%|▍         | 14509/371472 [1:10:07<27:28:19,  3.61it/s]
  4%|▍         | 14510/371472 [1:10:07<27:46:03,  3.57it/s]
  4%|▍         | 14511/371472 [1:10:08<29:18:45,  3.38it/s]
  4%|▍         | 14512/371472 [1:10:08<28:49:15,  3.44it/s]
  4%|▍         | 14513/371472 [1:10:08<30:50:31,  3.21it/s]
  4%|▍         | 14514/371472 [1:10:08<29:51:26,  3.32it/s]
  4%|▍         | 14515/371472 [1:10:09<28:24:35,  3.49it/s]
  4%|▍         | 14516/371472 [1:10:09<27:15:48,  3.64it/s]
  4%|▍         | 14517/371472 [1:10:09<28:26:16,  3.49it/s]
  4%|▍         | 14518/371472 [1:10:10<28:35:45,  3.47it/s]
  4%|▍         | 14519/371472 [1:10:10<27:22:39,  3.62it/s]
  4%|▍         | 14520/371472 [1:10:10<27:35:45,  3.59it/s]
                                                           
{'loss': 4.8825, 'learning_rate': 9.652869055571117e-07, 'epoch': 0.63}

  4%|▍         | 14520/371472 [1:10:10<27:35:45,  3.59it/s]
  4%|▍         | 14521/371472 [1:10:10<27:07:30,  3.66it/s]
  4%|▍         | 14522/371472 [1:10:11<27:22:45,  3.62it/s]
  4%|▍         | 14523/371472 [1:10:11<27:04:06,  3.66it/s]
  4%|▍         | 14524/371472 [1:10:11<27:51:41,  3.56it/s]
  4%|▍         | 14525/371472 [1:10:11<28:46:53,  3.44it/s]
  4%|▍         | 14526/371472 [1:10:12<28:17:49,  3.50it/s]
  4%|▍         | 14527/371472 [1:10:12<28:24:15,  3.49it/s]
  4%|▍         | 14528/371472 [1:10:12<27:30:05,  3.61it/s]
  4%|▍         | 14529/371472 [1:10:13<26:53:26,  3.69it/s]
  4%|▍         | 14530/371472 [1:10:13<27:28:34,  3.61it/s]
  4%|▍         | 14531/371472 [1:10:13<28:11:31,  3.52it/s]
  4%|▍         | 14532/371472 [1:10:14<30:31:47,  3.25it/s]
  4%|▍         | 14533/371472 [1:10:14<32:32:46,  3.05it/s]
  4%|▍         | 14534/371472 [1:10:14<30:50:10,  3.22it/s]
  4%|▍         | 14535/371472 [1:10:15<32:24:29,  3.06it/s]
  4%|▍         | 14536/371472 [1:10:15<31:16:39,  3.17it/s]
  4%|▍         | 14537/371472 [1:10:15<31:05:19,  3.19it/s]
  4%|▍         | 14538/371472 [1:10:15<29:26:46,  3.37it/s]
  4%|▍         | 14539/371472 [1:10:16<28:23:48,  3.49it/s]
  4%|▍         | 14540/371472 [1:10:16<28:40:30,  3.46it/s]
                                                           
{'loss': 4.8115, 'learning_rate': 9.652384235816328e-07, 'epoch': 0.63}

  4%|▍         | 14540/371472 [1:10:16<28:40:30,  3.46it/s]
  4%|▍         | 14541/371472 [1:10:16<28:27:16,  3.48it/s]
  4%|▍         | 14542/371472 [1:10:16<27:21:25,  3.62it/s]
  4%|▍         | 14543/371472 [1:10:17<28:08:10,  3.52it/s]
  4%|▍         | 14544/371472 [1:10:17<27:49:29,  3.56it/s]
  4%|▍         | 14545/371472 [1:10:17<28:09:36,  3.52it/s]
  4%|▍         | 14546/371472 [1:10:18<32:13:22,  3.08it/s]
  4%|▍         | 14547/371472 [1:10:18<30:15:05,  3.28it/s]
  4%|▍         | 14548/371472 [1:10:18<32:20:52,  3.06it/s]
  4%|▍         | 14549/371472 [1:10:19<30:25:26,  3.26it/s]
  4%|▍         | 14550/371472 [1:10:19<30:22:08,  3.26it/s]
  4%|▍         | 14551/371472 [1:10:19<29:46:09,  3.33it/s]
  4%|▍         | 14552/371472 [1:10:20<28:56:31,  3.43it/s]
  4%|▍         | 14553/371472 [1:10:20<28:24:26,  3.49it/s]
  4%|▍         | 14554/371472 [1:10:20<29:55:35,  3.31it/s]
  4%|▍         | 14555/371472 [1:10:20<28:42:02,  3.45it/s]
  4%|▍         | 14556/371472 [1:10:21<29:04:03,  3.41it/s]
  4%|▍         | 14557/371472 [1:10:21<29:23:09,  3.37it/s]
  4%|▍         | 14558/371472 [1:10:21<29:34:31,  3.35it/s]
  4%|▍         | 14559/371472 [1:10:22<28:09:28,  3.52it/s]
  4%|▍         | 14560/371472 [1:10:22<27:00:14,  3.67it/s]
                                                           
{'loss': 4.907, 'learning_rate': 9.65189941606154e-07, 'epoch': 0.63}

  4%|▍         | 14560/371472 [1:10:22<27:00:14,  3.67it/s]
  4%|▍         | 14561/371472 [1:10:22<28:48:31,  3.44it/s]
  4%|▍         | 14562/371472 [1:10:22<28:18:32,  3.50it/s]
  4%|▍         | 14563/371472 [1:10:23<28:06:19,  3.53it/s]
  4%|▍         | 14564/371472 [1:10:23<28:50:36,  3.44it/s]
  4%|▍         | 14565/371472 [1:10:23<29:02:59,  3.41it/s]
  4%|▍         | 14566/371472 [1:10:24<33:20:55,  2.97it/s]
  4%|▍         | 14567/371472 [1:10:24<33:23:44,  2.97it/s]
  4%|▍         | 14568/371472 [1:10:24<31:39:54,  3.13it/s]
  4%|▍         | 14569/371472 [1:10:25<30:05:27,  3.29it/s]
  4%|▍         | 14570/371472 [1:10:25<29:25:23,  3.37it/s]
  4%|▍         | 14571/371472 [1:10:25<28:37:53,  3.46it/s]
  4%|▍         | 14572/371472 [1:10:25<27:37:41,  3.59it/s]
  4%|▍         | 14573/371472 [1:10:26<28:58:45,  3.42it/s]
  4%|▍         | 14574/371472 [1:10:26<31:00:55,  3.20it/s]
  4%|▍         | 14575/371472 [1:10:26<30:26:04,  3.26it/s]
  4%|▍         | 14576/371472 [1:10:27<29:15:14,  3.39it/s]
  4%|▍         | 14577/371472 [1:10:27<30:04:06,  3.30it/s]
  4%|▍         | 14578/371472 [1:10:27<30:29:42,  3.25it/s]
  4%|▍         | 14579/371472 [1:10:28<29:27:55,  3.36it/s]
  4%|▍         | 14580/371472 [1:10:28<28:00:39,  3.54it/s]
                                                           
{'loss': 4.7589, 'learning_rate': 9.65141459630675e-07, 'epoch': 0.63}

  4%|▍         | 14580/371472 [1:10:28<28:00:39,  3.54it/s]
  4%|▍         | 14581/371472 [1:10:28<29:27:35,  3.37it/s]
  4%|▍         | 14582/371472 [1:10:28<29:28:35,  3.36it/s]
  4%|▍         | 14583/371472 [1:10:29<28:17:03,  3.50it/s]
  4%|▍         | 14584/371472 [1:10:29<26:57:57,  3.68it/s]
  4%|▍         | 14585/371472 [1:10:29<29:37:11,  3.35it/s]
  4%|▍         | 14586/371472 [1:10:30<28:52:32,  3.43it/s]
  4%|▍         | 14587/371472 [1:10:30<28:04:27,  3.53it/s]
  4%|▍         | 14588/371472 [1:10:30<27:09:05,  3.65it/s]
  4%|▍         | 14589/371472 [1:10:30<26:48:57,  3.70it/s]
  4%|▍         | 14590/371472 [1:10:31<26:54:30,  3.68it/s]
  4%|▍         | 14591/371472 [1:10:31<28:27:38,  3.48it/s]
  4%|▍         | 14592/371472 [1:10:31<30:26:10,  3.26it/s]
  4%|▍         | 14593/371472 [1:10:32<29:23:55,  3.37it/s]
  4%|▍         | 14594/371472 [1:10:32<29:25:39,  3.37it/s]
  4%|▍         | 14595/371472 [1:10:32<28:20:41,  3.50it/s]
  4%|▍         | 14596/371472 [1:10:32<27:53:29,  3.55it/s]
  4%|▍         | 14597/371472 [1:10:33<27:23:57,  3.62it/s]
  4%|▍         | 14598/371472 [1:10:33<27:30:10,  3.60it/s]
  4%|▍         | 14599/371472 [1:10:33<28:23:22,  3.49it/s]
  4%|▍         | 14600/371472 [1:10:34<28:25:15,  3.49it/s]
                                                           
{'loss': 4.6099, 'learning_rate': 9.650929776551962e-07, 'epoch': 0.63}

  4%|▍         | 14600/371472 [1:10:34<28:25:15,  3.49it/s]
  4%|▍         | 14601/371472 [1:10:34<29:31:51,  3.36it/s]
  4%|▍         | 14602/371472 [1:10:34<30:40:57,  3.23it/s]
  4%|▍         | 14603/371472 [1:10:34<29:04:29,  3.41it/s]
  4%|▍         | 14604/371472 [1:10:35<29:29:33,  3.36it/s]
  4%|▍         | 14605/371472 [1:10:35<30:07:11,  3.29it/s]
  4%|▍         | 14606/371472 [1:10:35<28:46:18,  3.45it/s]
  4%|▍         | 14607/371472 [1:10:36<27:51:36,  3.56it/s]
  4%|▍         | 14608/371472 [1:10:36<29:25:56,  3.37it/s]
  4%|▍         | 14609/371472 [1:10:36<31:26:50,  3.15it/s]
  4%|▍         | 14610/371472 [1:10:37<29:50:27,  3.32it/s]
  4%|▍         | 14611/371472 [1:10:37<28:43:14,  3.45it/s]
  4%|▍         | 14612/371472 [1:10:37<28:14:44,  3.51it/s]
  4%|▍         | 14613/371472 [1:10:37<28:28:37,  3.48it/s]
  4%|▍         | 14614/371472 [1:10:38<27:27:13,  3.61it/s]
  4%|▍         | 14615/371472 [1:10:38<27:27:55,  3.61it/s]
  4%|▍         | 14616/371472 [1:10:38<29:09:08,  3.40it/s]
  4%|▍         | 14617/371472 [1:10:39<29:03:39,  3.41it/s]
  4%|▍         | 14618/371472 [1:10:39<27:37:21,  3.59it/s]
  4%|▍         | 14619/371472 [1:10:39<28:29:05,  3.48it/s]
  4%|▍         | 14620/371472 [1:10:39<28:03:42,  3.53it/s]
                                                           
{'loss': 4.7292, 'learning_rate': 9.650444956797173e-07, 'epoch': 0.63}

  4%|▍         | 14620/371472 [1:10:39<28:03:42,  3.53it/s]
  4%|▍         | 14621/371472 [1:10:40<27:15:35,  3.64it/s]
  4%|▍         | 14622/371472 [1:10:40<28:30:45,  3.48it/s]
  4%|▍         | 14623/371472 [1:10:40<27:56:22,  3.55it/s]
  4%|▍         | 14624/371472 [1:10:41<28:30:58,  3.48it/s]
  4%|▍         | 14625/371472 [1:10:41<30:24:30,  3.26it/s]
  4%|▍         | 14626/371472 [1:10:41<29:23:29,  3.37it/s]
  4%|▍         | 14627/371472 [1:10:41<28:37:47,  3.46it/s]
  4%|▍         | 14628/371472 [1:10:42<28:46:32,  3.44it/s]
  4%|▍         | 14629/371472 [1:10:42<28:21:39,  3.50it/s]
  4%|▍         | 14630/371472 [1:10:42<27:35:07,  3.59it/s]
  4%|▍         | 14631/371472 [1:10:43<26:51:49,  3.69it/s]
  4%|▍         | 14632/371472 [1:10:43<27:24:56,  3.62it/s]
  4%|▍         | 14633/371472 [1:10:43<27:18:06,  3.63it/s]
  4%|▍         | 14634/371472 [1:10:43<29:53:39,  3.32it/s]
  4%|▍         | 14635/371472 [1:10:44<31:57:04,  3.10it/s]
  4%|▍         | 14636/371472 [1:10:44<31:50:10,  3.11it/s]
  4%|▍         | 14637/371472 [1:10:44<31:54:13,  3.11it/s]
  4%|▍         | 14638/371472 [1:10:45<32:47:47,  3.02it/s]
  4%|▍         | 14639/371472 [1:10:45<31:48:00,  3.12it/s]
  4%|▍         | 14640/371472 [1:10:45<30:13:33,  3.28it/s]
                                                           
{'loss': 4.8569, 'learning_rate': 9.649960137042383e-07, 'epoch': 0.63}

  4%|▍         | 14640/371472 [1:10:45<30:13:33,  3.28it/s]
  4%|▍         | 14641/371472 [1:10:46<29:14:33,  3.39it/s]
  4%|▍         | 14642/371472 [1:10:46<28:37:08,  3.46it/s]
  4%|▍         | 14643/371472 [1:10:46<28:27:21,  3.48it/s]
  4%|▍         | 14644/371472 [1:10:46<28:15:07,  3.51it/s]
  4%|▍         | 14645/371472 [1:10:47<27:49:39,  3.56it/s]
  4%|▍         | 14646/371472 [1:10:47<27:16:04,  3.63it/s]
  4%|▍         | 14647/371472 [1:10:47<27:24:54,  3.62it/s]
  4%|▍         | 14648/371472 [1:10:48<26:52:09,  3.69it/s]
  4%|▍         | 14649/371472 [1:10:48<28:11:39,  3.52it/s]
  4%|▍         | 14650/371472 [1:10:48<28:46:52,  3.44it/s]
  4%|▍         | 14651/371472 [1:10:48<29:20:19,  3.38it/s]
  4%|▍         | 14652/371472 [1:10:49<31:02:36,  3.19it/s]
  4%|▍         | 14653/371472 [1:10:49<31:28:53,  3.15it/s]
  4%|▍         | 14654/371472 [1:10:49<30:30:40,  3.25it/s]
  4%|▍         | 14655/371472 [1:10:50<29:23:18,  3.37it/s]
  4%|▍         | 14656/371472 [1:10:50<28:25:16,  3.49it/s]
  4%|▍         | 14657/371472 [1:10:50<27:54:53,  3.55it/s]
  4%|▍         | 14658/371472 [1:10:51<27:36:37,  3.59it/s]
  4%|▍         | 14659/371472 [1:10:51<26:57:38,  3.68it/s]
  4%|▍         | 14660/371472 [1:10:51<26:59:15,  3.67it/s]
                                                           
{'loss': 4.476, 'learning_rate': 9.649475317287594e-07, 'epoch': 0.63}

  4%|▍         | 14660/371472 [1:10:51<26:59:15,  3.67it/s]
  4%|▍         | 14661/371472 [1:10:51<26:46:13,  3.70it/s]
  4%|▍         | 14662/371472 [1:10:52<27:04:24,  3.66it/s]
  4%|▍         | 14663/371472 [1:10:52<28:43:47,  3.45it/s]
  4%|▍         | 14664/371472 [1:10:52<28:31:44,  3.47it/s]
  4%|▍         | 14665/371472 [1:10:52<28:03:54,  3.53it/s]
  4%|▍         | 14666/371472 [1:10:53<28:01:31,  3.54it/s]
  4%|▍         | 14667/371472 [1:10:53<27:21:32,  3.62it/s]
  4%|▍         | 14668/371472 [1:10:53<27:52:42,  3.56it/s]
  4%|▍         | 14669/371472 [1:10:54<27:23:12,  3.62it/s]
  4%|▍         | 14670/371472 [1:10:54<27:39:09,  3.58it/s]
  4%|▍         | 14671/371472 [1:10:54<27:33:49,  3.60it/s]
  4%|▍         | 14672/371472 [1:10:54<28:22:46,  3.49it/s]
  4%|▍         | 14673/371472 [1:10:55<30:29:58,  3.25it/s]
  4%|▍         | 14674/371472 [1:10:55<30:41:23,  3.23it/s]
  4%|▍         | 14675/371472 [1:10:55<30:24:32,  3.26it/s]
  4%|▍         | 14676/371472 [1:10:56<28:59:53,  3.42it/s]
  4%|▍         | 14677/371472 [1:10:56<28:20:51,  3.50it/s]
  4%|▍         | 14678/371472 [1:10:56<27:50:41,  3.56it/s]
  4%|▍         | 14679/371472 [1:10:56<27:26:49,  3.61it/s]
  4%|▍         | 14680/371472 [1:10:57<26:48:37,  3.70it/s]
                                                           
{'loss': 5.1189, 'learning_rate': 9.648990497532805e-07, 'epoch': 0.63}

  4%|▍         | 14680/371472 [1:10:57<26:48:37,  3.70it/s]
  4%|▍         | 14681/371472 [1:10:57<27:46:48,  3.57it/s]
  4%|▍         | 14682/371472 [1:10:57<28:03:32,  3.53it/s]
  4%|▍         | 14683/371472 [1:10:58<29:20:56,  3.38it/s]
  4%|▍         | 14684/371472 [1:10:58<30:01:42,  3.30it/s]
  4%|▍         | 14685/371472 [1:10:58<29:38:01,  3.34it/s]
  4%|▍         | 14686/371472 [1:10:59<28:27:39,  3.48it/s]
  4%|▍         | 14687/371472 [1:10:59<29:29:46,  3.36it/s]
  4%|▍         | 14688/371472 [1:10:59<29:20:24,  3.38it/s]
  4%|▍         | 14689/371472 [1:10:59<29:03:45,  3.41it/s]
  4%|▍         | 14690/371472 [1:11:00<29:13:28,  3.39it/s]
  4%|▍         | 14691/371472 [1:11:00<28:56:46,  3.42it/s]
  4%|▍         | 14692/371472 [1:11:00<28:11:36,  3.52it/s]
  4%|▍         | 14693/371472 [1:11:01<29:23:14,  3.37it/s]
  4%|▍         | 14694/371472 [1:11:01<29:12:57,  3.39it/s]
  4%|▍         | 14695/371472 [1:11:01<28:31:54,  3.47it/s]
  4%|▍         | 14696/371472 [1:11:01<28:03:36,  3.53it/s]
  4%|▍         | 14697/371472 [1:11:02<28:28:39,  3.48it/s]
  4%|▍         | 14698/371472 [1:11:02<28:39:31,  3.46it/s]
  4%|▍         | 14699/371472 [1:11:02<29:22:48,  3.37it/s]
  4%|▍         | 14700/371472 [1:11:03<28:30:52,  3.48it/s]
                                                           
{'loss': 4.4871, 'learning_rate': 9.648505677778018e-07, 'epoch': 0.63}

  4%|▍         | 14700/371472 [1:11:03<28:30:52,  3.48it/s]
  4%|▍         | 14701/371472 [1:11:03<29:31:26,  3.36it/s]
  4%|▍         | 14702/371472 [1:11:03<29:58:11,  3.31it/s]
  4%|▍         | 14703/371472 [1:11:04<29:50:27,  3.32it/s]
  4%|▍         | 14704/371472 [1:11:04<28:09:54,  3.52it/s]
  4%|▍         | 14705/371472 [1:11:04<27:14:57,  3.64it/s]
  4%|▍         | 14706/371472 [1:11:04<27:50:29,  3.56it/s]
  4%|▍         | 14707/371472 [1:11:05<28:02:32,  3.53it/s]
  4%|▍         | 14708/371472 [1:11:05<27:23:32,  3.62it/s]
  4%|▍         | 14709/371472 [1:11:05<28:32:50,  3.47it/s]
  4%|▍         | 14710/371472 [1:11:05<28:19:03,  3.50it/s]
  4%|▍         | 14711/371472 [1:11:06<27:51:32,  3.56it/s]
  4%|▍         | 14712/371472 [1:11:06<27:16:15,  3.63it/s]
  4%|▍         | 14713/371472 [1:11:06<28:42:12,  3.45it/s]
  4%|▍         | 14714/371472 [1:11:07<27:50:42,  3.56it/s]
  4%|▍         | 14715/371472 [1:11:07<27:17:21,  3.63it/s]
  4%|▍         | 14716/371472 [1:11:07<26:40:55,  3.71it/s]
  4%|▍         | 14717/371472 [1:11:07<28:56:23,  3.42it/s]
  4%|▍         | 14718/371472 [1:11:08<30:15:04,  3.28it/s]
  4%|▍         | 14719/371472 [1:11:08<30:09:59,  3.29it/s]
  4%|▍         | 14720/371472 [1:11:08<28:37:26,  3.46it/s]
                                                           
{'loss': 4.7954, 'learning_rate': 9.648020858023228e-07, 'epoch': 0.63}

  4%|▍         | 14720/371472 [1:11:08<28:37:26,  3.46it/s]
  4%|▍         | 14721/371472 [1:11:09<28:07:17,  3.52it/s]
  4%|▍         | 14722/371472 [1:11:09<27:33:35,  3.60it/s]
  4%|▍         | 14723/371472 [1:11:09<27:14:20,  3.64it/s]
  4%|▍         | 14724/371472 [1:11:10<29:22:45,  3.37it/s]
  4%|▍         | 14725/371472 [1:11:10<29:04:50,  3.41it/s]
  4%|▍         | 14726/371472 [1:11:10<29:51:41,  3.32it/s]
  4%|▍         | 14727/371472 [1:11:10<30:38:39,  3.23it/s]
  4%|▍         | 14728/371472 [1:11:11<29:30:24,  3.36it/s]
  4%|▍         | 14729/371472 [1:11:11<28:32:27,  3.47it/s]
  4%|▍         | 14730/371472 [1:11:11<28:27:26,  3.48it/s]
  4%|▍         | 14731/371472 [1:11:12<28:00:44,  3.54it/s]
  4%|▍         | 14732/371472 [1:11:12<27:35:15,  3.59it/s]
  4%|▍         | 14733/371472 [1:11:12<27:05:55,  3.66it/s]
  4%|▍         | 14734/371472 [1:11:12<28:18:50,  3.50it/s]
  4%|▍         | 14735/371472 [1:11:13<28:45:17,  3.45it/s]
  4%|▍         | 14736/371472 [1:11:13<28:25:18,  3.49it/s]
  4%|▍         | 14737/371472 [1:11:13<27:53:17,  3.55it/s]
  4%|▍         | 14738/371472 [1:11:13<27:40:40,  3.58it/s]
  4%|▍         | 14739/371472 [1:11:14<27:27:38,  3.61it/s]
  4%|▍         | 14740/371472 [1:11:14<32:53:48,  3.01it/s]
                                                           
{'loss': 4.8858, 'learning_rate': 9.64753603826844e-07, 'epoch': 0.63}

  4%|▍         | 14740/371472 [1:11:14<32:53:48,  3.01it/s]
  4%|▍         | 14741/371472 [1:11:15<31:26:41,  3.15it/s]
  4%|▍         | 14742/371472 [1:11:15<31:08:43,  3.18it/s]
  4%|▍         | 14743/371472 [1:11:15<29:39:15,  3.34it/s]
  4%|▍         | 14744/371472 [1:11:15<32:37:10,  3.04it/s]
  4%|▍         | 14745/371472 [1:11:16<30:33:17,  3.24it/s]
  4%|▍         | 14746/371472 [1:11:16<30:18:43,  3.27it/s]
  4%|▍         | 14747/371472 [1:11:16<29:21:14,  3.38it/s]
  4%|▍         | 14748/371472 [1:11:17<28:36:52,  3.46it/s]
  4%|▍         | 14749/371472 [1:11:17<27:49:01,  3.56it/s]
  4%|▍         | 14750/371472 [1:11:17<26:54:23,  3.68it/s]
  4%|▍         | 14751/371472 [1:11:17<26:44:31,  3.71it/s]
  4%|▍         | 14752/371472 [1:11:18<29:18:44,  3.38it/s]
  4%|▍         | 14753/371472 [1:11:18<29:42:38,  3.34it/s]
  4%|▍         | 14754/371472 [1:11:18<29:18:43,  3.38it/s]
  4%|▍         | 14755/371472 [1:11:19<31:36:47,  3.13it/s]
  4%|▍         | 14756/371472 [1:11:19<29:54:46,  3.31it/s]
  4%|▍         | 14757/371472 [1:11:19<28:43:15,  3.45it/s]
  4%|▍         | 14758/371472 [1:11:20<29:44:07,  3.33it/s]
  4%|▍         | 14759/371472 [1:11:20<29:08:12,  3.40it/s]
  4%|▍         | 14760/371472 [1:11:20<30:01:14,  3.30it/s]
                                                           
{'loss': 4.7299, 'learning_rate': 9.64705121851365e-07, 'epoch': 0.64}

  4%|▍         | 14760/371472 [1:11:20<30:01:14,  3.30it/s]
  4%|▍         | 14761/371472 [1:11:20<30:30:54,  3.25it/s]
  4%|▍         | 14762/371472 [1:11:21<29:45:29,  3.33it/s]
  4%|▍         | 14763/371472 [1:11:21<29:09:00,  3.40it/s]
  4%|▍         | 14764/371472 [1:11:21<30:38:36,  3.23it/s]
  4%|▍         | 14765/371472 [1:11:22<29:41:14,  3.34it/s]
  4%|▍         | 14766/371472 [1:11:22<29:26:56,  3.36it/s]
  4%|▍         | 14767/371472 [1:11:22<28:35:46,  3.46it/s]
  4%|▍         | 14768/371472 [1:11:23<29:21:36,  3.37it/s]
  4%|▍         | 14769/371472 [1:11:23<29:29:57,  3.36it/s]
  4%|▍         | 14770/371472 [1:11:23<30:08:01,  3.29it/s]
  4%|▍         | 14771/371472 [1:11:23<29:54:39,  3.31it/s]
  4%|▍         | 14772/371472 [1:11:24<29:45:54,  3.33it/s]
  4%|▍         | 14773/371472 [1:11:24<29:23:49,  3.37it/s]
  4%|▍         | 14774/371472 [1:11:24<31:26:22,  3.15it/s]
  4%|▍         | 14775/371472 [1:11:25<32:51:45,  3.02it/s]
  4%|▍         | 14776/371472 [1:11:25<30:11:52,  3.28it/s]
  4%|▍         | 14777/371472 [1:11:25<29:35:43,  3.35it/s]
  4%|▍         | 14778/371472 [1:11:26<27:55:26,  3.55it/s]
  4%|▍         | 14779/371472 [1:11:26<27:14:58,  3.64it/s]
  4%|▍         | 14780/371472 [1:11:26<28:43:31,  3.45it/s]
                                                           
{'loss': 4.6986, 'learning_rate': 9.64656639875886e-07, 'epoch': 0.64}

  4%|▍         | 14780/371472 [1:11:26<28:43:31,  3.45it/s]
  4%|▍         | 14781/371472 [1:11:26<28:53:49,  3.43it/s]
  4%|▍         | 14782/371472 [1:11:27<29:15:12,  3.39it/s]
  4%|▍         | 14783/371472 [1:11:27<29:46:10,  3.33it/s]
  4%|▍         | 14784/371472 [1:11:27<30:23:46,  3.26it/s]
  4%|▍         | 14785/371472 [1:11:28<28:51:01,  3.43it/s]
  4%|▍         | 14786/371472 [1:11:28<28:11:29,  3.51it/s]
  4%|▍         | 14787/371472 [1:11:28<30:26:28,  3.25it/s]
  4%|▍         | 14788/371472 [1:11:28<29:03:24,  3.41it/s]
  4%|▍         | 14789/371472 [1:11:29<28:36:30,  3.46it/s]
  4%|▍         | 14790/371472 [1:11:29<27:49:14,  3.56it/s]
  4%|▍         | 14791/371472 [1:11:29<27:09:35,  3.65it/s]
  4%|▍         | 14792/371472 [1:11:30<26:44:05,  3.71it/s]
  4%|▍         | 14793/371472 [1:11:30<27:31:19,  3.60it/s]
  4%|▍         | 14794/371472 [1:11:30<27:31:10,  3.60it/s]
  4%|▍         | 14795/371472 [1:11:30<28:16:02,  3.51it/s]
  4%|▍         | 14796/371472 [1:11:31<27:28:17,  3.61it/s]
  4%|▍         | 14797/371472 [1:11:31<26:56:03,  3.68it/s]
  4%|▍         | 14798/371472 [1:11:31<29:22:04,  3.37it/s]
  4%|▍         | 14799/371472 [1:11:32<30:17:55,  3.27it/s]
  4%|▍         | 14800/371472 [1:11:32<30:40:29,  3.23it/s]
                                                           
{'loss': 4.716, 'learning_rate': 9.646081579004071e-07, 'epoch': 0.64}

  4%|▍         | 14800/371472 [1:11:32<30:40:29,  3.23it/s]
  4%|▍         | 14801/371472 [1:11:32<29:56:07,  3.31it/s]
  4%|▍         | 14802/371472 [1:11:33<29:26:04,  3.37it/s]
  4%|▍         | 14803/371472 [1:11:33<31:48:29,  3.11it/s]
  4%|▍         | 14804/371472 [1:11:33<34:48:21,  2.85it/s]
  4%|▍         | 14805/371472 [1:11:34<33:21:19,  2.97it/s]
  4%|▍         | 14806/371472 [1:11:34<31:51:57,  3.11it/s]
  4%|▍         | 14807/371472 [1:11:34<32:04:24,  3.09it/s]
  4%|▍         | 14808/371472 [1:11:35<31:49:21,  3.11it/s]
  4%|▍         | 14809/371472 [1:11:35<30:06:24,  3.29it/s]
  4%|▍         | 14810/371472 [1:11:35<29:45:02,  3.33it/s]
  4%|▍         | 14811/371472 [1:11:35<28:31:42,  3.47it/s]
  4%|▍         | 14812/371472 [1:11:36<29:33:32,  3.35it/s]
  4%|▍         | 14813/371472 [1:11:36<28:16:12,  3.50it/s]
  4%|▍         | 14814/371472 [1:11:36<28:21:52,  3.49it/s]
  4%|▍         | 14815/371472 [1:11:36<27:33:53,  3.59it/s]
  4%|▍         | 14816/371472 [1:11:37<27:04:58,  3.66it/s]
  4%|▍         | 14817/371472 [1:11:37<27:02:52,  3.66it/s]
  4%|▍         | 14818/371472 [1:11:37<27:17:12,  3.63it/s]
  4%|▍         | 14819/371472 [1:11:38<28:07:10,  3.52it/s]
  4%|▍         | 14820/371472 [1:11:38<27:26:08,  3.61it/s]
                                                           
{'loss': 4.8712, 'learning_rate': 9.645596759249282e-07, 'epoch': 0.64}

  4%|▍         | 14820/371472 [1:11:38<27:26:08,  3.61it/s]
  4%|▍         | 14821/371472 [1:11:38<27:48:06,  3.56it/s]
  4%|▍         | 14822/371472 [1:11:38<27:46:03,  3.57it/s]
  4%|▍         | 14823/371472 [1:11:39<29:29:21,  3.36it/s]
  4%|▍         | 14824/371472 [1:11:39<28:48:54,  3.44it/s]
  4%|▍         | 14825/371472 [1:11:39<28:32:10,  3.47it/s]
  4%|▍         | 14826/371472 [1:11:40<27:58:50,  3.54it/s]
  4%|▍         | 14827/371472 [1:11:40<27:12:00,  3.64it/s]
  4%|▍         | 14828/371472 [1:11:40<29:44:14,  3.33it/s]
  4%|▍         | 14829/371472 [1:11:40<28:35:45,  3.46it/s]
  4%|▍         | 14830/371472 [1:11:41<27:51:24,  3.56it/s]
  4%|▍         | 14831/371472 [1:11:41<27:28:28,  3.61it/s]
  4%|▍         | 14832/371472 [1:11:41<27:18:36,  3.63it/s]
  4%|▍         | 14833/371472 [1:11:42<26:54:49,  3.68it/s]
  4%|▍         | 14834/371472 [1:11:42<28:15:33,  3.51it/s]
  4%|▍         | 14835/371472 [1:11:42<29:09:04,  3.40it/s]
  4%|▍         | 14836/371472 [1:11:43<30:34:42,  3.24it/s]
  4%|▍         | 14837/371472 [1:11:43<29:38:09,  3.34it/s]
  4%|▍         | 14838/371472 [1:11:43<31:02:52,  3.19it/s]
  4%|▍         | 14839/371472 [1:11:43<30:09:44,  3.28it/s]
  4%|▍         | 14840/371472 [1:11:44<30:02:17,  3.30it/s]
                                                           
{'loss': 4.5896, 'learning_rate': 9.645111939494495e-07, 'epoch': 0.64}

  4%|▍         | 14840/371472 [1:11:44<30:02:17,  3.30it/s]
  4%|▍         | 14841/371472 [1:11:44<28:43:51,  3.45it/s]
  4%|▍         | 14842/371472 [1:11:44<27:11:50,  3.64it/s]
  4%|▍         | 14843/371472 [1:11:45<27:55:36,  3.55it/s]
  4%|▍         | 14844/371472 [1:11:45<28:22:49,  3.49it/s]
  4%|▍         | 14845/371472 [1:11:45<28:14:44,  3.51it/s]
  4%|▍         | 14846/371472 [1:11:45<27:37:36,  3.59it/s]
  4%|▍         | 14847/371472 [1:11:46<27:31:16,  3.60it/s]
  4%|▍         | 14848/371472 [1:11:46<31:06:00,  3.19it/s]
  4%|▍         | 14849/371472 [1:11:46<29:14:43,  3.39it/s]
  4%|▍         | 14850/371472 [1:11:47<29:05:38,  3.40it/s]
  4%|▍         | 14851/371472 [1:11:47<27:54:50,  3.55it/s]
  4%|▍         | 14852/371472 [1:11:47<27:08:48,  3.65it/s]
  4%|▍         | 14853/371472 [1:11:47<26:53:13,  3.68it/s]
  4%|▍         | 14854/371472 [1:11:48<26:27:47,  3.74it/s]
  4%|▍         | 14855/371472 [1:11:48<26:48:42,  3.69it/s]
  4%|▍         | 14856/371472 [1:11:48<27:21:21,  3.62it/s]
  4%|▍         | 14857/371472 [1:11:48<26:59:41,  3.67it/s]
  4%|▍         | 14858/371472 [1:11:49<26:39:02,  3.72it/s]
  4%|▍         | 14859/371472 [1:11:49<26:43:20,  3.71it/s]
  4%|▍         | 14860/371472 [1:11:49<26:45:11,  3.70it/s]
                                                           
{'loss': 4.8666, 'learning_rate': 9.644627119739706e-07, 'epoch': 0.64}

  4%|▍         | 14860/371472 [1:11:49<26:45:11,  3.70it/s]
  4%|▍         | 14861/371472 [1:11:50<27:17:04,  3.63it/s]
  4%|▍         | 14862/371472 [1:11:50<26:53:25,  3.68it/s]
  4%|▍         | 14863/371472 [1:11:50<27:53:07,  3.55it/s]
  4%|▍         | 14864/371472 [1:11:50<27:08:10,  3.65it/s]
  4%|▍         | 14865/371472 [1:11:51<29:11:49,  3.39it/s]
  4%|▍         | 14866/371472 [1:11:51<27:51:20,  3.56it/s]
  4%|▍         | 14867/371472 [1:11:51<29:00:49,  3.41it/s]
  4%|▍         | 14868/371472 [1:11:52<28:39:17,  3.46it/s]
  4%|▍         | 14869/371472 [1:11:52<28:10:21,  3.52it/s]
  4%|▍         | 14870/371472 [1:11:52<27:53:23,  3.55it/s]
  4%|▍         | 14871/371472 [1:11:52<27:43:26,  3.57it/s]
  4%|▍         | 14872/371472 [1:11:53<27:35:56,  3.59it/s]
  4%|▍         | 14873/371472 [1:11:53<27:00:41,  3.67it/s]
  4%|▍         | 14874/371472 [1:11:53<27:23:01,  3.62it/s]
  4%|▍         | 14875/371472 [1:11:53<28:05:37,  3.53it/s]
  4%|▍         | 14876/371472 [1:11:54<27:37:28,  3.59it/s]
  4%|▍         | 14877/371472 [1:11:54<27:09:09,  3.65it/s]
  4%|▍         | 14878/371472 [1:11:54<27:36:20,  3.59it/s]
  4%|▍         | 14879/371472 [1:11:55<28:51:52,  3.43it/s]
  4%|▍         | 14880/371472 [1:11:55<28:06:02,  3.52it/s]
                                                           
{'loss': 4.6907, 'learning_rate': 9.644142299984916e-07, 'epoch': 0.64}

  4%|▍         | 14880/371472 [1:11:55<28:06:02,  3.52it/s]
  4%|▍         | 14881/371472 [1:11:55<28:02:27,  3.53it/s]
  4%|▍         | 14882/371472 [1:11:55<28:03:27,  3.53it/s]
  4%|▍         | 14883/371472 [1:11:56<28:05:16,  3.53it/s]
  4%|▍         | 14884/371472 [1:11:56<27:11:43,  3.64it/s]
  4%|▍         | 14885/371472 [1:11:56<27:21:35,  3.62it/s]
  4%|▍         | 14886/371472 [1:11:57<26:56:40,  3.68it/s]
  4%|▍         | 14887/371472 [1:11:57<29:31:17,  3.36it/s]
  4%|▍         | 14888/371472 [1:11:57<29:12:50,  3.39it/s]
  4%|▍         | 14889/371472 [1:11:57<28:50:59,  3.43it/s]
  4%|▍         | 14890/371472 [1:11:58<27:56:27,  3.54it/s]
  4%|▍         | 14891/371472 [1:11:58<27:41:27,  3.58it/s]
  4%|▍         | 14892/371472 [1:11:58<27:49:35,  3.56it/s]
  4%|▍         | 14893/371472 [1:11:59<28:24:23,  3.49it/s]
  4%|▍         | 14894/371472 [1:11:59<28:20:49,  3.49it/s]
  4%|▍         | 14895/371472 [1:11:59<29:19:50,  3.38it/s]
  4%|▍         | 14896/371472 [1:11:59<29:27:54,  3.36it/s]
  4%|▍         | 14897/371472 [1:12:00<30:49:58,  3.21it/s]
  4%|▍         | 14898/371472 [1:12:00<30:26:52,  3.25it/s]
  4%|▍         | 14899/371472 [1:12:00<30:30:53,  3.25it/s]
  4%|▍         | 14900/371472 [1:12:01<29:40:01,  3.34it/s]
                                                           
{'loss': 4.7755, 'learning_rate': 9.643657480230127e-07, 'epoch': 0.64}

  4%|▍         | 14900/371472 [1:12:01<29:40:01,  3.34it/s]
  4%|▍         | 14901/371472 [1:12:01<27:54:56,  3.55it/s]
  4%|▍         | 14902/371472 [1:12:01<27:54:58,  3.55it/s]
  4%|▍         | 14903/371472 [1:12:02<27:04:01,  3.66it/s]
  4%|▍         | 14904/371472 [1:12:02<27:27:16,  3.61it/s]
  4%|▍         | 14905/371472 [1:12:02<27:48:13,  3.56it/s]
  4%|▍         | 14906/371472 [1:12:02<26:44:33,  3.70it/s]
  4%|▍         | 14907/371472 [1:12:03<27:29:19,  3.60it/s]
  4%|▍         | 14908/371472 [1:12:03<27:13:18,  3.64it/s]
  4%|▍         | 14909/371472 [1:12:03<27:13:08,  3.64it/s]
  4%|▍         | 14910/371472 [1:12:03<27:19:33,  3.62it/s]
  4%|▍         | 14911/371472 [1:12:04<26:48:10,  3.70it/s]
  4%|▍         | 14912/371472 [1:12:04<27:16:03,  3.63it/s]
  4%|▍         | 14913/371472 [1:12:04<27:49:04,  3.56it/s]
  4%|▍         | 14914/371472 [1:12:05<30:13:40,  3.28it/s]
  4%|▍         | 14915/371472 [1:12:05<31:06:54,  3.18it/s]
  4%|▍         | 14916/371472 [1:12:05<29:25:04,  3.37it/s]
  4%|▍         | 14917/371472 [1:12:05<28:07:38,  3.52it/s]
  4%|▍         | 14918/371472 [1:12:06<27:49:59,  3.56it/s]
  4%|▍         | 14919/371472 [1:12:06<27:19:32,  3.62it/s]
  4%|▍         | 14920/371472 [1:12:06<27:07:08,  3.65it/s]
                                                           
{'loss': 4.8946, 'learning_rate': 9.643172660475338e-07, 'epoch': 0.64}

  4%|▍         | 14920/371472 [1:12:06<27:07:08,  3.65it/s]
  4%|▍         | 14921/371472 [1:12:07<26:43:30,  3.71it/s]
  4%|▍         | 14922/371472 [1:12:07<28:00:07,  3.54it/s]
  4%|▍         | 14923/371472 [1:12:07<27:15:20,  3.63it/s]
  4%|▍         | 14924/371472 [1:12:07<27:34:56,  3.59it/s]
  4%|▍         | 14925/371472 [1:12:08<26:52:19,  3.69it/s]
  4%|▍         | 14926/371472 [1:12:08<26:19:17,  3.76it/s]
  4%|▍         | 14927/371472 [1:12:08<28:30:03,  3.47it/s]
  4%|▍         | 14928/371472 [1:12:09<28:28:20,  3.48it/s]
  4%|▍         | 14929/371472 [1:12:09<29:12:39,  3.39it/s]
  4%|▍         | 14930/371472 [1:12:09<29:12:04,  3.39it/s]
  4%|▍         | 14931/371472 [1:12:09<29:36:34,  3.34it/s]
  4%|▍         | 14932/371472 [1:12:10<28:34:00,  3.47it/s]
  4%|▍         | 14933/371472 [1:12:10<28:01:12,  3.53it/s]
  4%|▍         | 14934/371472 [1:12:10<27:40:56,  3.58it/s]
  4%|▍         | 14935/371472 [1:12:11<28:19:26,  3.50it/s]
  4%|▍         | 14936/371472 [1:12:11<27:52:24,  3.55it/s]
  4%|▍         | 14937/371472 [1:12:11<27:43:10,  3.57it/s]
  4%|▍         | 14938/371472 [1:12:11<27:13:38,  3.64it/s]
  4%|▍         | 14939/371472 [1:12:12<27:10:17,  3.64it/s]
  4%|▍         | 14940/371472 [1:12:12<27:37:02,  3.59it/s]
                                                           
{'loss': 4.7275, 'learning_rate': 9.64268784072055e-07, 'epoch': 0.64}

  4%|▍         | 14940/371472 [1:12:12<27:37:02,  3.59it/s]
  4%|▍         | 14941/371472 [1:12:12<27:44:56,  3.57it/s]
  4%|▍         | 14942/371472 [1:12:13<27:45:57,  3.57it/s]
  4%|▍         | 14943/371472 [1:12:13<28:17:03,  3.50it/s]
  4%|▍         | 14944/371472 [1:12:13<27:32:42,  3.60it/s]
  4%|▍         | 14945/371472 [1:12:13<27:42:02,  3.58it/s]
  4%|▍         | 14946/371472 [1:12:14<27:49:37,  3.56it/s]
  4%|▍         | 14947/371472 [1:12:14<28:29:26,  3.48it/s]
  4%|▍         | 14948/371472 [1:12:14<29:42:16,  3.33it/s]
  4%|▍         | 14949/371472 [1:12:15<28:22:29,  3.49it/s]
  4%|▍         | 14950/371472 [1:12:15<27:24:35,  3.61it/s]
  4%|▍         | 14951/371472 [1:12:15<27:07:59,  3.65it/s]
  4%|▍         | 14952/371472 [1:12:15<28:02:21,  3.53it/s]
  4%|▍         | 14953/371472 [1:12:16<29:26:18,  3.36it/s]
  4%|▍         | 14954/371472 [1:12:16<28:28:52,  3.48it/s]
  4%|▍         | 14955/371472 [1:12:16<27:59:23,  3.54it/s]
  4%|▍         | 14956/371472 [1:12:17<31:29:54,  3.14it/s]
  4%|▍         | 14957/371472 [1:12:17<29:41:07,  3.34it/s]
  4%|▍         | 14958/371472 [1:12:17<29:09:52,  3.40it/s]
  4%|▍         | 14959/371472 [1:12:17<28:48:18,  3.44it/s]
  4%|▍         | 14960/371472 [1:12:18<28:19:29,  3.50it/s]
                                                           
{'loss': 4.7162, 'learning_rate': 9.64220302096576e-07, 'epoch': 0.64}

  4%|▍         | 14960/371472 [1:12:18<28:19:29,  3.50it/s]
  4%|▍         | 14961/371472 [1:12:18<28:44:45,  3.45it/s]
  4%|▍         | 14962/371472 [1:12:18<29:55:46,  3.31it/s]
  4%|▍         | 14963/371472 [1:12:19<34:45:42,  2.85it/s]
  4%|▍         | 14964/371472 [1:12:19<32:12:27,  3.07it/s]
  4%|▍         | 14965/371472 [1:12:19<30:03:00,  3.30it/s]
  4%|▍         | 14966/371472 [1:12:20<30:41:58,  3.23it/s]
  4%|▍         | 14967/371472 [1:12:20<29:11:23,  3.39it/s]
  4%|▍         | 14968/371472 [1:12:20<28:20:22,  3.49it/s]
  4%|▍         | 14969/371472 [1:12:21<31:25:40,  3.15it/s]
  4%|▍         | 14970/371472 [1:12:21<30:52:14,  3.21it/s]
  4%|▍         | 14971/371472 [1:12:21<30:17:14,  3.27it/s]
  4%|▍         | 14972/371472 [1:12:21<29:14:06,  3.39it/s]
  4%|▍         | 14973/371472 [1:12:22<28:31:06,  3.47it/s]
  4%|▍         | 14974/371472 [1:12:22<28:37:33,  3.46it/s]
  4%|▍         | 14975/371472 [1:12:22<27:21:47,  3.62it/s]
  4%|▍         | 14976/371472 [1:12:23<28:26:53,  3.48it/s]
  4%|▍         | 14977/371472 [1:12:23<29:13:35,  3.39it/s]
  4%|▍         | 14978/371472 [1:12:23<28:36:39,  3.46it/s]
  4%|▍         | 14979/371472 [1:12:23<28:51:13,  3.43it/s]
  4%|▍         | 14980/371472 [1:12:24<29:36:16,  3.34it/s]
                                                           
{'loss': 4.7541, 'learning_rate': 9.641718201210972e-07, 'epoch': 0.65}

  4%|▍         | 14980/371472 [1:12:24<29:36:16,  3.34it/s]
  4%|▍         | 14981/371472 [1:12:24<29:54:24,  3.31it/s]
  4%|▍         | 14982/371472 [1:12:24<30:19:21,  3.27it/s]
  4%|▍         | 14983/371472 [1:12:25<29:00:44,  3.41it/s]
  4%|▍         | 14984/371472 [1:12:25<28:33:59,  3.47it/s]
  4%|▍         | 14985/371472 [1:12:25<31:33:33,  3.14it/s]
  4%|▍         | 14986/371472 [1:12:26<30:18:18,  3.27it/s]
  4%|▍         | 14987/371472 [1:12:26<29:19:14,  3.38it/s]
  4%|▍         | 14988/371472 [1:12:26<28:42:52,  3.45it/s]
  4%|▍         | 14989/371472 [1:12:26<29:54:35,  3.31it/s]
  4%|▍         | 14990/371472 [1:12:27<28:56:45,  3.42it/s]
  4%|▍         | 14991/371472 [1:12:27<31:19:33,  3.16it/s]
  4%|▍         | 14992/371472 [1:12:27<31:37:36,  3.13it/s]
  4%|▍         | 14993/371472 [1:12:28<32:56:18,  3.01it/s]
  4%|▍         | 14994/371472 [1:12:28<33:36:11,  2.95it/s]
  4%|▍         | 14995/371472 [1:12:28<31:34:21,  3.14it/s]
  4%|▍         | 14996/371472 [1:12:29<34:03:47,  2.91it/s]
  4%|▍         | 14997/371472 [1:12:29<31:57:34,  3.10it/s]
  4%|▍         | 14998/371472 [1:12:29<30:52:45,  3.21it/s]
  4%|▍         | 14999/371472 [1:12:30<29:42:48,  3.33it/s]
  4%|▍         | 15000/371472 [1:12:30<29:24:48,  3.37it/s]
                                                           
{'loss': 4.7376, 'learning_rate': 9.641233381456183e-07, 'epoch': 0.65}

  4%|▍         | 15000/371472 [1:12:30<29:24:48,  3.37it/s]
  4%|▍         | 15001/371472 [1:12:30<29:17:13,  3.38it/s]
  4%|▍         | 15002/371472 [1:12:31<29:09:29,  3.40it/s]
  4%|▍         | 15003/371472 [1:12:31<30:17:32,  3.27it/s]
  4%|▍         | 15004/371472 [1:12:31<30:48:09,  3.21it/s]
  4%|▍         | 15005/371472 [1:12:31<29:44:25,  3.33it/s]
  4%|▍         | 15006/371472 [1:12:32<29:10:43,  3.39it/s]
  4%|▍         | 15007/371472 [1:12:32<27:42:40,  3.57it/s]
  4%|▍         | 15008/371472 [1:12:32<28:59:25,  3.42it/s]
  4%|▍         | 15009/371472 [1:12:33<27:44:15,  3.57it/s]
  4%|▍         | 15010/371472 [1:12:33<27:15:15,  3.63it/s]
  4%|▍         | 15011/371472 [1:12:33<29:19:37,  3.38it/s]
  4%|▍         | 15012/371472 [1:12:33<28:42:35,  3.45it/s]
  4%|▍         | 15013/371472 [1:12:34<28:01:26,  3.53it/s]
  4%|▍         | 15014/371472 [1:12:34<28:19:51,  3.49it/s]
  4%|▍         | 15015/371472 [1:12:34<27:38:27,  3.58it/s]
  4%|▍         | 15016/371472 [1:12:35<27:38:06,  3.58it/s]
  4%|▍         | 15017/371472 [1:12:35<30:19:20,  3.27it/s]
  4%|▍         | 15018/371472 [1:12:35<29:48:55,  3.32it/s]
  4%|▍         | 15019/371472 [1:12:35<29:17:04,  3.38it/s]
  4%|▍         | 15020/371472 [1:12:36<28:42:43,  3.45it/s]
                                                           
{'loss': 4.7821, 'learning_rate': 9.640748561701393e-07, 'epoch': 0.65}

  4%|▍         | 15020/371472 [1:12:36<28:42:43,  3.45it/s]
  4%|▍         | 15021/371472 [1:12:36<29:04:37,  3.41it/s]
  4%|▍         | 15022/371472 [1:12:36<29:53:37,  3.31it/s]
  4%|▍         | 15023/371472 [1:12:37<29:57:49,  3.30it/s]
  4%|▍         | 15024/371472 [1:12:37<29:34:35,  3.35it/s]
  4%|▍         | 15025/371472 [1:12:37<30:53:47,  3.20it/s]
  4%|▍         | 15026/371472 [1:12:38<28:42:48,  3.45it/s]
  4%|▍         | 15027/371472 [1:12:38<28:07:12,  3.52it/s]
  4%|▍         | 15028/371472 [1:12:38<30:12:38,  3.28it/s]
  4%|▍         | 15029/371472 [1:12:38<29:46:38,  3.33it/s]
  4%|▍         | 15030/371472 [1:12:39<28:44:01,  3.45it/s]
  4%|▍         | 15031/371472 [1:12:39<28:07:43,  3.52it/s]
  4%|▍         | 15032/371472 [1:12:39<27:54:46,  3.55it/s]
  4%|▍         | 15033/371472 [1:12:40<29:04:51,  3.40it/s]
  4%|▍         | 15034/371472 [1:12:40<29:37:06,  3.34it/s]
  4%|▍         | 15035/371472 [1:12:40<31:00:40,  3.19it/s]
  4%|▍         | 15036/371472 [1:12:41<32:19:43,  3.06it/s]
  4%|▍         | 15037/371472 [1:12:41<31:15:12,  3.17it/s]
  4%|▍         | 15038/371472 [1:12:41<30:03:12,  3.29it/s]
  4%|▍         | 15039/371472 [1:12:41<28:53:14,  3.43it/s]
  4%|▍         | 15040/371472 [1:12:42<29:35:39,  3.35it/s]
                                                           
{'loss': 4.5146, 'learning_rate': 9.640263741946604e-07, 'epoch': 0.65}

  4%|▍         | 15040/371472 [1:12:42<29:35:39,  3.35it/s]
  4%|▍         | 15041/371472 [1:12:42<28:25:16,  3.48it/s]
  4%|▍         | 15042/371472 [1:12:42<28:27:03,  3.48it/s]
  4%|▍         | 15043/371472 [1:12:43<28:46:36,  3.44it/s]
  4%|▍         | 15044/371472 [1:12:43<27:50:44,  3.56it/s]
  4%|▍         | 15045/371472 [1:12:43<27:12:22,  3.64it/s]
  4%|▍         | 15046/371472 [1:12:43<27:30:26,  3.60it/s]
  4%|▍         | 15047/371472 [1:12:44<27:15:15,  3.63it/s]
  4%|▍         | 15048/371472 [1:12:44<26:16:55,  3.77it/s]
  4%|▍         | 15049/371472 [1:12:44<27:54:24,  3.55it/s]
  4%|▍         | 15050/371472 [1:12:45<27:50:14,  3.56it/s]
  4%|▍         | 15051/371472 [1:12:45<28:16:25,  3.50it/s]
  4%|▍         | 15052/371472 [1:12:45<28:54:12,  3.43it/s]
  4%|▍         | 15053/371472 [1:12:45<30:19:09,  3.27it/s]
  4%|▍         | 15054/371472 [1:12:46<30:10:26,  3.28it/s]
  4%|▍         | 15055/371472 [1:12:46<29:58:26,  3.30it/s]
  4%|▍         | 15056/371472 [1:12:46<28:26:39,  3.48it/s]
  4%|▍         | 15057/371472 [1:12:47<28:59:28,  3.41it/s]
  4%|▍         | 15058/371472 [1:12:47<28:19:25,  3.50it/s]
  4%|▍         | 15059/371472 [1:12:47<28:30:38,  3.47it/s]
  4%|▍         | 15060/371472 [1:12:47<28:19:36,  3.50it/s]
                                                           
{'loss': 4.7323, 'learning_rate': 9.639778922191815e-07, 'epoch': 0.65}

  4%|▍         | 15060/371472 [1:12:47<28:19:36,  3.50it/s]
  4%|▍         | 15061/371472 [1:12:48<27:49:44,  3.56it/s]
  4%|▍         | 15062/371472 [1:12:48<28:15:47,  3.50it/s]
  4%|▍         | 15063/371472 [1:12:48<28:32:37,  3.47it/s]
  4%|▍         | 15064/371472 [1:12:49<29:46:56,  3.32it/s]
  4%|▍         | 15065/371472 [1:12:49<28:37:02,  3.46it/s]
  4%|▍         | 15066/371472 [1:12:49<30:37:07,  3.23it/s]
  4%|▍         | 15067/371472 [1:12:50<30:05:51,  3.29it/s]
  4%|▍         | 15068/371472 [1:12:50<29:25:22,  3.36it/s]
  4%|▍         | 15069/371472 [1:12:50<29:41:29,  3.33it/s]
  4%|▍         | 15070/371472 [1:12:50<29:02:58,  3.41it/s]
  4%|▍         | 15071/371472 [1:12:51<27:27:03,  3.61it/s]
  4%|▍         | 15072/371472 [1:12:51<27:07:51,  3.65it/s]
  4%|▍         | 15073/371472 [1:12:51<27:53:13,  3.55it/s]
  4%|▍         | 15074/371472 [1:12:52<27:15:05,  3.63it/s]
  4%|▍         | 15075/371472 [1:12:52<27:05:40,  3.65it/s]
  4%|▍         | 15076/371472 [1:12:52<27:10:00,  3.64it/s]
  4%|▍         | 15077/371472 [1:12:52<27:04:06,  3.66it/s]
  4%|▍         | 15078/371472 [1:12:53<26:38:20,  3.72it/s]
  4%|▍         | 15079/371472 [1:12:53<27:19:31,  3.62it/s]
  4%|▍         | 15080/371472 [1:12:53<26:50:01,  3.69it/s]
                                                           
{'loss': 4.5574, 'learning_rate': 9.639294102437028e-07, 'epoch': 0.65}

  4%|▍         | 15080/371472 [1:12:53<26:50:01,  3.69it/s]
  4%|▍         | 15081/371472 [1:12:53<28:15:02,  3.50it/s]
  4%|▍         | 15082/371472 [1:12:54<29:36:12,  3.34it/s]
  4%|▍         | 15083/371472 [1:12:54<30:08:38,  3.28it/s]
  4%|▍         | 15084/371472 [1:12:54<29:18:36,  3.38it/s]
  4%|▍         | 15085/371472 [1:12:55<28:53:48,  3.43it/s]
  4%|▍         | 15086/371472 [1:12:55<28:34:35,  3.46it/s]
  4%|▍         | 15087/371472 [1:12:55<29:03:14,  3.41it/s]
  4%|▍         | 15088/371472 [1:12:55<27:38:44,  3.58it/s]
  4%|▍         | 15089/371472 [1:12:56<26:29:09,  3.74it/s]
  4%|▍         | 15090/371472 [1:12:56<27:53:01,  3.55it/s]
  4%|▍         | 15091/371472 [1:12:56<30:46:39,  3.22it/s]
  4%|▍         | 15092/371472 [1:12:57<29:06:42,  3.40it/s]
  4%|▍         | 15093/371472 [1:12:57<28:00:05,  3.54it/s]
  4%|▍         | 15094/371472 [1:12:57<28:14:27,  3.51it/s]
  4%|▍         | 15095/371472 [1:12:57<27:15:05,  3.63it/s]
  4%|▍         | 15096/371472 [1:12:58<28:02:29,  3.53it/s]
  4%|▍         | 15097/371472 [1:12:58<28:53:02,  3.43it/s]
  4%|▍         | 15098/371472 [1:12:58<28:26:18,  3.48it/s]
  4%|▍         | 15099/371472 [1:12:59<28:48:55,  3.44it/s]
  4%|▍         | 15100/371472 [1:12:59<27:48:18,  3.56it/s]
                                                           
{'loss': 4.8495, 'learning_rate': 9.638809282682238e-07, 'epoch': 0.65}

  4%|▍         | 15100/371472 [1:12:59<27:48:18,  3.56it/s]
  4%|▍         | 15101/371472 [1:12:59<27:27:02,  3.61it/s]
  4%|▍         | 15102/371472 [1:12:59<27:52:34,  3.55it/s]
  4%|▍         | 15103/371472 [1:13:00<28:31:42,  3.47it/s]
  4%|▍         | 15104/371472 [1:13:00<27:28:44,  3.60it/s]
  4%|▍         | 15105/371472 [1:13:00<27:54:55,  3.55it/s]
  4%|▍         | 15106/371472 [1:13:01<26:43:28,  3.70it/s]
  4%|▍         | 15107/371472 [1:13:01<27:06:33,  3.65it/s]
  4%|▍         | 15108/371472 [1:13:01<27:21:22,  3.62it/s]
  4%|▍         | 15109/371472 [1:13:01<27:41:02,  3.58it/s]
  4%|▍         | 15110/371472 [1:13:02<28:56:52,  3.42it/s]
  4%|▍         | 15111/371472 [1:13:02<29:29:29,  3.36it/s]
  4%|▍         | 15112/371472 [1:13:02<28:40:08,  3.45it/s]
  4%|▍         | 15113/371472 [1:13:03<28:19:58,  3.49it/s]
  4%|▍         | 15114/371472 [1:13:03<27:26:44,  3.61it/s]
  4%|▍         | 15115/371472 [1:13:03<28:38:00,  3.46it/s]
  4%|▍         | 15116/371472 [1:13:03<28:56:17,  3.42it/s]
  4%|▍         | 15117/371472 [1:13:04<27:56:14,  3.54it/s]
  4%|▍         | 15118/371472 [1:13:04<27:39:51,  3.58it/s]
  4%|▍         | 15119/371472 [1:13:04<27:56:02,  3.54it/s]
  4%|▍         | 15120/371472 [1:13:05<27:39:51,  3.58it/s]
                                                           
{'loss': 4.5805, 'learning_rate': 9.63832446292745e-07, 'epoch': 0.65}

  4%|▍         | 15120/371472 [1:13:05<27:39:51,  3.58it/s]
  4%|▍         | 15121/371472 [1:13:05<27:56:52,  3.54it/s]
  4%|▍         | 15122/371472 [1:13:05<28:59:13,  3.41it/s]
  4%|▍         | 15123/371472 [1:13:05<27:43:58,  3.57it/s]
  4%|▍         | 15124/371472 [1:13:06<30:30:52,  3.24it/s]
  4%|▍         | 15125/371472 [1:13:06<30:29:32,  3.25it/s]
  4%|▍         | 15126/371472 [1:13:06<32:18:58,  3.06it/s]
  4%|▍         | 15127/371472 [1:13:07<30:45:32,  3.22it/s]
  4%|▍         | 15128/371472 [1:13:07<29:35:38,  3.34it/s]
  4%|▍         | 15129/371472 [1:13:07<28:22:04,  3.49it/s]
  4%|▍         | 15130/371472 [1:13:08<27:05:31,  3.65it/s]
  4%|▍         | 15131/371472 [1:13:08<26:55:29,  3.68it/s]
  4%|▍         | 15132/371472 [1:13:08<28:49:32,  3.43it/s]
  4%|▍         | 15133/371472 [1:13:08<28:48:54,  3.44it/s]
  4%|▍         | 15134/371472 [1:13:09<29:17:10,  3.38it/s]
  4%|▍         | 15135/371472 [1:13:09<28:58:20,  3.42it/s]
  4%|▍         | 15136/371472 [1:13:09<30:06:31,  3.29it/s]
  4%|▍         | 15137/371472 [1:13:10<29:04:44,  3.40it/s]
  4%|▍         | 15138/371472 [1:13:10<28:14:50,  3.50it/s]
  4%|▍         | 15139/371472 [1:13:10<34:47:24,  2.85it/s]
  4%|▍         | 15140/371472 [1:13:11<32:55:48,  3.01it/s]
                                                           
{'loss': 4.3699, 'learning_rate': 9.637839643172662e-07, 'epoch': 0.65}

  4%|▍         | 15140/371472 [1:13:11<32:55:48,  3.01it/s]
  4%|▍         | 15141/371472 [1:13:11<32:21:00,  3.06it/s]
  4%|▍         | 15142/371472 [1:13:11<30:30:55,  3.24it/s]
  4%|▍         | 15143/371472 [1:13:11<28:37:59,  3.46it/s]
  4%|▍         | 15144/371472 [1:13:12<28:17:51,  3.50it/s]
  4%|▍         | 15145/371472 [1:13:12<28:21:43,  3.49it/s]
  4%|▍         | 15146/371472 [1:13:12<28:13:27,  3.51it/s]
  4%|▍         | 15147/371472 [1:13:13<28:46:52,  3.44it/s]
  4%|▍         | 15148/371472 [1:13:13<28:13:41,  3.51it/s]
  4%|▍         | 15149/371472 [1:13:13<30:15:07,  3.27it/s]
  4%|▍         | 15150/371472 [1:13:14<29:26:52,  3.36it/s]
  4%|▍         | 15151/371472 [1:13:14<29:11:34,  3.39it/s]
  4%|▍         | 15152/371472 [1:13:14<28:04:39,  3.53it/s]
  4%|▍         | 15153/371472 [1:13:14<27:24:05,  3.61it/s]
  4%|▍         | 15154/371472 [1:13:15<28:57:18,  3.42it/s]
  4%|▍         | 15155/371472 [1:13:15<28:31:26,  3.47it/s]
  4%|▍         | 15156/371472 [1:13:15<28:07:51,  3.52it/s]
  4%|▍         | 15157/371472 [1:13:16<27:36:18,  3.59it/s]
  4%|▍         | 15158/371472 [1:13:16<28:26:00,  3.48it/s]
  4%|▍         | 15159/371472 [1:13:16<27:25:02,  3.61it/s]
  4%|▍         | 15160/371472 [1:13:16<29:51:08,  3.32it/s]
                                                           
{'loss': 4.8785, 'learning_rate': 9.63735482341787e-07, 'epoch': 0.65}

  4%|▍         | 15160/371472 [1:13:16<29:51:08,  3.32it/s]
  4%|▍         | 15161/371472 [1:13:17<29:34:39,  3.35it/s]
  4%|▍         | 15162/371472 [1:13:17<28:40:30,  3.45it/s]
  4%|▍         | 15163/371472 [1:13:17<28:41:14,  3.45it/s]
  4%|▍         | 15164/371472 [1:13:18<28:26:46,  3.48it/s]
  4%|▍         | 15165/371472 [1:13:18<28:32:09,  3.47it/s]
  4%|▍         | 15166/371472 [1:13:18<27:57:02,  3.54it/s]
  4%|▍         | 15167/371472 [1:13:18<27:37:57,  3.58it/s]
  4%|▍         | 15168/371472 [1:13:19<29:01:33,  3.41it/s]
  4%|▍         | 15169/371472 [1:13:19<29:52:27,  3.31it/s]
  4%|▍         | 15170/371472 [1:13:19<28:48:45,  3.44it/s]
  4%|▍         | 15171/371472 [1:13:20<27:26:30,  3.61it/s]
  4%|▍         | 15172/371472 [1:13:20<27:32:17,  3.59it/s]
  4%|▍         | 15173/371472 [1:13:20<27:15:23,  3.63it/s]
  4%|▍         | 15174/371472 [1:13:20<27:24:49,  3.61it/s]
  4%|▍         | 15175/371472 [1:13:21<27:29:08,  3.60it/s]
  4%|▍         | 15176/371472 [1:13:21<27:09:43,  3.64it/s]
  4%|▍         | 15177/371472 [1:13:21<27:36:56,  3.58it/s]
  4%|▍         | 15178/371472 [1:13:21<26:44:35,  3.70it/s]
  4%|▍         | 15179/371472 [1:13:22<27:05:31,  3.65it/s]
  4%|▍         | 15180/371472 [1:13:22<27:03:22,  3.66it/s]
                                                           
{'loss': 4.7165, 'learning_rate': 9.636870003663083e-07, 'epoch': 0.65}

  4%|▍         | 15180/371472 [1:13:22<27:03:22,  3.66it/s]
  4%|▍         | 15181/371472 [1:13:22<26:45:32,  3.70it/s]
  4%|▍         | 15182/371472 [1:13:23<26:13:20,  3.77it/s]
  4%|▍         | 15183/371472 [1:13:23<29:20:49,  3.37it/s]
  4%|▍         | 15184/371472 [1:13:23<29:40:27,  3.34it/s]
  4%|▍         | 15185/371472 [1:13:24<29:25:18,  3.36it/s]
  4%|▍         | 15186/371472 [1:13:24<29:39:28,  3.34it/s]
  4%|▍         | 15187/371472 [1:13:24<28:21:21,  3.49it/s]
  4%|▍         | 15188/371472 [1:13:24<28:54:50,  3.42it/s]
  4%|▍         | 15189/371472 [1:13:25<29:25:18,  3.36it/s]
  4%|▍         | 15190/371472 [1:13:25<27:53:13,  3.55it/s]
  4%|▍         | 15191/371472 [1:13:25<27:55:58,  3.54it/s]
  4%|▍         | 15192/371472 [1:13:25<27:54:08,  3.55it/s]
  4%|▍         | 15193/371472 [1:13:26<29:43:12,  3.33it/s]
  4%|▍         | 15194/371472 [1:13:26<29:25:33,  3.36it/s]
  4%|▍         | 15195/371472 [1:13:26<29:22:05,  3.37it/s]
  4%|▍         | 15196/371472 [1:13:27<28:45:31,  3.44it/s]
  4%|▍         | 15197/371472 [1:13:27<28:03:31,  3.53it/s]
  4%|▍         | 15198/371472 [1:13:27<27:30:02,  3.60it/s]
  4%|▍         | 15199/371472 [1:13:28<28:32:00,  3.47it/s]
  4%|▍         | 15200/371472 [1:13:28<28:59:56,  3.41it/s]
                                                           
{'loss': 4.8152, 'learning_rate': 9.636385183908292e-07, 'epoch': 0.65}

  4%|▍         | 15200/371472 [1:13:28<28:59:56,  3.41it/s]
  4%|▍         | 15201/371472 [1:13:28<28:49:32,  3.43it/s]
  4%|▍         | 15202/371472 [1:13:28<28:17:26,  3.50it/s]
  4%|▍         | 15203/371472 [1:13:29<28:28:19,  3.48it/s]
  4%|▍         | 15204/371472 [1:13:29<27:56:29,  3.54it/s]
  4%|▍         | 15205/371472 [1:13:29<30:51:21,  3.21it/s]
  4%|▍         | 15206/371472 [1:13:30<29:08:32,  3.40it/s]
  4%|▍         | 15207/371472 [1:13:30<29:12:40,  3.39it/s]
  4%|▍         | 15208/371472 [1:13:30<29:50:34,  3.32it/s]
  4%|▍         | 15209/371472 [1:13:30<28:46:03,  3.44it/s]
  4%|▍         | 15210/371472 [1:13:31<28:30:25,  3.47it/s]
  4%|▍         | 15211/371472 [1:13:31<28:15:08,  3.50it/s]
  4%|▍         | 15212/371472 [1:13:31<28:14:17,  3.50it/s]
  4%|▍         | 15213/371472 [1:13:32<28:22:43,  3.49it/s]
  4%|▍         | 15214/371472 [1:13:32<27:52:49,  3.55it/s]
  4%|▍         | 15215/371472 [1:13:32<29:01:53,  3.41it/s]
  4%|▍         | 15216/371472 [1:13:32<28:30:25,  3.47it/s]
  4%|▍         | 15217/371472 [1:13:33<28:10:01,  3.51it/s]
  4%|▍         | 15218/371472 [1:13:33<27:41:37,  3.57it/s]
  4%|▍         | 15219/371472 [1:13:33<28:14:57,  3.50it/s]
  4%|▍         | 15220/371472 [1:13:34<30:35:10,  3.24it/s]
                                                           
{'loss': 4.4532, 'learning_rate': 9.635900364153505e-07, 'epoch': 0.66}

  4%|▍         | 15220/371472 [1:13:34<30:35:10,  3.24it/s]
  4%|▍         | 15221/371472 [1:13:34<29:22:35,  3.37it/s]
  4%|▍         | 15222/371472 [1:13:34<28:15:05,  3.50it/s]
  4%|▍         | 15223/371472 [1:13:34<27:46:08,  3.56it/s]
  4%|▍         | 15224/371472 [1:13:35<27:01:56,  3.66it/s]
  4%|▍         | 15225/371472 [1:13:35<27:15:17,  3.63it/s]
  4%|▍         | 15226/371472 [1:13:35<28:32:52,  3.47it/s]
  4%|▍         | 15227/371472 [1:13:36<27:52:36,  3.55it/s]
  4%|▍         | 15228/371472 [1:13:36<28:04:00,  3.53it/s]
  4%|▍         | 15229/371472 [1:13:36<28:00:50,  3.53it/s]
  4%|▍         | 15230/371472 [1:13:36<27:04:53,  3.65it/s]
  4%|▍         | 15231/371472 [1:13:37<27:06:16,  3.65it/s]
  4%|▍         | 15232/371472 [1:13:37<26:47:59,  3.69it/s]
  4%|▍         | 15233/371472 [1:13:37<27:09:43,  3.64it/s]
  4%|▍         | 15234/371472 [1:13:38<27:59:34,  3.53it/s]
  4%|▍         | 15235/371472 [1:13:38<28:02:22,  3.53it/s]
  4%|▍         | 15236/371472 [1:13:38<28:58:18,  3.42it/s]
  4%|▍         | 15237/371472 [1:13:38<27:56:34,  3.54it/s]
  4%|▍         | 15238/371472 [1:13:39<27:01:55,  3.66it/s]
  4%|▍         | 15239/371472 [1:13:39<28:00:37,  3.53it/s]
  4%|▍         | 15240/371472 [1:13:39<27:23:17,  3.61it/s]
                                                           
{'loss': 4.6873, 'learning_rate': 9.635415544398716e-07, 'epoch': 0.66}

  4%|▍         | 15240/371472 [1:13:39<27:23:17,  3.61it/s]
  4%|▍         | 15241/371472 [1:13:39<26:39:14,  3.71it/s]
  4%|▍         | 15242/371472 [1:13:40<28:17:55,  3.50it/s]
  4%|▍         | 15243/371472 [1:13:40<27:39:22,  3.58it/s]
  4%|▍         | 15244/371472 [1:13:40<27:23:15,  3.61it/s]
  4%|▍         | 15245/371472 [1:13:41<28:05:05,  3.52it/s]
  4%|▍         | 15246/371472 [1:13:41<27:51:08,  3.55it/s]
  4%|▍         | 15247/371472 [1:13:41<27:27:36,  3.60it/s]
  4%|▍         | 15248/371472 [1:13:42<28:50:50,  3.43it/s]
  4%|▍         | 15249/371472 [1:13:42<28:52:37,  3.43it/s]
  4%|▍         | 15250/371472 [1:13:42<28:18:10,  3.50it/s]
  4%|▍         | 15251/371472 [1:13:42<28:24:14,  3.48it/s]
  4%|▍         | 15252/371472 [1:13:43<28:52:40,  3.43it/s]
  4%|▍         | 15253/371472 [1:13:43<27:39:44,  3.58it/s]
  4%|▍         | 15254/371472 [1:13:43<27:55:30,  3.54it/s]
  4%|▍         | 15255/371472 [1:13:43<27:50:51,  3.55it/s]
  4%|▍         | 15256/371472 [1:13:44<27:42:11,  3.57it/s]
  4%|▍         | 15257/371472 [1:13:44<28:34:29,  3.46it/s]
  4%|▍         | 15258/371472 [1:13:44<29:13:51,  3.39it/s]
  4%|▍         | 15259/371472 [1:13:45<28:50:17,  3.43it/s]
  4%|▍         | 15260/371472 [1:13:45<30:29:56,  3.24it/s]
                                                           
{'loss': 4.6663, 'learning_rate': 9.634930724643926e-07, 'epoch': 0.66}

  4%|▍         | 15260/371472 [1:13:45<30:29:56,  3.24it/s]
  4%|▍         | 15261/371472 [1:13:45<30:58:14,  3.19it/s]
  4%|▍         | 15262/371472 [1:13:46<34:24:23,  2.88it/s]
  4%|▍         | 15263/371472 [1:13:46<32:16:54,  3.07it/s]
  4%|▍         | 15264/371472 [1:13:46<30:17:16,  3.27it/s]
  4%|▍         | 15265/371472 [1:13:47<31:33:31,  3.14it/s]
  4%|▍         | 15266/371472 [1:13:47<30:10:31,  3.28it/s]
  4%|▍         | 15267/371472 [1:13:47<28:28:28,  3.47it/s]
  4%|▍         | 15268/371472 [1:13:47<27:31:19,  3.60it/s]
  4%|▍         | 15269/371472 [1:13:48<26:53:40,  3.68it/s]
  4%|▍         | 15270/371472 [1:13:48<26:26:28,  3.74it/s]
  4%|▍         | 15271/371472 [1:13:48<26:23:09,  3.75it/s]
  4%|▍         | 15272/371472 [1:13:49<27:57:24,  3.54it/s]
  4%|▍         | 15273/371472 [1:13:49<27:55:21,  3.54it/s]
  4%|▍         | 15274/371472 [1:13:49<27:34:46,  3.59it/s]
  4%|▍         | 15275/371472 [1:13:49<27:22:38,  3.61it/s]
  4%|▍         | 15276/371472 [1:13:50<26:46:17,  3.70it/s]
  4%|▍         | 15277/371472 [1:13:50<27:16:07,  3.63it/s]
  4%|▍         | 15278/371472 [1:13:50<27:10:37,  3.64it/s]
  4%|▍         | 15279/371472 [1:13:50<27:38:04,  3.58it/s]
  4%|▍         | 15280/371472 [1:13:51<27:21:52,  3.62it/s]
                                                           
{'loss': 4.776, 'learning_rate': 9.634445904889137e-07, 'epoch': 0.66}

  4%|▍         | 15280/371472 [1:13:51<27:21:52,  3.62it/s]
  4%|▍         | 15281/371472 [1:13:51<27:39:17,  3.58it/s]
  4%|▍         | 15282/371472 [1:13:51<28:33:22,  3.46it/s]
  4%|▍         | 15283/371472 [1:13:52<30:22:05,  3.26it/s]
  4%|▍         | 15284/371472 [1:13:52<29:00:26,  3.41it/s]
  4%|▍         | 15285/371472 [1:13:52<28:42:07,  3.45it/s]
  4%|▍         | 15286/371472 [1:13:52<28:20:27,  3.49it/s]
  4%|▍         | 15287/371472 [1:13:53<28:33:22,  3.46it/s]
  4%|▍         | 15288/371472 [1:13:53<30:20:10,  3.26it/s]
  4%|▍         | 15289/371472 [1:13:53<29:41:06,  3.33it/s]
  4%|▍         | 15290/371472 [1:13:54<29:05:18,  3.40it/s]
  4%|▍         | 15291/371472 [1:13:54<27:46:05,  3.56it/s]
  4%|▍         | 15292/371472 [1:13:54<27:49:21,  3.56it/s]
  4%|▍         | 15293/371472 [1:13:55<28:13:57,  3.50it/s]
  4%|▍         | 15294/371472 [1:13:55<28:25:36,  3.48it/s]
  4%|▍         | 15295/371472 [1:13:55<27:50:25,  3.55it/s]
  4%|▍         | 15296/371472 [1:13:55<27:51:09,  3.55it/s]
  4%|▍         | 15297/371472 [1:13:56<27:23:22,  3.61it/s]
  4%|▍         | 15298/371472 [1:13:56<26:38:17,  3.71it/s]
  4%|▍         | 15299/371472 [1:13:56<27:29:21,  3.60it/s]
  4%|▍         | 15300/371472 [1:13:56<26:49:36,  3.69it/s]
                                                           
{'loss': 4.6215, 'learning_rate': 9.633961085134348e-07, 'epoch': 0.66}

  4%|▍         | 15300/371472 [1:13:56<26:49:36,  3.69it/s]
  4%|▍         | 15301/371472 [1:13:57<28:24:18,  3.48it/s]
  4%|▍         | 15302/371472 [1:13:57<28:58:53,  3.41it/s]
  4%|▍         | 15303/371472 [1:13:57<29:12:23,  3.39it/s]
  4%|▍         | 15304/371472 [1:13:58<28:40:36,  3.45it/s]
  4%|▍         | 15305/371472 [1:13:58<28:25:17,  3.48it/s]
  4%|▍         | 15306/371472 [1:13:58<27:49:33,  3.56it/s]
  4%|▍         | 15307/371472 [1:13:58<27:22:00,  3.62it/s]
  4%|▍         | 15308/371472 [1:13:59<28:23:06,  3.49it/s]
  4%|▍         | 15309/371472 [1:13:59<27:13:58,  3.63it/s]
  4%|▍         | 15310/371472 [1:13:59<27:38:25,  3.58it/s]
  4%|▍         | 15311/371472 [1:14:00<27:29:57,  3.60it/s]
  4%|▍         | 15312/371472 [1:14:00<27:51:06,  3.55it/s]
  4%|▍         | 15313/371472 [1:14:00<27:03:15,  3.66it/s]
  4%|▍         | 15314/371472 [1:14:00<26:46:10,  3.70it/s]
  4%|▍         | 15315/371472 [1:14:01<28:30:46,  3.47it/s]
  4%|▍         | 15316/371472 [1:14:01<28:27:54,  3.48it/s]
  4%|▍         | 15317/371472 [1:14:01<32:22:50,  3.06it/s]
  4%|▍         | 15318/371472 [1:14:02<31:20:56,  3.16it/s]
  4%|▍         | 15319/371472 [1:14:02<29:42:41,  3.33it/s]
  4%|▍         | 15320/371472 [1:14:02<28:49:11,  3.43it/s]
                                                           
{'loss': 4.921, 'learning_rate': 9.63347626537956e-07, 'epoch': 0.66}

  4%|▍         | 15320/371472 [1:14:02<28:49:11,  3.43it/s]
  4%|▍         | 15321/371472 [1:14:03<28:28:09,  3.48it/s]
  4%|▍         | 15322/371472 [1:14:03<28:43:25,  3.44it/s]
  4%|▍         | 15323/371472 [1:14:03<29:05:40,  3.40it/s]
  4%|▍         | 15324/371472 [1:14:03<28:39:18,  3.45it/s]
  4%|▍         | 15325/371472 [1:14:04<28:23:41,  3.48it/s]
  4%|▍         | 15326/371472 [1:14:04<27:34:49,  3.59it/s]
  4%|▍         | 15327/371472 [1:14:04<28:32:58,  3.47it/s]
  4%|▍         | 15328/371472 [1:14:05<27:08:58,  3.64it/s]
  4%|▍         | 15329/371472 [1:14:05<26:45:21,  3.70it/s]
  4%|▍         | 15330/371472 [1:14:05<27:03:07,  3.66it/s]
  4%|▍         | 15331/371472 [1:14:05<26:38:35,  3.71it/s]
  4%|▍         | 15332/371472 [1:14:06<26:32:28,  3.73it/s]
  4%|▍         | 15333/371472 [1:14:06<27:33:49,  3.59it/s]
  4%|▍         | 15334/371472 [1:14:06<26:57:11,  3.67it/s]
  4%|▍         | 15335/371472 [1:14:06<28:26:38,  3.48it/s]
  4%|▍         | 15336/371472 [1:14:07<29:54:06,  3.31it/s]
  4%|▍         | 15337/371472 [1:14:07<28:45:53,  3.44it/s]
  4%|▍         | 15338/371472 [1:14:07<28:11:06,  3.51it/s]
  4%|▍         | 15339/371472 [1:14:08<27:24:15,  3.61it/s]
  4%|▍         | 15340/371472 [1:14:08<27:28:17,  3.60it/s]
                                                           
{'loss': 4.8543, 'learning_rate': 9.63299144562477e-07, 'epoch': 0.66}

  4%|▍         | 15340/371472 [1:14:08<27:28:17,  3.60it/s]
  4%|▍         | 15341/371472 [1:14:08<27:54:05,  3.55it/s]
  4%|▍         | 15342/371472 [1:14:09<30:40:06,  3.23it/s]
  4%|▍         | 15343/371472 [1:14:09<30:18:47,  3.26it/s]
  4%|▍         | 15344/371472 [1:14:09<30:45:11,  3.22it/s]
  4%|▍         | 15345/371472 [1:14:09<29:39:20,  3.34it/s]
  4%|▍         | 15346/371472 [1:14:10<28:23:35,  3.48it/s]
  4%|▍         | 15347/371472 [1:14:10<27:30:50,  3.60it/s]
  4%|▍         | 15348/371472 [1:14:10<27:19:59,  3.62it/s]
  4%|▍         | 15349/371472 [1:14:11<29:05:11,  3.40it/s]
  4%|▍         | 15350/371472 [1:14:11<28:14:14,  3.50it/s]
  4%|▍         | 15351/371472 [1:14:11<29:38:30,  3.34it/s]
  4%|▍         | 15352/371472 [1:14:11<28:23:36,  3.48it/s]
  4%|▍         | 15353/371472 [1:14:12<29:52:12,  3.31it/s]
  4%|▍         | 15354/371472 [1:14:12<30:32:54,  3.24it/s]
  4%|▍         | 15355/371472 [1:14:12<31:05:47,  3.18it/s]
  4%|▍         | 15356/371472 [1:14:13<29:33:37,  3.35it/s]
  4%|▍         | 15357/371472 [1:14:13<29:25:30,  3.36it/s]
  4%|▍         | 15358/371472 [1:14:13<30:06:27,  3.29it/s]
  4%|▍         | 15359/371472 [1:14:14<29:46:13,  3.32it/s]
  4%|▍         | 15360/371472 [1:14:14<29:51:46,  3.31it/s]
                                                           
{'loss': 4.643, 'learning_rate': 9.632506625869982e-07, 'epoch': 0.66}

  4%|▍         | 15360/371472 [1:14:14<29:51:46,  3.31it/s]
  4%|▍         | 15361/371472 [1:14:14<31:02:27,  3.19it/s]
  4%|▍         | 15362/371472 [1:14:14<29:31:19,  3.35it/s]
  4%|▍         | 15363/371472 [1:14:15<28:06:42,  3.52it/s]
  4%|▍         | 15364/371472 [1:14:15<28:21:29,  3.49it/s]
  4%|▍         | 15365/371472 [1:14:15<27:37:10,  3.58it/s]
  4%|▍         | 15366/371472 [1:14:16<27:37:05,  3.58it/s]
  4%|▍         | 15367/371472 [1:14:16<26:57:22,  3.67it/s]
  4%|▍         | 15368/371472 [1:14:16<26:52:28,  3.68it/s]
  4%|▍         | 15369/371472 [1:14:16<26:53:38,  3.68it/s]
  4%|▍         | 15370/371472 [1:14:17<29:18:00,  3.38it/s]
  4%|▍         | 15371/371472 [1:14:17<28:14:02,  3.50it/s]
  4%|▍         | 15372/371472 [1:14:17<27:06:39,  3.65it/s]
  4%|▍         | 15373/371472 [1:14:17<26:55:35,  3.67it/s]
  4%|▍         | 15374/371472 [1:14:18<28:05:47,  3.52it/s]
  4%|▍         | 15375/371472 [1:14:18<30:15:53,  3.27it/s]
  4%|▍         | 15376/371472 [1:14:18<29:33:06,  3.35it/s]
  4%|▍         | 15377/371472 [1:14:19<30:51:03,  3.21it/s]
  4%|▍         | 15378/371472 [1:14:19<28:54:05,  3.42it/s]
  4%|▍         | 15379/371472 [1:14:19<27:36:47,  3.58it/s]
  4%|▍         | 15380/371472 [1:14:20<28:04:32,  3.52it/s]
                                                           
{'loss': 4.901, 'learning_rate': 9.632021806115193e-07, 'epoch': 0.66}

  4%|▍         | 15380/371472 [1:14:20<28:04:32,  3.52it/s]
  4%|▍         | 15381/371472 [1:14:20<33:02:06,  2.99it/s]
  4%|▍         | 15382/371472 [1:14:20<31:30:01,  3.14it/s]
  4%|▍         | 15383/371472 [1:14:21<31:07:30,  3.18it/s]
  4%|▍         | 15384/371472 [1:14:21<30:06:37,  3.29it/s]
  4%|▍         | 15385/371472 [1:14:21<31:02:55,  3.19it/s]
  4%|▍         | 15386/371472 [1:14:21<29:20:18,  3.37it/s]
  4%|▍         | 15387/371472 [1:14:22<27:52:42,  3.55it/s]
  4%|▍         | 15388/371472 [1:14:22<27:36:37,  3.58it/s]
  4%|▍         | 15389/371472 [1:14:22<28:48:42,  3.43it/s]
  4%|▍         | 15390/371472 [1:14:23<28:02:11,  3.53it/s]
  4%|▍         | 15391/371472 [1:14:23<27:38:24,  3.58it/s]
  4%|▍         | 15392/371472 [1:14:23<27:45:52,  3.56it/s]
  4%|▍         | 15393/371472 [1:14:23<28:49:02,  3.43it/s]
  4%|▍         | 15394/371472 [1:14:24<27:54:04,  3.55it/s]
  4%|▍         | 15395/371472 [1:14:24<28:26:42,  3.48it/s]
  4%|▍         | 15396/371472 [1:14:24<27:38:40,  3.58it/s]
  4%|▍         | 15397/371472 [1:14:25<27:52:01,  3.55it/s]
  4%|▍         | 15398/371472 [1:14:25<27:21:31,  3.62it/s]
  4%|▍         | 15399/371472 [1:14:25<28:11:03,  3.51it/s]
  4%|▍         | 15400/371472 [1:14:25<27:15:08,  3.63it/s]
                                                           
{'loss': 4.6514, 'learning_rate': 9.631536986360403e-07, 'epoch': 0.66}

  4%|▍         | 15400/371472 [1:14:25<27:15:08,  3.63it/s]
  4%|▍         | 15401/371472 [1:14:26<26:53:37,  3.68it/s]
  4%|▍         | 15402/371472 [1:14:26<27:19:50,  3.62it/s]
  4%|▍         | 15403/371472 [1:14:26<30:55:56,  3.20it/s]
  4%|▍         | 15404/371472 [1:14:27<29:42:30,  3.33it/s]
  4%|▍         | 15405/371472 [1:14:27<30:04:38,  3.29it/s]
  4%|▍         | 15406/371472 [1:14:27<29:08:08,  3.39it/s]
  4%|▍         | 15407/371472 [1:14:27<27:58:44,  3.54it/s]
  4%|▍         | 15408/371472 [1:14:28<29:18:50,  3.37it/s]
  4%|▍         | 15409/371472 [1:14:28<30:10:54,  3.28it/s]
  4%|▍         | 15410/371472 [1:14:28<28:52:29,  3.43it/s]
  4%|▍         | 15411/371472 [1:14:29<28:31:20,  3.47it/s]
  4%|▍         | 15412/371472 [1:14:29<28:15:07,  3.50it/s]
  4%|▍         | 15413/371472 [1:14:29<27:57:23,  3.54it/s]
  4%|▍         | 15414/371472 [1:14:29<28:11:54,  3.51it/s]
  4%|▍         | 15415/371472 [1:14:30<27:58:30,  3.54it/s]
  4%|▍         | 15416/371472 [1:14:30<27:39:53,  3.58it/s]
  4%|▍         | 15417/371472 [1:14:30<27:12:32,  3.63it/s]
  4%|▍         | 15418/371472 [1:14:31<27:34:12,  3.59it/s]
  4%|▍         | 15419/371472 [1:14:31<28:06:55,  3.52it/s]
  4%|▍         | 15420/371472 [1:14:31<28:11:33,  3.51it/s]
                                                           
{'loss': 4.6956, 'learning_rate': 9.631052166605614e-07, 'epoch': 0.66}

  4%|▍         | 15420/371472 [1:14:31<28:11:33,  3.51it/s]
  4%|▍         | 15421/371472 [1:14:31<27:24:13,  3.61it/s]
  4%|▍         | 15422/371472 [1:14:32<26:41:46,  3.70it/s]
  4%|▍         | 15423/371472 [1:14:32<27:34:44,  3.59it/s]
  4%|▍         | 15424/371472 [1:14:32<27:22:49,  3.61it/s]
  4%|▍         | 15425/371472 [1:14:33<29:35:46,  3.34it/s]
  4%|▍         | 15426/371472 [1:14:33<28:44:37,  3.44it/s]
  4%|▍         | 15427/371472 [1:14:33<28:02:54,  3.53it/s]
  4%|▍         | 15428/371472 [1:14:33<27:42:12,  3.57it/s]
  4%|▍         | 15429/371472 [1:14:34<31:26:47,  3.15it/s]
  4%|▍         | 15430/371472 [1:14:34<30:26:55,  3.25it/s]
  4%|▍         | 15431/371472 [1:14:34<29:46:10,  3.32it/s]
  4%|▍         | 15432/371472 [1:14:35<30:57:20,  3.19it/s]
  4%|▍         | 15433/371472 [1:14:35<28:59:12,  3.41it/s]
  4%|▍         | 15434/371472 [1:14:35<27:37:48,  3.58it/s]
  4%|▍         | 15435/371472 [1:14:35<26:57:19,  3.67it/s]
  4%|▍         | 15436/371472 [1:14:36<26:11:30,  3.78it/s]
  4%|▍         | 15437/371472 [1:14:36<26:54:13,  3.68it/s]
  4%|▍         | 15438/371472 [1:14:36<27:40:58,  3.57it/s]
  4%|▍         | 15439/371472 [1:14:37<27:00:13,  3.66it/s]
  4%|▍         | 15440/371472 [1:14:37<27:39:33,  3.58it/s]
                                                           
{'loss': 4.6573, 'learning_rate': 9.630567346850825e-07, 'epoch': 0.67}

  4%|▍         | 15440/371472 [1:14:37<27:39:33,  3.58it/s]
  4%|▍         | 15441/371472 [1:14:37<28:18:21,  3.49it/s]
  4%|▍         | 15442/371472 [1:14:38<30:12:35,  3.27it/s]
  4%|▍         | 15443/371472 [1:14:38<28:26:23,  3.48it/s]
  4%|▍         | 15444/371472 [1:14:38<27:34:05,  3.59it/s]
  4%|▍         | 15445/371472 [1:14:38<28:23:43,  3.48it/s]
  4%|▍         | 15446/371472 [1:14:39<28:39:49,  3.45it/s]
  4%|▍         | 15447/371472 [1:14:39<27:33:12,  3.59it/s]
  4%|▍         | 15448/371472 [1:14:39<28:42:36,  3.44it/s]
  4%|▍         | 15449/371472 [1:14:39<28:53:50,  3.42it/s]
  4%|▍         | 15450/371472 [1:14:40<28:45:05,  3.44it/s]
  4%|▍         | 15451/371472 [1:14:40<28:29:48,  3.47it/s]
  4%|▍         | 15452/371472 [1:14:40<27:26:48,  3.60it/s]
  4%|▍         | 15453/371472 [1:14:41<27:44:01,  3.57it/s]
  4%|▍         | 15454/371472 [1:14:41<27:25:08,  3.61it/s]
  4%|▍         | 15455/371472 [1:14:41<27:06:44,  3.65it/s]
  4%|▍         | 15456/371472 [1:14:41<26:19:39,  3.76it/s]
  4%|▍         | 15457/371472 [1:14:42<26:07:47,  3.78it/s]
  4%|▍         | 15458/371472 [1:14:42<27:33:07,  3.59it/s]
  4%|▍         | 15459/371472 [1:14:42<26:49:00,  3.69it/s]
  4%|▍         | 15460/371472 [1:14:43<27:21:26,  3.61it/s]
                                                           
{'loss': 4.6353, 'learning_rate': 9.630082527096038e-07, 'epoch': 0.67}

  4%|▍         | 15460/371472 [1:14:43<27:21:26,  3.61it/s]
  4%|▍         | 15461/371472 [1:14:43<27:21:06,  3.62it/s]
  4%|▍         | 15462/371472 [1:14:43<27:19:49,  3.62it/s]
  4%|▍         | 15463/371472 [1:14:43<28:33:08,  3.46it/s]
  4%|▍         | 15464/371472 [1:14:44<29:51:00,  3.31it/s]
  4%|▍         | 15465/371472 [1:14:44<28:35:04,  3.46it/s]
  4%|▍         | 15466/371472 [1:14:44<28:58:20,  3.41it/s]
  4%|▍         | 15467/371472 [1:14:45<28:24:54,  3.48it/s]
  4%|▍         | 15468/371472 [1:14:45<27:45:03,  3.56it/s]
  4%|▍         | 15469/371472 [1:14:45<27:42:10,  3.57it/s]
  4%|▍         | 15470/371472 [1:14:45<26:57:44,  3.67it/s]
  4%|▍         | 15471/371472 [1:14:46<28:45:44,  3.44it/s]
  4%|▍         | 15472/371472 [1:14:46<27:39:56,  3.57it/s]
  4%|▍         | 15473/371472 [1:14:46<27:44:30,  3.56it/s]
  4%|▍         | 15474/371472 [1:14:47<29:09:59,  3.39it/s]
  4%|▍         | 15475/371472 [1:14:47<29:12:09,  3.39it/s]
  4%|▍         | 15476/371472 [1:14:47<29:26:38,  3.36it/s]
  4%|▍         | 15477/371472 [1:14:47<28:36:09,  3.46it/s]
  4%|▍         | 15478/371472 [1:14:48<27:56:37,  3.54it/s]
  4%|▍         | 15479/371472 [1:14:48<27:17:14,  3.62it/s]
  4%|▍         | 15480/371472 [1:14:48<28:51:08,  3.43it/s]
                                                           
{'loss': 4.6602, 'learning_rate': 9.629597707341248e-07, 'epoch': 0.67}

  4%|▍         | 15480/371472 [1:14:48<28:51:08,  3.43it/s]
  4%|▍         | 15481/371472 [1:14:49<28:08:00,  3.51it/s]
  4%|▍         | 15482/371472 [1:14:49<27:53:51,  3.54it/s]
  4%|▍         | 15483/371472 [1:14:49<28:24:50,  3.48it/s]
  4%|▍         | 15484/371472 [1:14:49<29:30:21,  3.35it/s]
  4%|▍         | 15485/371472 [1:14:50<27:57:08,  3.54it/s]
  4%|▍         | 15486/371472 [1:14:50<27:17:44,  3.62it/s]
  4%|▍         | 15487/371472 [1:14:50<26:40:59,  3.71it/s]
  4%|▍         | 15488/371472 [1:14:51<27:56:18,  3.54it/s]
  4%|▍         | 15489/371472 [1:14:51<28:08:47,  3.51it/s]
  4%|▍         | 15490/371472 [1:14:51<29:05:50,  3.40it/s]
  4%|▍         | 15491/371472 [1:14:51<29:07:01,  3.40it/s]
  4%|▍         | 15492/371472 [1:14:52<29:25:47,  3.36it/s]
  4%|▍         | 15493/371472 [1:14:52<29:18:35,  3.37it/s]
  4%|▍         | 15494/371472 [1:14:52<28:42:22,  3.44it/s]
  4%|▍         | 15495/371472 [1:14:53<28:43:18,  3.44it/s]
  4%|▍         | 15496/371472 [1:14:53<29:48:25,  3.32it/s]
  4%|▍         | 15497/371472 [1:14:53<29:22:39,  3.37it/s]
  4%|▍         | 15498/371472 [1:14:53<28:57:37,  3.41it/s]
  4%|▍         | 15499/371472 [1:14:54<27:50:59,  3.55it/s]
  4%|▍         | 15500/371472 [1:14:54<27:00:50,  3.66it/s]
                                                           
{'loss': 4.6295, 'learning_rate': 9.62911288758646e-07, 'epoch': 0.67}

  4%|▍         | 15500/371472 [1:14:54<27:00:50,  3.66it/s]
  4%|▍         | 15501/371472 [1:14:54<28:10:22,  3.51it/s]
  4%|▍         | 15502/371472 [1:14:55<27:42:05,  3.57it/s]
  4%|▍         | 15503/371472 [1:14:55<27:25:37,  3.61it/s]
  4%|▍         | 15504/371472 [1:14:55<27:16:26,  3.63it/s]
  4%|▍         | 15505/371472 [1:14:56<30:55:38,  3.20it/s]
  4%|▍         | 15506/371472 [1:14:56<29:59:38,  3.30it/s]
  4%|▍         | 15507/371472 [1:14:56<29:08:32,  3.39it/s]
  4%|▍         | 15508/371472 [1:14:56<30:19:57,  3.26it/s]
  4%|▍         | 15509/371472 [1:14:57<29:39:29,  3.33it/s]
  4%|▍         | 15510/371472 [1:14:57<29:04:45,  3.40it/s]
  4%|▍         | 15511/371472 [1:14:57<28:50:10,  3.43it/s]
  4%|▍         | 15512/371472 [1:14:58<28:38:18,  3.45it/s]
  4%|▍         | 15513/371472 [1:14:58<28:03:23,  3.52it/s]
  4%|▍         | 15514/371472 [1:14:58<27:23:37,  3.61it/s]
  4%|▍         | 15515/371472 [1:14:58<27:18:07,  3.62it/s]
  4%|▍         | 15516/371472 [1:14:59<26:15:33,  3.77it/s]
  4%|▍         | 15517/371472 [1:14:59<26:54:45,  3.67it/s]
  4%|▍         | 15518/371472 [1:14:59<27:59:28,  3.53it/s]
  4%|▍         | 15519/371472 [1:14:59<27:02:14,  3.66it/s]
  4%|▍         | 15520/371472 [1:15:00<26:53:58,  3.68it/s]
                                                           
{'loss': 4.7094, 'learning_rate': 9.628628067831672e-07, 'epoch': 0.67}

  4%|▍         | 15520/371472 [1:15:00<26:53:58,  3.68it/s]
  4%|▍         | 15521/371472 [1:15:00<28:03:52,  3.52it/s]
  4%|▍         | 15522/371472 [1:15:00<28:17:29,  3.49it/s]
  4%|▍         | 15523/371472 [1:15:01<30:10:15,  3.28it/s]
  4%|▍         | 15524/371472 [1:15:01<29:43:10,  3.33it/s]
  4%|▍         | 15525/371472 [1:15:01<29:21:14,  3.37it/s]
  4%|▍         | 15526/371472 [1:15:02<28:59:31,  3.41it/s]
  4%|▍         | 15527/371472 [1:15:02<28:08:25,  3.51it/s]
  4%|▍         | 15528/371472 [1:15:02<28:00:24,  3.53it/s]
  4%|▍         | 15529/371472 [1:15:02<28:39:45,  3.45it/s]
  4%|▍         | 15530/371472 [1:15:03<30:15:59,  3.27it/s]
  4%|▍         | 15531/371472 [1:15:03<30:24:38,  3.25it/s]
  4%|▍         | 15532/371472 [1:15:03<30:45:10,  3.22it/s]
  4%|▍         | 15533/371472 [1:15:04<31:22:43,  3.15it/s]
  4%|▍         | 15534/371472 [1:15:04<29:56:23,  3.30it/s]
  4%|▍         | 15535/371472 [1:15:04<29:08:52,  3.39it/s]
  4%|▍         | 15536/371472 [1:15:05<31:39:16,  3.12it/s]
  4%|▍         | 15537/371472 [1:15:05<31:05:51,  3.18it/s]
  4%|▍         | 15538/371472 [1:15:05<30:36:03,  3.23it/s]
  4%|▍         | 15539/371472 [1:15:06<31:12:16,  3.17it/s]
  4%|▍         | 15540/371472 [1:15:06<31:34:39,  3.13it/s]
                                                           
{'loss': 4.7686, 'learning_rate': 9.62814324807688e-07, 'epoch': 0.67}

  4%|▍         | 15540/371472 [1:15:06<31:34:39,  3.13it/s]
  4%|▍         | 15541/371472 [1:15:06<30:29:50,  3.24it/s]
  4%|▍         | 15542/371472 [1:15:06<29:33:52,  3.34it/s]
  4%|▍         | 15543/371472 [1:15:07<28:39:57,  3.45it/s]
  4%|▍         | 15544/371472 [1:15:07<28:48:27,  3.43it/s]
  4%|▍         | 15545/371472 [1:15:07<28:20:29,  3.49it/s]
  4%|▍         | 15546/371472 [1:15:08<28:00:26,  3.53it/s]
  4%|▍         | 15547/371472 [1:15:08<28:06:36,  3.52it/s]
  4%|▍         | 15548/371472 [1:15:08<28:12:21,  3.51it/s]
  4%|▍         | 15549/371472 [1:15:08<27:55:29,  3.54it/s]
  4%|▍         | 15550/371472 [1:15:09<27:25:34,  3.60it/s]
  4%|▍         | 15551/371472 [1:15:09<27:48:09,  3.56it/s]
  4%|▍         | 15552/371472 [1:15:09<28:33:26,  3.46it/s]
  4%|▍         | 15553/371472 [1:15:10<28:31:12,  3.47it/s]
  4%|▍         | 15554/371472 [1:15:10<28:43:46,  3.44it/s]
  4%|▍         | 15555/371472 [1:15:10<30:12:56,  3.27it/s]
  4%|▍         | 15556/371472 [1:15:10<29:47:34,  3.32it/s]
  4%|▍         | 15557/371472 [1:15:11<28:51:40,  3.43it/s]
  4%|▍         | 15558/371472 [1:15:11<31:48:07,  3.11it/s]
  4%|▍         | 15559/371472 [1:15:11<31:45:54,  3.11it/s]
  4%|▍         | 15560/371472 [1:15:12<30:24:36,  3.25it/s]
                                                           
{'loss': 4.3885, 'learning_rate': 9.627658428322093e-07, 'epoch': 0.67}

  4%|▍         | 15560/371472 [1:15:12<30:24:36,  3.25it/s]
  4%|▍         | 15561/371472 [1:15:12<28:48:34,  3.43it/s]
  4%|▍         | 15562/371472 [1:15:12<28:14:11,  3.50it/s]
  4%|▍         | 15563/371472 [1:15:13<28:46:54,  3.43it/s]
  4%|▍         | 15564/371472 [1:15:13<28:06:57,  3.52it/s]
  4%|▍         | 15565/371472 [1:15:13<28:24:10,  3.48it/s]
  4%|▍         | 15566/371472 [1:15:13<28:23:00,  3.48it/s]
  4%|▍         | 15567/371472 [1:15:14<27:46:55,  3.56it/s]
  4%|▍         | 15568/371472 [1:15:14<27:31:35,  3.59it/s]
  4%|▍         | 15569/371472 [1:15:14<28:58:34,  3.41it/s]
  4%|▍         | 15570/371472 [1:15:14<27:38:41,  3.58it/s]
  4%|▍         | 15571/371472 [1:15:15<27:50:02,  3.55it/s]
  4%|▍         | 15572/371472 [1:15:15<26:48:21,  3.69it/s]
  4%|▍         | 15573/371472 [1:15:15<27:03:54,  3.65it/s]
  4%|▍         | 15574/371472 [1:15:16<27:15:27,  3.63it/s]
  4%|▍         | 15575/371472 [1:15:16<29:38:26,  3.34it/s]
  4%|▍         | 15576/371472 [1:15:16<29:58:54,  3.30it/s]
  4%|▍         | 15577/371472 [1:15:17<28:57:12,  3.41it/s]
  4%|▍         | 15578/371472 [1:15:17<28:21:43,  3.49it/s]
  4%|▍         | 15579/371472 [1:15:17<30:19:27,  3.26it/s]
  4%|▍         | 15580/371472 [1:15:17<29:38:19,  3.34it/s]
                                                           
{'loss': 5.0316, 'learning_rate': 9.627173608567302e-07, 'epoch': 0.67}

  4%|▍         | 15580/371472 [1:15:17<29:38:19,  3.34it/s]
  4%|▍         | 15581/371472 [1:15:18<29:12:54,  3.38it/s]
  4%|▍         | 15582/371472 [1:15:18<29:00:04,  3.41it/s]
  4%|▍         | 15583/371472 [1:15:18<28:25:44,  3.48it/s]
  4%|▍         | 15584/371472 [1:15:19<28:30:36,  3.47it/s]
  4%|▍         | 15585/371472 [1:15:19<29:01:29,  3.41it/s]
  4%|▍         | 15586/371472 [1:15:19<30:36:58,  3.23it/s]
  4%|▍         | 15587/371472 [1:15:19<28:59:06,  3.41it/s]
  4%|▍         | 15588/371472 [1:15:20<27:55:07,  3.54it/s]
  4%|▍         | 15589/371472 [1:15:20<29:09:30,  3.39it/s]
  4%|▍         | 15590/371472 [1:15:20<28:13:36,  3.50it/s]
  4%|▍         | 15591/371472 [1:15:21<29:27:03,  3.36it/s]
  4%|▍         | 15592/371472 [1:15:21<33:03:13,  2.99it/s]
  4%|▍         | 15593/371472 [1:15:21<31:00:01,  3.19it/s]
  4%|▍         | 15594/371472 [1:15:22<29:59:50,  3.30it/s]
  4%|▍         | 15595/371472 [1:15:22<29:57:13,  3.30it/s]
  4%|▍         | 15596/371472 [1:15:22<32:05:02,  3.08it/s]
  4%|▍         | 15597/371472 [1:15:23<30:45:33,  3.21it/s]
  4%|▍         | 15598/371472 [1:15:23<29:02:18,  3.40it/s]
  4%|▍         | 15599/371472 [1:15:23<29:03:57,  3.40it/s]
  4%|▍         | 15600/371472 [1:15:23<28:36:37,  3.46it/s]
                                                           
{'loss': 4.5627, 'learning_rate': 9.626688788812515e-07, 'epoch': 0.67}

  4%|▍         | 15600/371472 [1:15:23<28:36:37,  3.46it/s]
  4%|▍         | 15601/371472 [1:15:24<27:40:28,  3.57it/s]
  4%|▍         | 15602/371472 [1:15:24<27:48:27,  3.55it/s]
  4%|▍         | 15603/371472 [1:15:24<27:36:04,  3.58it/s]
  4%|▍         | 15604/371472 [1:15:24<27:32:30,  3.59it/s]
  4%|▍         | 15605/371472 [1:15:25<26:53:01,  3.68it/s]
  4%|▍         | 15606/371472 [1:15:25<27:05:18,  3.65it/s]
  4%|▍         | 15607/371472 [1:15:25<27:01:21,  3.66it/s]
  4%|▍         | 15608/371472 [1:15:26<27:33:01,  3.59it/s]
  4%|▍         | 15609/371472 [1:15:26<27:11:41,  3.63it/s]
  4%|▍         | 15610/371472 [1:15:26<27:33:28,  3.59it/s]
  4%|▍         | 15611/371472 [1:15:26<28:42:22,  3.44it/s]
  4%|▍         | 15612/371472 [1:15:27<27:59:45,  3.53it/s]
  4%|▍         | 15613/371472 [1:15:27<27:19:46,  3.62it/s]
  4%|▍         | 15614/371472 [1:15:27<27:41:04,  3.57it/s]
  4%|▍         | 15615/371472 [1:15:28<27:35:31,  3.58it/s]
  4%|▍         | 15616/371472 [1:15:28<28:45:01,  3.44it/s]
  4%|▍         | 15617/371472 [1:15:28<28:03:05,  3.52it/s]
  4%|▍         | 15618/371472 [1:15:28<27:01:06,  3.66it/s]
  4%|▍         | 15619/371472 [1:15:29<27:49:28,  3.55it/s]
  4%|▍         | 15620/371472 [1:15:29<29:15:34,  3.38it/s]
                                                           
{'loss': 4.3815, 'learning_rate': 9.626203969057725e-07, 'epoch': 0.67}

  4%|▍         | 15620/371472 [1:15:29<29:15:34,  3.38it/s]
  4%|▍         | 15621/371472 [1:15:29<28:28:24,  3.47it/s]
  4%|▍         | 15622/371472 [1:15:30<29:24:05,  3.36it/s]
  4%|▍         | 15623/371472 [1:15:30<28:09:11,  3.51it/s]
  4%|▍         | 15624/371472 [1:15:30<28:45:42,  3.44it/s]
  4%|▍         | 15625/371472 [1:15:31<30:47:32,  3.21it/s]
  4%|▍         | 15626/371472 [1:15:31<29:20:49,  3.37it/s]
  4%|▍         | 15627/371472 [1:15:31<31:08:35,  3.17it/s]
  4%|▍         | 15628/371472 [1:15:31<30:10:17,  3.28it/s]
  4%|▍         | 15629/371472 [1:15:32<29:54:16,  3.31it/s]
  4%|▍         | 15630/371472 [1:15:32<29:14:46,  3.38it/s]
  4%|▍         | 15631/371472 [1:15:32<28:52:58,  3.42it/s]
  4%|▍         | 15632/371472 [1:15:33<29:00:24,  3.41it/s]
  4%|▍         | 15633/371472 [1:15:33<28:18:26,  3.49it/s]
  4%|▍         | 15634/371472 [1:15:33<28:34:48,  3.46it/s]
  4%|▍         | 15635/371472 [1:15:33<28:33:23,  3.46it/s]
  4%|▍         | 15636/371472 [1:15:34<27:11:24,  3.64it/s]
  4%|▍         | 15637/371472 [1:15:34<27:56:00,  3.54it/s]
  4%|▍         | 15638/371472 [1:15:34<30:09:07,  3.28it/s]
  4%|▍         | 15639/371472 [1:15:35<29:42:42,  3.33it/s]
  4%|▍         | 15640/371472 [1:15:35<30:26:30,  3.25it/s]
                                                           
{'loss': 4.74, 'learning_rate': 9.625719149302936e-07, 'epoch': 0.67}

  4%|▍         | 15640/371472 [1:15:35<30:26:30,  3.25it/s]
  4%|▍         | 15641/371472 [1:15:35<29:39:44,  3.33it/s]
  4%|▍         | 15642/371472 [1:15:36<29:13:23,  3.38it/s]
  4%|▍         | 15643/371472 [1:15:36<28:09:17,  3.51it/s]
  4%|▍         | 15644/371472 [1:15:36<28:29:39,  3.47it/s]
  4%|▍         | 15645/371472 [1:15:36<27:43:35,  3.56it/s]
  4%|▍         | 15646/371472 [1:15:37<27:02:35,  3.65it/s]
  4%|▍         | 15647/371472 [1:15:37<27:50:33,  3.55it/s]
  4%|▍         | 15648/371472 [1:15:37<28:47:57,  3.43it/s]
  4%|▍         | 15649/371472 [1:15:38<29:51:25,  3.31it/s]
  4%|▍         | 15650/371472 [1:15:38<28:24:37,  3.48it/s]
  4%|▍         | 15651/371472 [1:15:38<27:14:14,  3.63it/s]
  4%|▍         | 15652/371472 [1:15:38<29:35:55,  3.34it/s]
  4%|▍         | 15653/371472 [1:15:39<30:06:18,  3.28it/s]
  4%|▍         | 15654/371472 [1:15:39<29:02:15,  3.40it/s]
  4%|▍         | 15655/371472 [1:15:39<29:29:10,  3.35it/s]
  4%|▍         | 15656/371472 [1:15:40<27:56:51,  3.54it/s]
  4%|▍         | 15657/371472 [1:15:40<27:16:42,  3.62it/s]
  4%|▍         | 15658/371472 [1:15:40<27:15:15,  3.63it/s]
  4%|▍         | 15659/371472 [1:15:40<27:24:05,  3.61it/s]
  4%|▍         | 15660/371472 [1:15:41<27:11:27,  3.63it/s]
                                                           
{'loss': 4.6831, 'learning_rate': 9.625234329548147e-07, 'epoch': 0.67}

  4%|▍         | 15660/371472 [1:15:41<27:11:27,  3.63it/s]
  4%|▍         | 15661/371472 [1:15:41<26:54:51,  3.67it/s]
  4%|▍         | 15662/371472 [1:15:41<28:15:59,  3.50it/s]
  4%|▍         | 15663/371472 [1:15:41<27:31:51,  3.59it/s]
  4%|▍         | 15664/371472 [1:15:42<27:13:16,  3.63it/s]
  4%|▍         | 15665/371472 [1:15:42<27:21:40,  3.61it/s]
  4%|▍         | 15666/371472 [1:15:42<27:57:22,  3.54it/s]
  4%|▍         | 15667/371472 [1:15:43<28:51:41,  3.42it/s]
  4%|▍         | 15668/371472 [1:15:43<30:41:16,  3.22it/s]
  4%|▍         | 15669/371472 [1:15:43<30:53:06,  3.20it/s]
  4%|▍         | 15670/371472 [1:15:44<29:30:23,  3.35it/s]
  4%|▍         | 15671/371472 [1:15:44<29:19:33,  3.37it/s]
  4%|▍         | 15672/371472 [1:15:44<28:49:34,  3.43it/s]
  4%|▍         | 15673/371472 [1:15:44<29:18:32,  3.37it/s]
  4%|▍         | 15674/371472 [1:15:45<29:05:58,  3.40it/s]
  4%|▍         | 15675/371472 [1:15:45<27:55:28,  3.54it/s]
  4%|▍         | 15676/371472 [1:15:45<27:37:50,  3.58it/s]
  4%|▍         | 15677/371472 [1:15:46<27:01:24,  3.66it/s]
  4%|▍         | 15678/371472 [1:15:46<26:17:12,  3.76it/s]
  4%|▍         | 15679/371472 [1:15:46<29:47:13,  3.32it/s]
  4%|▍         | 15680/371472 [1:15:46<29:12:06,  3.38it/s]
                                                           
{'loss': 4.609, 'learning_rate': 9.624749509793358e-07, 'epoch': 0.68}

  4%|▍         | 15680/371472 [1:15:46<29:12:06,  3.38it/s]
  4%|▍         | 15681/371472 [1:15:47<28:24:51,  3.48it/s]
  4%|▍         | 15682/371472 [1:15:47<28:10:06,  3.51it/s]
  4%|▍         | 15683/371472 [1:15:47<27:52:50,  3.54it/s]
  4%|▍         | 15684/371472 [1:15:48<29:09:16,  3.39it/s]
  4%|▍         | 15685/371472 [1:15:48<28:31:43,  3.46it/s]
  4%|▍         | 15686/371472 [1:15:48<27:51:51,  3.55it/s]
  4%|▍         | 15687/371472 [1:15:48<27:50:40,  3.55it/s]
  4%|▍         | 15688/371472 [1:15:49<28:56:33,  3.41it/s]
  4%|▍         | 15689/371472 [1:15:49<27:53:25,  3.54it/s]
  4%|▍         | 15690/371472 [1:15:49<27:45:21,  3.56it/s]
  4%|▍         | 15691/371472 [1:15:50<27:19:00,  3.62it/s]
  4%|▍         | 15692/371472 [1:15:50<26:58:02,  3.66it/s]
  4%|▍         | 15693/371472 [1:15:50<26:10:11,  3.78it/s]
  4%|▍         | 15694/371472 [1:15:50<26:37:06,  3.71it/s]
  4%|▍         | 15695/371472 [1:15:51<26:49:13,  3.68it/s]
  4%|▍         | 15696/371472 [1:15:51<26:23:48,  3.74it/s]
  4%|▍         | 15697/371472 [1:15:51<29:23:58,  3.36it/s]
  4%|▍         | 15698/371472 [1:15:51<28:31:09,  3.47it/s]
  4%|▍         | 15699/371472 [1:15:52<31:19:41,  3.15it/s]
  4%|▍         | 15700/371472 [1:15:52<29:58:04,  3.30it/s]
                                                           
{'loss': 4.823, 'learning_rate': 9.62426469003857e-07, 'epoch': 0.68}

  4%|▍         | 15700/371472 [1:15:52<29:58:04,  3.30it/s]
  4%|▍         | 15701/371472 [1:15:52<28:56:52,  3.41it/s]
  4%|▍         | 15702/371472 [1:15:53<28:16:48,  3.49it/s]
  4%|▍         | 15703/371472 [1:15:53<27:33:12,  3.59it/s]
  4%|▍         | 15704/371472 [1:15:53<28:16:50,  3.49it/s]
  4%|▍         | 15705/371472 [1:15:54<28:12:25,  3.50it/s]
  4%|▍         | 15706/371472 [1:15:54<27:23:35,  3.61it/s]
  4%|▍         | 15707/371472 [1:15:54<27:11:54,  3.63it/s]
  4%|▍         | 15708/371472 [1:15:54<27:49:16,  3.55it/s]
  4%|▍         | 15709/371472 [1:15:55<27:41:34,  3.57it/s]
  4%|▍         | 15710/371472 [1:15:55<27:05:05,  3.65it/s]
  4%|▍         | 15711/371472 [1:15:55<27:49:23,  3.55it/s]
  4%|▍         | 15712/371472 [1:15:55<27:54:41,  3.54it/s]
  4%|▍         | 15713/371472 [1:15:56<27:21:17,  3.61it/s]
  4%|▍         | 15714/371472 [1:15:56<27:39:11,  3.57it/s]
  4%|▍         | 15715/371472 [1:15:56<27:01:49,  3.66it/s]
  4%|▍         | 15716/371472 [1:15:57<26:38:30,  3.71it/s]
  4%|▍         | 15717/371472 [1:15:57<26:40:34,  3.70it/s]
  4%|▍         | 15718/371472 [1:15:57<27:09:05,  3.64it/s]
  4%|▍         | 15719/371472 [1:15:57<27:05:49,  3.65it/s]
  4%|▍         | 15720/371472 [1:15:58<27:19:33,  3.62it/s]
                                                           
{'loss': 4.9465, 'learning_rate': 9.623779870283781e-07, 'epoch': 0.68}

  4%|▍         | 15720/371472 [1:15:58<27:19:33,  3.62it/s]
  4%|▍         | 15721/371472 [1:15:58<28:19:04,  3.49it/s]
  4%|▍         | 15722/371472 [1:15:58<27:13:21,  3.63it/s]
  4%|▍         | 15723/371472 [1:15:58<26:52:39,  3.68it/s]
  4%|▍         | 15724/371472 [1:15:59<26:51:03,  3.68it/s]
  4%|▍         | 15725/371472 [1:15:59<27:43:29,  3.56it/s]
  4%|▍         | 15726/371472 [1:15:59<27:13:28,  3.63it/s]
  4%|▍         | 15727/371472 [1:16:00<27:11:45,  3.63it/s]
  4%|▍         | 15728/371472 [1:16:00<29:56:53,  3.30it/s]
  4%|▍         | 15729/371472 [1:16:00<28:38:00,  3.45it/s]
  4%|▍         | 15730/371472 [1:16:01<30:56:09,  3.19it/s]
  4%|▍         | 15731/371472 [1:16:01<30:28:14,  3.24it/s]
  4%|▍         | 15732/371472 [1:16:01<28:50:49,  3.43it/s]
  4%|▍         | 15733/371472 [1:16:01<29:08:24,  3.39it/s]
  4%|▍         | 15734/371472 [1:16:02<28:17:26,  3.49it/s]
  4%|▍         | 15735/371472 [1:16:02<28:36:57,  3.45it/s]
  4%|▍         | 15736/371472 [1:16:02<29:15:41,  3.38it/s]
  4%|▍         | 15737/371472 [1:16:03<28:12:58,  3.50it/s]
  4%|▍         | 15738/371472 [1:16:03<30:05:46,  3.28it/s]
  4%|▍         | 15739/371472 [1:16:03<31:23:03,  3.15it/s]
  4%|▍         | 15740/371472 [1:16:04<31:32:18,  3.13it/s]
                                                           
{'loss': 4.7628, 'learning_rate': 9.623295050528992e-07, 'epoch': 0.68}

  4%|▍         | 15740/371472 [1:16:04<31:32:18,  3.13it/s]
  4%|▍         | 15741/371472 [1:16:04<31:04:37,  3.18it/s]
  4%|▍         | 15742/371472 [1:16:04<29:25:07,  3.36it/s]
  4%|▍         | 15743/371472 [1:16:04<29:49:54,  3.31it/s]
  4%|▍         | 15744/371472 [1:16:05<30:58:45,  3.19it/s]
  4%|▍         | 15745/371472 [1:16:05<30:39:58,  3.22it/s]
  4%|▍         | 15746/371472 [1:16:05<29:56:55,  3.30it/s]
  4%|▍         | 15747/371472 [1:16:06<31:43:53,  3.11it/s]
  4%|▍         | 15748/371472 [1:16:06<29:43:16,  3.32it/s]
  4%|▍         | 15749/371472 [1:16:06<30:39:53,  3.22it/s]
  4%|▍         | 15750/371472 [1:16:07<28:48:52,  3.43it/s]
  4%|▍         | 15751/371472 [1:16:07<28:04:57,  3.52it/s]
  4%|▍         | 15752/371472 [1:16:07<27:20:53,  3.61it/s]
  4%|▍         | 15753/371472 [1:16:07<27:16:29,  3.62it/s]
  4%|▍         | 15754/371472 [1:16:08<26:53:46,  3.67it/s]
  4%|▍         | 15755/371472 [1:16:08<26:35:42,  3.72it/s]
  4%|▍         | 15756/371472 [1:16:08<26:55:52,  3.67it/s]
  4%|▍         | 15757/371472 [1:16:09<27:42:47,  3.57it/s]
  4%|▍         | 15758/371472 [1:16:09<27:01:26,  3.66it/s]
  4%|▍         | 15759/371472 [1:16:09<30:24:34,  3.25it/s]
  4%|▍         | 15760/371472 [1:16:09<31:04:28,  3.18it/s]
                                                           
{'loss': 4.5836, 'learning_rate': 9.622810230774205e-07, 'epoch': 0.68}

  4%|▍         | 15760/371472 [1:16:09<31:04:28,  3.18it/s]
  4%|▍         | 15761/371472 [1:16:10<29:32:05,  3.35it/s]
  4%|▍         | 15762/371472 [1:16:10<28:52:09,  3.42it/s]
  4%|▍         | 15763/371472 [1:16:10<27:45:08,  3.56it/s]
  4%|▍         | 15764/371472 [1:16:11<27:34:37,  3.58it/s]
  4%|▍         | 15765/371472 [1:16:11<27:06:43,  3.64it/s]
  4%|▍         | 15766/371472 [1:16:11<28:06:46,  3.51it/s]
  4%|▍         | 15767/371472 [1:16:11<27:29:07,  3.59it/s]
  4%|▍         | 15768/371472 [1:16:12<27:39:08,  3.57it/s]
  4%|▍         | 15769/371472 [1:16:12<28:52:44,  3.42it/s]
  4%|▍         | 15770/371472 [1:16:12<28:08:08,  3.51it/s]
  4%|▍         | 15771/371472 [1:16:13<28:47:59,  3.43it/s]
  4%|▍         | 15772/371472 [1:16:13<28:03:36,  3.52it/s]
  4%|▍         | 15773/371472 [1:16:13<28:27:34,  3.47it/s]
  4%|▍         | 15774/371472 [1:16:13<27:57:43,  3.53it/s]
  4%|▍         | 15775/371472 [1:16:14<27:41:14,  3.57it/s]
  4%|▍         | 15776/371472 [1:16:14<28:34:12,  3.46it/s]
  4%|▍         | 15777/371472 [1:16:14<28:16:03,  3.50it/s]
  4%|▍         | 15778/371472 [1:16:15<29:31:08,  3.35it/s]
  4%|▍         | 15779/371472 [1:16:15<29:00:51,  3.41it/s]
  4%|▍         | 15780/371472 [1:16:15<30:20:22,  3.26it/s]
                                                           
{'loss': 4.8521, 'learning_rate': 9.622325411019413e-07, 'epoch': 0.68}

  4%|▍         | 15780/371472 [1:16:15<30:20:22,  3.26it/s]
  4%|▍         | 15781/371472 [1:16:16<32:17:52,  3.06it/s]
  4%|▍         | 15782/371472 [1:16:16<30:59:31,  3.19it/s]
  4%|▍         | 15783/371472 [1:16:16<29:28:18,  3.35it/s]
  4%|▍         | 15784/371472 [1:16:16<28:31:43,  3.46it/s]
  4%|▍         | 15785/371472 [1:16:17<29:46:31,  3.32it/s]
  4%|▍         | 15786/371472 [1:16:17<28:35:20,  3.46it/s]
  4%|▍         | 15787/371472 [1:16:17<28:48:13,  3.43it/s]
  4%|▍         | 15788/371472 [1:16:18<28:18:20,  3.49it/s]
  4%|▍         | 15789/371472 [1:16:18<28:10:00,  3.51it/s]
  4%|▍         | 15790/371472 [1:16:18<27:18:51,  3.62it/s]
  4%|▍         | 15791/371472 [1:16:18<28:01:50,  3.52it/s]
  4%|▍         | 15792/371472 [1:16:19<27:04:59,  3.65it/s]
  4%|▍         | 15793/371472 [1:16:19<27:10:35,  3.64it/s]
  4%|▍         | 15794/371472 [1:16:19<27:12:41,  3.63it/s]
  4%|▍         | 15795/371472 [1:16:20<28:16:39,  3.49it/s]
  4%|▍         | 15796/371472 [1:16:20<27:27:12,  3.60it/s]
  4%|▍         | 15797/371472 [1:16:20<27:34:57,  3.58it/s]
  4%|▍         | 15798/371472 [1:16:20<27:05:34,  3.65it/s]
  4%|▍         | 15799/371472 [1:16:21<26:48:03,  3.69it/s]
  4%|▍         | 15800/371472 [1:16:21<27:32:13,  3.59it/s]
                                                           
{'loss': 4.7569, 'learning_rate': 9.621840591264626e-07, 'epoch': 0.68}

  4%|▍         | 15800/371472 [1:16:21<27:32:13,  3.59it/s]
  4%|▍         | 15801/371472 [1:16:21<27:04:12,  3.65it/s]
  4%|▍         | 15802/371472 [1:16:22<39:57:20,  2.47it/s]
  4%|▍         | 15803/371472 [1:16:22<36:23:42,  2.71it/s]
  4%|▍         | 15804/371472 [1:16:22<33:39:21,  2.94it/s]
  4%|▍         | 15805/371472 [1:16:23<31:27:59,  3.14it/s]
  4%|▍         | 15806/371472 [1:16:23<30:42:31,  3.22it/s]
  4%|▍         | 15807/371472 [1:16:23<29:55:09,  3.30it/s]
  4%|▍         | 15808/371472 [1:16:24<29:15:44,  3.38it/s]
  4%|▍         | 15809/371472 [1:16:24<29:48:05,  3.32it/s]
  4%|▍         | 15810/371472 [1:16:24<28:52:54,  3.42it/s]
  4%|▍         | 15811/371472 [1:16:24<27:54:40,  3.54it/s]
  4%|▍         | 15812/371472 [1:16:25<26:46:28,  3.69it/s]
  4%|▍         | 15813/371472 [1:16:25<29:12:10,  3.38it/s]
  4%|▍         | 15814/371472 [1:16:25<29:48:09,  3.31it/s]
  4%|▍         | 15815/371472 [1:16:26<29:44:22,  3.32it/s]
  4%|▍         | 15816/371472 [1:16:26<29:33:00,  3.34it/s]
  4%|▍         | 15817/371472 [1:16:26<28:48:49,  3.43it/s]
  4%|▍         | 15818/371472 [1:16:26<28:05:15,  3.52it/s]
  4%|▍         | 15819/371472 [1:16:27<27:24:58,  3.60it/s]
  4%|▍         | 15820/371472 [1:16:27<26:45:45,  3.69it/s]
                                                           
{'loss': 4.4686, 'learning_rate': 9.621355771509835e-07, 'epoch': 0.68}

  4%|▍         | 15820/371472 [1:16:27<26:45:45,  3.69it/s]
  4%|▍         | 15821/371472 [1:16:27<26:17:23,  3.76it/s]
  4%|▍         | 15822/371472 [1:16:28<28:02:10,  3.52it/s]
  4%|▍         | 15823/371472 [1:16:28<27:37:52,  3.58it/s]
  4%|▍         | 15824/371472 [1:16:28<28:40:33,  3.45it/s]
  4%|▍         | 15825/371472 [1:16:28<28:05:03,  3.52it/s]
  4%|▍         | 15826/371472 [1:16:29<26:56:39,  3.67it/s]
  4%|▍         | 15827/371472 [1:16:29<25:57:21,  3.81it/s]
  4%|▍         | 15828/371472 [1:16:29<26:10:20,  3.77it/s]
  4%|▍         | 15829/371472 [1:16:29<27:08:35,  3.64it/s]
  4%|▍         | 15830/371472 [1:16:30<28:14:32,  3.50it/s]
  4%|▍         | 15831/371472 [1:16:30<29:25:29,  3.36it/s]
  4%|▍         | 15832/371472 [1:16:30<29:26:30,  3.36it/s]
  4%|▍         | 15833/371472 [1:16:31<28:48:43,  3.43it/s]
  4%|▍         | 15834/371472 [1:16:31<29:21:49,  3.36it/s]
  4%|▍         | 15835/371472 [1:16:31<28:28:25,  3.47it/s]
  4%|▍         | 15836/371472 [1:16:32<28:50:01,  3.43it/s]
  4%|▍         | 15837/371472 [1:16:32<27:54:01,  3.54it/s]
  4%|▍         | 15838/371472 [1:16:32<26:44:55,  3.69it/s]
  4%|▍         | 15839/371472 [1:16:32<28:02:43,  3.52it/s]
  4%|▍         | 15840/371472 [1:16:33<27:50:21,  3.55it/s]
                                                           
{'loss': 4.7357, 'learning_rate': 9.620870951755048e-07, 'epoch': 0.68}

  4%|▍         | 15840/371472 [1:16:33<27:50:21,  3.55it/s]
  4%|▍         | 15841/371472 [1:16:33<27:23:08,  3.61it/s]
  4%|▍         | 15842/371472 [1:16:33<28:25:09,  3.48it/s]
  4%|▍         | 15843/371472 [1:16:34<30:20:35,  3.26it/s]
  4%|▍         | 15844/371472 [1:16:34<29:47:37,  3.32it/s]
  4%|▍         | 15845/371472 [1:16:34<28:48:23,  3.43it/s]
  4%|▍         | 15846/371472 [1:16:34<28:07:05,  3.51it/s]
  4%|▍         | 15847/371472 [1:16:35<28:03:54,  3.52it/s]
  4%|▍         | 15848/371472 [1:16:35<28:58:12,  3.41it/s]
  4%|▍         | 15849/371472 [1:16:35<27:51:55,  3.55it/s]
  4%|▍         | 15850/371472 [1:16:36<27:48:57,  3.55it/s]
  4%|▍         | 15851/371472 [1:16:36<30:12:05,  3.27it/s]
  4%|▍         | 15852/371472 [1:16:36<29:29:08,  3.35it/s]
  4%|▍         | 15853/371472 [1:16:36<29:06:32,  3.39it/s]
  4%|▍         | 15854/371472 [1:16:37<28:32:19,  3.46it/s]
  4%|▍         | 15855/371472 [1:16:37<27:43:53,  3.56it/s]
  4%|▍         | 15856/371472 [1:16:37<30:37:06,  3.23it/s]
  4%|▍         | 15857/371472 [1:16:38<30:08:43,  3.28it/s]
  4%|▍         | 15858/371472 [1:16:38<30:21:42,  3.25it/s]
  4%|▍         | 15859/371472 [1:16:38<30:13:13,  3.27it/s]
  4%|▍         | 15860/371472 [1:16:39<30:20:37,  3.26it/s]
                                                           
{'loss': 4.6195, 'learning_rate': 9.620386132000258e-07, 'epoch': 0.68}

  4%|▍         | 15860/371472 [1:16:39<30:20:37,  3.26it/s]
  4%|▍         | 15861/371472 [1:16:39<29:04:45,  3.40it/s]
  4%|▍         | 15862/371472 [1:16:39<29:14:17,  3.38it/s]
  4%|▍         | 15863/371472 [1:16:39<28:27:21,  3.47it/s]
  4%|▍         | 15864/371472 [1:16:40<30:22:16,  3.25it/s]
  4%|▍         | 15865/371472 [1:16:40<28:47:22,  3.43it/s]
  4%|▍         | 15866/371472 [1:16:40<30:05:18,  3.28it/s]
  4%|▍         | 15867/371472 [1:16:41<31:40:59,  3.12it/s]
  4%|▍         | 15868/371472 [1:16:41<30:38:24,  3.22it/s]
  4%|▍         | 15869/371472 [1:16:41<31:01:01,  3.18it/s]
  4%|▍         | 15870/371472 [1:16:42<30:46:37,  3.21it/s]
  4%|▍         | 15871/371472 [1:16:42<29:01:59,  3.40it/s]
  4%|▍         | 15872/371472 [1:16:42<29:01:51,  3.40it/s]
  4%|▍         | 15873/371472 [1:16:42<29:16:03,  3.37it/s]
  4%|▍         | 15874/371472 [1:16:43<33:42:04,  2.93it/s]
  4%|▍         | 15875/371472 [1:16:43<31:41:26,  3.12it/s]
  4%|▍         | 15876/371472 [1:16:43<29:38:45,  3.33it/s]
  4%|▍         | 15877/371472 [1:16:44<29:04:21,  3.40it/s]
  4%|▍         | 15878/371472 [1:16:44<28:19:28,  3.49it/s]
  4%|▍         | 15879/371472 [1:16:44<29:00:37,  3.40it/s]
  4%|▍         | 15880/371472 [1:16:45<29:40:42,  3.33it/s]
                                                           
{'loss': 4.7323, 'learning_rate': 9.61990131224547e-07, 'epoch': 0.68}

  4%|▍         | 15880/371472 [1:16:45<29:40:42,  3.33it/s]
  4%|▍         | 15881/371472 [1:16:45<28:37:19,  3.45it/s]
  4%|▍         | 15882/371472 [1:16:45<27:51:06,  3.55it/s]
  4%|▍         | 15883/371472 [1:16:45<28:16:16,  3.49it/s]
  4%|▍         | 15884/371472 [1:16:46<29:06:31,  3.39it/s]
  4%|▍         | 15885/371472 [1:16:46<29:26:06,  3.36it/s]
  4%|▍         | 15886/371472 [1:16:46<28:09:55,  3.51it/s]
  4%|▍         | 15887/371472 [1:16:47<27:30:25,  3.59it/s]
  4%|▍         | 15888/371472 [1:16:47<29:32:05,  3.34it/s]
  4%|▍         | 15889/371472 [1:16:47<28:26:34,  3.47it/s]
  4%|▍         | 15890/371472 [1:16:47<27:52:03,  3.54it/s]
  4%|▍         | 15891/371472 [1:16:48<30:27:00,  3.24it/s]
  4%|▍         | 15892/371472 [1:16:48<33:07:23,  2.98it/s]
  4%|▍         | 15893/371472 [1:16:48<31:08:29,  3.17it/s]
  4%|▍         | 15894/371472 [1:16:49<29:33:20,  3.34it/s]
  4%|▍         | 15895/371472 [1:16:49<28:44:25,  3.44it/s]
  4%|▍         | 15896/371472 [1:16:49<27:43:39,  3.56it/s]
  4%|▍         | 15897/371472 [1:16:50<28:17:13,  3.49it/s]
  4%|▍         | 15898/371472 [1:16:50<27:18:20,  3.62it/s]
  4%|▍         | 15899/371472 [1:16:50<27:43:36,  3.56it/s]
  4%|▍         | 15900/371472 [1:16:50<28:04:16,  3.52it/s]
                                                           
{'loss': 4.6049, 'learning_rate': 9.619416492490682e-07, 'epoch': 0.68}

  4%|▍         | 15900/371472 [1:16:50<28:04:16,  3.52it/s]
  4%|▍         | 15901/371472 [1:16:51<31:46:02,  3.11it/s]
  4%|▍         | 15902/371472 [1:16:51<31:09:50,  3.17it/s]
  4%|▍         | 15903/371472 [1:16:51<29:19:28,  3.37it/s]
  4%|▍         | 15904/371472 [1:16:52<29:11:31,  3.38it/s]
  4%|▍         | 15905/371472 [1:16:52<27:36:12,  3.58it/s]
  4%|▍         | 15906/371472 [1:16:52<27:02:58,  3.65it/s]
  4%|▍         | 15907/371472 [1:16:52<27:30:57,  3.59it/s]
  4%|▍         | 15908/371472 [1:16:53<27:50:12,  3.55it/s]
  4%|▍         | 15909/371472 [1:16:53<28:59:05,  3.41it/s]
  4%|▍         | 15910/371472 [1:16:53<29:59:04,  3.29it/s]
  4%|▍         | 15911/371472 [1:16:54<29:22:43,  3.36it/s]
  4%|▍         | 15912/371472 [1:16:54<29:06:18,  3.39it/s]
  4%|▍         | 15913/371472 [1:16:54<31:07:40,  3.17it/s]
  4%|▍         | 15914/371472 [1:16:55<29:22:46,  3.36it/s]
  4%|▍         | 15915/371472 [1:16:55<29:22:19,  3.36it/s]
  4%|▍         | 15916/371472 [1:16:55<28:49:20,  3.43it/s]
  4%|▍         | 15917/371472 [1:16:55<27:40:53,  3.57it/s]
  4%|▍         | 15918/371472 [1:16:56<27:08:00,  3.64it/s]
  4%|▍         | 15919/371472 [1:16:56<26:47:39,  3.69it/s]
  4%|▍         | 15920/371472 [1:16:56<26:10:08,  3.77it/s]
                                                           
{'loss': 4.5214, 'learning_rate': 9.61893167273589e-07, 'epoch': 0.69}

  4%|▍         | 15920/371472 [1:16:56<26:10:08,  3.77it/s]
  4%|▍         | 15921/371472 [1:16:57<28:16:05,  3.49it/s]
  4%|▍         | 15922/371472 [1:16:57<27:32:22,  3.59it/s]
  4%|▍         | 15923/371472 [1:16:57<30:50:14,  3.20it/s]
  4%|▍         | 15924/371472 [1:16:57<30:19:40,  3.26it/s]
  4%|▍         | 15925/371472 [1:16:58<29:52:29,  3.31it/s]
  4%|▍         | 15926/371472 [1:16:58<31:47:01,  3.11it/s]
  4%|▍         | 15927/371472 [1:16:59<34:50:06,  2.84it/s]
  4%|▍         | 15928/371472 [1:16:59<31:32:06,  3.13it/s]
  4%|▍         | 15929/371472 [1:16:59<30:44:02,  3.21it/s]
  4%|▍         | 15930/371472 [1:16:59<30:01:27,  3.29it/s]
  4%|▍         | 15931/371472 [1:17:00<30:10:33,  3.27it/s]
  4%|▍         | 15932/371472 [1:17:00<29:05:30,  3.39it/s]
  4%|▍         | 15933/371472 [1:17:00<29:18:57,  3.37it/s]
  4%|▍         | 15934/371472 [1:17:01<28:18:50,  3.49it/s]
  4%|▍         | 15935/371472 [1:17:01<28:23:14,  3.48it/s]
  4%|▍         | 15936/371472 [1:17:01<28:03:18,  3.52it/s]
  4%|▍         | 15937/371472 [1:17:01<28:10:27,  3.51it/s]
  4%|▍         | 15938/371472 [1:17:02<28:04:09,  3.52it/s]
  4%|▍         | 15939/371472 [1:17:02<27:37:37,  3.57it/s]
  4%|▍         | 15940/371472 [1:17:02<27:05:12,  3.65it/s]
                                                           
{'loss': 4.4264, 'learning_rate': 9.618446852981103e-07, 'epoch': 0.69}

  4%|▍         | 15940/371472 [1:17:02<27:05:12,  3.65it/s]
  4%|▍         | 15941/371472 [1:17:02<27:17:41,  3.62it/s]
  4%|▍         | 15942/371472 [1:17:03<29:01:30,  3.40it/s]
  4%|▍         | 15943/371472 [1:17:03<28:15:54,  3.49it/s]
  4%|▍         | 15944/371472 [1:17:03<28:30:28,  3.46it/s]
  4%|▍         | 15945/371472 [1:17:04<28:15:46,  3.49it/s]
  4%|▍         | 15946/371472 [1:17:04<27:14:16,  3.63it/s]
  4%|▍         | 15947/371472 [1:17:04<28:18:46,  3.49it/s]
  4%|▍         | 15948/371472 [1:17:05<30:15:25,  3.26it/s]
  4%|▍         | 15949/371472 [1:17:05<29:28:30,  3.35it/s]
  4%|▍         | 15950/371472 [1:17:05<28:36:05,  3.45it/s]
  4%|▍         | 15951/371472 [1:17:05<27:45:56,  3.56it/s]
  4%|▍         | 15952/371472 [1:17:06<27:37:45,  3.57it/s]
  4%|▍         | 15953/371472 [1:17:06<28:15:50,  3.49it/s]
  4%|▍         | 15954/371472 [1:17:06<28:03:04,  3.52it/s]
  4%|▍         | 15955/371472 [1:17:07<27:56:30,  3.53it/s]
  4%|▍         | 15956/371472 [1:17:07<27:45:58,  3.56it/s]
  4%|▍         | 15957/371472 [1:17:07<27:10:40,  3.63it/s]
  4%|▍         | 15958/371472 [1:17:07<27:47:04,  3.55it/s]
  4%|▍         | 15959/371472 [1:17:08<30:28:09,  3.24it/s]
  4%|▍         | 15960/371472 [1:17:08<29:07:09,  3.39it/s]
                                                           
{'loss': 4.9132, 'learning_rate': 9.617962033226312e-07, 'epoch': 0.69}

  4%|▍         | 15960/371472 [1:17:08<29:07:09,  3.39it/s]
  4%|▍         | 15961/371472 [1:17:08<29:34:30,  3.34it/s]
  4%|▍         | 15962/371472 [1:17:09<28:39:40,  3.45it/s]
  4%|▍         | 15963/371472 [1:17:09<28:24:32,  3.48it/s]
  4%|▍         | 15964/371472 [1:17:09<27:43:34,  3.56it/s]
  4%|▍         | 15965/371472 [1:17:09<26:40:56,  3.70it/s]
  4%|▍         | 15966/371472 [1:17:10<27:25:44,  3.60it/s]
  4%|▍         | 15967/371472 [1:17:10<28:04:37,  3.52it/s]
  4%|▍         | 15968/371472 [1:17:10<28:00:10,  3.53it/s]
  4%|▍         | 15969/371472 [1:17:11<28:09:04,  3.51it/s]
  4%|▍         | 15970/371472 [1:17:11<28:07:47,  3.51it/s]
  4%|▍         | 15971/371472 [1:17:11<27:16:25,  3.62it/s]
  4%|▍         | 15972/371472 [1:17:11<28:59:14,  3.41it/s]
  4%|▍         | 15973/371472 [1:17:12<28:08:34,  3.51it/s]
  4%|▍         | 15974/371472 [1:17:12<28:51:42,  3.42it/s]
  4%|▍         | 15975/371472 [1:17:12<27:46:33,  3.56it/s]
  4%|▍         | 15976/371472 [1:17:12<26:56:35,  3.67it/s]
  4%|▍         | 15977/371472 [1:17:13<28:32:42,  3.46it/s]
  4%|▍         | 15978/371472 [1:17:13<27:52:42,  3.54it/s]
  4%|▍         | 15979/371472 [1:17:13<30:58:48,  3.19it/s]
  4%|▍         | 15980/371472 [1:17:14<29:38:28,  3.33it/s]
                                                           
{'loss': 4.5938, 'learning_rate': 9.617477213471525e-07, 'epoch': 0.69}

  4%|▍         | 15980/371472 [1:17:14<29:38:28,  3.33it/s]
  4%|▍         | 15981/371472 [1:17:14<29:49:40,  3.31it/s]
  4%|▍         | 15982/371472 [1:17:14<29:07:07,  3.39it/s]
  4%|▍         | 15983/371472 [1:17:15<27:43:08,  3.56it/s]
  4%|▍         | 15984/371472 [1:17:15<28:16:12,  3.49it/s]
  4%|▍         | 15985/371472 [1:17:15<28:04:11,  3.52it/s]
  4%|▍         | 15986/371472 [1:17:15<28:15:16,  3.49it/s]
  4%|▍         | 15987/371472 [1:17:16<28:35:23,  3.45it/s]
  4%|▍         | 15988/371472 [1:17:16<27:47:52,  3.55it/s]
  4%|▍         | 15989/371472 [1:17:16<27:27:47,  3.60it/s]
  4%|▍         | 15990/371472 [1:17:17<27:39:31,  3.57it/s]
  4%|▍         | 15991/371472 [1:17:17<28:12:10,  3.50it/s]
  4%|▍         | 15992/371472 [1:17:17<27:35:25,  3.58it/s]
  4%|▍         | 15993/371472 [1:17:17<27:04:53,  3.65it/s]
  4%|▍         | 15994/371472 [1:17:18<27:18:03,  3.62it/s]
  4%|▍         | 15995/371472 [1:17:18<27:26:30,  3.60it/s]
  4%|▍         | 15996/371472 [1:17:18<27:50:45,  3.55it/s]
  4%|▍         | 15997/371472 [1:17:19<27:47:19,  3.55it/s]
  4%|▍         | 15998/371472 [1:17:19<27:46:47,  3.55it/s]
  4%|▍         | 15999/371472 [1:17:19<27:22:06,  3.61it/s]
  4%|▍         | 16000/371472 [1:17:19<27:21:03,  3.61it/s]
                                                           
{'loss': 4.8424, 'learning_rate': 9.616992393716735e-07, 'epoch': 0.69}

  4%|▍         | 16000/371472 [1:17:19<27:21:03,  3.61it/s]
  4%|▍         | 16001/371472 [1:17:20<26:48:19,  3.68it/s]
  4%|▍         | 16002/371472 [1:17:20<27:33:43,  3.58it/s]
  4%|▍         | 16003/371472 [1:17:20<27:44:36,  3.56it/s]
  4%|▍         | 16004/371472 [1:17:20<27:02:25,  3.65it/s]
  4%|▍         | 16005/371472 [1:17:21<26:14:52,  3.76it/s]
  4%|▍         | 16006/371472 [1:17:21<26:00:39,  3.80it/s]
  4%|▍         | 16007/371472 [1:17:21<26:22:24,  3.74it/s]
  4%|▍         | 16008/371472 [1:17:21<26:39:23,  3.70it/s]
  4%|▍         | 16009/371472 [1:17:22<26:26:58,  3.73it/s]
  4%|▍         | 16010/371472 [1:17:22<26:08:23,  3.78it/s]
  4%|▍         | 16011/371472 [1:17:22<27:03:58,  3.65it/s]
  4%|▍         | 16012/371472 [1:17:23<27:17:43,  3.62it/s]
  4%|▍         | 16013/371472 [1:17:23<27:47:40,  3.55it/s]
  4%|▍         | 16014/371472 [1:17:23<27:57:21,  3.53it/s]
  4%|▍         | 16015/371472 [1:17:23<28:33:38,  3.46it/s]
  4%|▍         | 16016/371472 [1:17:24<28:16:53,  3.49it/s]
  4%|▍         | 16017/371472 [1:17:24<28:22:13,  3.48it/s]
  4%|▍         | 16018/371472 [1:17:24<29:38:05,  3.33it/s]
  4%|▍         | 16019/371472 [1:17:25<28:56:48,  3.41it/s]
  4%|▍         | 16020/371472 [1:17:25<28:07:05,  3.51it/s]
                                                           
{'loss': 4.7597, 'learning_rate': 9.616507573961946e-07, 'epoch': 0.69}

  4%|▍         | 16020/371472 [1:17:25<28:07:05,  3.51it/s]
  4%|▍         | 16021/371472 [1:17:25<29:50:44,  3.31it/s]
  4%|▍         | 16022/371472 [1:17:26<28:52:28,  3.42it/s]
  4%|▍         | 16023/371472 [1:17:26<27:48:17,  3.55it/s]
  4%|▍         | 16024/371472 [1:17:26<30:32:06,  3.23it/s]
  4%|▍         | 16025/371472 [1:17:26<31:27:32,  3.14it/s]
  4%|▍         | 16026/371472 [1:17:27<30:46:16,  3.21it/s]
  4%|▍         | 16027/371472 [1:17:27<29:46:11,  3.32it/s]
  4%|▍         | 16028/371472 [1:17:27<29:27:08,  3.35it/s]
  4%|▍         | 16029/371472 [1:17:28<28:54:11,  3.42it/s]
  4%|▍         | 16030/371472 [1:17:28<27:56:41,  3.53it/s]
  4%|▍         | 16031/371472 [1:17:28<27:44:32,  3.56it/s]
  4%|▍         | 16032/371472 [1:17:28<27:55:43,  3.54it/s]
  4%|▍         | 16033/371472 [1:17:29<27:38:01,  3.57it/s]
  4%|▍         | 16034/371472 [1:17:29<27:17:57,  3.62it/s]
  4%|▍         | 16035/371472 [1:17:29<26:42:38,  3.70it/s]
  4%|▍         | 16036/371472 [1:17:30<26:45:38,  3.69it/s]
  4%|▍         | 16037/371472 [1:17:30<26:36:56,  3.71it/s]
  4%|▍         | 16038/371472 [1:17:30<27:34:04,  3.58it/s]
  4%|▍         | 16039/371472 [1:17:30<27:31:06,  3.59it/s]
  4%|▍         | 16040/371472 [1:17:31<27:02:25,  3.65it/s]
                                                           
{'loss': 4.7149, 'learning_rate': 9.616022754207159e-07, 'epoch': 0.69}

  4%|▍         | 16040/371472 [1:17:31<27:02:25,  3.65it/s]
  4%|▍         | 16041/371472 [1:17:31<27:15:31,  3.62it/s]
  4%|▍         | 16042/371472 [1:17:31<27:13:11,  3.63it/s]
  4%|▍         | 16043/371472 [1:17:31<27:57:41,  3.53it/s]
  4%|▍         | 16044/371472 [1:17:32<28:13:06,  3.50it/s]
  4%|▍         | 16045/371472 [1:17:32<29:14:48,  3.38it/s]
  4%|▍         | 16046/371472 [1:17:32<28:34:57,  3.45it/s]
  4%|▍         | 16047/371472 [1:17:33<28:19:54,  3.48it/s]
  4%|▍         | 16048/371472 [1:17:33<29:01:05,  3.40it/s]
  4%|▍         | 16049/371472 [1:17:33<28:03:24,  3.52it/s]
  4%|▍         | 16050/371472 [1:17:34<27:35:09,  3.58it/s]
  4%|▍         | 16051/371472 [1:17:34<26:53:39,  3.67it/s]
  4%|▍         | 16052/371472 [1:17:34<26:40:07,  3.70it/s]
  4%|▍         | 16053/371472 [1:17:34<27:00:44,  3.65it/s]
  4%|▍         | 16054/371472 [1:17:35<26:41:45,  3.70it/s]
  4%|▍         | 16055/371472 [1:17:35<26:40:01,  3.70it/s]
  4%|▍         | 16056/371472 [1:17:35<25:48:55,  3.82it/s]
  4%|▍         | 16057/371472 [1:17:35<26:40:53,  3.70it/s]
  4%|▍         | 16058/371472 [1:17:36<26:54:46,  3.67it/s]
  4%|▍         | 16059/371472 [1:17:36<26:29:10,  3.73it/s]
  4%|▍         | 16060/371472 [1:17:36<26:51:31,  3.68it/s]
                                                           
{'loss': 4.6915, 'learning_rate': 9.615537934452368e-07, 'epoch': 0.69}

  4%|▍         | 16060/371472 [1:17:36<26:51:31,  3.68it/s]
  4%|▍         | 16061/371472 [1:17:36<27:17:02,  3.62it/s]
  4%|▍         | 16062/371472 [1:17:37<27:49:27,  3.55it/s]
  4%|▍         | 16063/371472 [1:17:37<28:12:54,  3.50it/s]
  4%|▍         | 16064/371472 [1:17:37<28:46:09,  3.43it/s]
  4%|▍         | 16065/371472 [1:17:38<28:30:46,  3.46it/s]
  4%|▍         | 16066/371472 [1:17:38<29:02:52,  3.40it/s]
  4%|▍         | 16067/371472 [1:17:38<28:51:15,  3.42it/s]
  4%|▍         | 16068/371472 [1:17:39<28:06:15,  3.51it/s]
  4%|▍         | 16069/371472 [1:17:39<27:45:04,  3.56it/s]
  4%|▍         | 16070/371472 [1:17:39<26:59:53,  3.66it/s]
  4%|▍         | 16071/371472 [1:17:39<27:49:09,  3.55it/s]
  4%|▍         | 16072/371472 [1:17:40<27:36:49,  3.58it/s]
  4%|▍         | 16073/371472 [1:17:40<27:31:42,  3.59it/s]
  4%|▍         | 16074/371472 [1:17:40<30:21:48,  3.25it/s]
  4%|▍         | 16075/371472 [1:17:41<30:57:01,  3.19it/s]
  4%|▍         | 16076/371472 [1:17:41<31:37:01,  3.12it/s]
  4%|▍         | 16077/371472 [1:17:41<29:45:27,  3.32it/s]
  4%|▍         | 16078/371472 [1:17:41<29:37:07,  3.33it/s]
  4%|▍         | 16079/371472 [1:17:42<29:36:50,  3.33it/s]
  4%|▍         | 16080/371472 [1:17:42<28:29:30,  3.46it/s]
                                                           
{'loss': 4.714, 'learning_rate': 9.61505311469758e-07, 'epoch': 0.69}

  4%|▍         | 16080/371472 [1:17:42<28:29:30,  3.46it/s]
  4%|▍         | 16081/371472 [1:17:42<27:38:54,  3.57it/s]
  4%|▍         | 16082/371472 [1:17:43<26:33:11,  3.72it/s]
  4%|▍         | 16083/371472 [1:17:43<26:36:20,  3.71it/s]
  4%|▍         | 16084/371472 [1:17:43<29:35:05,  3.34it/s]
  4%|▍         | 16085/371472 [1:17:44<30:55:43,  3.19it/s]
  4%|▍         | 16086/371472 [1:17:44<29:55:09,  3.30it/s]
  4%|▍         | 16087/371472 [1:17:44<29:34:05,  3.34it/s]
  4%|▍         | 16088/371472 [1:17:44<28:41:10,  3.44it/s]
  4%|▍         | 16089/371472 [1:17:45<27:46:46,  3.55it/s]
  4%|▍         | 16090/371472 [1:17:45<27:21:46,  3.61it/s]
  4%|▍         | 16091/371472 [1:17:45<26:34:40,  3.71it/s]
  4%|▍         | 16092/371472 [1:17:45<26:44:42,  3.69it/s]
  4%|▍         | 16093/371472 [1:17:46<27:22:35,  3.61it/s]
  4%|▍         | 16094/371472 [1:17:46<27:23:22,  3.60it/s]
  4%|▍         | 16095/371472 [1:17:46<27:45:50,  3.56it/s]
  4%|▍         | 16096/371472 [1:17:47<27:46:19,  3.55it/s]
  4%|▍         | 16097/371472 [1:17:47<27:42:44,  3.56it/s]
  4%|▍         | 16098/371472 [1:17:47<27:59:46,  3.53it/s]
  4%|▍         | 16099/371472 [1:17:48<31:51:50,  3.10it/s]
  4%|▍         | 16100/371472 [1:17:48<29:47:32,  3.31it/s]
                                                           
{'loss': 4.497, 'learning_rate': 9.614568294942791e-07, 'epoch': 0.69}

  4%|▍         | 16100/371472 [1:17:48<29:47:32,  3.31it/s]
  4%|▍         | 16101/371472 [1:17:48<29:18:24,  3.37it/s]
  4%|▍         | 16102/371472 [1:17:48<28:28:39,  3.47it/s]
  4%|▍         | 16103/371472 [1:17:49<28:06:21,  3.51it/s]
  4%|▍         | 16104/371472 [1:17:49<27:30:16,  3.59it/s]
  4%|▍         | 16105/371472 [1:17:49<27:51:25,  3.54it/s]
  4%|▍         | 16106/371472 [1:17:50<29:08:19,  3.39it/s]
  4%|▍         | 16107/371472 [1:17:50<28:33:20,  3.46it/s]
  4%|▍         | 16108/371472 [1:17:50<27:37:41,  3.57it/s]
  4%|▍         | 16109/371472 [1:17:50<28:24:31,  3.47it/s]
  4%|▍         | 16110/371472 [1:17:51<29:30:17,  3.35it/s]
  4%|▍         | 16111/371472 [1:17:51<27:55:40,  3.53it/s]
  4%|▍         | 16112/371472 [1:17:51<29:02:23,  3.40it/s]
  4%|▍         | 16113/371472 [1:17:52<28:44:07,  3.44it/s]
  4%|▍         | 16114/371472 [1:17:52<30:13:13,  3.27it/s]
  4%|▍         | 16115/371472 [1:17:52<29:05:06,  3.39it/s]
  4%|▍         | 16116/371472 [1:17:52<28:43:09,  3.44it/s]
  4%|▍         | 16117/371472 [1:17:53<27:30:42,  3.59it/s]
  4%|▍         | 16118/371472 [1:17:53<26:54:59,  3.67it/s]
  4%|▍         | 16119/371472 [1:17:53<28:35:34,  3.45it/s]
  4%|▍         | 16120/371472 [1:17:54<28:24:55,  3.47it/s]
                                                           
{'loss': 4.8497, 'learning_rate': 9.614083475188002e-07, 'epoch': 0.69}

  4%|▍         | 16120/371472 [1:17:54<28:24:55,  3.47it/s]
  4%|▍         | 16121/371472 [1:17:54<27:49:27,  3.55it/s]
  4%|▍         | 16122/371472 [1:17:54<29:40:09,  3.33it/s]
  4%|▍         | 16123/371472 [1:17:54<28:10:45,  3.50it/s]
  4%|▍         | 16124/371472 [1:17:55<27:28:01,  3.59it/s]
  4%|▍         | 16125/371472 [1:17:55<28:06:28,  3.51it/s]
  4%|▍         | 16126/371472 [1:17:55<27:37:23,  3.57it/s]
  4%|▍         | 16127/371472 [1:17:56<29:30:23,  3.35it/s]
  4%|▍         | 16128/371472 [1:17:56<28:25:55,  3.47it/s]
  4%|▍         | 16129/371472 [1:17:56<29:59:36,  3.29it/s]
  4%|▍         | 16130/371472 [1:17:56<30:08:49,  3.27it/s]
  4%|▍         | 16131/371472 [1:17:57<30:26:00,  3.24it/s]
  4%|▍         | 16132/371472 [1:17:57<29:08:16,  3.39it/s]
  4%|▍         | 16133/371472 [1:17:57<27:53:08,  3.54it/s]
  4%|▍         | 16134/371472 [1:17:58<27:15:15,  3.62it/s]
  4%|▍         | 16135/371472 [1:17:58<26:41:13,  3.70it/s]
  4%|▍         | 16136/371472 [1:17:58<26:38:23,  3.71it/s]
  4%|▍         | 16137/371472 [1:17:58<28:21:42,  3.48it/s]
  4%|▍         | 16138/371472 [1:17:59<30:23:18,  3.25it/s]
  4%|▍         | 16139/371472 [1:17:59<30:21:37,  3.25it/s]
  4%|▍         | 16140/371472 [1:17:59<31:04:34,  3.18it/s]
                                                           
{'loss': 4.691, 'learning_rate': 9.613598655433215e-07, 'epoch': 0.7}

  4%|▍         | 16140/371472 [1:17:59<31:04:34,  3.18it/s]
  4%|▍         | 16141/371472 [1:18:00<31:38:09,  3.12it/s]
  4%|▍         | 16142/371472 [1:18:00<30:06:14,  3.28it/s]
  4%|▍         | 16143/371472 [1:18:00<29:04:20,  3.40it/s]
  4%|▍         | 16144/371472 [1:18:01<30:49:03,  3.20it/s]
  4%|▍         | 16145/371472 [1:18:01<29:54:39,  3.30it/s]
  4%|▍         | 16146/371472 [1:18:01<30:13:33,  3.27it/s]
  4%|▍         | 16147/371472 [1:18:02<28:38:42,  3.45it/s]
  4%|▍         | 16148/371472 [1:18:02<27:32:37,  3.58it/s]
  4%|▍         | 16149/371472 [1:18:02<26:45:05,  3.69it/s]
  4%|▍         | 16150/371472 [1:18:02<28:57:10,  3.41it/s]
  4%|▍         | 16151/371472 [1:18:03<28:22:49,  3.48it/s]
  4%|▍         | 16152/371472 [1:18:03<28:43:05,  3.44it/s]
  4%|▍         | 16153/371472 [1:18:03<28:21:45,  3.48it/s]
  4%|▍         | 16154/371472 [1:18:04<29:23:50,  3.36it/s]
  4%|▍         | 16155/371472 [1:18:04<29:00:17,  3.40it/s]
  4%|▍         | 16156/371472 [1:18:04<28:04:31,  3.52it/s]
  4%|▍         | 16157/371472 [1:18:04<27:17:39,  3.62it/s]
  4%|▍         | 16158/371472 [1:18:05<26:57:26,  3.66it/s]
  4%|▍         | 16159/371472 [1:18:05<27:06:26,  3.64it/s]
  4%|▍         | 16160/371472 [1:18:05<27:31:24,  3.59it/s]
                                                           
{'loss': 4.8417, 'learning_rate': 9.613113835678423e-07, 'epoch': 0.7}

  4%|▍         | 16160/371472 [1:18:05<27:31:24,  3.59it/s]
  4%|▍         | 16161/371472 [1:18:05<27:29:14,  3.59it/s]
  4%|▍         | 16162/371472 [1:18:06<26:56:32,  3.66it/s]
  4%|▍         | 16163/371472 [1:18:06<28:39:11,  3.44it/s]
  4%|▍         | 16164/371472 [1:18:06<28:11:32,  3.50it/s]
  4%|▍         | 16165/371472 [1:18:07<27:34:55,  3.58it/s]
  4%|▍         | 16166/371472 [1:18:07<27:29:33,  3.59it/s]
  4%|▍         | 16167/371472 [1:18:07<28:03:46,  3.52it/s]
  4%|▍         | 16168/371472 [1:18:07<27:55:55,  3.53it/s]
  4%|▍         | 16169/371472 [1:18:08<28:36:05,  3.45it/s]
  4%|▍         | 16170/371472 [1:18:08<31:14:51,  3.16it/s]
  4%|▍         | 16171/371472 [1:18:08<30:12:46,  3.27it/s]
  4%|▍         | 16172/371472 [1:18:09<30:42:06,  3.21it/s]
  4%|▍         | 16173/371472 [1:18:09<30:18:07,  3.26it/s]
  4%|▍         | 16174/371472 [1:18:09<30:19:56,  3.25it/s]
  4%|▍         | 16175/371472 [1:18:10<29:33:57,  3.34it/s]
  4%|▍         | 16176/371472 [1:18:10<29:15:33,  3.37it/s]
  4%|▍         | 16177/371472 [1:18:10<29:10:13,  3.38it/s]
  4%|▍         | 16178/371472 [1:18:10<28:42:13,  3.44it/s]
  4%|▍         | 16179/371472 [1:18:11<28:14:24,  3.49it/s]
  4%|▍         | 16180/371472 [1:18:11<28:46:25,  3.43it/s]
                                                           
{'loss': 4.7323, 'learning_rate': 9.612629015923636e-07, 'epoch': 0.7}

  4%|▍         | 16180/371472 [1:18:11<28:46:25,  3.43it/s]
  4%|▍         | 16181/371472 [1:18:11<28:06:44,  3.51it/s]
  4%|▍         | 16182/371472 [1:18:12<27:43:39,  3.56it/s]
  4%|▍         | 16183/371472 [1:18:12<29:35:20,  3.34it/s]
  4%|▍         | 16184/371472 [1:18:12<29:35:03,  3.34it/s]
  4%|▍         | 16185/371472 [1:18:13<28:59:55,  3.40it/s]
  4%|▍         | 16186/371472 [1:18:13<28:24:45,  3.47it/s]
  4%|▍         | 16187/371472 [1:18:13<27:51:58,  3.54it/s]
  4%|▍         | 16188/371472 [1:18:13<27:58:37,  3.53it/s]
  4%|▍         | 16189/371472 [1:18:14<27:07:23,  3.64it/s]
  4%|▍         | 16190/371472 [1:18:14<27:00:02,  3.66it/s]
  4%|▍         | 16191/371472 [1:18:14<26:05:54,  3.78it/s]
  4%|▍         | 16192/371472 [1:18:14<26:02:09,  3.79it/s]
  4%|▍         | 16193/371472 [1:18:15<26:16:25,  3.76it/s]
  4%|▍         | 16194/371472 [1:18:15<27:10:54,  3.63it/s]
  4%|▍         | 16195/371472 [1:18:15<27:49:01,  3.55it/s]
  4%|▍         | 16196/371472 [1:18:15<27:03:40,  3.65it/s]
  4%|▍         | 16197/371472 [1:18:16<27:55:16,  3.53it/s]
  4%|▍         | 16198/371472 [1:18:16<27:35:22,  3.58it/s]
  4%|▍         | 16199/371472 [1:18:16<27:30:51,  3.59it/s]
  4%|▍         | 16200/371472 [1:18:17<27:53:07,  3.54it/s]
                                                           
{'loss': 4.632, 'learning_rate': 9.612144196168845e-07, 'epoch': 0.7}

  4%|▍         | 16200/371472 [1:18:17<27:53:07,  3.54it/s]
  4%|▍         | 16201/371472 [1:18:17<27:23:25,  3.60it/s]
  4%|▍         | 16202/371472 [1:18:17<27:46:42,  3.55it/s]
  4%|▍         | 16203/371472 [1:18:17<26:35:10,  3.71it/s]
  4%|▍         | 16204/371472 [1:18:18<26:44:49,  3.69it/s]
  4%|▍         | 16205/371472 [1:18:18<26:32:08,  3.72it/s]
  4%|▍         | 16206/371472 [1:18:18<26:32:00,  3.72it/s]
  4%|▍         | 16207/371472 [1:18:19<26:22:54,  3.74it/s]
  4%|▍         | 16208/371472 [1:18:19<26:51:18,  3.67it/s]
  4%|▍         | 16209/371472 [1:18:19<26:54:35,  3.67it/s]
  4%|▍         | 16210/371472 [1:18:19<26:46:39,  3.69it/s]
  4%|▍         | 16211/371472 [1:18:20<26:35:55,  3.71it/s]
  4%|▍         | 16212/371472 [1:18:20<26:46:24,  3.69it/s]
  4%|▍         | 16213/371472 [1:18:20<28:17:49,  3.49it/s]
  4%|▍         | 16214/371472 [1:18:21<31:16:10,  3.16it/s]
  4%|▍         | 16215/371472 [1:18:21<30:47:30,  3.20it/s]
  4%|▍         | 16216/371472 [1:18:21<30:39:41,  3.22it/s]
  4%|▍         | 16217/371472 [1:18:22<32:55:28,  3.00it/s]
  4%|▍         | 16218/371472 [1:18:22<33:12:39,  2.97it/s]
  4%|▍         | 16219/371472 [1:18:22<30:47:03,  3.21it/s]
  4%|▍         | 16220/371472 [1:18:22<29:08:33,  3.39it/s]
                                                           
{'loss': 4.8886, 'learning_rate': 9.611659376414057e-07, 'epoch': 0.7}

  4%|▍         | 16220/371472 [1:18:22<29:08:33,  3.39it/s]
  4%|▍         | 16221/371472 [1:18:23<29:42:10,  3.32it/s]
  4%|▍         | 16222/371472 [1:18:23<29:08:18,  3.39it/s]
  4%|▍         | 16223/371472 [1:18:23<29:30:02,  3.35it/s]
  4%|▍         | 16224/371472 [1:18:24<28:29:45,  3.46it/s]
  4%|▍         | 16225/371472 [1:18:24<28:33:28,  3.46it/s]
  4%|▍         | 16226/371472 [1:18:24<27:39:33,  3.57it/s]
  4%|▍         | 16227/371472 [1:18:24<27:21:42,  3.61it/s]
  4%|▍         | 16228/371472 [1:18:25<27:31:46,  3.58it/s]
  4%|▍         | 16229/371472 [1:18:25<27:43:01,  3.56it/s]
  4%|▍         | 16230/371472 [1:18:25<30:52:32,  3.20it/s]
  4%|▍         | 16231/371472 [1:18:26<30:49:13,  3.20it/s]
  4%|▍         | 16232/371472 [1:18:26<31:09:41,  3.17it/s]
  4%|▍         | 16233/371472 [1:18:26<29:56:43,  3.30it/s]
  4%|▍         | 16234/371472 [1:18:27<31:07:14,  3.17it/s]
  4%|▍         | 16235/371472 [1:18:27<29:33:32,  3.34it/s]
  4%|▍         | 16236/371472 [1:18:27<33:36:41,  2.94it/s]
  4%|▍         | 16237/371472 [1:18:28<32:21:52,  3.05it/s]
  4%|▍         | 16238/371472 [1:18:28<31:24:47,  3.14it/s]
  4%|▍         | 16239/371472 [1:18:28<30:26:46,  3.24it/s]
  4%|▍         | 16240/371472 [1:18:29<30:51:41,  3.20it/s]
                                                           
{'loss': 4.3369, 'learning_rate': 9.611174556659268e-07, 'epoch': 0.7}

  4%|▍         | 16240/371472 [1:18:29<30:51:41,  3.20it/s]
  4%|▍         | 16241/371472 [1:18:29<29:48:55,  3.31it/s]
  4%|▍         | 16242/371472 [1:18:29<28:54:20,  3.41it/s]
  4%|▍         | 16243/371472 [1:18:29<28:16:57,  3.49it/s]
  4%|▍         | 16244/371472 [1:18:30<27:24:58,  3.60it/s]
  4%|▍         | 16245/371472 [1:18:30<28:26:55,  3.47it/s]
  4%|▍         | 16246/371472 [1:18:30<27:16:56,  3.62it/s]
  4%|▍         | 16247/371472 [1:18:30<27:42:37,  3.56it/s]
  4%|▍         | 16248/371472 [1:18:31<27:15:42,  3.62it/s]
  4%|▍         | 16249/371472 [1:18:31<26:58:30,  3.66it/s]
  4%|▍         | 16250/371472 [1:18:31<26:57:26,  3.66it/s]
  4%|▍         | 16251/371472 [1:18:32<32:49:37,  3.01it/s]
  4%|▍         | 16252/371472 [1:18:32<30:56:11,  3.19it/s]
  4%|▍         | 16253/371472 [1:18:32<30:02:53,  3.28it/s]
  4%|▍         | 16254/371472 [1:18:33<29:35:23,  3.33it/s]
  4%|▍         | 16255/371472 [1:18:33<28:57:39,  3.41it/s]
  4%|▍         | 16256/371472 [1:18:33<29:10:21,  3.38it/s]
  4%|▍         | 16257/371472 [1:18:33<28:48:42,  3.42it/s]
  4%|▍         | 16258/371472 [1:18:34<28:20:35,  3.48it/s]
  4%|▍         | 16259/371472 [1:18:34<28:39:24,  3.44it/s]
  4%|▍         | 16260/371472 [1:18:34<28:22:36,  3.48it/s]
                                                           
{'loss': 4.6227, 'learning_rate': 9.610689736904479e-07, 'epoch': 0.7}

  4%|▍         | 16260/371472 [1:18:34<28:22:36,  3.48it/s]
  4%|▍         | 16261/371472 [1:18:35<30:11:40,  3.27it/s]
  4%|▍         | 16262/371472 [1:18:35<29:11:23,  3.38it/s]
  4%|▍         | 16263/371472 [1:18:35<28:55:09,  3.41it/s]
  4%|▍         | 16264/371472 [1:18:35<27:43:06,  3.56it/s]
  4%|▍         | 16265/371472 [1:18:36<27:43:38,  3.56it/s]
  4%|▍         | 16266/371472 [1:18:36<27:16:55,  3.62it/s]
  4%|▍         | 16267/371472 [1:18:36<27:04:26,  3.64it/s]
  4%|▍         | 16268/371472 [1:18:37<26:08:55,  3.77it/s]
  4%|▍         | 16269/371472 [1:18:37<27:14:21,  3.62it/s]
  4%|▍         | 16270/371472 [1:18:37<26:37:49,  3.71it/s]
  4%|▍         | 16271/371472 [1:18:37<28:46:46,  3.43it/s]
  4%|▍         | 16272/371472 [1:18:38<30:52:36,  3.20it/s]
  4%|▍         | 16273/371472 [1:18:38<33:34:31,  2.94it/s]
  4%|▍         | 16274/371472 [1:18:38<31:50:20,  3.10it/s]
  4%|▍         | 16275/371472 [1:18:39<29:42:17,  3.32it/s]
  4%|▍         | 16276/371472 [1:18:39<29:32:34,  3.34it/s]
  4%|▍         | 16277/371472 [1:18:39<28:59:12,  3.40it/s]
  4%|▍         | 16278/371472 [1:18:40<28:27:58,  3.47it/s]
  4%|▍         | 16279/371472 [1:18:40<27:17:49,  3.61it/s]
  4%|▍         | 16280/371472 [1:18:40<29:45:38,  3.32it/s]
                                                           
{'loss': 4.5117, 'learning_rate': 9.610204917149692e-07, 'epoch': 0.7}

  4%|▍         | 16280/371472 [1:18:40<29:45:38,  3.32it/s]
  4%|▍         | 16281/371472 [1:18:40<30:01:02,  3.29it/s]
  4%|▍         | 16282/371472 [1:18:41<28:37:54,  3.45it/s]
  4%|▍         | 16283/371472 [1:18:41<28:39:16,  3.44it/s]
  4%|▍         | 16284/371472 [1:18:41<29:43:41,  3.32it/s]
  4%|▍         | 16285/371472 [1:18:42<28:38:34,  3.44it/s]
  4%|▍         | 16286/371472 [1:18:42<29:27:42,  3.35it/s]
  4%|▍         | 16287/371472 [1:18:42<30:10:54,  3.27it/s]
  4%|▍         | 16288/371472 [1:18:43<28:55:14,  3.41it/s]
  4%|▍         | 16289/371472 [1:18:43<28:03:59,  3.52it/s]
  4%|▍         | 16290/371472 [1:18:43<27:49:47,  3.55it/s]
  4%|▍         | 16291/371472 [1:18:43<30:51:10,  3.20it/s]
  4%|▍         | 16292/371472 [1:18:44<29:26:27,  3.35it/s]
  4%|▍         | 16293/371472 [1:18:44<28:24:37,  3.47it/s]
  4%|▍         | 16294/371472 [1:18:44<30:47:45,  3.20it/s]
  4%|▍         | 16295/371472 [1:18:45<29:25:42,  3.35it/s]
  4%|▍         | 16296/371472 [1:18:45<28:41:28,  3.44it/s]
  4%|▍         | 16297/371472 [1:18:45<29:12:14,  3.38it/s]
  4%|▍         | 16298/371472 [1:18:45<28:20:39,  3.48it/s]
  4%|▍         | 16299/371472 [1:18:46<28:18:06,  3.49it/s]
  4%|▍         | 16300/371472 [1:18:46<27:42:38,  3.56it/s]
                                                           
{'loss': 4.7759, 'learning_rate': 9.6097200973949e-07, 'epoch': 0.7}

  4%|▍         | 16300/371472 [1:18:46<27:42:38,  3.56it/s]
  4%|▍         | 16301/371472 [1:18:46<29:40:03,  3.33it/s]
  4%|▍         | 16302/371472 [1:18:47<29:35:07,  3.33it/s]
  4%|▍         | 16303/371472 [1:18:47<28:07:26,  3.51it/s]
  4%|▍         | 16304/371472 [1:18:47<27:09:49,  3.63it/s]
  4%|▍         | 16305/371472 [1:18:48<28:45:23,  3.43it/s]
  4%|▍         | 16306/371472 [1:18:48<27:51:04,  3.54it/s]
  4%|▍         | 16307/371472 [1:18:48<27:27:52,  3.59it/s]
  4%|▍         | 16308/371472 [1:18:48<28:07:26,  3.51it/s]
  4%|▍         | 16309/371472 [1:18:49<26:58:00,  3.66it/s]
  4%|▍         | 16310/371472 [1:18:49<26:38:39,  3.70it/s]
  4%|▍         | 16311/371472 [1:18:49<27:06:58,  3.64it/s]
  4%|▍         | 16312/371472 [1:18:49<27:05:02,  3.64it/s]
  4%|▍         | 16313/371472 [1:18:50<27:33:23,  3.58it/s]
  4%|▍         | 16314/371472 [1:18:50<27:57:30,  3.53it/s]
  4%|▍         | 16315/371472 [1:18:50<27:23:06,  3.60it/s]
  4%|▍         | 16316/371472 [1:18:51<26:47:32,  3.68it/s]
  4%|▍         | 16317/371472 [1:18:51<29:13:30,  3.38it/s]
  4%|▍         | 16318/371472 [1:18:51<29:57:52,  3.29it/s]
  4%|▍         | 16319/371472 [1:18:51<28:32:35,  3.46it/s]
  4%|▍         | 16320/371472 [1:18:52<29:11:38,  3.38it/s]
                                                           
{'loss': 4.6303, 'learning_rate': 9.609235277640113e-07, 'epoch': 0.7}

  4%|▍         | 16320/371472 [1:18:52<29:11:38,  3.38it/s]
  4%|▍         | 16321/371472 [1:18:52<27:51:15,  3.54it/s]
  4%|▍         | 16322/371472 [1:18:52<27:21:34,  3.61it/s]
  4%|▍         | 16323/371472 [1:18:53<27:09:54,  3.63it/s]
  4%|▍         | 16324/371472 [1:18:53<27:00:21,  3.65it/s]
  4%|▍         | 16325/371472 [1:18:53<26:42:51,  3.69it/s]
  4%|▍         | 16326/371472 [1:18:53<26:44:06,  3.69it/s]
  4%|▍         | 16327/371472 [1:18:54<29:17:13,  3.37it/s]
  4%|▍         | 16328/371472 [1:18:54<30:12:44,  3.27it/s]
  4%|▍         | 16329/371472 [1:18:54<28:49:40,  3.42it/s]
  4%|▍         | 16330/371472 [1:18:55<28:07:56,  3.51it/s]
  4%|▍         | 16331/371472 [1:18:55<27:39:40,  3.57it/s]
  4%|▍         | 16332/371472 [1:18:55<28:31:48,  3.46it/s]
  4%|▍         | 16333/371472 [1:18:55<28:05:13,  3.51it/s]
  4%|▍         | 16334/371472 [1:18:56<27:16:01,  3.62it/s]
  4%|▍         | 16335/371472 [1:18:56<26:40:07,  3.70it/s]
  4%|▍         | 16336/371472 [1:18:56<27:17:04,  3.62it/s]
  4%|▍         | 16337/371472 [1:18:57<27:39:47,  3.57it/s]
  4%|▍         | 16338/371472 [1:18:57<27:44:57,  3.55it/s]
  4%|▍         | 16339/371472 [1:18:57<28:12:41,  3.50it/s]
  4%|▍         | 16340/371472 [1:18:57<27:46:16,  3.55it/s]
                                                           
{'loss': 4.836, 'learning_rate': 9.608750457885324e-07, 'epoch': 0.7}

  4%|▍         | 16340/371472 [1:18:57<27:46:16,  3.55it/s]
  4%|▍         | 16341/371472 [1:18:58<27:13:42,  3.62it/s]
  4%|▍         | 16342/371472 [1:18:58<27:42:29,  3.56it/s]
  4%|▍         | 16343/371472 [1:18:58<28:04:41,  3.51it/s]
  4%|▍         | 16344/371472 [1:18:58<27:18:16,  3.61it/s]
  4%|▍         | 16345/371472 [1:18:59<27:43:43,  3.56it/s]
  4%|▍         | 16346/371472 [1:18:59<26:54:11,  3.67it/s]
  4%|▍         | 16347/371472 [1:18:59<27:22:16,  3.60it/s]
  4%|▍         | 16348/371472 [1:19:00<28:13:23,  3.50it/s]
  4%|▍         | 16349/371472 [1:19:00<28:02:38,  3.52it/s]
  4%|▍         | 16350/371472 [1:19:00<27:40:59,  3.56it/s]
  4%|▍         | 16351/371472 [1:19:00<28:01:01,  3.52it/s]
  4%|▍         | 16352/371472 [1:19:01<28:10:39,  3.50it/s]
  4%|▍         | 16353/371472 [1:19:01<27:59:42,  3.52it/s]
  4%|▍         | 16354/371472 [1:19:01<27:52:51,  3.54it/s]
  4%|▍         | 16355/371472 [1:19:02<27:09:51,  3.63it/s]
  4%|▍         | 16356/371472 [1:19:02<26:43:19,  3.69it/s]
  4%|▍         | 16357/371472 [1:19:02<26:45:53,  3.69it/s]
  4%|▍         | 16358/371472 [1:19:02<28:26:08,  3.47it/s]
  4%|▍         | 16359/371472 [1:19:03<28:00:24,  3.52it/s]
  4%|▍         | 16360/371472 [1:19:03<27:11:42,  3.63it/s]
                                                           
{'loss': 4.7166, 'learning_rate': 9.608265638130535e-07, 'epoch': 0.7}

  4%|▍         | 16360/371472 [1:19:03<27:11:42,  3.63it/s]
  4%|▍         | 16361/371472 [1:19:03<28:18:28,  3.48it/s]
  4%|▍         | 16362/371472 [1:19:04<27:35:53,  3.57it/s]
  4%|▍         | 16363/371472 [1:19:04<27:57:16,  3.53it/s]
  4%|▍         | 16364/371472 [1:19:04<28:29:49,  3.46it/s]
  4%|▍         | 16365/371472 [1:19:04<27:51:23,  3.54it/s]
  4%|▍         | 16366/371472 [1:19:05<32:46:44,  3.01it/s]
  4%|▍         | 16367/371472 [1:19:05<31:05:49,  3.17it/s]
  4%|▍         | 16368/371472 [1:19:05<32:54:21,  3.00it/s]
  4%|▍         | 16369/371472 [1:19:06<32:54:42,  3.00it/s]
  4%|▍         | 16370/371472 [1:19:06<31:33:18,  3.13it/s]
  4%|▍         | 16371/371472 [1:19:06<30:06:19,  3.28it/s]
  4%|▍         | 16372/371472 [1:19:07<29:03:35,  3.39it/s]
  4%|▍         | 16373/371472 [1:19:07<28:38:43,  3.44it/s]
  4%|▍         | 16374/371472 [1:19:07<28:11:25,  3.50it/s]
  4%|▍         | 16375/371472 [1:19:07<27:33:10,  3.58it/s]
  4%|▍         | 16376/371472 [1:19:08<27:26:38,  3.59it/s]
  4%|▍         | 16377/371472 [1:19:08<27:28:06,  3.59it/s]
  4%|▍         | 16378/371472 [1:19:08<29:02:22,  3.40it/s]
  4%|▍         | 16379/371472 [1:19:09<30:15:45,  3.26it/s]
  4%|▍         | 16380/371472 [1:19:09<32:42:58,  3.01it/s]
                                                           
{'loss': 4.489, 'learning_rate': 9.607780818375745e-07, 'epoch': 0.71}

  4%|▍         | 16380/371472 [1:19:09<32:42:58,  3.01it/s]
  4%|▍         | 16381/371472 [1:19:09<30:20:35,  3.25it/s]
  4%|▍         | 16382/371472 [1:19:10<29:28:15,  3.35it/s]
  4%|▍         | 16383/371472 [1:19:10<27:55:34,  3.53it/s]
  4%|▍         | 16384/371472 [1:19:10<27:22:41,  3.60it/s]
  4%|▍         | 16385/371472 [1:19:10<27:48:15,  3.55it/s]
  4%|▍         | 16386/371472 [1:19:11<27:43:48,  3.56it/s]
  4%|▍         | 16387/371472 [1:19:11<27:42:28,  3.56it/s]
  4%|▍         | 16388/371472 [1:19:11<28:13:14,  3.50it/s]
  4%|▍         | 16389/371472 [1:19:12<28:23:43,  3.47it/s]
  4%|▍         | 16390/371472 [1:19:12<30:15:11,  3.26it/s]
  4%|▍         | 16391/371472 [1:19:12<30:00:54,  3.29it/s]
  4%|▍         | 16392/371472 [1:19:12<29:35:05,  3.33it/s]
  4%|▍         | 16393/371472 [1:19:13<30:01:58,  3.28it/s]
  4%|▍         | 16394/371472 [1:19:13<29:42:50,  3.32it/s]
  4%|▍         | 16395/371472 [1:19:13<30:39:42,  3.22it/s]
  4%|▍         | 16396/371472 [1:19:14<29:01:25,  3.40it/s]
  4%|▍         | 16397/371472 [1:19:14<28:52:32,  3.42it/s]
  4%|▍         | 16398/371472 [1:19:14<27:22:18,  3.60it/s]
  4%|▍         | 16399/371472 [1:19:15<27:58:43,  3.53it/s]
  4%|▍         | 16400/371472 [1:19:15<28:22:49,  3.48it/s]
                                                           
{'loss': 4.6527, 'learning_rate': 9.607295998620956e-07, 'epoch': 0.71}

  4%|▍         | 16400/371472 [1:19:15<28:22:49,  3.48it/s]
  4%|▍         | 16401/371472 [1:19:15<29:40:17,  3.32it/s]
  4%|▍         | 16402/371472 [1:19:15<28:24:11,  3.47it/s]
  4%|▍         | 16403/371472 [1:19:16<29:06:05,  3.39it/s]
  4%|▍         | 16404/371472 [1:19:16<28:25:19,  3.47it/s]
  4%|▍         | 16405/371472 [1:19:16<29:15:52,  3.37it/s]
  4%|▍         | 16406/371472 [1:19:17<28:49:00,  3.42it/s]
  4%|▍         | 16407/371472 [1:19:17<28:53:10,  3.41it/s]
  4%|▍         | 16408/371472 [1:19:17<28:52:33,  3.42it/s]
  4%|▍         | 16409/371472 [1:19:18<30:10:45,  3.27it/s]
  4%|▍         | 16410/371472 [1:19:18<29:13:47,  3.37it/s]
  4%|▍         | 16411/371472 [1:19:18<28:30:45,  3.46it/s]
  4%|▍         | 16412/371472 [1:19:18<27:15:04,  3.62it/s]
  4%|▍         | 16413/371472 [1:19:19<29:49:20,  3.31it/s]
  4%|▍         | 16414/371472 [1:19:19<29:54:52,  3.30it/s]
  4%|▍         | 16415/371472 [1:19:19<30:17:52,  3.26it/s]
  4%|▍         | 16416/371472 [1:19:20<28:33:33,  3.45it/s]
  4%|▍         | 16417/371472 [1:19:20<27:22:59,  3.60it/s]
  4%|▍         | 16418/371472 [1:19:20<27:54:58,  3.53it/s]
  4%|▍         | 16419/371472 [1:19:20<28:12:50,  3.50it/s]
  4%|▍         | 16420/371472 [1:19:21<28:39:59,  3.44it/s]
                                                           
{'loss': 4.4992, 'learning_rate': 9.606811178866169e-07, 'epoch': 0.71}

  4%|▍         | 16420/371472 [1:19:21<28:39:59,  3.44it/s]
  4%|▍         | 16421/371472 [1:19:21<28:11:33,  3.50it/s]
  4%|▍         | 16422/371472 [1:19:21<28:51:34,  3.42it/s]
  4%|▍         | 16423/371472 [1:19:22<30:30:20,  3.23it/s]
  4%|▍         | 16424/371472 [1:19:22<29:47:11,  3.31it/s]
  4%|▍         | 16425/371472 [1:19:22<28:48:02,  3.42it/s]
  4%|▍         | 16426/371472 [1:19:22<27:59:51,  3.52it/s]
  4%|▍         | 16427/371472 [1:19:23<28:10:48,  3.50it/s]
  4%|▍         | 16428/371472 [1:19:23<28:20:13,  3.48it/s]
  4%|▍         | 16429/371472 [1:19:23<28:00:52,  3.52it/s]
  4%|▍         | 16430/371472 [1:19:24<28:48:25,  3.42it/s]
  4%|▍         | 16431/371472 [1:19:24<30:02:58,  3.28it/s]
  4%|▍         | 16432/371472 [1:19:24<29:00:49,  3.40it/s]
  4%|▍         | 16433/371472 [1:19:24<28:36:39,  3.45it/s]
  4%|▍         | 16434/371472 [1:19:25<29:12:47,  3.38it/s]
  4%|▍         | 16435/371472 [1:19:25<29:48:08,  3.31it/s]
  4%|▍         | 16436/371472 [1:19:25<29:06:42,  3.39it/s]
  4%|▍         | 16437/371472 [1:19:26<28:35:04,  3.45it/s]
  4%|▍         | 16438/371472 [1:19:26<28:16:20,  3.49it/s]
  4%|▍         | 16439/371472 [1:19:26<27:46:58,  3.55it/s]
  4%|▍         | 16440/371472 [1:19:27<28:23:33,  3.47it/s]
                                                           
{'loss': 4.9018, 'learning_rate': 9.606326359111377e-07, 'epoch': 0.71}

  4%|▍         | 16440/371472 [1:19:27<28:23:33,  3.47it/s]
  4%|▍         | 16441/371472 [1:19:27<29:27:45,  3.35it/s]
  4%|▍         | 16442/371472 [1:19:27<29:14:20,  3.37it/s]
  4%|▍         | 16443/371472 [1:19:27<28:50:56,  3.42it/s]
  4%|▍         | 16444/371472 [1:19:28<28:12:16,  3.50it/s]
  4%|▍         | 16445/371472 [1:19:28<27:56:48,  3.53it/s]
  4%|▍         | 16446/371472 [1:19:28<27:41:54,  3.56it/s]
  4%|▍         | 16447/371472 [1:19:29<27:10:23,  3.63it/s]
  4%|▍         | 16448/371472 [1:19:29<26:49:50,  3.68it/s]
  4%|▍         | 16449/371472 [1:19:29<26:53:26,  3.67it/s]
  4%|▍         | 16450/371472 [1:19:29<26:59:29,  3.65it/s]
  4%|▍         | 16451/371472 [1:19:30<26:39:52,  3.70it/s]
  4%|▍         | 16452/371472 [1:19:30<27:07:04,  3.64it/s]
  4%|▍         | 16453/371472 [1:19:30<26:46:35,  3.68it/s]
  4%|▍         | 16454/371472 [1:19:30<26:34:31,  3.71it/s]
  4%|▍         | 16455/371472 [1:19:31<27:13:43,  3.62it/s]
  4%|▍         | 16456/371472 [1:19:31<28:08:12,  3.50it/s]
  4%|▍         | 16457/371472 [1:19:31<27:31:10,  3.58it/s]
  4%|▍         | 16458/371472 [1:19:32<27:09:52,  3.63it/s]
  4%|▍         | 16459/371472 [1:19:32<27:12:04,  3.63it/s]
  4%|▍         | 16460/371472 [1:19:32<26:18:12,  3.75it/s]
                                                           
{'loss': 4.854, 'learning_rate': 9.60584153935659e-07, 'epoch': 0.71}

  4%|▍         | 16460/371472 [1:19:32<26:18:12,  3.75it/s]
  4%|▍         | 16461/371472 [1:19:32<26:19:16,  3.75it/s]
  4%|▍         | 16462/371472 [1:19:33<26:59:23,  3.65it/s]
  4%|▍         | 16463/371472 [1:19:33<26:26:48,  3.73it/s]
  4%|▍         | 16464/371472 [1:19:33<27:02:45,  3.65it/s]
  4%|▍         | 16465/371472 [1:19:33<27:43:22,  3.56it/s]
  4%|▍         | 16466/371472 [1:19:34<27:42:20,  3.56it/s]
  4%|▍         | 16467/371472 [1:19:34<29:18:31,  3.36it/s]
  4%|▍         | 16468/371472 [1:19:34<29:30:54,  3.34it/s]
  4%|▍         | 16469/371472 [1:19:35<30:48:19,  3.20it/s]
  4%|▍         | 16470/371472 [1:19:35<30:37:50,  3.22it/s]
  4%|▍         | 16471/371472 [1:19:35<29:27:16,  3.35it/s]
  4%|▍         | 16472/371472 [1:19:36<28:22:07,  3.48it/s]
  4%|▍         | 16473/371472 [1:19:36<27:32:55,  3.58it/s]
  4%|▍         | 16474/371472 [1:19:36<27:14:06,  3.62it/s]
  4%|▍         | 16475/371472 [1:19:36<30:06:05,  3.28it/s]
  4%|▍         | 16476/371472 [1:19:37<29:42:31,  3.32it/s]
  4%|▍         | 16477/371472 [1:19:37<28:15:56,  3.49it/s]
  4%|▍         | 16478/371472 [1:19:37<27:19:59,  3.61it/s]
  4%|▍         | 16479/371472 [1:19:38<26:45:09,  3.69it/s]
  4%|▍         | 16480/371472 [1:19:38<26:57:39,  3.66it/s]
                                                           
{'loss': 4.8965, 'learning_rate': 9.6053567196018e-07, 'epoch': 0.71}

  4%|▍         | 16480/371472 [1:19:38<26:57:39,  3.66it/s]
  4%|▍         | 16481/371472 [1:19:38<26:55:59,  3.66it/s]
  4%|▍         | 16482/371472 [1:19:38<28:57:25,  3.41it/s]
  4%|▍         | 16483/371472 [1:19:39<29:26:10,  3.35it/s]
  4%|▍         | 16484/371472 [1:19:39<31:05:20,  3.17it/s]
  4%|▍         | 16485/371472 [1:19:39<29:42:13,  3.32it/s]
  4%|▍         | 16486/371472 [1:19:40<28:37:57,  3.44it/s]
  4%|▍         | 16487/371472 [1:19:40<29:41:14,  3.32it/s]
  4%|▍         | 16488/371472 [1:19:40<28:24:21,  3.47it/s]
  4%|▍         | 16489/371472 [1:19:41<29:27:14,  3.35it/s]
  4%|▍         | 16490/371472 [1:19:41<30:50:38,  3.20it/s]
  4%|▍         | 16491/371472 [1:19:41<29:56:04,  3.29it/s]
  4%|▍         | 16492/371472 [1:19:41<29:13:26,  3.37it/s]
  4%|▍         | 16493/371472 [1:19:42<28:04:14,  3.51it/s]
  4%|▍         | 16494/371472 [1:19:42<27:45:00,  3.55it/s]
  4%|▍         | 16495/371472 [1:19:42<27:42:28,  3.56it/s]
  4%|▍         | 16496/371472 [1:19:43<28:09:03,  3.50it/s]
  4%|▍         | 16497/371472 [1:19:43<29:19:08,  3.36it/s]
  4%|▍         | 16498/371472 [1:19:43<29:09:20,  3.38it/s]
  4%|▍         | 16499/371472 [1:19:43<29:46:48,  3.31it/s]
  4%|▍         | 16500/371472 [1:19:44<29:05:46,  3.39it/s]
                                                           
{'loss': 4.5009, 'learning_rate': 9.604871899847012e-07, 'epoch': 0.71}

  4%|▍         | 16500/371472 [1:19:44<29:05:46,  3.39it/s]
  4%|▍         | 16501/371472 [1:19:44<29:13:49,  3.37it/s]
  4%|▍         | 16502/371472 [1:19:44<29:52:31,  3.30it/s]
  4%|▍         | 16503/371472 [1:19:45<28:27:58,  3.46it/s]
  4%|▍         | 16504/371472 [1:19:45<28:42:01,  3.44it/s]
  4%|▍         | 16505/371472 [1:19:45<28:52:49,  3.41it/s]
  4%|▍         | 16506/371472 [1:19:45<28:34:10,  3.45it/s]
  4%|▍         | 16507/371472 [1:19:46<27:38:27,  3.57it/s]
  4%|▍         | 16508/371472 [1:19:46<28:07:21,  3.51it/s]
  4%|▍         | 16509/371472 [1:19:46<29:12:30,  3.38it/s]
  4%|▍         | 16510/371472 [1:19:47<30:20:31,  3.25it/s]
  4%|▍         | 16511/371472 [1:19:47<29:30:50,  3.34it/s]
  4%|▍         | 16512/371472 [1:19:47<28:27:43,  3.46it/s]
  4%|▍         | 16513/371472 [1:19:48<30:13:26,  3.26it/s]
  4%|▍         | 16514/371472 [1:19:48<29:45:42,  3.31it/s]
  4%|▍         | 16515/371472 [1:19:48<28:21:03,  3.48it/s]
  4%|▍         | 16516/371472 [1:19:48<27:26:01,  3.59it/s]
  4%|▍         | 16517/371472 [1:19:49<28:07:10,  3.51it/s]
  4%|▍         | 16518/371472 [1:19:49<28:49:46,  3.42it/s]
  4%|▍         | 16519/371472 [1:19:49<28:01:17,  3.52it/s]
  4%|▍         | 16520/371472 [1:19:50<27:58:36,  3.52it/s]
                                                           
{'loss': 4.8104, 'learning_rate': 9.604387080092225e-07, 'epoch': 0.71}

  4%|▍         | 16520/371472 [1:19:50<27:58:36,  3.52it/s]
  4%|▍         | 16521/371472 [1:19:50<27:31:35,  3.58it/s]
  4%|▍         | 16522/371472 [1:19:50<28:53:28,  3.41it/s]
  4%|▍         | 16523/371472 [1:19:50<28:24:23,  3.47it/s]
  4%|▍         | 16524/371472 [1:19:51<28:38:08,  3.44it/s]
  4%|▍         | 16525/371472 [1:19:51<27:18:25,  3.61it/s]
  4%|▍         | 16526/371472 [1:19:51<26:40:54,  3.70it/s]
  4%|▍         | 16527/371472 [1:19:52<27:17:42,  3.61it/s]
  4%|▍         | 16528/371472 [1:19:52<27:27:12,  3.59it/s]
  4%|▍         | 16529/371472 [1:19:52<27:03:10,  3.64it/s]
  4%|▍         | 16530/371472 [1:19:52<27:27:37,  3.59it/s]
  4%|▍         | 16531/371472 [1:19:53<29:04:17,  3.39it/s]
  4%|▍         | 16532/371472 [1:19:53<30:08:36,  3.27it/s]
  4%|▍         | 16533/371472 [1:19:53<31:08:56,  3.17it/s]
  4%|▍         | 16534/371472 [1:19:54<31:49:12,  3.10it/s]
  4%|▍         | 16535/371472 [1:19:54<30:14:34,  3.26it/s]
  4%|▍         | 16536/371472 [1:19:54<28:46:20,  3.43it/s]
  4%|▍         | 16537/371472 [1:19:54<27:37:32,  3.57it/s]
  4%|▍         | 16538/371472 [1:19:55<26:55:17,  3.66it/s]
  4%|▍         | 16539/371472 [1:19:55<28:06:20,  3.51it/s]
  4%|▍         | 16540/371472 [1:19:55<29:38:02,  3.33it/s]
                                                           
{'loss': 4.698, 'learning_rate': 9.603902260337433e-07, 'epoch': 0.71}

  4%|▍         | 16540/371472 [1:19:55<29:38:02,  3.33it/s]
  4%|▍         | 16541/371472 [1:19:56<29:52:11,  3.30it/s]
  4%|▍         | 16542/371472 [1:19:56<29:33:18,  3.34it/s]
  4%|▍         | 16543/371472 [1:19:56<30:57:11,  3.19it/s]
  4%|▍         | 16544/371472 [1:19:57<29:30:44,  3.34it/s]
  4%|▍         | 16545/371472 [1:19:57<28:23:09,  3.47it/s]
  4%|▍         | 16546/371472 [1:19:57<28:26:49,  3.47it/s]
  4%|▍         | 16547/371472 [1:19:57<28:10:05,  3.50it/s]
  4%|▍         | 16548/371472 [1:19:58<29:52:21,  3.30it/s]
  4%|▍         | 16549/371472 [1:19:58<28:41:45,  3.44it/s]
  4%|▍         | 16550/371472 [1:19:58<29:46:04,  3.31it/s]
  4%|▍         | 16551/371472 [1:19:59<29:17:10,  3.37it/s]
  4%|▍         | 16552/371472 [1:19:59<27:57:24,  3.53it/s]
  4%|▍         | 16553/371472 [1:19:59<28:27:22,  3.46it/s]
  4%|▍         | 16554/371472 [1:19:59<28:04:19,  3.51it/s]
  4%|▍         | 16555/371472 [1:20:00<29:41:21,  3.32it/s]
  4%|▍         | 16556/371472 [1:20:00<28:44:13,  3.43it/s]
  4%|▍         | 16557/371472 [1:20:00<28:07:38,  3.51it/s]
  4%|▍         | 16558/371472 [1:20:01<27:31:54,  3.58it/s]
  4%|▍         | 16559/371472 [1:20:01<27:15:15,  3.62it/s]
  4%|▍         | 16560/371472 [1:20:01<27:12:00,  3.62it/s]
                                                           
{'loss': 4.7735, 'learning_rate': 9.603417440582646e-07, 'epoch': 0.71}

  4%|▍         | 16560/371472 [1:20:01<27:12:00,  3.62it/s]
  4%|▍         | 16561/371472 [1:20:01<27:51:32,  3.54it/s]
  4%|▍         | 16562/371472 [1:20:02<27:52:02,  3.54it/s]
  4%|▍         | 16563/371472 [1:20:02<27:11:04,  3.63it/s]
  4%|▍         | 16564/371472 [1:20:02<27:17:08,  3.61it/s]
  4%|▍         | 16565/371472 [1:20:03<27:11:16,  3.63it/s]
  4%|▍         | 16566/371472 [1:20:03<27:40:16,  3.56it/s]
  4%|▍         | 16567/371472 [1:20:03<26:55:37,  3.66it/s]
  4%|▍         | 16568/371472 [1:20:04<32:22:47,  3.04it/s]
  4%|▍         | 16569/371472 [1:20:04<31:31:06,  3.13it/s]
  4%|▍         | 16570/371472 [1:20:04<30:30:36,  3.23it/s]
  4%|▍         | 16571/371472 [1:20:04<29:16:45,  3.37it/s]
  4%|▍         | 16572/371472 [1:20:05<29:20:12,  3.36it/s]
  4%|▍         | 16573/371472 [1:20:05<29:02:23,  3.39it/s]
  4%|▍         | 16574/371472 [1:20:05<29:59:24,  3.29it/s]
  4%|▍         | 16575/371472 [1:20:06<28:59:41,  3.40it/s]
  4%|▍         | 16576/371472 [1:20:06<29:27:47,  3.35it/s]
  4%|▍         | 16577/371472 [1:20:06<28:17:45,  3.48it/s]
  4%|▍         | 16578/371472 [1:20:06<28:12:47,  3.49it/s]
  4%|▍         | 16579/371472 [1:20:07<28:04:27,  3.51it/s]
  4%|▍         | 16580/371472 [1:20:07<28:15:39,  3.49it/s]
                                                           
{'loss': 4.6545, 'learning_rate': 9.602932620827855e-07, 'epoch': 0.71}

  4%|▍         | 16580/371472 [1:20:07<28:15:39,  3.49it/s]
  4%|▍         | 16581/371472 [1:20:07<27:26:47,  3.59it/s]
  4%|▍         | 16582/371472 [1:20:08<27:40:51,  3.56it/s]
  4%|▍         | 16583/371472 [1:20:08<27:20:06,  3.61it/s]
  4%|▍         | 16584/371472 [1:20:08<27:12:26,  3.62it/s]
  4%|▍         | 16585/371472 [1:20:08<26:33:10,  3.71it/s]
  4%|▍         | 16586/371472 [1:20:09<26:35:25,  3.71it/s]
  4%|▍         | 16587/371472 [1:20:09<26:19:57,  3.74it/s]
  4%|▍         | 16588/371472 [1:20:09<26:13:17,  3.76it/s]
  4%|▍         | 16589/371472 [1:20:09<26:42:56,  3.69it/s]
  4%|▍         | 16590/371472 [1:20:10<26:39:54,  3.70it/s]
  4%|▍         | 16591/371472 [1:20:10<26:15:26,  3.75it/s]
  4%|▍         | 16592/371472 [1:20:10<26:20:31,  3.74it/s]
  4%|▍         | 16593/371472 [1:20:11<26:53:52,  3.66it/s]
  4%|▍         | 16594/371472 [1:20:11<27:35:58,  3.57it/s]
  4%|▍         | 16595/371472 [1:20:11<26:52:29,  3.67it/s]
  4%|▍         | 16596/371472 [1:20:11<27:24:16,  3.60it/s]
  4%|▍         | 16597/371472 [1:20:12<26:59:45,  3.65it/s]
  4%|▍         | 16598/371472 [1:20:12<27:28:29,  3.59it/s]
  4%|▍         | 16599/371472 [1:20:12<27:02:01,  3.65it/s]
  4%|▍         | 16600/371472 [1:20:12<26:38:31,  3.70it/s]
                                                           
{'loss': 4.988, 'learning_rate': 9.602447801073067e-07, 'epoch': 0.71}

  4%|▍         | 16600/371472 [1:20:12<26:38:31,  3.70it/s]
  4%|▍         | 16601/371472 [1:20:13<27:53:51,  3.53it/s]
  4%|▍         | 16602/371472 [1:20:13<26:50:33,  3.67it/s]
  4%|▍         | 16603/371472 [1:20:13<27:26:21,  3.59it/s]
  4%|▍         | 16604/371472 [1:20:14<28:22:10,  3.47it/s]
  4%|▍         | 16605/371472 [1:20:14<28:51:01,  3.42it/s]
  4%|▍         | 16606/371472 [1:20:14<28:53:33,  3.41it/s]
  4%|▍         | 16607/371472 [1:20:14<28:15:27,  3.49it/s]
  4%|▍         | 16608/371472 [1:20:15<29:58:27,  3.29it/s]
  4%|▍         | 16609/371472 [1:20:15<29:53:49,  3.30it/s]
  4%|▍         | 16610/371472 [1:20:15<28:43:24,  3.43it/s]
  4%|▍         | 16611/371472 [1:20:16<28:29:53,  3.46it/s]
  4%|▍         | 16612/371472 [1:20:16<27:24:32,  3.60it/s]
  4%|▍         | 16613/371472 [1:20:16<27:03:51,  3.64it/s]
  4%|▍         | 16614/371472 [1:20:16<28:15:23,  3.49it/s]
  4%|▍         | 16615/371472 [1:20:17<27:40:54,  3.56it/s]
  4%|▍         | 16616/371472 [1:20:17<28:25:57,  3.47it/s]
  4%|▍         | 16617/371472 [1:20:17<27:50:03,  3.54it/s]
  4%|▍         | 16618/371472 [1:20:18<28:00:00,  3.52it/s]
  4%|▍         | 16619/371472 [1:20:18<29:36:06,  3.33it/s]
  4%|▍         | 16620/371472 [1:20:18<29:23:02,  3.35it/s]
                                                           
{'loss': 4.6552, 'learning_rate': 9.601962981318278e-07, 'epoch': 0.72}

  4%|▍         | 16620/371472 [1:20:18<29:23:02,  3.35it/s]
  4%|▍         | 16621/371472 [1:20:19<28:06:11,  3.51it/s]
  4%|▍         | 16622/371472 [1:20:19<28:31:48,  3.45it/s]
  4%|▍         | 16623/371472 [1:20:19<27:13:16,  3.62it/s]
  4%|▍         | 16624/371472 [1:20:19<27:10:51,  3.63it/s]
  4%|▍         | 16625/371472 [1:20:20<27:23:51,  3.60it/s]
  4%|▍         | 16626/371472 [1:20:20<26:55:37,  3.66it/s]
  4%|▍         | 16627/371472 [1:20:20<27:12:56,  3.62it/s]
  4%|▍         | 16628/371472 [1:20:20<28:17:28,  3.48it/s]
  4%|▍         | 16629/371472 [1:20:21<28:51:31,  3.42it/s]
  4%|▍         | 16630/371472 [1:20:21<29:23:55,  3.35it/s]
  4%|▍         | 16631/371472 [1:20:21<30:26:16,  3.24it/s]
  4%|▍         | 16632/371472 [1:20:22<29:31:18,  3.34it/s]
  4%|▍         | 16633/371472 [1:20:22<30:19:12,  3.25it/s]
  4%|▍         | 16634/371472 [1:20:22<29:46:24,  3.31it/s]
  4%|▍         | 16635/371472 [1:20:23<30:08:18,  3.27it/s]
  4%|▍         | 16636/371472 [1:20:23<29:11:28,  3.38it/s]
  4%|▍         | 16637/371472 [1:20:23<29:29:22,  3.34it/s]
  4%|▍         | 16638/371472 [1:20:23<28:32:10,  3.45it/s]
  4%|▍         | 16639/371472 [1:20:24<29:55:29,  3.29it/s]
  4%|▍         | 16640/371472 [1:20:24<28:42:38,  3.43it/s]
                                                           
{'loss': 4.4583, 'learning_rate': 9.601478161563489e-07, 'epoch': 0.72}

  4%|▍         | 16640/371472 [1:20:24<28:42:38,  3.43it/s]
  4%|▍         | 16641/371472 [1:20:24<29:28:32,  3.34it/s]
  4%|▍         | 16642/371472 [1:20:25<32:07:32,  3.07it/s]
  4%|▍         | 16643/371472 [1:20:25<32:01:21,  3.08it/s]
  4%|▍         | 16644/371472 [1:20:25<30:20:33,  3.25it/s]
  4%|▍         | 16645/371472 [1:20:26<29:50:46,  3.30it/s]
  4%|▍         | 16646/371472 [1:20:26<30:41:58,  3.21it/s]
  4%|▍         | 16647/371472 [1:20:26<30:53:39,  3.19it/s]
  4%|▍         | 16648/371472 [1:20:27<37:49:17,  2.61it/s]
  4%|▍         | 16649/371472 [1:20:27<36:04:24,  2.73it/s]
  4%|▍         | 16650/371472 [1:20:27<34:29:11,  2.86it/s]
  4%|▍         | 16651/371472 [1:20:28<33:42:15,  2.92it/s]
  4%|▍         | 16652/371472 [1:20:28<31:24:53,  3.14it/s]
  4%|▍         | 16653/371472 [1:20:28<29:28:20,  3.34it/s]
  4%|▍         | 16654/371472 [1:20:29<28:16:34,  3.49it/s]
  4%|▍         | 16655/371472 [1:20:29<28:34:18,  3.45it/s]
  4%|▍         | 16656/371472 [1:20:29<28:03:14,  3.51it/s]
  4%|▍         | 16657/371472 [1:20:29<27:18:14,  3.61it/s]
  4%|▍         | 16658/371472 [1:20:30<26:57:48,  3.66it/s]
  4%|▍         | 16659/371472 [1:20:30<27:41:07,  3.56it/s]
  4%|▍         | 16660/371472 [1:20:30<28:57:33,  3.40it/s]
                                                           
{'loss': 4.6773, 'learning_rate': 9.600993341808702e-07, 'epoch': 0.72}

  4%|▍         | 16660/371472 [1:20:30<28:57:33,  3.40it/s]
  4%|▍         | 16661/371472 [1:20:31<28:02:35,  3.51it/s]
  4%|▍         | 16662/371472 [1:20:31<28:42:13,  3.43it/s]
  4%|▍         | 16663/371472 [1:20:31<31:46:11,  3.10it/s]
  4%|▍         | 16664/371472 [1:20:32<30:49:20,  3.20it/s]
  4%|▍         | 16665/371472 [1:20:32<31:14:55,  3.15it/s]
  4%|▍         | 16666/371472 [1:20:32<31:05:38,  3.17it/s]
  4%|▍         | 16667/371472 [1:20:32<29:15:23,  3.37it/s]
  4%|▍         | 16668/371472 [1:20:33<28:54:52,  3.41it/s]
  4%|▍         | 16669/371472 [1:20:33<31:23:40,  3.14it/s]
  4%|▍         | 16670/371472 [1:20:33<31:12:35,  3.16it/s]
  4%|▍         | 16671/371472 [1:20:34<29:10:31,  3.38it/s]
  4%|▍         | 16672/371472 [1:20:34<30:27:29,  3.24it/s]
  4%|▍         | 16673/371472 [1:20:34<30:59:59,  3.18it/s]
  4%|▍         | 16674/371472 [1:20:35<29:23:29,  3.35it/s]
  4%|▍         | 16675/371472 [1:20:35<28:18:39,  3.48it/s]
  4%|▍         | 16676/371472 [1:20:35<27:27:50,  3.59it/s]
  4%|▍         | 16677/371472 [1:20:35<26:56:04,  3.66it/s]
  4%|▍         | 16678/371472 [1:20:36<27:05:13,  3.64it/s]
  4%|▍         | 16679/371472 [1:20:36<27:38:47,  3.56it/s]
  4%|▍         | 16680/371472 [1:20:36<28:14:10,  3.49it/s]
                                                           
{'loss': 4.5659, 'learning_rate': 9.60050852205391e-07, 'epoch': 0.72}

  4%|▍         | 16680/371472 [1:20:36<28:14:10,  3.49it/s]
  4%|▍         | 16681/371472 [1:20:37<28:02:53,  3.51it/s]
  4%|▍         | 16682/371472 [1:20:37<29:50:34,  3.30it/s]
  4%|▍         | 16683/371472 [1:20:37<28:18:47,  3.48it/s]
  4%|▍         | 16684/371472 [1:20:37<27:52:24,  3.54it/s]
  4%|▍         | 16685/371472 [1:20:38<28:10:51,  3.50it/s]
  4%|▍         | 16686/371472 [1:20:38<27:51:41,  3.54it/s]
  4%|▍         | 16687/371472 [1:20:38<27:17:39,  3.61it/s]
  4%|▍         | 16688/371472 [1:20:39<29:37:43,  3.33it/s]
  4%|▍         | 16689/371472 [1:20:39<28:39:07,  3.44it/s]
  4%|▍         | 16690/371472 [1:20:39<27:46:40,  3.55it/s]
  4%|▍         | 16691/371472 [1:20:39<27:23:59,  3.60it/s]
  4%|▍         | 16692/371472 [1:20:40<26:38:03,  3.70it/s]
  4%|▍         | 16693/371472 [1:20:40<26:42:27,  3.69it/s]
  4%|▍         | 16694/371472 [1:20:40<27:56:27,  3.53it/s]
  4%|▍         | 16695/371472 [1:20:41<28:42:35,  3.43it/s]
  4%|▍         | 16696/371472 [1:20:41<28:23:56,  3.47it/s]
  4%|▍         | 16697/371472 [1:20:41<28:11:27,  3.50it/s]
  4%|▍         | 16698/371472 [1:20:41<27:27:14,  3.59it/s]
  4%|▍         | 16699/371472 [1:20:42<28:37:06,  3.44it/s]
  4%|▍         | 16700/371472 [1:20:42<27:57:46,  3.52it/s]
                                                           
{'loss': 4.866, 'learning_rate': 9.600023702299123e-07, 'epoch': 0.72}

  4%|▍         | 16700/371472 [1:20:42<27:57:46,  3.52it/s]
  4%|▍         | 16701/371472 [1:20:42<29:15:59,  3.37it/s]
  4%|▍         | 16702/371472 [1:20:43<28:05:12,  3.51it/s]
  4%|▍         | 16703/371472 [1:20:43<27:24:04,  3.60it/s]
  4%|▍         | 16704/371472 [1:20:43<29:38:07,  3.33it/s]
  4%|▍         | 16705/371472 [1:20:43<29:03:37,  3.39it/s]
  4%|▍         | 16706/371472 [1:20:44<28:16:35,  3.49it/s]
  4%|▍         | 16707/371472 [1:20:44<27:49:11,  3.54it/s]
  4%|▍         | 16708/371472 [1:20:44<27:18:28,  3.61it/s]
  4%|▍         | 16709/371472 [1:20:45<27:45:52,  3.55it/s]
  4%|▍         | 16710/371472 [1:20:45<30:11:57,  3.26it/s]
  4%|▍         | 16711/371472 [1:20:45<29:29:32,  3.34it/s]
  4%|▍         | 16712/371472 [1:20:45<28:08:54,  3.50it/s]
  4%|▍         | 16713/371472 [1:20:46<27:30:51,  3.58it/s]
  4%|▍         | 16714/371472 [1:20:46<26:48:12,  3.68it/s]
  4%|▍         | 16715/371472 [1:20:46<28:16:34,  3.49it/s]
  4%|▍         | 16716/371472 [1:20:47<28:44:48,  3.43it/s]
  5%|▍         | 16717/371472 [1:20:47<29:07:40,  3.38it/s]
  5%|▍         | 16718/371472 [1:20:47<28:55:00,  3.41it/s]
  5%|▍         | 16719/371472 [1:20:47<29:35:53,  3.33it/s]
  5%|▍         | 16720/371472 [1:20:48<27:58:03,  3.52it/s]
                                                           
{'loss': 4.8379, 'learning_rate': 9.599538882544334e-07, 'epoch': 0.72}

  5%|▍         | 16720/371472 [1:20:48<27:58:03,  3.52it/s]
  5%|▍         | 16721/371472 [1:20:48<27:53:36,  3.53it/s]
  5%|▍         | 16722/371472 [1:20:48<28:18:10,  3.48it/s]
  5%|▍         | 16723/371472 [1:20:49<27:33:05,  3.58it/s]
  5%|▍         | 16724/371472 [1:20:49<27:08:03,  3.63it/s]
  5%|▍         | 16725/371472 [1:20:49<26:44:23,  3.69it/s]
  5%|▍         | 16726/371472 [1:20:49<26:04:36,  3.78it/s]
  5%|▍         | 16727/371472 [1:20:50<26:30:05,  3.72it/s]
  5%|▍         | 16728/371472 [1:20:50<30:16:17,  3.26it/s]
  5%|▍         | 16729/371472 [1:20:50<30:00:09,  3.28it/s]
  5%|▍         | 16730/371472 [1:20:51<29:46:04,  3.31it/s]
  5%|▍         | 16731/371472 [1:20:51<29:18:08,  3.36it/s]
  5%|▍         | 16732/371472 [1:20:51<30:12:23,  3.26it/s]
  5%|▍         | 16733/371472 [1:20:52<29:23:10,  3.35it/s]
  5%|▍         | 16734/371472 [1:20:52<28:10:23,  3.50it/s]
  5%|▍         | 16735/371472 [1:20:52<27:58:38,  3.52it/s]
  5%|▍         | 16736/371472 [1:20:52<28:58:07,  3.40it/s]
  5%|▍         | 16737/371472 [1:20:53<30:25:39,  3.24it/s]
  5%|▍         | 16738/371472 [1:20:53<29:58:28,  3.29it/s]
  5%|▍         | 16739/371472 [1:20:53<30:04:20,  3.28it/s]
  5%|▍         | 16740/371472 [1:20:54<29:47:16,  3.31it/s]
                                                           
{'loss': 4.5252, 'learning_rate': 9.599054062789545e-07, 'epoch': 0.72}

  5%|▍         | 16740/371472 [1:20:54<29:47:16,  3.31it/s]
  5%|▍         | 16741/371472 [1:20:54<29:41:30,  3.32it/s]
  5%|▍         | 16742/371472 [1:20:54<29:07:18,  3.38it/s]
  5%|▍         | 16743/371472 [1:20:54<28:28:14,  3.46it/s]
  5%|▍         | 16744/371472 [1:20:55<27:32:35,  3.58it/s]
  5%|▍         | 16745/371472 [1:20:55<27:57:09,  3.53it/s]
  5%|▍         | 16746/371472 [1:20:55<27:26:12,  3.59it/s]
  5%|▍         | 16747/371472 [1:20:56<29:26:35,  3.35it/s]
  5%|▍         | 16748/371472 [1:20:56<29:46:44,  3.31it/s]
  5%|▍         | 16749/371472 [1:20:56<29:33:39,  3.33it/s]
  5%|▍         | 16750/371472 [1:20:56<28:19:05,  3.48it/s]
  5%|▍         | 16751/371472 [1:20:57<27:30:18,  3.58it/s]
  5%|▍         | 16752/371472 [1:20:57<27:06:13,  3.64it/s]
  5%|▍         | 16753/371472 [1:20:57<26:49:09,  3.67it/s]
  5%|▍         | 16754/371472 [1:20:58<26:30:03,  3.72it/s]
  5%|▍         | 16755/371472 [1:20:58<25:52:36,  3.81it/s]
  5%|▍         | 16756/371472 [1:20:58<26:49:06,  3.67it/s]
  5%|▍         | 16757/371472 [1:20:58<26:35:35,  3.71it/s]
  5%|▍         | 16758/371472 [1:20:59<26:53:22,  3.66it/s]
  5%|▍         | 16759/371472 [1:20:59<26:18:46,  3.74it/s]
  5%|▍         | 16760/371472 [1:20:59<26:17:24,  3.75it/s]
                                                           
{'loss': 4.7735, 'learning_rate': 9.598569243034757e-07, 'epoch': 0.72}

  5%|▍         | 16760/371472 [1:20:59<26:17:24,  3.75it/s]
  5%|▍         | 16761/371472 [1:20:59<27:17:31,  3.61it/s]
  5%|▍         | 16762/371472 [1:21:00<26:24:49,  3.73it/s]
  5%|▍         | 16763/371472 [1:21:00<26:29:15,  3.72it/s]
  5%|▍         | 16764/371472 [1:21:00<26:28:05,  3.72it/s]
  5%|▍         | 16765/371472 [1:21:01<26:53:53,  3.66it/s]
  5%|▍         | 16766/371472 [1:21:01<26:59:11,  3.65it/s]
  5%|▍         | 16767/371472 [1:21:01<30:17:28,  3.25it/s]
  5%|▍         | 16768/371472 [1:21:01<29:39:06,  3.32it/s]
  5%|▍         | 16769/371472 [1:21:02<29:28:30,  3.34it/s]
  5%|▍         | 16770/371472 [1:21:02<28:22:44,  3.47it/s]
  5%|▍         | 16771/371472 [1:21:02<27:42:17,  3.56it/s]
  5%|▍         | 16772/371472 [1:21:03<28:43:06,  3.43it/s]
  5%|▍         | 16773/371472 [1:21:03<28:20:36,  3.48it/s]
  5%|▍         | 16774/371472 [1:21:03<27:25:41,  3.59it/s]
  5%|▍         | 16775/371472 [1:21:03<28:22:26,  3.47it/s]
  5%|▍         | 16776/371472 [1:21:04<27:58:30,  3.52it/s]
  5%|▍         | 16777/371472 [1:21:04<28:46:26,  3.42it/s]
  5%|▍         | 16778/371472 [1:21:04<29:25:17,  3.35it/s]
  5%|▍         | 16779/371472 [1:21:05<28:21:00,  3.48it/s]
  5%|▍         | 16780/371472 [1:21:05<27:43:09,  3.55it/s]
                                                           
{'loss': 4.6124, 'learning_rate': 9.598084423279966e-07, 'epoch': 0.72}

  5%|▍         | 16780/371472 [1:21:05<27:43:09,  3.55it/s]
  5%|▍         | 16781/371472 [1:21:05<27:16:38,  3.61it/s]
  5%|▍         | 16782/371472 [1:21:05<29:25:16,  3.35it/s]
  5%|▍         | 16783/371472 [1:21:06<29:33:54,  3.33it/s]
  5%|▍         | 16784/371472 [1:21:06<28:19:51,  3.48it/s]
  5%|▍         | 16785/371472 [1:21:06<29:01:03,  3.40it/s]
  5%|▍         | 16786/371472 [1:21:07<30:08:40,  3.27it/s]
  5%|▍         | 16787/371472 [1:21:07<29:08:01,  3.38it/s]
  5%|▍         | 16788/371472 [1:21:07<28:11:23,  3.50it/s]
  5%|▍         | 16789/371472 [1:21:08<30:34:57,  3.22it/s]
  5%|▍         | 16790/371472 [1:21:08<30:37:42,  3.22it/s]
  5%|▍         | 16791/371472 [1:21:08<29:37:02,  3.33it/s]
  5%|▍         | 16792/371472 [1:21:08<29:27:02,  3.35it/s]
  5%|▍         | 16793/371472 [1:21:09<28:42:44,  3.43it/s]
  5%|▍         | 16794/371472 [1:21:09<28:27:08,  3.46it/s]
  5%|▍         | 16795/371472 [1:21:09<28:18:32,  3.48it/s]
  5%|▍         | 16796/371472 [1:21:10<27:03:23,  3.64it/s]
  5%|▍         | 16797/371472 [1:21:10<26:44:48,  3.68it/s]
  5%|▍         | 16798/371472 [1:21:10<26:50:08,  3.67it/s]
  5%|▍         | 16799/371472 [1:21:10<29:44:19,  3.31it/s]
  5%|▍         | 16800/371472 [1:21:11<28:28:34,  3.46it/s]
                                                           
{'loss': 4.8224, 'learning_rate': 9.597599603525179e-07, 'epoch': 0.72}

  5%|▍         | 16800/371472 [1:21:11<28:28:34,  3.46it/s]
  5%|▍         | 16801/371472 [1:21:11<28:00:14,  3.52it/s]
  5%|▍         | 16802/371472 [1:21:11<29:05:43,  3.39it/s]
  5%|▍         | 16803/371472 [1:21:12<30:04:30,  3.28it/s]
  5%|▍         | 16804/371472 [1:21:12<28:43:39,  3.43it/s]
  5%|▍         | 16805/371472 [1:21:12<28:20:43,  3.48it/s]
  5%|▍         | 16806/371472 [1:21:12<27:19:24,  3.61it/s]
  5%|▍         | 16807/371472 [1:21:13<26:49:00,  3.67it/s]
  5%|▍         | 16808/371472 [1:21:13<30:05:49,  3.27it/s]
  5%|▍         | 16809/371472 [1:21:13<30:09:16,  3.27it/s]
  5%|▍         | 16810/371472 [1:21:14<29:12:27,  3.37it/s]
  5%|▍         | 16811/371472 [1:21:14<28:32:45,  3.45it/s]
  5%|▍         | 16812/371472 [1:21:14<28:18:12,  3.48it/s]
  5%|▍         | 16813/371472 [1:21:15<28:29:32,  3.46it/s]
  5%|▍         | 16814/371472 [1:21:15<28:04:06,  3.51it/s]
  5%|▍         | 16815/371472 [1:21:15<28:07:19,  3.50it/s]
  5%|▍         | 16816/371472 [1:21:15<27:35:25,  3.57it/s]
  5%|▍         | 16817/371472 [1:21:16<30:26:07,  3.24it/s]
  5%|▍         | 16818/371472 [1:21:16<29:08:40,  3.38it/s]
  5%|▍         | 16819/371472 [1:21:16<30:14:04,  3.26it/s]
  5%|▍         | 16820/371472 [1:21:17<28:39:00,  3.44it/s]
                                                           
{'loss': 4.4931, 'learning_rate': 9.597114783770387e-07, 'epoch': 0.72}

  5%|▍         | 16820/371472 [1:21:17<28:39:00,  3.44it/s]
  5%|▍         | 16821/371472 [1:21:17<29:19:25,  3.36it/s]
  5%|▍         | 16822/371472 [1:21:17<29:17:48,  3.36it/s]
  5%|▍         | 16823/371472 [1:21:18<30:26:59,  3.24it/s]
  5%|▍         | 16824/371472 [1:21:18<32:24:22,  3.04it/s]
  5%|▍         | 16825/371472 [1:21:18<32:05:06,  3.07it/s]
  5%|▍         | 16826/371472 [1:21:19<32:39:08,  3.02it/s]
  5%|▍         | 16827/371472 [1:21:19<31:12:00,  3.16it/s]
  5%|▍         | 16828/371472 [1:21:19<29:53:11,  3.30it/s]
  5%|▍         | 16829/371472 [1:21:19<28:30:14,  3.46it/s]
  5%|▍         | 16830/371472 [1:21:20<29:40:03,  3.32it/s]
  5%|▍         | 16831/371472 [1:21:20<28:35:13,  3.45it/s]
  5%|▍         | 16832/371472 [1:21:20<27:34:48,  3.57it/s]
  5%|▍         | 16833/371472 [1:21:20<27:20:31,  3.60it/s]
  5%|▍         | 16834/371472 [1:21:21<27:53:31,  3.53it/s]
  5%|▍         | 16835/371472 [1:21:21<27:48:12,  3.54it/s]
  5%|▍         | 16836/371472 [1:21:21<28:52:11,  3.41it/s]
  5%|▍         | 16837/371472 [1:21:22<27:52:44,  3.53it/s]
  5%|▍         | 16838/371472 [1:21:22<27:53:44,  3.53it/s]
  5%|▍         | 16839/371472 [1:21:22<27:59:12,  3.52it/s]
  5%|▍         | 16840/371472 [1:21:23<29:36:35,  3.33it/s]
                                                           
{'loss': 4.7042, 'learning_rate': 9.5966299640156e-07, 'epoch': 0.73}

  5%|▍         | 16840/371472 [1:21:23<29:36:35,  3.33it/s]
  5%|▍         | 16841/371472 [1:21:23<30:48:35,  3.20it/s]
  5%|▍         | 16842/371472 [1:21:23<30:07:20,  3.27it/s]
  5%|▍         | 16843/371472 [1:21:23<29:35:37,  3.33it/s]
  5%|▍         | 16844/371472 [1:21:24<29:10:44,  3.38it/s]
  5%|▍         | 16845/371472 [1:21:24<28:42:57,  3.43it/s]
  5%|▍         | 16846/371472 [1:21:24<29:36:31,  3.33it/s]
  5%|▍         | 16847/371472 [1:21:25<29:01:31,  3.39it/s]
  5%|▍         | 16848/371472 [1:21:25<28:24:29,  3.47it/s]
  5%|▍         | 16849/371472 [1:21:25<27:44:30,  3.55it/s]
  5%|▍         | 16850/371472 [1:21:25<28:20:55,  3.47it/s]
  5%|▍         | 16851/371472 [1:21:26<27:50:49,  3.54it/s]
  5%|▍         | 16852/371472 [1:21:26<29:04:10,  3.39it/s]
  5%|▍         | 16853/371472 [1:21:26<27:47:21,  3.54it/s]
  5%|▍         | 16854/371472 [1:21:27<28:23:59,  3.47it/s]
  5%|▍         | 16855/371472 [1:21:27<28:29:25,  3.46it/s]
  5%|▍         | 16856/371472 [1:21:27<29:57:20,  3.29it/s]
  5%|▍         | 16857/371472 [1:21:28<32:34:00,  3.02it/s]
  5%|▍         | 16858/371472 [1:21:28<30:53:26,  3.19it/s]
  5%|▍         | 16859/371472 [1:21:28<30:23:36,  3.24it/s]
  5%|▍         | 16860/371472 [1:21:29<30:12:49,  3.26it/s]
                                                           
{'loss': 4.4158, 'learning_rate': 9.59614514426081e-07, 'epoch': 0.73}

  5%|▍         | 16860/371472 [1:21:29<30:12:49,  3.26it/s]
  5%|▍         | 16861/371472 [1:21:29<28:53:26,  3.41it/s]
  5%|▍         | 16862/371472 [1:21:29<30:45:42,  3.20it/s]
  5%|▍         | 16863/371472 [1:21:29<31:34:48,  3.12it/s]
  5%|▍         | 16864/371472 [1:21:30<29:53:05,  3.30it/s]
  5%|▍         | 16865/371472 [1:21:30<29:34:41,  3.33it/s]
  5%|▍         | 16866/371472 [1:21:30<31:13:18,  3.15it/s]
  5%|▍         | 16867/371472 [1:21:31<29:27:56,  3.34it/s]
  5%|▍         | 16868/371472 [1:21:31<29:02:39,  3.39it/s]
  5%|▍         | 16869/371472 [1:21:31<28:08:23,  3.50it/s]
  5%|▍         | 16870/371472 [1:21:31<27:43:21,  3.55it/s]
  5%|▍         | 16871/371472 [1:21:32<27:03:35,  3.64it/s]
  5%|▍         | 16872/371472 [1:21:32<29:36:48,  3.33it/s]
  5%|▍         | 16873/371472 [1:21:32<29:27:18,  3.34it/s]
  5%|▍         | 16874/371472 [1:21:33<29:47:52,  3.31it/s]
  5%|▍         | 16875/371472 [1:21:33<29:55:15,  3.29it/s]
  5%|▍         | 16876/371472 [1:21:33<30:24:15,  3.24it/s]
  5%|▍         | 16877/371472 [1:21:34<30:25:17,  3.24it/s]
  5%|▍         | 16878/371472 [1:21:34<30:00:55,  3.28it/s]
  5%|▍         | 16879/371472 [1:21:34<29:54:34,  3.29it/s]
  5%|▍         | 16880/371472 [1:21:35<29:17:24,  3.36it/s]
                                                           
{'loss': 4.6365, 'learning_rate': 9.595660324506022e-07, 'epoch': 0.73}

  5%|▍         | 16880/371472 [1:21:35<29:17:24,  3.36it/s]
  5%|▍         | 16881/371472 [1:21:35<29:07:22,  3.38it/s]
  5%|▍         | 16882/371472 [1:21:35<28:38:10,  3.44it/s]
  5%|▍         | 16883/371472 [1:21:35<29:31:38,  3.34it/s]
  5%|▍         | 16884/371472 [1:21:36<30:02:36,  3.28it/s]
  5%|▍         | 16885/371472 [1:21:36<28:57:21,  3.40it/s]
  5%|▍         | 16886/371472 [1:21:36<28:22:58,  3.47it/s]
  5%|▍         | 16887/371472 [1:21:37<26:59:17,  3.65it/s]
  5%|▍         | 16888/371472 [1:21:37<28:13:59,  3.49it/s]
  5%|▍         | 16889/371472 [1:21:37<27:33:16,  3.57it/s]
  5%|▍         | 16890/371472 [1:21:37<27:42:04,  3.56it/s]
  5%|▍         | 16891/371472 [1:21:38<28:01:08,  3.52it/s]
  5%|▍         | 16892/371472 [1:21:38<27:24:42,  3.59it/s]
  5%|▍         | 16893/371472 [1:21:38<29:57:20,  3.29it/s]
  5%|▍         | 16894/371472 [1:21:39<30:34:39,  3.22it/s]
  5%|▍         | 16895/371472 [1:21:39<31:28:02,  3.13it/s]
  5%|▍         | 16896/371472 [1:21:39<30:18:10,  3.25it/s]
  5%|▍         | 16897/371472 [1:21:40<28:50:32,  3.41it/s]
  5%|▍         | 16898/371472 [1:21:40<27:35:56,  3.57it/s]
  5%|▍         | 16899/371472 [1:21:40<26:57:02,  3.65it/s]
  5%|▍         | 16900/371472 [1:21:40<26:47:33,  3.68it/s]
                                                           
{'loss': 4.6285, 'learning_rate': 9.595175504751234e-07, 'epoch': 0.73}

  5%|▍         | 16900/371472 [1:21:40<26:47:33,  3.68it/s]
  5%|▍         | 16901/371472 [1:21:41<27:35:43,  3.57it/s]
  5%|▍         | 16902/371472 [1:21:41<26:58:45,  3.65it/s]
  5%|▍         | 16903/371472 [1:21:41<26:47:32,  3.68it/s]
  5%|▍         | 16904/371472 [1:21:41<26:57:50,  3.65it/s]
  5%|▍         | 16905/371472 [1:21:42<27:08:56,  3.63it/s]
  5%|▍         | 16906/371472 [1:21:42<27:25:29,  3.59it/s]
  5%|▍         | 16907/371472 [1:21:42<28:08:52,  3.50it/s]
  5%|▍         | 16908/371472 [1:21:43<27:31:03,  3.58it/s]
  5%|▍         | 16909/371472 [1:21:43<27:16:44,  3.61it/s]
  5%|▍         | 16910/371472 [1:21:43<27:27:09,  3.59it/s]
  5%|▍         | 16911/371472 [1:21:43<28:56:18,  3.40it/s]
  5%|▍         | 16912/371472 [1:21:44<29:01:41,  3.39it/s]
  5%|▍         | 16913/371472 [1:21:44<27:47:18,  3.54it/s]
  5%|▍         | 16914/371472 [1:21:44<28:56:10,  3.40it/s]
  5%|▍         | 16915/371472 [1:21:45<28:32:35,  3.45it/s]
  5%|▍         | 16916/371472 [1:21:45<28:06:27,  3.50it/s]
  5%|▍         | 16917/371472 [1:21:45<27:22:22,  3.60it/s]
  5%|▍         | 16918/371472 [1:21:45<27:57:00,  3.52it/s]
  5%|▍         | 16919/371472 [1:21:46<27:42:43,  3.55it/s]
  5%|▍         | 16920/371472 [1:21:46<27:08:18,  3.63it/s]
                                                           
{'loss': 4.6141, 'learning_rate': 9.594690684996443e-07, 'epoch': 0.73}

  5%|▍         | 16920/371472 [1:21:46<27:08:18,  3.63it/s]
  5%|▍         | 16921/371472 [1:21:46<26:27:44,  3.72it/s]
  5%|▍         | 16922/371472 [1:21:46<26:16:07,  3.75it/s]
  5%|▍         | 16923/371472 [1:21:47<26:42:57,  3.69it/s]
  5%|▍         | 16924/371472 [1:21:47<28:45:58,  3.42it/s]
  5%|▍         | 16925/371472 [1:21:47<29:12:26,  3.37it/s]
  5%|▍         | 16926/371472 [1:21:48<29:40:37,  3.32it/s]
  5%|▍         | 16927/371472 [1:21:48<30:24:59,  3.24it/s]
  5%|▍         | 16928/371472 [1:21:48<29:56:13,  3.29it/s]
  5%|▍         | 16929/371472 [1:21:49<29:30:49,  3.34it/s]
  5%|▍         | 16930/371472 [1:21:49<29:17:00,  3.36it/s]
  5%|▍         | 16931/371472 [1:21:49<28:59:24,  3.40it/s]
  5%|▍         | 16932/371472 [1:21:49<29:17:08,  3.36it/s]
  5%|▍         | 16933/371472 [1:21:50<34:01:28,  2.89it/s]
  5%|▍         | 16934/371472 [1:21:50<32:01:40,  3.07it/s]
  5%|▍         | 16935/371472 [1:21:50<30:13:03,  3.26it/s]
  5%|▍         | 16936/371472 [1:21:51<29:11:23,  3.37it/s]
  5%|▍         | 16937/371472 [1:21:51<28:30:18,  3.45it/s]
  5%|▍         | 16938/371472 [1:21:51<28:14:10,  3.49it/s]
  5%|▍         | 16939/371472 [1:21:52<29:26:22,  3.35it/s]
  5%|▍         | 16940/371472 [1:21:52<29:33:58,  3.33it/s]
                                                           
{'loss': 4.6042, 'learning_rate': 9.594205865241656e-07, 'epoch': 0.73}

  5%|▍         | 16940/371472 [1:21:52<29:33:58,  3.33it/s]
  5%|▍         | 16941/371472 [1:21:52<31:44:26,  3.10it/s]
  5%|▍         | 16942/371472 [1:21:53<34:18:38,  2.87it/s]
  5%|▍         | 16943/371472 [1:21:53<32:00:45,  3.08it/s]
  5%|▍         | 16944/371472 [1:21:53<31:08:00,  3.16it/s]
  5%|▍         | 16945/371472 [1:21:54<29:32:31,  3.33it/s]
  5%|▍         | 16946/371472 [1:21:54<28:44:58,  3.43it/s]
  5%|▍         | 16947/371472 [1:21:54<29:01:02,  3.39it/s]
  5%|▍         | 16948/371472 [1:21:54<28:02:01,  3.51it/s]
  5%|▍         | 16949/371472 [1:21:55<27:23:51,  3.59it/s]
  5%|▍         | 16950/371472 [1:21:55<29:18:18,  3.36it/s]
  5%|▍         | 16951/371472 [1:21:55<28:45:11,  3.42it/s]
  5%|▍         | 16952/371472 [1:21:56<27:38:00,  3.56it/s]
  5%|▍         | 16953/371472 [1:21:56<27:30:59,  3.58it/s]
  5%|▍         | 16954/371472 [1:21:56<27:58:56,  3.52it/s]
  5%|▍         | 16955/371472 [1:21:56<27:28:36,  3.58it/s]
  5%|▍         | 16956/371472 [1:21:57<27:58:05,  3.52it/s]
  5%|▍         | 16957/371472 [1:21:57<33:13:08,  2.96it/s]
  5%|▍         | 16958/371472 [1:21:57<34:12:03,  2.88it/s]
  5%|▍         | 16959/371472 [1:21:58<33:42:28,  2.92it/s]
  5%|▍         | 16960/371472 [1:21:58<33:16:00,  2.96it/s]
                                                           
{'loss': 4.4642, 'learning_rate': 9.593721045486865e-07, 'epoch': 0.73}

  5%|▍         | 16960/371472 [1:21:58<33:16:00,  2.96it/s]
  5%|▍         | 16961/371472 [1:21:58<32:06:50,  3.07it/s]
  5%|▍         | 16962/371472 [1:21:59<30:54:50,  3.19it/s]
  5%|▍         | 16963/371472 [1:21:59<29:48:53,  3.30it/s]
  5%|▍         | 16964/371472 [1:21:59<29:58:11,  3.29it/s]
  5%|▍         | 16965/371472 [1:22:00<28:39:45,  3.44it/s]
  5%|▍         | 16966/371472 [1:22:00<28:52:52,  3.41it/s]
  5%|▍         | 16967/371472 [1:22:00<27:56:32,  3.52it/s]
  5%|▍         | 16968/371472 [1:22:00<29:55:39,  3.29it/s]
  5%|▍         | 16969/371472 [1:22:01<29:39:41,  3.32it/s]
  5%|▍         | 16970/371472 [1:22:01<28:44:57,  3.43it/s]
  5%|▍         | 16971/371472 [1:22:01<28:08:40,  3.50it/s]
  5%|▍         | 16972/371472 [1:22:02<28:53:02,  3.41it/s]
  5%|▍         | 16973/371472 [1:22:02<29:25:41,  3.35it/s]
  5%|▍         | 16974/371472 [1:22:02<28:15:51,  3.48it/s]
  5%|▍         | 16975/371472 [1:22:03<28:49:19,  3.42it/s]
  5%|▍         | 16976/371472 [1:22:03<29:49:28,  3.30it/s]
  5%|▍         | 16977/371472 [1:22:03<29:54:22,  3.29it/s]
  5%|▍         | 16978/371472 [1:22:03<30:45:24,  3.20it/s]
  5%|▍         | 16979/371472 [1:22:04<30:36:28,  3.22it/s]
  5%|▍         | 16980/371472 [1:22:04<29:56:48,  3.29it/s]
                                                           
{'loss': 4.7874, 'learning_rate': 9.593236225732077e-07, 'epoch': 0.73}

  5%|▍         | 16980/371472 [1:22:04<29:56:48,  3.29it/s]
  5%|▍         | 16981/371472 [1:22:04<28:38:57,  3.44it/s]
  5%|▍         | 16982/371472 [1:22:05<27:52:37,  3.53it/s]
  5%|▍         | 16983/371472 [1:22:05<27:21:42,  3.60it/s]
  5%|▍         | 16984/371472 [1:22:05<28:02:34,  3.51it/s]
  5%|▍         | 16985/371472 [1:22:05<27:43:54,  3.55it/s]
  5%|▍         | 16986/371472 [1:22:06<27:43:21,  3.55it/s]
  5%|▍         | 16987/371472 [1:22:06<29:31:53,  3.33it/s]
  5%|▍         | 16988/371472 [1:22:06<29:29:34,  3.34it/s]
  5%|▍         | 16989/371472 [1:22:07<28:15:20,  3.48it/s]
  5%|▍         | 16990/371472 [1:22:07<27:58:15,  3.52it/s]
  5%|▍         | 16991/371472 [1:22:07<27:51:37,  3.53it/s]
  5%|▍         | 16992/371472 [1:22:07<27:45:51,  3.55it/s]
  5%|▍         | 16993/371472 [1:22:08<27:40:49,  3.56it/s]
  5%|▍         | 16994/371472 [1:22:08<27:48:54,  3.54it/s]
  5%|▍         | 16995/371472 [1:22:08<27:33:53,  3.57it/s]
  5%|▍         | 16996/371472 [1:22:09<28:40:25,  3.43it/s]
  5%|▍         | 16997/371472 [1:22:09<28:10:16,  3.50it/s]
  5%|▍         | 16998/371472 [1:22:09<28:20:26,  3.47it/s]
  5%|▍         | 16999/371472 [1:22:09<27:39:34,  3.56it/s]
  5%|▍         | 17000/371472 [1:22:10<27:09:11,  3.63it/s]
                                                           
{'loss': 4.7062, 'learning_rate': 9.592751405977288e-07, 'epoch': 0.73}

  5%|▍         | 17000/371472 [1:22:10<27:09:11,  3.63it/s]
  5%|▍         | 17001/371472 [1:22:10<27:58:46,  3.52it/s]
  5%|▍         | 17002/371472 [1:22:10<27:17:11,  3.61it/s]
  5%|▍         | 17003/371472 [1:22:11<28:00:34,  3.52it/s]
  5%|▍         | 17004/371472 [1:22:11<30:02:49,  3.28it/s]
  5%|▍         | 17005/371472 [1:22:11<28:30:48,  3.45it/s]
  5%|▍         | 17006/371472 [1:22:12<29:42:32,  3.31it/s]
  5%|▍         | 17007/371472 [1:22:12<29:48:48,  3.30it/s]
  5%|▍         | 17008/371472 [1:22:12<28:51:58,  3.41it/s]
  5%|▍         | 17009/371472 [1:22:12<27:49:20,  3.54it/s]
  5%|▍         | 17010/371472 [1:22:13<29:14:03,  3.37it/s]
  5%|▍         | 17011/371472 [1:22:13<27:56:32,  3.52it/s]
  5%|▍         | 17012/371472 [1:22:13<27:29:28,  3.58it/s]
  5%|▍         | 17013/371472 [1:22:14<29:05:35,  3.38it/s]
  5%|▍         | 17014/371472 [1:22:14<30:02:00,  3.28it/s]
  5%|▍         | 17015/371472 [1:22:14<33:21:16,  2.95it/s]
  5%|▍         | 17016/371472 [1:22:15<31:33:48,  3.12it/s]
  5%|▍         | 17017/371472 [1:22:15<29:21:01,  3.35it/s]
  5%|▍         | 17018/371472 [1:22:15<28:30:50,  3.45it/s]
  5%|▍         | 17019/371472 [1:22:15<28:06:49,  3.50it/s]
  5%|▍         | 17020/371472 [1:22:16<28:58:44,  3.40it/s]
                                                           
{'loss': 4.7244, 'learning_rate': 9.592266586222499e-07, 'epoch': 0.73}

  5%|▍         | 17020/371472 [1:22:16<28:58:44,  3.40it/s]
  5%|▍         | 17021/371472 [1:22:16<30:07:35,  3.27it/s]
  5%|▍         | 17022/371472 [1:22:16<30:10:51,  3.26it/s]
  5%|▍         | 17023/371472 [1:22:17<30:51:30,  3.19it/s]
  5%|▍         | 17024/371472 [1:22:17<29:12:36,  3.37it/s]
  5%|▍         | 17025/371472 [1:22:17<29:55:55,  3.29it/s]
  5%|▍         | 17026/371472 [1:22:17<28:44:24,  3.43it/s]
  5%|▍         | 17027/371472 [1:22:18<29:02:07,  3.39it/s]
  5%|▍         | 17028/371472 [1:22:18<28:04:43,  3.51it/s]
  5%|▍         | 17029/371472 [1:22:18<27:21:43,  3.60it/s]
  5%|▍         | 17030/371472 [1:22:19<26:46:27,  3.68it/s]
  5%|▍         | 17031/371472 [1:22:19<27:31:42,  3.58it/s]
  5%|▍         | 17032/371472 [1:22:19<29:07:49,  3.38it/s]
  5%|▍         | 17033/371472 [1:22:19<28:15:28,  3.48it/s]
  5%|▍         | 17034/371472 [1:22:20<28:17:13,  3.48it/s]
  5%|▍         | 17035/371472 [1:22:20<27:44:09,  3.55it/s]
  5%|▍         | 17036/371472 [1:22:20<26:59:38,  3.65it/s]
  5%|▍         | 17037/371472 [1:22:21<27:04:27,  3.64it/s]
  5%|▍         | 17038/371472 [1:22:21<27:45:38,  3.55it/s]
  5%|▍         | 17039/371472 [1:22:21<27:06:02,  3.63it/s]
  5%|▍         | 17040/371472 [1:22:21<27:23:40,  3.59it/s]
                                                           
{'loss': 4.6183, 'learning_rate': 9.591781766467712e-07, 'epoch': 0.73}

  5%|▍         | 17040/371472 [1:22:21<27:23:40,  3.59it/s]
  5%|▍         | 17041/371472 [1:22:22<26:45:20,  3.68it/s]
  5%|▍         | 17042/371472 [1:22:22<26:58:54,  3.65it/s]
  5%|▍         | 17043/371472 [1:22:22<28:02:03,  3.51it/s]
  5%|▍         | 17044/371472 [1:22:23<27:56:42,  3.52it/s]
  5%|▍         | 17045/371472 [1:22:23<27:37:06,  3.56it/s]
  5%|▍         | 17046/371472 [1:22:23<28:52:50,  3.41it/s]
  5%|▍         | 17047/371472 [1:22:23<29:25:32,  3.35it/s]
  5%|▍         | 17048/371472 [1:22:24<29:45:25,  3.31it/s]
  5%|▍         | 17049/371472 [1:22:24<29:08:05,  3.38it/s]
  5%|▍         | 17050/371472 [1:22:24<29:54:33,  3.29it/s]
  5%|▍         | 17051/371472 [1:22:25<29:46:11,  3.31it/s]
  5%|▍         | 17052/371472 [1:22:25<28:16:29,  3.48it/s]
  5%|▍         | 17053/371472 [1:22:25<28:11:38,  3.49it/s]
  5%|▍         | 17054/371472 [1:22:25<27:40:29,  3.56it/s]
  5%|▍         | 17055/371472 [1:22:26<29:48:27,  3.30it/s]
  5%|▍         | 17056/371472 [1:22:26<28:39:57,  3.43it/s]
  5%|▍         | 17057/371472 [1:22:26<27:56:18,  3.52it/s]
  5%|▍         | 17058/371472 [1:22:27<28:25:07,  3.46it/s]
  5%|▍         | 17059/371472 [1:22:27<31:29:06,  3.13it/s]
  5%|▍         | 17060/371472 [1:22:27<29:59:22,  3.28it/s]
                                                           
{'loss': 4.592, 'learning_rate': 9.59129694671292e-07, 'epoch': 0.73}

  5%|▍         | 17060/371472 [1:22:27<29:59:22,  3.28it/s]
  5%|▍         | 17061/371472 [1:22:28<28:56:57,  3.40it/s]
  5%|▍         | 17062/371472 [1:22:28<29:36:04,  3.33it/s]
  5%|▍         | 17063/371472 [1:22:28<31:23:17,  3.14it/s]
  5%|▍         | 17064/371472 [1:22:28<30:03:19,  3.28it/s]
  5%|▍         | 17065/371472 [1:22:29<29:43:07,  3.31it/s]
  5%|▍         | 17066/371472 [1:22:29<28:59:30,  3.40it/s]
  5%|▍         | 17067/371472 [1:22:29<27:40:08,  3.56it/s]
  5%|▍         | 17068/371472 [1:22:30<34:42:20,  2.84it/s]
  5%|▍         | 17069/371472 [1:22:30<32:39:04,  3.02it/s]
  5%|▍         | 17070/371472 [1:22:30<30:42:40,  3.21it/s]
  5%|▍         | 17071/371472 [1:22:31<29:23:27,  3.35it/s]
  5%|▍         | 17072/371472 [1:22:31<27:57:01,  3.52it/s]
  5%|▍         | 17073/371472 [1:22:31<26:53:44,  3.66it/s]
  5%|▍         | 17074/371472 [1:22:32<29:39:42,  3.32it/s]
  5%|▍         | 17075/371472 [1:22:32<28:17:57,  3.48it/s]
  5%|▍         | 17076/371472 [1:22:32<27:55:04,  3.53it/s]
  5%|▍         | 17077/371472 [1:22:32<28:06:30,  3.50it/s]
  5%|▍         | 17078/371472 [1:22:33<27:20:47,  3.60it/s]
  5%|▍         | 17079/371472 [1:22:33<27:38:46,  3.56it/s]
  5%|▍         | 17080/371472 [1:22:33<28:06:26,  3.50it/s]
                                                           
{'loss': 4.8319, 'learning_rate': 9.590812126958133e-07, 'epoch': 0.74}

  5%|▍         | 17080/371472 [1:22:33<28:06:26,  3.50it/s]
  5%|▍         | 17081/371472 [1:22:33<28:06:06,  3.50it/s]
  5%|▍         | 17082/371472 [1:22:34<28:39:07,  3.44it/s]
  5%|▍         | 17083/371472 [1:22:34<27:39:29,  3.56it/s]
  5%|▍         | 17084/371472 [1:22:34<26:49:23,  3.67it/s]
  5%|▍         | 17085/371472 [1:22:35<28:09:16,  3.50it/s]
  5%|▍         | 17086/371472 [1:22:35<28:02:44,  3.51it/s]
  5%|▍         | 17087/371472 [1:22:35<27:18:20,  3.61it/s]
  5%|▍         | 17088/371472 [1:22:35<26:58:33,  3.65it/s]
  5%|▍         | 17089/371472 [1:22:36<28:36:26,  3.44it/s]
  5%|▍         | 17090/371472 [1:22:36<28:13:18,  3.49it/s]
  5%|▍         | 17091/371472 [1:22:36<28:52:56,  3.41it/s]
  5%|▍         | 17092/371472 [1:22:37<29:15:56,  3.36it/s]
  5%|▍         | 17093/371472 [1:22:37<28:21:54,  3.47it/s]
  5%|▍         | 17094/371472 [1:22:37<28:27:49,  3.46it/s]
  5%|▍         | 17095/371472 [1:22:38<29:25:36,  3.35it/s]
  5%|▍         | 17096/371472 [1:22:38<28:18:33,  3.48it/s]
  5%|▍         | 17097/371472 [1:22:38<28:21:59,  3.47it/s]
  5%|▍         | 17098/371472 [1:22:38<29:07:56,  3.38it/s]
  5%|▍         | 17099/371472 [1:22:39<29:32:15,  3.33it/s]
  5%|▍         | 17100/371472 [1:22:39<29:15:06,  3.37it/s]
                                                           
{'loss': 4.8552, 'learning_rate': 9.590327307203344e-07, 'epoch': 0.74}

  5%|▍         | 17100/371472 [1:22:39<29:15:06,  3.37it/s]
  5%|▍         | 17101/371472 [1:22:39<29:08:17,  3.38it/s]
  5%|▍         | 17102/371472 [1:22:40<30:12:37,  3.26it/s]
  5%|▍         | 17103/371472 [1:22:40<28:48:28,  3.42it/s]
  5%|▍         | 17104/371472 [1:22:40<28:08:24,  3.50it/s]
  5%|▍         | 17105/371472 [1:22:40<28:43:15,  3.43it/s]
  5%|▍         | 17106/371472 [1:22:41<28:51:51,  3.41it/s]
  5%|▍         | 17107/371472 [1:22:41<27:55:28,  3.53it/s]
  5%|▍         | 17108/371472 [1:22:41<27:58:01,  3.52it/s]
  5%|▍         | 17109/371472 [1:22:42<27:35:31,  3.57it/s]
  5%|▍         | 17110/371472 [1:22:42<28:13:41,  3.49it/s]
  5%|▍         | 17111/371472 [1:22:42<27:51:09,  3.53it/s]
  5%|▍         | 17112/371472 [1:22:42<28:01:36,  3.51it/s]
  5%|▍         | 17113/371472 [1:22:43<28:39:53,  3.43it/s]
  5%|▍         | 17114/371472 [1:22:43<27:58:31,  3.52it/s]
  5%|▍         | 17115/371472 [1:22:43<27:32:04,  3.57it/s]
  5%|▍         | 17116/371472 [1:22:44<27:45:21,  3.55it/s]
  5%|▍         | 17117/371472 [1:22:44<27:58:27,  3.52it/s]
  5%|▍         | 17118/371472 [1:22:44<27:48:33,  3.54it/s]
  5%|▍         | 17119/371472 [1:22:44<26:42:10,  3.69it/s]
  5%|▍         | 17120/371472 [1:22:45<26:43:14,  3.68it/s]
                                                           
{'loss': 4.9682, 'learning_rate': 9.589842487448554e-07, 'epoch': 0.74}

  5%|▍         | 17120/371472 [1:22:45<26:43:14,  3.68it/s]
  5%|▍         | 17121/371472 [1:22:45<26:40:44,  3.69it/s]
  5%|▍         | 17122/371472 [1:22:45<26:32:06,  3.71it/s]
  5%|▍         | 17123/371472 [1:22:46<29:10:41,  3.37it/s]
  5%|▍         | 17124/371472 [1:22:46<29:20:35,  3.35it/s]
  5%|▍         | 17125/371472 [1:22:46<29:16:22,  3.36it/s]
  5%|▍         | 17126/371472 [1:22:46<29:15:09,  3.36it/s]
  5%|▍         | 17127/371472 [1:22:47<31:29:19,  3.13it/s]
  5%|▍         | 17128/371472 [1:22:47<31:03:22,  3.17it/s]
  5%|▍         | 17129/371472 [1:22:47<29:57:40,  3.29it/s]
  5%|▍         | 17130/371472 [1:22:48<29:57:44,  3.29it/s]
  5%|▍         | 17131/371472 [1:22:48<30:02:07,  3.28it/s]
  5%|▍         | 17132/371472 [1:22:48<30:11:23,  3.26it/s]
  5%|▍         | 17133/371472 [1:22:49<29:11:16,  3.37it/s]
  5%|▍         | 17134/371472 [1:22:49<31:24:17,  3.13it/s]
  5%|▍         | 17135/371472 [1:22:49<29:29:37,  3.34it/s]
  5%|▍         | 17136/371472 [1:22:50<29:54:31,  3.29it/s]
  5%|▍         | 17137/371472 [1:22:50<28:45:11,  3.42it/s]
  5%|▍         | 17138/371472 [1:22:50<27:25:05,  3.59it/s]
  5%|▍         | 17139/371472 [1:22:50<29:28:01,  3.34it/s]
  5%|▍         | 17140/371472 [1:22:51<28:54:39,  3.40it/s]
                                                           
{'loss': 4.8142, 'learning_rate': 9.589357667693767e-07, 'epoch': 0.74}

  5%|▍         | 17140/371472 [1:22:51<28:54:39,  3.40it/s]
  5%|▍         | 17141/371472 [1:22:51<28:22:15,  3.47it/s]
  5%|▍         | 17142/371472 [1:22:51<28:55:04,  3.40it/s]
  5%|▍         | 17143/371472 [1:22:52<29:41:55,  3.31it/s]
  5%|▍         | 17144/371472 [1:22:52<29:27:08,  3.34it/s]
  5%|▍         | 17145/371472 [1:22:52<30:09:36,  3.26it/s]
  5%|▍         | 17146/371472 [1:22:52<29:39:03,  3.32it/s]
  5%|▍         | 17147/371472 [1:22:53<29:02:16,  3.39it/s]
  5%|▍         | 17148/371472 [1:22:53<30:33:36,  3.22it/s]
  5%|▍         | 17149/371472 [1:22:53<29:09:43,  3.38it/s]
  5%|▍         | 17150/371472 [1:22:54<29:28:12,  3.34it/s]
  5%|▍         | 17151/371472 [1:22:54<29:29:25,  3.34it/s]
  5%|▍         | 17152/371472 [1:22:54<27:45:17,  3.55it/s]
  5%|▍         | 17153/371472 [1:22:54<26:58:54,  3.65it/s]
  5%|▍         | 17154/371472 [1:22:55<27:16:03,  3.61it/s]
  5%|▍         | 17155/371472 [1:22:55<27:07:35,  3.63it/s]
  5%|▍         | 17156/371472 [1:22:55<27:15:02,  3.61it/s]
  5%|▍         | 17157/371472 [1:22:56<27:05:18,  3.63it/s]
  5%|▍         | 17158/371472 [1:22:56<28:42:47,  3.43it/s]
  5%|▍         | 17159/371472 [1:22:56<28:13:11,  3.49it/s]
  5%|▍         | 17160/371472 [1:22:56<28:07:13,  3.50it/s]
                                                           
{'loss': 4.4919, 'learning_rate': 9.588872847938976e-07, 'epoch': 0.74}

  5%|▍         | 17160/371472 [1:22:56<28:07:13,  3.50it/s]
  5%|▍         | 17161/371472 [1:22:57<27:28:27,  3.58it/s]
  5%|▍         | 17162/371472 [1:22:57<29:22:47,  3.35it/s]
  5%|▍         | 17163/371472 [1:22:57<28:48:16,  3.42it/s]
  5%|▍         | 17164/371472 [1:22:58<27:59:16,  3.52it/s]
  5%|▍         | 17165/371472 [1:22:58<28:22:01,  3.47it/s]
  5%|▍         | 17166/371472 [1:22:58<28:53:46,  3.41it/s]
  5%|▍         | 17167/371472 [1:22:58<28:23:22,  3.47it/s]
  5%|▍         | 17168/371472 [1:22:59<28:55:47,  3.40it/s]
  5%|▍         | 17169/371472 [1:22:59<31:18:17,  3.14it/s]
  5%|▍         | 17170/371472 [1:22:59<30:23:48,  3.24it/s]
  5%|▍         | 17171/371472 [1:23:00<29:26:01,  3.34it/s]
  5%|▍         | 17172/371472 [1:23:00<28:42:48,  3.43it/s]
  5%|▍         | 17173/371472 [1:23:00<28:42:15,  3.43it/s]
  5%|▍         | 17174/371472 [1:23:01<31:44:29,  3.10it/s]
  5%|▍         | 17175/371472 [1:23:01<30:23:09,  3.24it/s]
  5%|▍         | 17176/371472 [1:23:01<28:52:35,  3.41it/s]
  5%|▍         | 17177/371472 [1:23:01<28:10:17,  3.49it/s]
  5%|▍         | 17178/371472 [1:23:02<27:19:03,  3.60it/s]
  5%|▍         | 17179/371472 [1:23:02<28:00:47,  3.51it/s]
  5%|▍         | 17180/371472 [1:23:02<27:27:06,  3.59it/s]
                                                           
{'loss': 4.7011, 'learning_rate': 9.588388028184189e-07, 'epoch': 0.74}

  5%|▍         | 17180/371472 [1:23:02<27:27:06,  3.59it/s]
  5%|▍         | 17181/371472 [1:23:03<30:32:30,  3.22it/s]
  5%|▍         | 17182/371472 [1:23:03<29:30:03,  3.34it/s]
  5%|▍         | 17183/371472 [1:23:03<27:56:46,  3.52it/s]
  5%|▍         | 17184/371472 [1:23:03<27:33:51,  3.57it/s]
  5%|▍         | 17185/371472 [1:23:04<26:55:43,  3.65it/s]
  5%|▍         | 17186/371472 [1:23:04<26:42:10,  3.69it/s]
  5%|▍         | 17187/371472 [1:23:04<27:13:55,  3.61it/s]
  5%|▍         | 17188/371472 [1:23:05<27:03:35,  3.64it/s]
  5%|▍         | 17189/371472 [1:23:05<29:12:56,  3.37it/s]
  5%|▍         | 17190/371472 [1:23:05<29:53:58,  3.29it/s]
  5%|▍         | 17191/371472 [1:23:06<28:32:49,  3.45it/s]
  5%|▍         | 17192/371472 [1:23:06<27:58:39,  3.52it/s]
  5%|▍         | 17193/371472 [1:23:06<27:24:06,  3.59it/s]
  5%|▍         | 17194/371472 [1:23:06<29:10:14,  3.37it/s]
  5%|▍         | 17195/371472 [1:23:07<28:16:17,  3.48it/s]
  5%|▍         | 17196/371472 [1:23:07<30:41:10,  3.21it/s]
  5%|▍         | 17197/371472 [1:23:07<29:19:12,  3.36it/s]
  5%|▍         | 17198/371472 [1:23:08<28:19:02,  3.48it/s]
  5%|▍         | 17199/371472 [1:23:08<29:26:08,  3.34it/s]
  5%|▍         | 17200/371472 [1:23:08<30:43:47,  3.20it/s]
                                                           
{'loss': 4.7958, 'learning_rate': 9.587903208429397e-07, 'epoch': 0.74}

  5%|▍         | 17200/371472 [1:23:08<30:43:47,  3.20it/s]
  5%|▍         | 17201/371472 [1:23:08<30:05:04,  3.27it/s]
  5%|▍         | 17202/371472 [1:23:09<28:54:29,  3.40it/s]
  5%|▍         | 17203/371472 [1:23:09<28:26:55,  3.46it/s]
  5%|▍         | 17204/371472 [1:23:09<27:49:29,  3.54it/s]
  5%|▍         | 17205/371472 [1:23:10<27:18:23,  3.60it/s]
  5%|▍         | 17206/371472 [1:23:10<33:50:51,  2.91it/s]
  5%|▍         | 17207/371472 [1:23:10<34:24:47,  2.86it/s]
  5%|▍         | 17208/371472 [1:23:11<32:00:29,  3.07it/s]
  5%|▍         | 17209/371472 [1:23:11<30:53:49,  3.18it/s]
  5%|▍         | 17210/371472 [1:23:11<30:40:56,  3.21it/s]
  5%|▍         | 17211/371472 [1:23:12<31:25:47,  3.13it/s]
  5%|▍         | 17212/371472 [1:23:12<30:39:50,  3.21it/s]
  5%|▍         | 17213/371472 [1:23:12<29:51:06,  3.30it/s]
  5%|▍         | 17214/371472 [1:23:12<28:56:47,  3.40it/s]
  5%|▍         | 17215/371472 [1:23:13<28:38:43,  3.44it/s]
  5%|▍         | 17216/371472 [1:23:13<27:47:14,  3.54it/s]
  5%|▍         | 17217/371472 [1:23:13<30:16:18,  3.25it/s]
  5%|▍         | 17218/371472 [1:23:14<28:50:38,  3.41it/s]
  5%|▍         | 17219/371472 [1:23:14<27:56:33,  3.52it/s]
  5%|▍         | 17220/371472 [1:23:14<27:46:51,  3.54it/s]
                                                           
{'loss': 4.6178, 'learning_rate': 9.58741838867461e-07, 'epoch': 0.74}

  5%|▍         | 17220/371472 [1:23:14<27:46:51,  3.54it/s]
  5%|▍         | 17221/371472 [1:23:14<27:39:48,  3.56it/s]
  5%|▍         | 17222/371472 [1:23:15<27:38:31,  3.56it/s]
  5%|▍         | 17223/371472 [1:23:15<27:48:01,  3.54it/s]
  5%|▍         | 17224/371472 [1:23:15<27:38:11,  3.56it/s]
  5%|▍         | 17225/371472 [1:23:16<26:42:36,  3.68it/s]
  5%|▍         | 17226/371472 [1:23:16<29:30:50,  3.33it/s]
  5%|▍         | 17227/371472 [1:23:16<28:03:03,  3.51it/s]
  5%|▍         | 17228/371472 [1:23:16<27:41:26,  3.55it/s]
  5%|▍         | 17229/371472 [1:23:17<27:09:28,  3.62it/s]
  5%|▍         | 17230/371472 [1:23:17<27:06:37,  3.63it/s]
  5%|▍         | 17231/371472 [1:23:17<26:23:03,  3.73it/s]
  5%|▍         | 17232/371472 [1:23:18<27:24:43,  3.59it/s]
  5%|▍         | 17233/371472 [1:23:18<28:03:15,  3.51it/s]
  5%|▍         | 17234/371472 [1:23:18<27:45:30,  3.54it/s]
  5%|▍         | 17235/371472 [1:23:18<26:41:28,  3.69it/s]
  5%|▍         | 17236/371472 [1:23:19<26:27:17,  3.72it/s]
  5%|▍         | 17237/371472 [1:23:19<26:22:33,  3.73it/s]
  5%|▍         | 17238/371472 [1:23:19<30:13:05,  3.26it/s]
  5%|▍         | 17239/371472 [1:23:20<29:11:22,  3.37it/s]
  5%|▍         | 17240/371472 [1:23:20<28:19:07,  3.47it/s]
                                                           
{'loss': 4.6442, 'learning_rate': 9.58693356891982e-07, 'epoch': 0.74}

  5%|▍         | 17240/371472 [1:23:20<28:19:07,  3.47it/s]
  5%|▍         | 17241/371472 [1:23:20<27:12:24,  3.62it/s]
  5%|▍         | 17242/371472 [1:23:20<28:17:38,  3.48it/s]
  5%|▍         | 17243/371472 [1:23:21<28:13:01,  3.49it/s]
  5%|▍         | 17244/371472 [1:23:21<28:00:25,  3.51it/s]
  5%|▍         | 17245/371472 [1:23:21<27:56:46,  3.52it/s]
  5%|▍         | 17246/371472 [1:23:22<29:17:15,  3.36it/s]
  5%|▍         | 17247/371472 [1:23:22<31:07:17,  3.16it/s]
  5%|▍         | 17248/371472 [1:23:22<29:08:07,  3.38it/s]
  5%|▍         | 17249/371472 [1:23:22<27:36:30,  3.56it/s]
  5%|▍         | 17250/371472 [1:23:23<27:45:02,  3.55it/s]
  5%|▍         | 17251/371472 [1:23:23<27:02:04,  3.64it/s]
  5%|▍         | 17252/371472 [1:23:23<27:30:14,  3.58it/s]
  5%|▍         | 17253/371472 [1:23:24<28:11:48,  3.49it/s]
  5%|▍         | 17254/371472 [1:23:24<30:01:39,  3.28it/s]
  5%|▍         | 17255/371472 [1:23:24<29:20:45,  3.35it/s]
  5%|▍         | 17256/371472 [1:23:25<29:30:01,  3.34it/s]
  5%|▍         | 17257/371472 [1:23:25<28:00:40,  3.51it/s]
  5%|▍         | 17258/371472 [1:23:25<27:22:24,  3.59it/s]
  5%|▍         | 17259/371472 [1:23:25<27:30:16,  3.58it/s]
  5%|▍         | 17260/371472 [1:23:26<27:44:04,  3.55it/s]
                                                           
{'loss': 4.7595, 'learning_rate': 9.586448749165032e-07, 'epoch': 0.74}

  5%|▍         | 17260/371472 [1:23:26<27:44:04,  3.55it/s]
  5%|▍         | 17261/371472 [1:23:26<28:36:18,  3.44it/s]
  5%|▍         | 17262/371472 [1:23:26<28:17:58,  3.48it/s]
  5%|▍         | 17263/371472 [1:23:26<27:33:26,  3.57it/s]
  5%|▍         | 17264/371472 [1:23:27<27:21:01,  3.60it/s]
  5%|▍         | 17265/371472 [1:23:27<26:59:55,  3.64it/s]
  5%|▍         | 17266/371472 [1:23:27<26:23:07,  3.73it/s]
  5%|▍         | 17267/371472 [1:23:27<26:01:22,  3.78it/s]
  5%|▍         | 17268/371472 [1:23:28<25:59:34,  3.79it/s]
  5%|▍         | 17269/371472 [1:23:28<26:07:21,  3.77it/s]
  5%|▍         | 17270/371472 [1:23:28<26:19:41,  3.74it/s]
  5%|▍         | 17271/371472 [1:23:29<26:59:17,  3.65it/s]
  5%|▍         | 17272/371472 [1:23:29<26:07:36,  3.77it/s]
  5%|▍         | 17273/371472 [1:23:29<26:50:38,  3.67it/s]
  5%|▍         | 17274/371472 [1:23:29<27:06:55,  3.63it/s]
  5%|▍         | 17275/371472 [1:23:30<26:29:55,  3.71it/s]
  5%|▍         | 17276/371472 [1:23:30<26:58:01,  3.65it/s]
  5%|▍         | 17277/371472 [1:23:30<28:35:48,  3.44it/s]
  5%|▍         | 17278/371472 [1:23:31<27:45:39,  3.54it/s]
  5%|▍         | 17279/371472 [1:23:31<28:06:49,  3.50it/s]
  5%|▍         | 17280/371472 [1:23:31<29:01:27,  3.39it/s]
                                                           
{'loss': 4.7747, 'learning_rate': 9.585963929410244e-07, 'epoch': 0.74}

  5%|▍         | 17280/371472 [1:23:31<29:01:27,  3.39it/s]
  5%|▍         | 17281/371472 [1:23:31<29:21:55,  3.35it/s]
  5%|▍         | 17282/371472 [1:23:32<28:59:00,  3.39it/s]
  5%|▍         | 17283/371472 [1:23:32<30:22:40,  3.24it/s]
  5%|▍         | 17284/371472 [1:23:32<31:35:38,  3.11it/s]
  5%|▍         | 17285/371472 [1:23:33<30:44:47,  3.20it/s]
  5%|▍         | 17286/371472 [1:23:33<30:26:28,  3.23it/s]
  5%|▍         | 17287/371472 [1:23:33<29:30:51,  3.33it/s]
  5%|▍         | 17288/371472 [1:23:34<28:38:36,  3.43it/s]
  5%|▍         | 17289/371472 [1:23:34<27:53:43,  3.53it/s]
  5%|▍         | 17290/371472 [1:23:34<28:27:25,  3.46it/s]
  5%|▍         | 17291/371472 [1:23:34<28:44:41,  3.42it/s]
  5%|▍         | 17292/371472 [1:23:35<28:34:17,  3.44it/s]
  5%|▍         | 17293/371472 [1:23:35<27:16:22,  3.61it/s]
  5%|▍         | 17294/371472 [1:23:35<28:25:50,  3.46it/s]
  5%|▍         | 17295/371472 [1:23:36<28:10:00,  3.49it/s]
  5%|▍         | 17296/371472 [1:23:36<27:22:23,  3.59it/s]
  5%|▍         | 17297/371472 [1:23:36<28:56:22,  3.40it/s]
  5%|▍         | 17298/371472 [1:23:36<30:11:47,  3.26it/s]
  5%|▍         | 17299/371472 [1:23:37<30:05:34,  3.27it/s]
  5%|▍         | 17300/371472 [1:23:37<28:45:34,  3.42it/s]
                                                           
{'loss': 4.7121, 'learning_rate': 9.585479109655455e-07, 'epoch': 0.75}

  5%|▍         | 17300/371472 [1:23:37<28:45:34,  3.42it/s]
  5%|▍         | 17301/371472 [1:23:37<27:54:40,  3.52it/s]
  5%|▍         | 17302/371472 [1:23:38<27:23:25,  3.59it/s]
  5%|▍         | 17303/371472 [1:23:38<27:21:06,  3.60it/s]
  5%|▍         | 17304/371472 [1:23:38<27:23:15,  3.59it/s]
  5%|▍         | 17305/371472 [1:23:38<27:23:03,  3.59it/s]
  5%|▍         | 17306/371472 [1:23:39<26:48:40,  3.67it/s]
  5%|▍         | 17307/371472 [1:23:39<27:20:40,  3.60it/s]
  5%|▍         | 17308/371472 [1:23:39<27:08:11,  3.63it/s]
  5%|▍         | 17309/371472 [1:23:40<27:18:11,  3.60it/s]
  5%|▍         | 17310/371472 [1:23:40<29:26:10,  3.34it/s]
  5%|▍         | 17311/371472 [1:23:40<28:46:48,  3.42it/s]
  5%|▍         | 17312/371472 [1:23:41<31:55:42,  3.08it/s]
  5%|▍         | 17313/371472 [1:23:41<29:41:21,  3.31it/s]
  5%|▍         | 17314/371472 [1:23:41<28:36:08,  3.44it/s]
  5%|▍         | 17315/371472 [1:23:41<27:27:53,  3.58it/s]
  5%|▍         | 17316/371472 [1:23:42<27:12:47,  3.62it/s]
  5%|▍         | 17317/371472 [1:23:42<26:53:52,  3.66it/s]
  5%|▍         | 17318/371472 [1:23:42<29:05:41,  3.38it/s]
  5%|▍         | 17319/371472 [1:23:42<28:34:11,  3.44it/s]
  5%|▍         | 17320/371472 [1:23:43<28:46:29,  3.42it/s]
                                                           
{'loss': 4.8845, 'learning_rate': 9.584994289900666e-07, 'epoch': 0.75}

  5%|▍         | 17320/371472 [1:23:43<28:46:29,  3.42it/s]
  5%|▍         | 17321/371472 [1:23:43<29:27:05,  3.34it/s]
  5%|▍         | 17322/371472 [1:23:43<30:32:31,  3.22it/s]
  5%|▍         | 17323/371472 [1:23:44<29:19:13,  3.36it/s]
  5%|▍         | 17324/371472 [1:23:44<28:19:54,  3.47it/s]
  5%|▍         | 17325/371472 [1:23:44<28:13:12,  3.49it/s]
  5%|▍         | 17326/371472 [1:23:45<27:35:11,  3.57it/s]
  5%|▍         | 17327/371472 [1:23:45<27:13:50,  3.61it/s]
  5%|▍         | 17328/371472 [1:23:45<27:18:50,  3.60it/s]
  5%|▍         | 17329/371472 [1:23:45<26:41:24,  3.69it/s]
  5%|▍         | 17330/371472 [1:23:46<27:17:49,  3.60it/s]
  5%|▍         | 17331/371472 [1:23:46<27:14:33,  3.61it/s]
  5%|▍         | 17332/371472 [1:23:46<27:37:07,  3.56it/s]
  5%|▍         | 17333/371472 [1:23:46<26:57:34,  3.65it/s]
  5%|▍         | 17334/371472 [1:23:47<26:39:49,  3.69it/s]
  5%|▍         | 17335/371472 [1:23:47<26:15:35,  3.75it/s]
  5%|▍         | 17336/371472 [1:23:47<26:33:16,  3.70it/s]
  5%|▍         | 17337/371472 [1:23:48<27:24:01,  3.59it/s]
  5%|▍         | 17338/371472 [1:23:48<27:07:28,  3.63it/s]
  5%|▍         | 17339/371472 [1:23:48<26:36:36,  3.70it/s]
  5%|▍         | 17340/371472 [1:23:48<26:46:30,  3.67it/s]
                                                           
{'loss': 4.7855, 'learning_rate': 9.584509470145877e-07, 'epoch': 0.75}

  5%|▍         | 17340/371472 [1:23:48<26:46:30,  3.67it/s]
  5%|▍         | 17341/371472 [1:23:49<26:16:31,  3.74it/s]
  5%|▍         | 17342/371472 [1:23:49<27:16:34,  3.61it/s]
  5%|▍         | 17343/371472 [1:23:49<26:54:49,  3.65it/s]
  5%|▍         | 17344/371472 [1:23:49<28:30:01,  3.45it/s]
  5%|▍         | 17345/371472 [1:23:50<30:41:10,  3.21it/s]
  5%|▍         | 17346/371472 [1:23:50<30:14:08,  3.25it/s]
  5%|▍         | 17347/371472 [1:23:50<30:00:15,  3.28it/s]
  5%|▍         | 17348/371472 [1:23:51<30:10:26,  3.26it/s]
  5%|▍         | 17349/371472 [1:23:51<28:29:46,  3.45it/s]
  5%|▍         | 17350/371472 [1:23:51<27:31:35,  3.57it/s]
  5%|▍         | 17351/371472 [1:23:52<28:50:48,  3.41it/s]
  5%|▍         | 17352/371472 [1:23:52<27:44:42,  3.55it/s]
  5%|▍         | 17353/371472 [1:23:52<27:30:25,  3.58it/s]
  5%|▍         | 17354/371472 [1:23:52<28:01:59,  3.51it/s]
  5%|▍         | 17355/371472 [1:23:53<27:15:33,  3.61it/s]
  5%|▍         | 17356/371472 [1:23:53<27:09:11,  3.62it/s]
  5%|▍         | 17357/371472 [1:23:53<27:30:58,  3.57it/s]
  5%|▍         | 17358/371472 [1:23:54<28:07:22,  3.50it/s]
  5%|▍         | 17359/371472 [1:23:54<27:54:30,  3.52it/s]
  5%|▍         | 17360/371472 [1:23:54<27:47:40,  3.54it/s]
                                                           
{'loss': 4.6848, 'learning_rate': 9.584024650391087e-07, 'epoch': 0.75}

  5%|▍         | 17360/371472 [1:23:54<27:47:40,  3.54it/s]
  5%|▍         | 17361/371472 [1:23:54<28:08:18,  3.50it/s]
  5%|▍         | 17362/371472 [1:23:55<26:59:32,  3.64it/s]
  5%|▍         | 17363/371472 [1:23:55<27:49:07,  3.54it/s]
  5%|▍         | 17364/371472 [1:23:55<28:57:56,  3.40it/s]
  5%|▍         | 17365/371472 [1:23:56<27:50:22,  3.53it/s]
  5%|▍         | 17366/371472 [1:23:56<27:29:36,  3.58it/s]
  5%|▍         | 17367/371472 [1:23:56<27:40:45,  3.55it/s]
  5%|▍         | 17368/371472 [1:23:56<27:24:00,  3.59it/s]
  5%|▍         | 17369/371472 [1:23:57<27:13:17,  3.61it/s]
  5%|▍         | 17370/371472 [1:23:57<26:57:08,  3.65it/s]
  5%|▍         | 17371/371472 [1:23:57<26:46:50,  3.67it/s]
  5%|▍         | 17372/371472 [1:23:57<26:51:14,  3.66it/s]
  5%|▍         | 17373/371472 [1:23:58<26:44:11,  3.68it/s]
  5%|▍         | 17374/371472 [1:23:58<30:03:08,  3.27it/s]
  5%|▍         | 17375/371472 [1:23:58<29:34:29,  3.33it/s]
  5%|▍         | 17376/371472 [1:23:59<28:33:35,  3.44it/s]
  5%|▍         | 17377/371472 [1:23:59<27:34:10,  3.57it/s]
  5%|▍         | 17378/371472 [1:23:59<29:12:46,  3.37it/s]
  5%|▍         | 17379/371472 [1:24:00<28:44:46,  3.42it/s]
  5%|▍         | 17380/371472 [1:24:00<27:44:00,  3.55it/s]
                                                           
{'loss': 4.7187, 'learning_rate': 9.5835398306363e-07, 'epoch': 0.75}

  5%|▍         | 17380/371472 [1:24:00<27:44:00,  3.55it/s]
  5%|▍         | 17381/371472 [1:24:00<28:06:45,  3.50it/s]
  5%|▍         | 17382/371472 [1:24:00<27:56:12,  3.52it/s]
  5%|▍         | 17383/371472 [1:24:01<27:04:32,  3.63it/s]
  5%|▍         | 17384/371472 [1:24:01<26:27:16,  3.72it/s]
  5%|▍         | 17385/371472 [1:24:01<26:37:42,  3.69it/s]
  5%|▍         | 17386/371472 [1:24:01<26:45:17,  3.68it/s]
  5%|▍         | 17387/371472 [1:24:02<27:47:29,  3.54it/s]
  5%|▍         | 17388/371472 [1:24:02<27:06:44,  3.63it/s]
  5%|▍         | 17389/371472 [1:24:02<27:30:25,  3.58it/s]
  5%|▍         | 17390/371472 [1:24:03<27:16:27,  3.61it/s]
  5%|▍         | 17391/371472 [1:24:03<30:48:51,  3.19it/s]
  5%|▍         | 17392/371472 [1:24:03<31:14:16,  3.15it/s]
  5%|▍         | 17393/371472 [1:24:04<30:03:38,  3.27it/s]
  5%|▍         | 17394/371472 [1:24:04<28:42:33,  3.43it/s]
  5%|▍         | 17395/371472 [1:24:04<27:34:52,  3.57it/s]
  5%|▍         | 17396/371472 [1:24:04<30:31:13,  3.22it/s]
  5%|▍         | 17397/371472 [1:24:05<29:25:25,  3.34it/s]
  5%|▍         | 17398/371472 [1:24:05<29:21:04,  3.35it/s]
  5%|▍         | 17399/371472 [1:24:05<28:34:59,  3.44it/s]
  5%|▍         | 17400/371472 [1:24:06<28:14:12,  3.48it/s]
                                                           
{'loss': 4.5737, 'learning_rate': 9.583055010881509e-07, 'epoch': 0.75}

  5%|▍         | 17400/371472 [1:24:06<28:14:12,  3.48it/s]
  5%|▍         | 17401/371472 [1:24:06<29:13:36,  3.37it/s]
  5%|▍         | 17402/371472 [1:24:06<29:02:45,  3.39it/s]
  5%|▍         | 17403/371472 [1:24:06<27:48:36,  3.54it/s]
  5%|▍         | 17404/371472 [1:24:07<26:55:31,  3.65it/s]
  5%|▍         | 17405/371472 [1:24:07<26:43:29,  3.68it/s]
  5%|▍         | 17406/371472 [1:24:07<27:00:44,  3.64it/s]
  5%|▍         | 17407/371472 [1:24:07<26:52:00,  3.66it/s]
  5%|▍         | 17408/371472 [1:24:08<26:51:49,  3.66it/s]
  5%|▍         | 17409/371472 [1:24:08<27:05:36,  3.63it/s]
  5%|▍         | 17410/371472 [1:24:08<26:16:19,  3.74it/s]
  5%|▍         | 17411/371472 [1:24:09<26:14:04,  3.75it/s]
  5%|▍         | 17412/371472 [1:24:09<26:41:47,  3.68it/s]
  5%|▍         | 17413/371472 [1:24:09<26:31:02,  3.71it/s]
  5%|▍         | 17414/371472 [1:24:09<26:12:09,  3.75it/s]
  5%|▍         | 17415/371472 [1:24:10<27:23:03,  3.59it/s]
  5%|▍         | 17416/371472 [1:24:10<27:22:47,  3.59it/s]
  5%|▍         | 17417/371472 [1:24:10<26:57:10,  3.65it/s]
  5%|▍         | 17418/371472 [1:24:10<26:57:11,  3.65it/s]
  5%|▍         | 17419/371472 [1:24:11<26:03:08,  3.78it/s]
  5%|▍         | 17420/371472 [1:24:11<25:27:09,  3.86it/s]
                                                           
{'loss': 4.9443, 'learning_rate': 9.582570191126722e-07, 'epoch': 0.75}

  5%|▍         | 17420/371472 [1:24:11<25:27:09,  3.86it/s]
  5%|▍         | 17421/371472 [1:24:11<26:09:48,  3.76it/s]
  5%|▍         | 17422/371472 [1:24:12<25:45:11,  3.82it/s]
  5%|▍         | 17423/371472 [1:24:12<25:57:11,  3.79it/s]
  5%|▍         | 17424/371472 [1:24:12<25:52:56,  3.80it/s]
  5%|▍         | 17425/371472 [1:24:12<25:40:04,  3.83it/s]
  5%|▍         | 17426/371472 [1:24:13<26:00:21,  3.78it/s]
  5%|▍         | 17427/371472 [1:24:13<26:54:06,  3.66it/s]
  5%|▍         | 17428/371472 [1:24:13<28:30:00,  3.45it/s]
  5%|▍         | 17429/371472 [1:24:13<27:34:31,  3.57it/s]
  5%|▍         | 17430/371472 [1:24:14<28:25:17,  3.46it/s]
  5%|▍         | 17431/371472 [1:24:14<27:42:20,  3.55it/s]
  5%|▍         | 17432/371472 [1:24:14<26:47:52,  3.67it/s]
  5%|▍         | 17433/371472 [1:24:15<26:06:26,  3.77it/s]
  5%|▍         | 17434/371472 [1:24:15<26:35:17,  3.70it/s]
  5%|▍         | 17435/371472 [1:24:15<28:16:07,  3.48it/s]
  5%|▍         | 17436/371472 [1:24:15<27:37:00,  3.56it/s]
  5%|▍         | 17437/371472 [1:24:16<27:13:24,  3.61it/s]
  5%|▍         | 17438/371472 [1:24:16<26:46:27,  3.67it/s]
  5%|▍         | 17439/371472 [1:24:16<26:31:57,  3.71it/s]
  5%|▍         | 17440/371472 [1:24:16<25:32:26,  3.85it/s]
                                                           
{'loss': 4.9395, 'learning_rate': 9.58208537137193e-07, 'epoch': 0.75}

  5%|▍         | 17440/371472 [1:24:16<25:32:26,  3.85it/s]
  5%|▍         | 17441/371472 [1:24:17<26:32:08,  3.71it/s]
  5%|▍         | 17442/371472 [1:24:17<28:49:43,  3.41it/s]
  5%|▍         | 17443/371472 [1:24:17<28:49:35,  3.41it/s]
  5%|▍         | 17444/371472 [1:24:18<27:24:03,  3.59it/s]
  5%|▍         | 17445/371472 [1:24:18<27:16:08,  3.61it/s]
  5%|▍         | 17446/371472 [1:24:18<27:52:43,  3.53it/s]
  5%|▍         | 17447/371472 [1:24:18<27:46:43,  3.54it/s]
  5%|▍         | 17448/371472 [1:24:19<27:07:13,  3.63it/s]
  5%|▍         | 17449/371472 [1:24:19<27:25:51,  3.58it/s]
  5%|▍         | 17450/371472 [1:24:19<28:32:21,  3.45it/s]
  5%|▍         | 17451/371472 [1:24:20<29:39:28,  3.32it/s]
  5%|▍         | 17452/371472 [1:24:20<28:44:00,  3.42it/s]
  5%|▍         | 17453/371472 [1:24:20<28:04:54,  3.50it/s]
  5%|▍         | 17454/371472 [1:24:20<27:40:58,  3.55it/s]
  5%|▍         | 17455/371472 [1:24:21<28:09:43,  3.49it/s]
  5%|▍         | 17456/371472 [1:24:21<27:55:28,  3.52it/s]
  5%|▍         | 17457/371472 [1:24:21<29:17:08,  3.36it/s]
  5%|▍         | 17458/371472 [1:24:22<31:02:22,  3.17it/s]
  5%|▍         | 17459/371472 [1:24:22<30:41:59,  3.20it/s]
  5%|▍         | 17460/371472 [1:24:22<29:36:13,  3.32it/s]
                                                           
{'loss': 4.5068, 'learning_rate': 9.581600551617143e-07, 'epoch': 0.75}

  5%|▍         | 17460/371472 [1:24:22<29:36:13,  3.32it/s]
  5%|▍         | 17461/371472 [1:24:23<30:08:01,  3.26it/s]
  5%|▍         | 17462/371472 [1:24:23<32:05:49,  3.06it/s]
  5%|▍         | 17463/371472 [1:24:23<30:53:41,  3.18it/s]
  5%|▍         | 17464/371472 [1:24:24<29:02:19,  3.39it/s]
  5%|▍         | 17465/371472 [1:24:24<28:19:42,  3.47it/s]
  5%|▍         | 17466/371472 [1:24:24<27:33:06,  3.57it/s]
  5%|▍         | 17467/371472 [1:24:24<26:59:18,  3.64it/s]
  5%|▍         | 17468/371472 [1:24:25<27:52:51,  3.53it/s]
  5%|▍         | 17469/371472 [1:24:25<27:37:24,  3.56it/s]
  5%|▍         | 17470/371472 [1:24:25<28:47:08,  3.42it/s]
  5%|▍         | 17471/371472 [1:24:25<28:12:06,  3.49it/s]
  5%|▍         | 17472/371472 [1:24:26<27:29:59,  3.58it/s]
  5%|▍         | 17473/371472 [1:24:26<26:44:23,  3.68it/s]
  5%|▍         | 17474/371472 [1:24:26<27:11:36,  3.62it/s]
  5%|▍         | 17475/371472 [1:24:27<27:54:48,  3.52it/s]
  5%|▍         | 17476/371472 [1:24:27<28:10:58,  3.49it/s]
  5%|▍         | 17477/371472 [1:24:27<29:08:41,  3.37it/s]
  5%|▍         | 17478/371472 [1:24:28<30:08:01,  3.26it/s]
  5%|▍         | 17479/371472 [1:24:28<30:17:35,  3.25it/s]
  5%|▍         | 17480/371472 [1:24:28<29:12:11,  3.37it/s]
                                                           
{'loss': 4.9245, 'learning_rate': 9.581115731862354e-07, 'epoch': 0.75}

  5%|▍         | 17480/371472 [1:24:28<29:12:11,  3.37it/s]
  5%|▍         | 17481/371472 [1:24:28<28:44:05,  3.42it/s]
  5%|▍         | 17482/371472 [1:24:29<27:54:02,  3.52it/s]
  5%|▍         | 17483/371472 [1:24:29<27:45:56,  3.54it/s]
  5%|▍         | 17484/371472 [1:24:29<26:52:13,  3.66it/s]
  5%|▍         | 17485/371472 [1:24:30<28:29:01,  3.45it/s]
  5%|▍         | 17486/371472 [1:24:30<28:26:27,  3.46it/s]
  5%|▍         | 17487/371472 [1:24:30<28:09:09,  3.49it/s]
  5%|▍         | 17488/371472 [1:24:30<28:31:41,  3.45it/s]
  5%|▍         | 17489/371472 [1:24:31<28:07:05,  3.50it/s]
  5%|▍         | 17490/371472 [1:24:31<28:36:14,  3.44it/s]
  5%|▍         | 17491/371472 [1:24:31<29:50:47,  3.29it/s]
  5%|▍         | 17492/371472 [1:24:32<28:34:22,  3.44it/s]
  5%|▍         | 17493/371472 [1:24:32<28:44:41,  3.42it/s]
  5%|▍         | 17494/371472 [1:24:32<28:48:00,  3.41it/s]
  5%|▍         | 17495/371472 [1:24:32<28:03:12,  3.50it/s]
  5%|▍         | 17496/371472 [1:24:33<26:59:33,  3.64it/s]
  5%|▍         | 17497/371472 [1:24:33<26:43:16,  3.68it/s]
  5%|▍         | 17498/371472 [1:24:33<26:14:24,  3.75it/s]
  5%|▍         | 17499/371472 [1:24:33<26:17:41,  3.74it/s]
  5%|▍         | 17500/371472 [1:24:34<26:48:23,  3.67it/s]
                                                           
{'loss': 4.6495, 'learning_rate': 9.580630912107564e-07, 'epoch': 0.75}

  5%|▍         | 17500/371472 [1:24:34<26:48:23,  3.67it/s]
  5%|▍         | 17501/371472 [1:24:34<26:11:03,  3.76it/s]
  5%|▍         | 17502/371472 [1:24:34<26:22:02,  3.73it/s]
  5%|▍         | 17503/371472 [1:24:35<26:29:20,  3.71it/s]
  5%|▍         | 17504/371472 [1:24:35<26:30:20,  3.71it/s]
  5%|▍         | 17505/371472 [1:24:35<27:10:56,  3.62it/s]
  5%|▍         | 17506/371472 [1:24:35<26:37:12,  3.69it/s]
  5%|▍         | 17507/371472 [1:24:36<26:35:23,  3.70it/s]
  5%|▍         | 17508/371472 [1:24:36<27:24:30,  3.59it/s]
  5%|▍         | 17509/371472 [1:24:36<29:29:07,  3.33it/s]
  5%|▍         | 17510/371472 [1:24:37<31:31:22,  3.12it/s]
  5%|▍         | 17511/371472 [1:24:37<31:48:36,  3.09it/s]
  5%|▍         | 17512/371472 [1:24:37<31:39:35,  3.11it/s]
  5%|▍         | 17513/371472 [1:24:38<30:07:01,  3.26it/s]
  5%|▍         | 17514/371472 [1:24:38<28:57:51,  3.39it/s]
  5%|▍         | 17515/371472 [1:24:38<28:38:56,  3.43it/s]
  5%|▍         | 17516/371472 [1:24:38<28:11:10,  3.49it/s]
  5%|▍         | 17517/371472 [1:24:39<27:35:51,  3.56it/s]
  5%|▍         | 17518/371472 [1:24:39<27:01:12,  3.64it/s]
  5%|▍         | 17519/371472 [1:24:39<27:32:52,  3.57it/s]
  5%|▍         | 17520/371472 [1:24:39<27:10:50,  3.62it/s]
                                                           
{'loss': 4.4371, 'learning_rate': 9.580146092352777e-07, 'epoch': 0.75}

  5%|▍         | 17520/371472 [1:24:39<27:10:50,  3.62it/s]
  5%|▍         | 17521/371472 [1:24:40<27:23:47,  3.59it/s]
  5%|▍         | 17522/371472 [1:24:40<30:21:45,  3.24it/s]
  5%|▍         | 17523/371472 [1:24:40<31:24:12,  3.13it/s]
  5%|▍         | 17524/371472 [1:24:41<29:24:24,  3.34it/s]
  5%|▍         | 17525/371472 [1:24:41<31:49:16,  3.09it/s]
  5%|▍         | 17526/371472 [1:24:41<30:26:12,  3.23it/s]
  5%|▍         | 17527/371472 [1:24:42<29:00:40,  3.39it/s]
  5%|▍         | 17528/371472 [1:24:42<28:43:21,  3.42it/s]
  5%|▍         | 17529/371472 [1:24:42<29:18:41,  3.35it/s]
  5%|▍         | 17530/371472 [1:24:43<29:02:21,  3.39it/s]
  5%|▍         | 17531/371472 [1:24:43<29:06:47,  3.38it/s]
  5%|▍         | 17532/371472 [1:24:43<28:38:40,  3.43it/s]
  5%|▍         | 17533/371472 [1:24:43<28:55:44,  3.40it/s]
  5%|▍         | 17534/371472 [1:24:44<29:39:02,  3.32it/s]
  5%|▍         | 17535/371472 [1:24:44<28:33:35,  3.44it/s]
  5%|▍         | 17536/371472 [1:24:44<28:01:28,  3.51it/s]
  5%|▍         | 17537/371472 [1:24:45<27:30:47,  3.57it/s]
  5%|▍         | 17538/371472 [1:24:45<29:19:21,  3.35it/s]
  5%|▍         | 17539/371472 [1:24:45<28:03:18,  3.50it/s]
  5%|▍         | 17540/371472 [1:24:45<27:16:14,  3.61it/s]
                                                           
{'loss': 4.5391, 'learning_rate': 9.579661272597986e-07, 'epoch': 0.76}

  5%|▍         | 17540/371472 [1:24:45<27:16:14,  3.61it/s]
  5%|▍         | 17541/371472 [1:24:46<29:41:57,  3.31it/s]
  5%|▍         | 17542/371472 [1:24:46<29:49:28,  3.30it/s]
  5%|▍         | 17543/371472 [1:24:46<29:40:18,  3.31it/s]
  5%|▍         | 17544/371472 [1:24:47<29:35:42,  3.32it/s]
  5%|▍         | 17545/371472 [1:24:47<29:11:43,  3.37it/s]
  5%|▍         | 17546/371472 [1:24:47<30:46:41,  3.19it/s]
  5%|▍         | 17547/371472 [1:24:48<30:50:57,  3.19it/s]
  5%|▍         | 17548/371472 [1:24:48<29:18:07,  3.36it/s]
  5%|▍         | 17549/371472 [1:24:48<27:59:38,  3.51it/s]
  5%|▍         | 17550/371472 [1:24:48<27:17:45,  3.60it/s]
  5%|▍         | 17551/371472 [1:24:49<27:22:54,  3.59it/s]
  5%|▍         | 17552/371472 [1:24:49<26:36:50,  3.69it/s]
  5%|▍         | 17553/371472 [1:24:49<28:21:05,  3.47it/s]
  5%|▍         | 17554/371472 [1:24:50<28:38:42,  3.43it/s]
  5%|▍         | 17555/371472 [1:24:50<27:36:56,  3.56it/s]
  5%|▍         | 17556/371472 [1:24:50<27:05:10,  3.63it/s]
  5%|▍         | 17557/371472 [1:24:50<27:55:07,  3.52it/s]
  5%|▍         | 17558/371472 [1:24:51<28:03:24,  3.50it/s]
  5%|▍         | 17559/371472 [1:24:51<27:22:16,  3.59it/s]
  5%|▍         | 17560/371472 [1:24:51<26:26:12,  3.72it/s]
                                                           
{'loss': 4.4885, 'learning_rate': 9.579176452843199e-07, 'epoch': 0.76}

  5%|▍         | 17560/371472 [1:24:51<26:26:12,  3.72it/s]
  5%|▍         | 17561/371472 [1:24:51<25:57:32,  3.79it/s]
  5%|▍         | 17562/371472 [1:24:52<26:50:30,  3.66it/s]
  5%|▍         | 17563/371472 [1:24:52<29:53:59,  3.29it/s]
  5%|▍         | 17564/371472 [1:24:52<28:12:34,  3.48it/s]
  5%|▍         | 17565/371472 [1:24:53<29:23:42,  3.34it/s]
  5%|▍         | 17566/371472 [1:24:53<28:34:34,  3.44it/s]
  5%|▍         | 17567/371472 [1:24:53<29:58:55,  3.28it/s]
  5%|▍         | 17568/371472 [1:24:54<29:28:56,  3.33it/s]
  5%|▍         | 17569/371472 [1:24:54<28:22:04,  3.47it/s]
  5%|▍         | 17570/371472 [1:24:54<30:17:10,  3.25it/s]
  5%|▍         | 17571/371472 [1:24:54<29:25:32,  3.34it/s]
  5%|▍         | 17572/371472 [1:24:55<28:39:33,  3.43it/s]
  5%|▍         | 17573/371472 [1:24:55<29:11:24,  3.37it/s]
  5%|▍         | 17574/371472 [1:24:55<28:38:26,  3.43it/s]
  5%|▍         | 17575/371472 [1:24:56<29:19:30,  3.35it/s]
  5%|▍         | 17576/371472 [1:24:56<28:41:01,  3.43it/s]
  5%|▍         | 17577/371472 [1:24:56<32:01:33,  3.07it/s]
  5%|▍         | 17578/371472 [1:24:57<29:59:39,  3.28it/s]
  5%|▍         | 17579/371472 [1:24:57<30:00:14,  3.28it/s]
  5%|▍         | 17580/371472 [1:24:57<28:49:49,  3.41it/s]
                                                           
{'loss': 4.5693, 'learning_rate': 9.578691633088407e-07, 'epoch': 0.76}

  5%|▍         | 17580/371472 [1:24:57<28:49:49,  3.41it/s]
  5%|▍         | 17581/371472 [1:24:57<28:21:15,  3.47it/s]
  5%|▍         | 17582/371472 [1:24:58<31:34:01,  3.11it/s]
  5%|▍         | 17583/371472 [1:24:58<30:24:56,  3.23it/s]
  5%|▍         | 17584/371472 [1:24:58<29:39:11,  3.32it/s]
  5%|▍         | 17585/371472 [1:24:59<29:36:16,  3.32it/s]
  5%|▍         | 17586/371472 [1:24:59<31:13:43,  3.15it/s]
  5%|▍         | 17587/371472 [1:24:59<29:25:28,  3.34it/s]
  5%|▍         | 17588/371472 [1:25:00<30:16:31,  3.25it/s]
  5%|▍         | 17589/371472 [1:25:00<30:22:11,  3.24it/s]
  5%|▍         | 17590/371472 [1:25:00<30:22:41,  3.24it/s]
  5%|▍         | 17591/371472 [1:25:00<28:24:00,  3.46it/s]
  5%|▍         | 17592/371472 [1:25:01<31:02:26,  3.17it/s]
  5%|▍         | 17593/371472 [1:25:01<30:33:47,  3.22it/s]
  5%|▍         | 17594/371472 [1:25:01<29:10:30,  3.37it/s]
  5%|▍         | 17595/371472 [1:25:02<29:39:07,  3.32it/s]
  5%|▍         | 17596/371472 [1:25:02<28:55:10,  3.40it/s]
  5%|▍         | 17597/371472 [1:25:02<27:49:53,  3.53it/s]
  5%|▍         | 17598/371472 [1:25:03<27:36:14,  3.56it/s]
  5%|▍         | 17599/371472 [1:25:03<28:39:52,  3.43it/s]
  5%|▍         | 17600/371472 [1:25:03<28:23:22,  3.46it/s]
                                                           
{'loss': 4.4952, 'learning_rate': 9.57820681333362e-07, 'epoch': 0.76}

  5%|▍         | 17600/371472 [1:25:03<28:23:22,  3.46it/s]
  5%|▍         | 17601/371472 [1:25:03<28:52:00,  3.41it/s]
  5%|▍         | 17602/371472 [1:25:04<29:00:28,  3.39it/s]
  5%|▍         | 17603/371472 [1:25:04<31:03:32,  3.16it/s]
  5%|▍         | 17604/371472 [1:25:04<29:21:49,  3.35it/s]
  5%|▍         | 17605/371472 [1:25:05<31:12:36,  3.15it/s]
  5%|▍         | 17606/371472 [1:25:05<32:29:52,  3.02it/s]
  5%|▍         | 17607/371472 [1:25:05<30:44:50,  3.20it/s]
  5%|▍         | 17608/371472 [1:25:06<29:18:10,  3.35it/s]
  5%|▍         | 17609/371472 [1:25:06<28:33:10,  3.44it/s]
  5%|▍         | 17610/371472 [1:25:06<28:34:58,  3.44it/s]
  5%|▍         | 17611/371472 [1:25:06<28:06:41,  3.50it/s]
  5%|▍         | 17612/371472 [1:25:07<28:12:51,  3.48it/s]
  5%|▍         | 17613/371472 [1:25:07<28:08:24,  3.49it/s]
  5%|▍         | 17614/371472 [1:25:07<28:34:27,  3.44it/s]
  5%|▍         | 17615/371472 [1:25:08<27:48:13,  3.54it/s]
  5%|▍         | 17616/371472 [1:25:08<27:08:07,  3.62it/s]
  5%|▍         | 17617/371472 [1:25:08<26:40:26,  3.68it/s]
  5%|▍         | 17618/371472 [1:25:08<26:11:11,  3.75it/s]
  5%|▍         | 17619/371472 [1:25:09<26:01:45,  3.78it/s]
  5%|▍         | 17620/371472 [1:25:09<29:15:41,  3.36it/s]
                                                           
{'loss': 4.633, 'learning_rate': 9.57772199357883e-07, 'epoch': 0.76}

  5%|▍         | 17620/371472 [1:25:09<29:15:41,  3.36it/s]
  5%|▍         | 17621/371472 [1:25:09<28:29:01,  3.45it/s]
  5%|▍         | 17622/371472 [1:25:10<28:42:46,  3.42it/s]
  5%|▍         | 17623/371472 [1:25:10<30:25:08,  3.23it/s]
  5%|▍         | 17624/371472 [1:25:10<29:14:03,  3.36it/s]
  5%|▍         | 17625/371472 [1:25:11<28:48:11,  3.41it/s]
  5%|▍         | 17626/371472 [1:25:11<29:09:34,  3.37it/s]
  5%|▍         | 17627/371472 [1:25:11<28:39:01,  3.43it/s]
  5%|▍         | 17628/371472 [1:25:11<28:00:56,  3.51it/s]
  5%|▍         | 17629/371472 [1:25:12<29:06:23,  3.38it/s]
  5%|▍         | 17630/371472 [1:25:12<29:28:33,  3.33it/s]
  5%|▍         | 17631/371472 [1:25:12<29:34:39,  3.32it/s]
  5%|▍         | 17632/371472 [1:25:13<28:58:11,  3.39it/s]
  5%|▍         | 17633/371472 [1:25:13<28:12:33,  3.48it/s]
  5%|▍         | 17634/371472 [1:25:13<29:22:26,  3.35it/s]
  5%|▍         | 17635/371472 [1:25:13<29:29:40,  3.33it/s]
  5%|▍         | 17636/371472 [1:25:14<28:30:12,  3.45it/s]
  5%|▍         | 17637/371472 [1:25:14<28:41:55,  3.42it/s]
  5%|▍         | 17638/371472 [1:25:14<28:58:41,  3.39it/s]
  5%|▍         | 17639/371472 [1:25:15<28:31:19,  3.45it/s]
  5%|▍         | 17640/371472 [1:25:15<31:32:33,  3.12it/s]
                                                           
{'loss': 4.6817, 'learning_rate': 9.577237173824042e-07, 'epoch': 0.76}

  5%|▍         | 17640/371472 [1:25:15<31:32:33,  3.12it/s]
  5%|▍         | 17641/371472 [1:25:15<32:13:49,  3.05it/s]
  5%|▍         | 17642/371472 [1:25:16<30:54:04,  3.18it/s]
  5%|▍         | 17643/371472 [1:25:16<31:23:16,  3.13it/s]
  5%|▍         | 17644/371472 [1:25:16<30:03:13,  3.27it/s]
  5%|▍         | 17645/371472 [1:25:16<28:37:23,  3.43it/s]
  5%|▍         | 17646/371472 [1:25:17<28:18:09,  3.47it/s]
  5%|▍         | 17647/371472 [1:25:17<27:32:01,  3.57it/s]
  5%|▍         | 17648/371472 [1:25:17<27:24:59,  3.58it/s]
  5%|▍         | 17649/371472 [1:25:18<27:45:24,  3.54it/s]
  5%|▍         | 17650/371472 [1:25:18<27:39:07,  3.55it/s]
  5%|▍         | 17651/371472 [1:25:18<27:21:47,  3.59it/s]
  5%|▍         | 17652/371472 [1:25:19<29:44:39,  3.30it/s]
  5%|▍         | 17653/371472 [1:25:19<29:33:52,  3.32it/s]
  5%|▍         | 17654/371472 [1:25:19<28:46:45,  3.42it/s]
  5%|▍         | 17655/371472 [1:25:19<32:13:10,  3.05it/s]
  5%|▍         | 17656/371472 [1:25:20<30:49:25,  3.19it/s]
  5%|▍         | 17657/371472 [1:25:20<31:19:41,  3.14it/s]
  5%|▍         | 17658/371472 [1:25:20<29:51:06,  3.29it/s]
  5%|▍         | 17659/371472 [1:25:21<29:00:52,  3.39it/s]
  5%|▍         | 17660/371472 [1:25:21<29:33:59,  3.32it/s]
                                                           
{'loss': 4.647, 'learning_rate': 9.576752354069254e-07, 'epoch': 0.76}

  5%|▍         | 17660/371472 [1:25:21<29:33:59,  3.32it/s]
  5%|▍         | 17661/371472 [1:25:21<30:29:13,  3.22it/s]
  5%|▍         | 17662/371472 [1:25:22<30:23:11,  3.23it/s]
  5%|▍         | 17663/371472 [1:25:22<30:30:14,  3.22it/s]
  5%|▍         | 17664/371472 [1:25:22<30:02:50,  3.27it/s]
  5%|▍         | 17665/371472 [1:25:23<30:32:24,  3.22it/s]
  5%|▍         | 17666/371472 [1:25:23<29:37:55,  3.32it/s]
  5%|▍         | 17667/371472 [1:25:23<28:58:19,  3.39it/s]
  5%|▍         | 17668/371472 [1:25:23<28:59:32,  3.39it/s]
  5%|▍         | 17669/371472 [1:25:24<29:10:17,  3.37it/s]
  5%|▍         | 17670/371472 [1:25:24<29:08:13,  3.37it/s]
  5%|▍         | 17671/371472 [1:25:24<32:24:58,  3.03it/s]
  5%|▍         | 17672/371472 [1:25:25<30:25:00,  3.23it/s]
  5%|▍         | 17673/371472 [1:25:25<30:16:18,  3.25it/s]
  5%|▍         | 17674/371472 [1:25:25<30:02:05,  3.27it/s]
  5%|▍         | 17675/371472 [1:25:26<30:31:12,  3.22it/s]
  5%|▍         | 17676/371472 [1:25:26<28:59:14,  3.39it/s]
  5%|▍         | 17677/371472 [1:25:26<28:21:31,  3.47it/s]
  5%|▍         | 17678/371472 [1:25:26<30:07:34,  3.26it/s]
  5%|▍         | 17679/371472 [1:25:27<29:44:41,  3.30it/s]
  5%|▍         | 17680/371472 [1:25:27<28:12:51,  3.48it/s]
                                                           
{'loss': 4.6863, 'learning_rate': 9.576267534314465e-07, 'epoch': 0.76}

  5%|▍         | 17680/371472 [1:25:27<28:12:51,  3.48it/s]
  5%|▍         | 17681/371472 [1:25:27<27:50:40,  3.53it/s]
  5%|▍         | 17682/371472 [1:25:28<30:30:16,  3.22it/s]
  5%|▍         | 17683/371472 [1:25:28<29:43:49,  3.31it/s]
  5%|▍         | 17684/371472 [1:25:28<31:03:19,  3.16it/s]
  5%|▍         | 17685/371472 [1:25:29<29:11:53,  3.37it/s]
  5%|▍         | 17686/371472 [1:25:29<27:52:49,  3.52it/s]
  5%|▍         | 17687/371472 [1:25:29<27:56:41,  3.52it/s]
  5%|▍         | 17688/371472 [1:25:29<29:49:59,  3.29it/s]
  5%|▍         | 17689/371472 [1:25:30<28:38:32,  3.43it/s]
  5%|▍         | 17690/371472 [1:25:30<28:31:57,  3.44it/s]
  5%|▍         | 17691/371472 [1:25:30<27:59:35,  3.51it/s]
  5%|▍         | 17692/371472 [1:25:31<28:00:53,  3.51it/s]
  5%|▍         | 17693/371472 [1:25:31<26:41:34,  3.68it/s]
  5%|▍         | 17694/371472 [1:25:31<26:55:03,  3.65it/s]
  5%|▍         | 17695/371472 [1:25:31<28:52:41,  3.40it/s]
  5%|▍         | 17696/371472 [1:25:32<28:18:46,  3.47it/s]
  5%|▍         | 17697/371472 [1:25:32<29:03:33,  3.38it/s]
  5%|▍         | 17698/371472 [1:25:32<28:39:38,  3.43it/s]
  5%|▍         | 17699/371472 [1:25:33<28:18:20,  3.47it/s]
  5%|▍         | 17700/371472 [1:25:33<27:16:24,  3.60it/s]
                                                           
{'loss': 4.8397, 'learning_rate': 9.575782714559676e-07, 'epoch': 0.76}

  5%|▍         | 17700/371472 [1:25:33<27:16:24,  3.60it/s]
  5%|▍         | 17701/371472 [1:25:33<26:53:47,  3.65it/s]
  5%|▍         | 17702/371472 [1:25:33<28:11:40,  3.49it/s]
  5%|▍         | 17703/371472 [1:25:34<27:21:14,  3.59it/s]
  5%|▍         | 17704/371472 [1:25:34<28:48:22,  3.41it/s]
  5%|▍         | 17705/371472 [1:25:34<28:04:55,  3.50it/s]
  5%|▍         | 17706/371472 [1:25:34<27:22:45,  3.59it/s]
  5%|▍         | 17707/371472 [1:25:35<28:45:46,  3.42it/s]
  5%|▍         | 17708/371472 [1:25:35<28:30:48,  3.45it/s]
  5%|▍         | 17709/371472 [1:25:35<30:17:12,  3.24it/s]
  5%|▍         | 17710/371472 [1:25:36<31:15:41,  3.14it/s]
  5%|▍         | 17711/371472 [1:25:36<29:43:29,  3.31it/s]
  5%|▍         | 17712/371472 [1:25:36<29:57:07,  3.28it/s]
  5%|▍         | 17713/371472 [1:25:37<28:51:33,  3.41it/s]
  5%|▍         | 17714/371472 [1:25:37<28:16:27,  3.48it/s]
  5%|▍         | 17715/371472 [1:25:37<28:16:59,  3.47it/s]
  5%|▍         | 17716/371472 [1:25:38<29:08:32,  3.37it/s]
  5%|▍         | 17717/371472 [1:25:38<30:00:36,  3.27it/s]
  5%|▍         | 17718/371472 [1:25:38<30:22:34,  3.23it/s]
  5%|▍         | 17719/371472 [1:25:39<31:36:57,  3.11it/s]
  5%|▍         | 17720/371472 [1:25:39<29:45:50,  3.30it/s]
                                                           
{'loss': 4.4226, 'learning_rate': 9.575297894804887e-07, 'epoch': 0.76}

  5%|▍         | 17720/371472 [1:25:39<29:45:50,  3.30it/s]
  5%|▍         | 17721/371472 [1:25:39<28:21:59,  3.46it/s]
  5%|▍         | 17722/371472 [1:25:39<28:18:49,  3.47it/s]
  5%|▍         | 17723/371472 [1:25:40<30:21:48,  3.24it/s]
  5%|▍         | 17724/371472 [1:25:40<28:48:37,  3.41it/s]
  5%|▍         | 17725/371472 [1:25:40<28:38:47,  3.43it/s]
  5%|▍         | 17726/371472 [1:25:41<28:58:18,  3.39it/s]
  5%|▍         | 17727/371472 [1:25:41<28:54:32,  3.40it/s]
  5%|▍         | 17728/371472 [1:25:41<28:49:03,  3.41it/s]
  5%|▍         | 17729/371472 [1:25:41<28:30:38,  3.45it/s]
  5%|▍         | 17730/371472 [1:25:42<28:27:19,  3.45it/s]
  5%|▍         | 17731/371472 [1:25:42<28:10:28,  3.49it/s]
  5%|▍         | 17732/371472 [1:25:42<30:17:44,  3.24it/s]
  5%|▍         | 17733/371472 [1:25:43<30:52:42,  3.18it/s]
  5%|▍         | 17734/371472 [1:25:43<29:57:32,  3.28it/s]
  5%|▍         | 17735/371472 [1:25:43<29:24:06,  3.34it/s]
  5%|▍         | 17736/371472 [1:25:44<30:15:36,  3.25it/s]
  5%|▍         | 17737/371472 [1:25:44<29:58:03,  3.28it/s]
  5%|▍         | 17738/371472 [1:25:44<29:29:33,  3.33it/s]
  5%|▍         | 17739/371472 [1:25:44<28:52:00,  3.40it/s]
  5%|▍         | 17740/371472 [1:25:45<28:01:02,  3.51it/s]
                                                           
{'loss': 4.4665, 'learning_rate': 9.574813075050097e-07, 'epoch': 0.76}

  5%|▍         | 17740/371472 [1:25:45<28:01:02,  3.51it/s]
  5%|▍         | 17741/371472 [1:25:45<28:13:01,  3.48it/s]
  5%|▍         | 17742/371472 [1:25:45<28:37:23,  3.43it/s]
  5%|▍         | 17743/371472 [1:25:46<28:12:47,  3.48it/s]
  5%|▍         | 17744/371472 [1:25:46<28:00:13,  3.51it/s]
  5%|▍         | 17745/371472 [1:25:46<27:34:37,  3.56it/s]
  5%|▍         | 17746/371472 [1:25:46<27:30:35,  3.57it/s]
  5%|▍         | 17747/371472 [1:25:47<29:24:22,  3.34it/s]
  5%|▍         | 17748/371472 [1:25:47<30:41:10,  3.20it/s]
  5%|▍         | 17749/371472 [1:25:47<32:29:33,  3.02it/s]
  5%|▍         | 17750/371472 [1:25:48<29:52:19,  3.29it/s]
  5%|▍         | 17751/371472 [1:25:48<29:22:30,  3.34it/s]
  5%|▍         | 17752/371472 [1:25:48<28:34:32,  3.44it/s]
  5%|▍         | 17753/371472 [1:25:48<27:41:48,  3.55it/s]
  5%|▍         | 17754/371472 [1:25:49<27:27:47,  3.58it/s]
  5%|▍         | 17755/371472 [1:25:49<28:07:26,  3.49it/s]
  5%|▍         | 17756/371472 [1:25:49<27:56:26,  3.52it/s]
  5%|▍         | 17757/371472 [1:25:50<27:09:27,  3.62it/s]
  5%|▍         | 17758/371472 [1:25:50<27:53:37,  3.52it/s]
  5%|▍         | 17759/371472 [1:25:50<30:20:55,  3.24it/s]
  5%|▍         | 17760/371472 [1:25:51<29:35:58,  3.32it/s]
                                                           
{'loss': 4.6331, 'learning_rate': 9.57432825529531e-07, 'epoch': 0.76}

  5%|▍         | 17760/371472 [1:25:51<29:35:58,  3.32it/s]
  5%|▍         | 17761/371472 [1:25:51<29:27:07,  3.34it/s]
  5%|▍         | 17762/371472 [1:25:51<28:17:50,  3.47it/s]
  5%|▍         | 17763/371472 [1:25:51<28:55:22,  3.40it/s]
  5%|▍         | 17764/371472 [1:25:52<27:56:17,  3.52it/s]
  5%|▍         | 17765/371472 [1:25:52<27:02:56,  3.63it/s]
  5%|▍         | 17766/371472 [1:25:52<27:44:13,  3.54it/s]
  5%|▍         | 17767/371472 [1:25:53<28:16:09,  3.48it/s]
  5%|▍         | 17768/371472 [1:25:53<27:25:05,  3.58it/s]
  5%|▍         | 17769/371472 [1:25:53<27:13:21,  3.61it/s]
  5%|▍         | 17770/371472 [1:25:53<27:25:57,  3.58it/s]
  5%|▍         | 17771/371472 [1:25:54<27:31:02,  3.57it/s]
  5%|▍         | 17772/371472 [1:25:54<26:55:37,  3.65it/s]
  5%|▍         | 17773/371472 [1:25:54<27:15:41,  3.60it/s]
  5%|▍         | 17774/371472 [1:25:54<26:58:11,  3.64it/s]
  5%|▍         | 17775/371472 [1:25:55<27:30:22,  3.57it/s]
  5%|▍         | 17776/371472 [1:25:55<27:50:35,  3.53it/s]
  5%|▍         | 17777/371472 [1:25:55<28:49:09,  3.41it/s]
  5%|▍         | 17778/371472 [1:25:56<28:02:03,  3.50it/s]
  5%|▍         | 17779/371472 [1:25:56<27:11:46,  3.61it/s]
  5%|▍         | 17780/371472 [1:25:56<28:35:59,  3.44it/s]
                                                           
{'loss': 4.7533, 'learning_rate': 9.573843435540519e-07, 'epoch': 0.77}

  5%|▍         | 17780/371472 [1:25:56<28:35:59,  3.44it/s]
  5%|▍         | 17781/371472 [1:25:56<28:22:00,  3.46it/s]
  5%|▍         | 17782/371472 [1:25:57<28:08:08,  3.49it/s]
  5%|▍         | 17783/371472 [1:25:57<27:21:48,  3.59it/s]
  5%|▍         | 17784/371472 [1:25:57<27:04:01,  3.63it/s]
  5%|▍         | 17785/371472 [1:25:58<26:40:30,  3.68it/s]
  5%|▍         | 17786/371472 [1:25:58<26:27:33,  3.71it/s]
  5%|▍         | 17787/371472 [1:25:58<25:52:16,  3.80it/s]
  5%|▍         | 17788/371472 [1:25:58<28:28:32,  3.45it/s]
  5%|▍         | 17789/371472 [1:25:59<28:00:58,  3.51it/s]
  5%|▍         | 17790/371472 [1:25:59<29:17:25,  3.35it/s]
  5%|▍         | 17791/371472 [1:25:59<28:23:46,  3.46it/s]
  5%|▍         | 17792/371472 [1:26:00<29:28:57,  3.33it/s]
  5%|▍         | 17793/371472 [1:26:00<28:04:57,  3.50it/s]
  5%|▍         | 17794/371472 [1:26:00<27:13:24,  3.61it/s]
  5%|▍         | 17795/371472 [1:26:00<27:41:30,  3.55it/s]
  5%|▍         | 17796/371472 [1:26:01<26:51:58,  3.66it/s]
  5%|▍         | 17797/371472 [1:26:01<35:58:03,  2.73it/s]
  5%|▍         | 17798/371472 [1:26:02<34:49:25,  2.82it/s]
  5%|▍         | 17799/371472 [1:26:02<32:33:15,  3.02it/s]
  5%|▍         | 17800/371472 [1:26:02<30:22:05,  3.24it/s]
                                                           
{'loss': 4.4459, 'learning_rate': 9.573358615785731e-07, 'epoch': 0.77}

  5%|▍         | 17800/371472 [1:26:02<30:22:05,  3.24it/s]
  5%|▍         | 17801/371472 [1:26:02<29:20:40,  3.35it/s]
  5%|▍         | 17802/371472 [1:26:03<28:29:18,  3.45it/s]
  5%|▍         | 17803/371472 [1:26:03<27:34:38,  3.56it/s]
  5%|▍         | 17804/371472 [1:26:03<27:54:09,  3.52it/s]
  5%|▍         | 17805/371472 [1:26:03<27:17:30,  3.60it/s]
  5%|▍         | 17806/371472 [1:26:04<26:19:30,  3.73it/s]
  5%|▍         | 17807/371472 [1:26:04<26:12:53,  3.75it/s]
  5%|▍         | 17808/371472 [1:26:04<26:47:15,  3.67it/s]
  5%|▍         | 17809/371472 [1:26:05<28:35:48,  3.44it/s]
  5%|▍         | 17810/371472 [1:26:05<28:28:25,  3.45it/s]
  5%|▍         | 17811/371472 [1:26:05<29:28:55,  3.33it/s]
  5%|▍         | 17812/371472 [1:26:06<30:45:56,  3.19it/s]
  5%|▍         | 17813/371472 [1:26:06<29:04:01,  3.38it/s]
  5%|▍         | 17814/371472 [1:26:06<28:20:14,  3.47it/s]
  5%|▍         | 17815/371472 [1:26:06<28:31:36,  3.44it/s]
  5%|▍         | 17816/371472 [1:26:07<27:17:53,  3.60it/s]
  5%|▍         | 17817/371472 [1:26:07<27:01:38,  3.63it/s]
  5%|▍         | 17818/371472 [1:26:07<26:44:47,  3.67it/s]
  5%|▍         | 17819/371472 [1:26:08<30:13:13,  3.25it/s]
  5%|▍         | 17820/371472 [1:26:08<28:41:39,  3.42it/s]
                                                           
{'loss': 4.5337, 'learning_rate': 9.572873796030942e-07, 'epoch': 0.77}

  5%|▍         | 17820/371472 [1:26:08<28:41:39,  3.42it/s]
  5%|▍         | 17821/371472 [1:26:08<28:19:24,  3.47it/s]
  5%|▍         | 17822/371472 [1:26:08<28:57:17,  3.39it/s]
  5%|▍         | 17823/371472 [1:26:09<30:11:41,  3.25it/s]
  5%|▍         | 17824/371472 [1:26:09<31:02:20,  3.16it/s]
  5%|▍         | 17825/371472 [1:26:09<29:12:31,  3.36it/s]
  5%|▍         | 17826/371472 [1:26:10<28:29:50,  3.45it/s]
  5%|▍         | 17827/371472 [1:26:10<29:07:38,  3.37it/s]
  5%|▍         | 17828/371472 [1:26:10<28:19:18,  3.47it/s]
  5%|▍         | 17829/371472 [1:26:11<30:28:07,  3.22it/s]
  5%|▍         | 17830/371472 [1:26:11<32:37:27,  3.01it/s]
  5%|▍         | 17831/371472 [1:26:11<30:38:44,  3.21it/s]
  5%|▍         | 17832/371472 [1:26:11<28:46:05,  3.41it/s]
  5%|▍         | 17833/371472 [1:26:12<28:20:56,  3.47it/s]
  5%|▍         | 17834/371472 [1:26:12<27:56:31,  3.52it/s]
  5%|▍         | 17835/371472 [1:26:12<28:48:49,  3.41it/s]
  5%|▍         | 17836/371472 [1:26:13<27:44:26,  3.54it/s]
  5%|▍         | 17837/371472 [1:26:13<26:51:14,  3.66it/s]
  5%|▍         | 17838/371472 [1:26:13<26:53:27,  3.65it/s]
  5%|▍         | 17839/371472 [1:26:13<26:49:34,  3.66it/s]
  5%|▍         | 17840/371472 [1:26:14<26:33:50,  3.70it/s]
                                                           
{'loss': 4.6425, 'learning_rate': 9.572388976276153e-07, 'epoch': 0.77}

  5%|▍         | 17840/371472 [1:26:14<26:33:50,  3.70it/s]
  5%|▍         | 17841/371472 [1:26:14<26:06:12,  3.76it/s]
  5%|▍         | 17842/371472 [1:26:14<25:35:35,  3.84it/s]
  5%|▍         | 17843/371472 [1:26:14<28:18:57,  3.47it/s]
  5%|▍         | 17844/371472 [1:26:15<28:20:47,  3.47it/s]
  5%|▍         | 17845/371472 [1:26:15<28:41:33,  3.42it/s]
  5%|▍         | 17846/371472 [1:26:15<29:46:44,  3.30it/s]
  5%|▍         | 17847/371472 [1:26:16<28:35:01,  3.44it/s]
  5%|▍         | 17848/371472 [1:26:16<28:19:27,  3.47it/s]
  5%|▍         | 17849/371472 [1:26:16<27:32:54,  3.57it/s]
  5%|▍         | 17850/371472 [1:26:16<27:19:48,  3.59it/s]
  5%|▍         | 17851/371472 [1:26:17<27:35:20,  3.56it/s]
  5%|▍         | 17852/371472 [1:26:17<28:27:10,  3.45it/s]
  5%|▍         | 17853/371472 [1:26:17<28:16:37,  3.47it/s]
  5%|▍         | 17854/371472 [1:26:18<29:22:01,  3.34it/s]
  5%|▍         | 17855/371472 [1:26:18<27:55:13,  3.52it/s]
  5%|▍         | 17856/371472 [1:26:18<27:37:37,  3.56it/s]
  5%|▍         | 17857/371472 [1:26:18<27:49:55,  3.53it/s]
  5%|▍         | 17858/371472 [1:26:19<27:52:35,  3.52it/s]
  5%|▍         | 17859/371472 [1:26:19<28:13:04,  3.48it/s]
  5%|▍         | 17860/371472 [1:26:19<28:33:02,  3.44it/s]
                                                           
{'loss': 4.4908, 'learning_rate': 9.571904156521364e-07, 'epoch': 0.77}

  5%|▍         | 17860/371472 [1:26:19<28:33:02,  3.44it/s]
  5%|▍         | 17861/371472 [1:26:20<27:37:21,  3.56it/s]
  5%|▍         | 17862/371472 [1:26:20<27:33:20,  3.56it/s]
  5%|▍         | 17863/371472 [1:26:20<27:44:23,  3.54it/s]
  5%|▍         | 17864/371472 [1:26:20<26:59:34,  3.64it/s]
  5%|▍         | 17865/371472 [1:26:21<26:59:35,  3.64it/s]
  5%|▍         | 17866/371472 [1:26:21<26:42:53,  3.68it/s]
  5%|▍         | 17867/371472 [1:26:21<32:39:07,  3.01it/s]
  5%|▍         | 17868/371472 [1:26:22<31:08:54,  3.15it/s]
  5%|▍         | 17869/371472 [1:26:22<29:52:47,  3.29it/s]
  5%|▍         | 17870/371472 [1:26:22<29:10:23,  3.37it/s]
  5%|▍         | 17871/371472 [1:26:23<28:13:51,  3.48it/s]
  5%|▍         | 17872/371472 [1:26:23<28:18:05,  3.47it/s]
  5%|▍         | 17873/371472 [1:26:23<27:33:21,  3.56it/s]
  5%|▍         | 17874/371472 [1:26:23<28:53:59,  3.40it/s]
  5%|▍         | 17875/371472 [1:26:24<28:17:06,  3.47it/s]
  5%|▍         | 17876/371472 [1:26:24<28:55:57,  3.39it/s]
  5%|▍         | 17877/371472 [1:26:24<29:21:40,  3.35it/s]
  5%|▍         | 17878/371472 [1:26:25<29:02:15,  3.38it/s]
  5%|▍         | 17879/371472 [1:26:25<28:11:34,  3.48it/s]
  5%|▍         | 17880/371472 [1:26:25<27:31:39,  3.57it/s]
                                                           
{'loss': 4.6324, 'learning_rate': 9.571419336766574e-07, 'epoch': 0.77}

  5%|▍         | 17880/371472 [1:26:25<27:31:39,  3.57it/s]
  5%|▍         | 17881/371472 [1:26:25<27:17:01,  3.60it/s]
  5%|▍         | 17882/371472 [1:26:26<28:03:59,  3.50it/s]
  5%|▍         | 17883/371472 [1:26:26<27:08:40,  3.62it/s]
  5%|▍         | 17884/371472 [1:26:26<26:55:21,  3.65it/s]
  5%|▍         | 17885/371472 [1:26:27<26:11:58,  3.75it/s]
  5%|▍         | 17886/371472 [1:26:27<26:01:22,  3.77it/s]
  5%|▍         | 17887/371472 [1:26:27<25:45:08,  3.81it/s]
  5%|▍         | 17888/371472 [1:26:27<26:00:46,  3.78it/s]
  5%|▍         | 17889/371472 [1:26:28<28:46:26,  3.41it/s]
  5%|▍         | 17890/371472 [1:26:28<27:23:43,  3.59it/s]
  5%|▍         | 17891/371472 [1:26:28<29:33:18,  3.32it/s]
  5%|▍         | 17892/371472 [1:26:29<28:25:05,  3.46it/s]
  5%|▍         | 17893/371472 [1:26:29<28:16:15,  3.47it/s]
  5%|▍         | 17894/371472 [1:26:29<30:09:31,  3.26it/s]
  5%|▍         | 17895/371472 [1:26:29<30:53:30,  3.18it/s]
  5%|▍         | 17896/371472 [1:26:30<33:06:34,  2.97it/s]
  5%|▍         | 17897/371472 [1:26:30<30:53:49,  3.18it/s]
  5%|▍         | 17898/371472 [1:26:30<30:14:02,  3.25it/s]
  5%|▍         | 17899/371472 [1:26:31<29:00:27,  3.39it/s]
  5%|▍         | 17900/371472 [1:26:31<28:36:57,  3.43it/s]
                                                           
{'loss': 4.5503, 'learning_rate': 9.570934517011787e-07, 'epoch': 0.77}

  5%|▍         | 17900/371472 [1:26:31<28:36:57,  3.43it/s]
  5%|▍         | 17901/371472 [1:26:31<30:35:49,  3.21it/s]
  5%|▍         | 17902/371472 [1:26:32<30:43:42,  3.20it/s]
  5%|▍         | 17903/371472 [1:26:32<29:54:58,  3.28it/s]
  5%|▍         | 17904/371472 [1:26:32<32:02:24,  3.07it/s]
  5%|▍         | 17905/371472 [1:26:33<33:05:47,  2.97it/s]
  5%|▍         | 17906/371472 [1:26:33<31:17:42,  3.14it/s]
  5%|▍         | 17907/371472 [1:26:33<30:51:39,  3.18it/s]
  5%|▍         | 17908/371472 [1:26:34<28:43:56,  3.42it/s]
  5%|▍         | 17909/371472 [1:26:34<27:57:25,  3.51it/s]
  5%|▍         | 17910/371472 [1:26:34<28:31:36,  3.44it/s]
  5%|▍         | 17911/371472 [1:26:34<28:12:10,  3.48it/s]
  5%|▍         | 17912/371472 [1:26:35<27:30:52,  3.57it/s]
  5%|▍         | 17913/371472 [1:26:35<27:38:19,  3.55it/s]
  5%|▍         | 17914/371472 [1:26:35<26:55:46,  3.65it/s]
  5%|▍         | 17915/371472 [1:26:35<26:26:27,  3.71it/s]
  5%|▍         | 17916/371472 [1:26:36<27:45:31,  3.54it/s]
  5%|▍         | 17917/371472 [1:26:36<26:34:50,  3.69it/s]
  5%|▍         | 17918/371472 [1:26:36<26:49:29,  3.66it/s]
  5%|▍         | 17919/371472 [1:26:37<26:21:19,  3.73it/s]
  5%|▍         | 17920/371472 [1:26:37<29:00:19,  3.39it/s]
                                                           
{'loss': 4.3948, 'learning_rate': 9.570449697256998e-07, 'epoch': 0.77}

  5%|▍         | 17920/371472 [1:26:37<29:00:19,  3.39it/s]
  5%|▍         | 17921/371472 [1:26:37<29:22:50,  3.34it/s]
  5%|▍         | 17922/371472 [1:26:37<30:01:41,  3.27it/s]
  5%|▍         | 17923/371472 [1:26:38<28:41:46,  3.42it/s]
  5%|▍         | 17924/371472 [1:26:38<28:07:05,  3.49it/s]
  5%|▍         | 17925/371472 [1:26:38<28:10:13,  3.49it/s]
  5%|▍         | 17926/371472 [1:26:39<27:17:30,  3.60it/s]
  5%|▍         | 17927/371472 [1:26:39<26:33:08,  3.70it/s]
  5%|▍         | 17928/371472 [1:26:39<28:01:27,  3.50it/s]
  5%|▍         | 17929/371472 [1:26:39<27:41:49,  3.55it/s]
  5%|▍         | 17930/371472 [1:26:40<29:17:05,  3.35it/s]
  5%|▍         | 17931/371472 [1:26:40<29:21:42,  3.34it/s]
  5%|▍         | 17932/371472 [1:26:40<29:15:40,  3.36it/s]
  5%|▍         | 17933/371472 [1:26:41<28:58:29,  3.39it/s]
  5%|▍         | 17934/371472 [1:26:41<28:02:23,  3.50it/s]
  5%|▍         | 17935/371472 [1:26:41<29:06:06,  3.37it/s]
  5%|▍         | 17936/371472 [1:26:42<29:07:01,  3.37it/s]
  5%|▍         | 17937/371472 [1:26:42<29:17:56,  3.35it/s]
  5%|▍         | 17938/371472 [1:26:42<28:59:34,  3.39it/s]
  5%|▍         | 17939/371472 [1:26:42<28:48:08,  3.41it/s]
  5%|▍         | 17940/371472 [1:26:43<28:05:27,  3.50it/s]
                                                           
{'loss': 4.7714, 'learning_rate': 9.569964877502209e-07, 'epoch': 0.77}

  5%|▍         | 17940/371472 [1:26:43<28:05:27,  3.50it/s]
  5%|▍         | 17941/371472 [1:26:43<28:03:53,  3.50it/s]
  5%|▍         | 17942/371472 [1:26:43<29:36:04,  3.32it/s]
  5%|▍         | 17943/371472 [1:26:44<29:13:53,  3.36it/s]
  5%|▍         | 17944/371472 [1:26:44<28:25:59,  3.45it/s]
  5%|▍         | 17945/371472 [1:26:44<27:40:43,  3.55it/s]
  5%|▍         | 17946/371472 [1:26:44<27:29:18,  3.57it/s]
  5%|▍         | 17947/371472 [1:26:45<27:14:24,  3.61it/s]
  5%|▍         | 17948/371472 [1:26:45<27:39:25,  3.55it/s]
  5%|▍         | 17949/371472 [1:26:45<27:26:13,  3.58it/s]
  5%|▍         | 17950/371472 [1:26:46<28:18:41,  3.47it/s]
  5%|▍         | 17951/371472 [1:26:46<27:11:06,  3.61it/s]
  5%|▍         | 17952/371472 [1:26:46<26:45:20,  3.67it/s]
  5%|▍         | 17953/371472 [1:26:46<26:42:08,  3.68it/s]
  5%|▍         | 17954/371472 [1:26:47<27:27:10,  3.58it/s]
  5%|▍         | 17955/371472 [1:26:47<26:31:36,  3.70it/s]
  5%|▍         | 17956/371472 [1:26:47<25:51:26,  3.80it/s]
  5%|▍         | 17957/371472 [1:26:47<28:59:13,  3.39it/s]
  5%|▍         | 17958/371472 [1:26:48<28:10:26,  3.49it/s]
  5%|▍         | 17959/371472 [1:26:48<28:35:44,  3.43it/s]
  5%|▍         | 17960/371472 [1:26:48<27:19:27,  3.59it/s]
                                                           
{'loss': 4.4958, 'learning_rate': 9.56948005774742e-07, 'epoch': 0.77}

  5%|▍         | 17960/371472 [1:26:48<27:19:27,  3.59it/s]
  5%|▍         | 17961/371472 [1:26:49<27:15:56,  3.60it/s]
  5%|▍         | 17962/371472 [1:26:49<27:58:25,  3.51it/s]
  5%|▍         | 17963/371472 [1:26:49<27:14:30,  3.60it/s]
  5%|▍         | 17964/371472 [1:26:49<27:21:09,  3.59it/s]
  5%|▍         | 17965/371472 [1:26:50<29:16:31,  3.35it/s]
  5%|▍         | 17966/371472 [1:26:50<28:21:37,  3.46it/s]
  5%|▍         | 17967/371472 [1:26:51<33:59:42,  2.89it/s]
  5%|▍         | 17968/371472 [1:26:51<31:42:29,  3.10it/s]
  5%|▍         | 17969/371472 [1:26:51<30:34:25,  3.21it/s]
  5%|▍         | 17970/371472 [1:26:51<29:08:08,  3.37it/s]
  5%|▍         | 17971/371472 [1:26:52<28:58:37,  3.39it/s]
  5%|▍         | 17972/371472 [1:26:52<27:20:41,  3.59it/s]
  5%|▍         | 17973/371472 [1:26:52<28:43:54,  3.42it/s]
  5%|▍         | 17974/371472 [1:26:52<27:59:42,  3.51it/s]
  5%|▍         | 17975/371472 [1:26:53<27:35:05,  3.56it/s]
  5%|▍         | 17976/371472 [1:26:53<27:28:20,  3.57it/s]
  5%|▍         | 17977/371472 [1:26:53<28:43:20,  3.42it/s]
  5%|▍         | 17978/371472 [1:26:54<29:10:19,  3.37it/s]
  5%|▍         | 17979/371472 [1:26:54<29:00:49,  3.38it/s]
  5%|▍         | 17980/371472 [1:26:54<30:13:10,  3.25it/s]
                                                           
{'loss': 4.8341, 'learning_rate': 9.56899523799263e-07, 'epoch': 0.77}

  5%|▍         | 17980/371472 [1:26:54<30:13:10,  3.25it/s]
  5%|▍         | 17981/371472 [1:26:55<29:30:06,  3.33it/s]
  5%|▍         | 17982/371472 [1:26:55<28:50:12,  3.41it/s]
  5%|▍         | 17983/371472 [1:26:55<28:33:19,  3.44it/s]
  5%|▍         | 17984/371472 [1:26:55<28:27:09,  3.45it/s]
  5%|▍         | 17985/371472 [1:26:56<28:19:42,  3.47it/s]
  5%|▍         | 17986/371472 [1:26:56<28:30:39,  3.44it/s]
  5%|▍         | 17987/371472 [1:26:56<27:45:06,  3.54it/s]
  5%|▍         | 17988/371472 [1:26:57<27:47:12,  3.53it/s]
  5%|▍         | 17989/371472 [1:26:57<27:48:49,  3.53it/s]
  5%|▍         | 17990/371472 [1:26:57<27:48:12,  3.53it/s]
  5%|▍         | 17991/371472 [1:26:57<26:55:58,  3.65it/s]
  5%|▍         | 17992/371472 [1:26:58<27:37:56,  3.55it/s]
  5%|▍         | 17993/371472 [1:26:58<26:58:42,  3.64it/s]
  5%|▍         | 17994/371472 [1:26:58<26:09:34,  3.75it/s]
  5%|▍         | 17995/371472 [1:26:58<26:49:37,  3.66it/s]
  5%|▍         | 17996/371472 [1:26:59<28:39:48,  3.43it/s]
  5%|▍         | 17997/371472 [1:26:59<29:36:58,  3.32it/s]
  5%|▍         | 17998/371472 [1:26:59<28:59:51,  3.39it/s]
  5%|▍         | 17999/371472 [1:27:00<31:44:10,  3.09it/s]
  5%|▍         | 18000/371472 [1:27:00<30:04:02,  3.27it/s]
                                                           
{'loss': 4.8692, 'learning_rate': 9.56851041823784e-07, 'epoch': 0.78}

  5%|▍         | 18000/371472 [1:27:00<30:04:02,  3.27it/s]
  5%|▍         | 18001/371472 [1:27:00<29:20:27,  3.35it/s]
  5%|▍         | 18002/371472 [1:27:01<30:57:28,  3.17it/s]
  5%|▍         | 18003/371472 [1:27:01<30:38:02,  3.21it/s]
  5%|▍         | 18004/371472 [1:27:01<31:46:19,  3.09it/s]
  5%|▍         | 18005/371472 [1:27:02<30:07:59,  3.26it/s]
  5%|▍         | 18006/371472 [1:27:02<30:45:29,  3.19it/s]
  5%|▍         | 18007/371472 [1:27:02<29:38:45,  3.31it/s]
  5%|▍         | 18008/371472 [1:27:02<28:13:44,  3.48it/s]
  5%|▍         | 18009/371472 [1:27:03<27:40:06,  3.55it/s]
  5%|▍         | 18010/371472 [1:27:03<29:57:31,  3.28it/s]
  5%|▍         | 18011/371472 [1:27:03<29:23:57,  3.34it/s]
  5%|▍         | 18012/371472 [1:27:04<29:08:31,  3.37it/s]
  5%|▍         | 18013/371472 [1:27:04<30:01:17,  3.27it/s]
  5%|▍         | 18014/371472 [1:27:04<29:51:34,  3.29it/s]
  5%|▍         | 18015/371472 [1:27:05<29:31:52,  3.32it/s]
  5%|▍         | 18016/371472 [1:27:05<29:09:53,  3.37it/s]
  5%|▍         | 18017/371472 [1:27:05<29:47:47,  3.30it/s]
  5%|▍         | 18018/371472 [1:27:05<28:27:55,  3.45it/s]
  5%|▍         | 18019/371472 [1:27:06<30:45:22,  3.19it/s]
  5%|▍         | 18020/371472 [1:27:06<29:32:28,  3.32it/s]
                                                           
{'loss': 4.5919, 'learning_rate': 9.568025598483051e-07, 'epoch': 0.78}

  5%|▍         | 18020/371472 [1:27:06<29:32:28,  3.32it/s]
  5%|▍         | 18021/371472 [1:27:06<28:38:22,  3.43it/s]
  5%|▍         | 18022/371472 [1:27:07<28:02:46,  3.50it/s]
  5%|▍         | 18023/371472 [1:27:07<29:12:07,  3.36it/s]
  5%|▍         | 18024/371472 [1:27:07<28:17:06,  3.47it/s]
  5%|▍         | 18025/371472 [1:27:07<27:27:46,  3.58it/s]
  5%|▍         | 18026/371472 [1:27:08<26:43:58,  3.67it/s]
  5%|▍         | 18027/371472 [1:27:08<28:49:22,  3.41it/s]
  5%|▍         | 18028/371472 [1:27:08<27:44:35,  3.54it/s]
  5%|▍         | 18029/371472 [1:27:09<27:52:02,  3.52it/s]
  5%|▍         | 18030/371472 [1:27:09<27:59:36,  3.51it/s]
  5%|▍         | 18031/371472 [1:27:09<28:54:57,  3.40it/s]
  5%|▍         | 18032/371472 [1:27:10<29:37:51,  3.31it/s]
  5%|▍         | 18033/371472 [1:27:10<28:32:07,  3.44it/s]
  5%|▍         | 18034/371472 [1:27:10<30:35:06,  3.21it/s]
  5%|▍         | 18035/371472 [1:27:10<30:40:34,  3.20it/s]
  5%|▍         | 18036/371472 [1:27:11<29:18:28,  3.35it/s]
  5%|▍         | 18037/371472 [1:27:11<29:02:37,  3.38it/s]
  5%|▍         | 18038/371472 [1:27:11<27:58:47,  3.51it/s]
  5%|▍         | 18039/371472 [1:27:12<27:18:39,  3.59it/s]
  5%|▍         | 18040/371472 [1:27:12<27:00:27,  3.64it/s]
                                                           
{'loss': 4.5073, 'learning_rate': 9.567540778728264e-07, 'epoch': 0.78}

  5%|▍         | 18040/371472 [1:27:12<27:00:27,  3.64it/s]
  5%|▍         | 18041/371472 [1:27:12<26:30:43,  3.70it/s]
  5%|▍         | 18042/371472 [1:27:12<27:52:31,  3.52it/s]
  5%|▍         | 18043/371472 [1:27:13<27:14:46,  3.60it/s]
  5%|▍         | 18044/371472 [1:27:13<27:53:39,  3.52it/s]
  5%|▍         | 18045/371472 [1:27:13<27:34:20,  3.56it/s]
  5%|▍         | 18046/371472 [1:27:13<27:19:10,  3.59it/s]
  5%|▍         | 18047/371472 [1:27:14<26:59:40,  3.64it/s]
  5%|▍         | 18048/371472 [1:27:14<27:29:32,  3.57it/s]
  5%|▍         | 18049/371472 [1:27:14<27:41:41,  3.54it/s]
  5%|▍         | 18050/371472 [1:27:15<29:25:44,  3.34it/s]
  5%|▍         | 18051/371472 [1:27:15<28:46:45,  3.41it/s]
  5%|▍         | 18052/371472 [1:27:15<27:44:38,  3.54it/s]
  5%|▍         | 18053/371472 [1:27:15<27:23:16,  3.58it/s]
  5%|▍         | 18054/371472 [1:27:16<27:53:25,  3.52it/s]
  5%|▍         | 18055/371472 [1:27:16<27:55:53,  3.51it/s]
  5%|▍         | 18056/371472 [1:27:16<28:26:51,  3.45it/s]
  5%|▍         | 18057/371472 [1:27:17<27:41:23,  3.55it/s]
  5%|▍         | 18058/371472 [1:27:17<28:12:49,  3.48it/s]
  5%|▍         | 18059/371472 [1:27:17<27:25:52,  3.58it/s]
  5%|▍         | 18060/371472 [1:27:18<29:43:37,  3.30it/s]
                                                           
{'loss': 4.541, 'learning_rate': 9.567055958973475e-07, 'epoch': 0.78}

  5%|▍         | 18060/371472 [1:27:18<29:43:37,  3.30it/s]
  5%|▍         | 18061/371472 [1:27:18<28:40:41,  3.42it/s]
  5%|▍         | 18062/371472 [1:27:18<28:47:00,  3.41it/s]
  5%|▍         | 18063/371472 [1:27:18<29:18:26,  3.35it/s]
  5%|▍         | 18064/371472 [1:27:19<27:53:21,  3.52it/s]
  5%|▍         | 18065/371472 [1:27:19<28:27:30,  3.45it/s]
  5%|▍         | 18066/371472 [1:27:19<29:50:08,  3.29it/s]
  5%|▍         | 18067/371472 [1:27:20<29:11:27,  3.36it/s]
  5%|▍         | 18068/371472 [1:27:20<28:15:00,  3.47it/s]
  5%|▍         | 18069/371472 [1:27:20<28:49:11,  3.41it/s]
  5%|▍         | 18070/371472 [1:27:20<29:24:43,  3.34it/s]
  5%|▍         | 18071/371472 [1:27:21<29:12:14,  3.36it/s]
  5%|▍         | 18072/371472 [1:27:21<27:58:05,  3.51it/s]
  5%|▍         | 18073/371472 [1:27:21<29:06:15,  3.37it/s]
  5%|▍         | 18074/371472 [1:27:22<29:33:35,  3.32it/s]
  5%|▍         | 18075/371472 [1:27:22<28:42:04,  3.42it/s]
  5%|▍         | 18076/371472 [1:27:22<28:15:45,  3.47it/s]
  5%|▍         | 18077/371472 [1:27:23<28:15:44,  3.47it/s]
  5%|▍         | 18078/371472 [1:27:23<28:24:54,  3.45it/s]
  5%|▍         | 18079/371472 [1:27:23<27:29:32,  3.57it/s]
  5%|▍         | 18080/371472 [1:27:23<27:51:23,  3.52it/s]
                                                           
{'loss': 4.5663, 'learning_rate': 9.566571139218686e-07, 'epoch': 0.78}

  5%|▍         | 18080/371472 [1:27:23<27:51:23,  3.52it/s]
  5%|▍         | 18081/371472 [1:27:24<27:11:39,  3.61it/s]
  5%|▍         | 18082/371472 [1:27:24<26:47:29,  3.66it/s]
  5%|▍         | 18083/371472 [1:27:24<27:06:20,  3.62it/s]
  5%|▍         | 18084/371472 [1:27:24<27:17:37,  3.60it/s]
  5%|▍         | 18085/371472 [1:27:25<27:08:41,  3.62it/s]
  5%|▍         | 18086/371472 [1:27:25<28:15:32,  3.47it/s]
  5%|▍         | 18087/371472 [1:27:25<27:55:55,  3.51it/s]
  5%|▍         | 18088/371472 [1:27:26<27:49:21,  3.53it/s]
  5%|▍         | 18089/371472 [1:27:26<27:42:34,  3.54it/s]
  5%|▍         | 18090/371472 [1:27:26<27:36:19,  3.56it/s]
  5%|▍         | 18091/371472 [1:27:26<27:51:03,  3.52it/s]
  5%|▍         | 18092/371472 [1:27:27<27:32:46,  3.56it/s]
  5%|▍         | 18093/371472 [1:27:27<27:16:39,  3.60it/s]
  5%|▍         | 18094/371472 [1:27:27<28:17:25,  3.47it/s]
  5%|▍         | 18095/371472 [1:27:28<28:13:32,  3.48it/s]
  5%|▍         | 18096/371472 [1:27:28<29:24:08,  3.34it/s]
  5%|▍         | 18097/371472 [1:27:28<28:16:32,  3.47it/s]
  5%|▍         | 18098/371472 [1:27:29<29:52:18,  3.29it/s]
  5%|▍         | 18099/371472 [1:27:29<28:59:01,  3.39it/s]
  5%|▍         | 18100/371472 [1:27:29<32:04:57,  3.06it/s]
                                                           
{'loss': 4.4336, 'learning_rate': 9.566086319463896e-07, 'epoch': 0.78}

  5%|▍         | 18100/371472 [1:27:29<32:04:57,  3.06it/s]
  5%|▍         | 18101/371472 [1:27:29<30:25:18,  3.23it/s]
  5%|▍         | 18102/371472 [1:27:30<28:47:59,  3.41it/s]
  5%|▍         | 18103/371472 [1:27:30<28:10:27,  3.48it/s]
  5%|▍         | 18104/371472 [1:27:30<28:51:21,  3.40it/s]
  5%|▍         | 18105/371472 [1:27:31<28:44:19,  3.42it/s]
  5%|▍         | 18106/371472 [1:27:31<28:21:47,  3.46it/s]
  5%|▍         | 18107/371472 [1:27:31<28:58:14,  3.39it/s]
  5%|▍         | 18108/371472 [1:27:31<29:12:32,  3.36it/s]
  5%|▍         | 18109/371472 [1:27:32<28:38:02,  3.43it/s]
  5%|▍         | 18110/371472 [1:27:32<32:30:31,  3.02it/s]
  5%|▍         | 18111/371472 [1:27:32<30:39:50,  3.20it/s]
  5%|▍         | 18112/371472 [1:27:33<29:44:16,  3.30it/s]
  5%|▍         | 18113/371472 [1:27:33<28:56:34,  3.39it/s]
  5%|▍         | 18114/371472 [1:27:33<28:16:15,  3.47it/s]
  5%|▍         | 18115/371472 [1:27:34<29:39:10,  3.31it/s]
  5%|▍         | 18116/371472 [1:27:34<30:06:25,  3.26it/s]
  5%|▍         | 18117/371472 [1:27:34<29:44:00,  3.30it/s]
  5%|▍         | 18118/371472 [1:27:35<29:03:40,  3.38it/s]
  5%|▍         | 18119/371472 [1:27:35<27:41:00,  3.55it/s]
  5%|▍         | 18120/371472 [1:27:35<28:22:25,  3.46it/s]
                                                           
{'loss': 4.4726, 'learning_rate': 9.565601499709107e-07, 'epoch': 0.78}

  5%|▍         | 18120/371472 [1:27:35<28:22:25,  3.46it/s]
  5%|▍         | 18121/371472 [1:27:35<28:25:17,  3.45it/s]
  5%|▍         | 18122/371472 [1:27:36<28:36:22,  3.43it/s]
  5%|▍         | 18123/371472 [1:27:36<27:44:08,  3.54it/s]
  5%|▍         | 18124/371472 [1:27:36<27:23:51,  3.58it/s]
  5%|▍         | 18125/371472 [1:27:36<27:45:15,  3.54it/s]
  5%|▍         | 18126/371472 [1:27:37<27:01:02,  3.63it/s]
  5%|▍         | 18127/371472 [1:27:37<26:36:56,  3.69it/s]
  5%|▍         | 18128/371472 [1:27:37<26:06:27,  3.76it/s]
  5%|▍         | 18129/371472 [1:27:38<25:55:53,  3.78it/s]
  5%|▍         | 18130/371472 [1:27:38<26:08:11,  3.76it/s]
  5%|▍         | 18131/371472 [1:27:38<32:04:39,  3.06it/s]
  5%|▍         | 18132/371472 [1:27:39<30:49:35,  3.18it/s]
  5%|▍         | 18133/371472 [1:27:39<29:57:54,  3.28it/s]
  5%|▍         | 18134/371472 [1:27:39<29:51:31,  3.29it/s]
  5%|▍         | 18135/371472 [1:27:39<29:04:28,  3.38it/s]
  5%|▍         | 18136/371472 [1:27:40<30:50:28,  3.18it/s]
  5%|▍         | 18137/371472 [1:27:40<30:34:50,  3.21it/s]
  5%|▍         | 18138/371472 [1:27:40<29:10:45,  3.36it/s]
  5%|▍         | 18139/371472 [1:27:41<28:05:23,  3.49it/s]
  5%|▍         | 18140/371472 [1:27:41<28:05:45,  3.49it/s]
                                                           
{'loss': 4.5123, 'learning_rate': 9.56511667995432e-07, 'epoch': 0.78}

  5%|▍         | 18140/371472 [1:27:41<28:05:45,  3.49it/s]
  5%|▍         | 18141/371472 [1:27:41<28:03:59,  3.50it/s]
  5%|▍         | 18142/371472 [1:27:41<26:50:00,  3.66it/s]
  5%|▍         | 18143/371472 [1:27:42<27:14:03,  3.60it/s]
  5%|▍         | 18144/371472 [1:27:42<27:07:29,  3.62it/s]
  5%|▍         | 18145/371472 [1:27:42<28:49:03,  3.41it/s]
  5%|▍         | 18146/371472 [1:27:43<30:21:56,  3.23it/s]
  5%|▍         | 18147/371472 [1:27:43<31:54:58,  3.08it/s]
  5%|▍         | 18148/371472 [1:27:43<32:09:54,  3.05it/s]
  5%|▍         | 18149/371472 [1:27:44<30:17:47,  3.24it/s]
  5%|▍         | 18150/371472 [1:27:44<29:01:32,  3.38it/s]
  5%|▍         | 18151/371472 [1:27:44<27:57:50,  3.51it/s]
  5%|▍         | 18152/371472 [1:27:44<27:05:50,  3.62it/s]
  5%|▍         | 18153/371472 [1:27:45<26:32:13,  3.70it/s]
  5%|▍         | 18154/371472 [1:27:45<27:49:16,  3.53it/s]
  5%|▍         | 18155/371472 [1:27:45<27:17:05,  3.60it/s]
  5%|▍         | 18156/371472 [1:27:45<26:28:30,  3.71it/s]
  5%|▍         | 18157/371472 [1:27:46<27:15:51,  3.60it/s]
  5%|▍         | 18158/371472 [1:27:46<26:58:57,  3.64it/s]
  5%|▍         | 18159/371472 [1:27:46<28:44:02,  3.42it/s]
  5%|▍         | 18160/371472 [1:27:47<28:09:45,  3.48it/s]
                                                           
{'loss': 4.6115, 'learning_rate': 9.564631860199529e-07, 'epoch': 0.78}

  5%|▍         | 18160/371472 [1:27:47<28:09:45,  3.48it/s]
  5%|▍         | 18161/371472 [1:27:47<29:48:19,  3.29it/s]
  5%|▍         | 18162/371472 [1:27:47<28:41:26,  3.42it/s]
  5%|▍         | 18163/371472 [1:27:48<28:18:45,  3.47it/s]
  5%|▍         | 18164/371472 [1:27:48<28:20:11,  3.46it/s]
  5%|▍         | 18165/371472 [1:27:48<28:01:21,  3.50it/s]
  5%|▍         | 18166/371472 [1:27:48<28:43:20,  3.42it/s]
  5%|▍         | 18167/371472 [1:27:49<29:26:11,  3.33it/s]
  5%|▍         | 18168/371472 [1:27:49<29:15:03,  3.36it/s]
  5%|▍         | 18169/371472 [1:27:49<30:57:52,  3.17it/s]
  5%|▍         | 18170/371472 [1:27:50<30:27:25,  3.22it/s]
  5%|▍         | 18171/371472 [1:27:50<29:09:29,  3.37it/s]
  5%|▍         | 18172/371472 [1:27:50<28:01:48,  3.50it/s]
  5%|▍         | 18173/371472 [1:27:50<27:30:31,  3.57it/s]
  5%|▍         | 18174/371472 [1:27:51<28:00:31,  3.50it/s]
  5%|▍         | 18175/371472 [1:27:51<27:12:49,  3.61it/s]
  5%|▍         | 18176/371472 [1:27:51<27:31:52,  3.56it/s]
  5%|▍         | 18177/371472 [1:27:52<27:23:09,  3.58it/s]
  5%|▍         | 18178/371472 [1:27:52<28:50:42,  3.40it/s]
  5%|▍         | 18179/371472 [1:27:52<29:11:33,  3.36it/s]
  5%|▍         | 18180/371472 [1:27:53<29:42:45,  3.30it/s]
                                                           
{'loss': 4.7271, 'learning_rate': 9.564147040444741e-07, 'epoch': 0.78}

  5%|▍         | 18180/371472 [1:27:53<29:42:45,  3.30it/s]
  5%|▍         | 18181/371472 [1:27:53<28:52:22,  3.40it/s]
  5%|▍         | 18182/371472 [1:27:53<28:32:44,  3.44it/s]
  5%|▍         | 18183/371472 [1:27:53<30:24:29,  3.23it/s]
  5%|▍         | 18184/371472 [1:27:54<28:52:42,  3.40it/s]
  5%|▍         | 18185/371472 [1:27:54<28:46:49,  3.41it/s]
  5%|▍         | 18186/371472 [1:27:54<27:44:20,  3.54it/s]
  5%|▍         | 18187/371472 [1:27:55<27:06:27,  3.62it/s]
  5%|▍         | 18188/371472 [1:27:55<27:03:12,  3.63it/s]
  5%|▍         | 18189/371472 [1:27:55<26:43:45,  3.67it/s]
  5%|▍         | 18190/371472 [1:27:55<27:33:30,  3.56it/s]
  5%|▍         | 18191/371472 [1:27:56<27:34:46,  3.56it/s]
  5%|▍         | 18192/371472 [1:27:56<26:27:38,  3.71it/s]
  5%|▍         | 18193/371472 [1:27:56<29:10:13,  3.36it/s]
  5%|▍         | 18194/371472 [1:27:57<29:03:35,  3.38it/s]
  5%|▍         | 18195/371472 [1:27:57<28:10:56,  3.48it/s]
  5%|▍         | 18196/371472 [1:27:57<27:41:59,  3.54it/s]
  5%|▍         | 18197/371472 [1:27:57<27:41:51,  3.54it/s]
  5%|▍         | 18198/371472 [1:27:58<26:53:53,  3.65it/s]
  5%|▍         | 18199/371472 [1:27:58<26:35:57,  3.69it/s]
  5%|▍         | 18200/371472 [1:27:58<27:04:14,  3.62it/s]
                                                           
{'loss': 4.815, 'learning_rate': 9.563662220689952e-07, 'epoch': 0.78}

  5%|▍         | 18200/371472 [1:27:58<27:04:14,  3.62it/s]
  5%|▍         | 18201/371472 [1:27:58<27:40:59,  3.54it/s]
  5%|▍         | 18202/371472 [1:27:59<27:05:37,  3.62it/s]
  5%|▍         | 18203/371472 [1:27:59<26:37:42,  3.69it/s]
  5%|▍         | 18204/371472 [1:27:59<27:46:22,  3.53it/s]
  5%|▍         | 18205/371472 [1:28:00<27:19:01,  3.59it/s]
  5%|▍         | 18206/371472 [1:28:00<27:39:52,  3.55it/s]
  5%|▍         | 18207/371472 [1:28:00<28:01:23,  3.50it/s]
  5%|▍         | 18208/371472 [1:28:00<27:32:48,  3.56it/s]
  5%|▍         | 18209/371472 [1:28:01<27:35:46,  3.56it/s]
  5%|▍         | 18210/371472 [1:28:01<27:41:10,  3.54it/s]
  5%|▍         | 18211/371472 [1:28:01<27:41:22,  3.54it/s]
  5%|▍         | 18212/371472 [1:28:01<26:43:17,  3.67it/s]
  5%|▍         | 18213/371472 [1:28:02<27:22:09,  3.59it/s]
  5%|▍         | 18214/371472 [1:28:02<26:38:28,  3.68it/s]
  5%|▍         | 18215/371472 [1:28:02<27:04:49,  3.62it/s]
  5%|▍         | 18216/371472 [1:28:03<27:06:01,  3.62it/s]
  5%|▍         | 18217/371472 [1:28:03<27:40:57,  3.54it/s]
  5%|▍         | 18218/371472 [1:28:03<27:41:40,  3.54it/s]
  5%|▍         | 18219/371472 [1:28:03<28:23:06,  3.46it/s]
  5%|▍         | 18220/371472 [1:28:04<28:10:25,  3.48it/s]
                                                           
{'loss': 4.5781, 'learning_rate': 9.563177400935163e-07, 'epoch': 0.78}

  5%|▍         | 18220/371472 [1:28:04<28:10:25,  3.48it/s]
  5%|▍         | 18221/371472 [1:28:04<28:09:24,  3.48it/s]
  5%|▍         | 18222/371472 [1:28:04<28:47:30,  3.41it/s]
  5%|▍         | 18223/371472 [1:28:05<27:45:55,  3.53it/s]
  5%|▍         | 18224/371472 [1:28:05<27:39:09,  3.55it/s]
  5%|▍         | 18225/371472 [1:28:05<28:03:11,  3.50it/s]
  5%|▍         | 18226/371472 [1:28:05<27:16:44,  3.60it/s]
  5%|▍         | 18227/371472 [1:28:06<26:50:39,  3.66it/s]
  5%|▍         | 18228/371472 [1:28:06<26:54:04,  3.65it/s]
  5%|▍         | 18229/371472 [1:28:06<27:14:55,  3.60it/s]
  5%|▍         | 18230/371472 [1:28:07<29:42:27,  3.30it/s]
  5%|▍         | 18231/371472 [1:28:07<29:32:42,  3.32it/s]
  5%|▍         | 18232/371472 [1:28:07<31:15:41,  3.14it/s]
  5%|▍         | 18233/371472 [1:28:08<29:27:55,  3.33it/s]
  5%|▍         | 18234/371472 [1:28:08<28:56:25,  3.39it/s]
  5%|▍         | 18235/371472 [1:28:08<28:44:27,  3.41it/s]
  5%|▍         | 18236/371472 [1:28:08<28:25:57,  3.45it/s]
  5%|▍         | 18237/371472 [1:28:09<27:54:42,  3.52it/s]
  5%|▍         | 18238/371472 [1:28:09<27:13:46,  3.60it/s]
  5%|▍         | 18239/371472 [1:28:09<26:17:09,  3.73it/s]
  5%|▍         | 18240/371472 [1:28:09<25:44:48,  3.81it/s]
                                                           
{'loss': 4.5923, 'learning_rate': 9.562692581180374e-07, 'epoch': 0.79}

  5%|▍         | 18240/371472 [1:28:09<25:44:48,  3.81it/s]
  5%|▍         | 18241/371472 [1:28:10<26:06:22,  3.76it/s]
  5%|▍         | 18242/371472 [1:28:10<27:38:41,  3.55it/s]
  5%|▍         | 18243/371472 [1:28:10<27:11:17,  3.61it/s]
  5%|▍         | 18244/371472 [1:28:11<26:59:27,  3.64it/s]
  5%|▍         | 18245/371472 [1:28:11<28:10:27,  3.48it/s]
  5%|▍         | 18246/371472 [1:28:11<27:42:23,  3.54it/s]
  5%|▍         | 18247/371472 [1:28:11<27:32:11,  3.56it/s]
  5%|▍         | 18248/371472 [1:28:12<26:27:09,  3.71it/s]
  5%|▍         | 18249/371472 [1:28:12<28:55:42,  3.39it/s]
  5%|▍         | 18250/371472 [1:28:12<27:50:33,  3.52it/s]
  5%|▍         | 18251/371472 [1:28:13<27:22:29,  3.58it/s]
  5%|▍         | 18252/371472 [1:28:13<30:01:42,  3.27it/s]
  5%|▍         | 18253/371472 [1:28:13<29:33:54,  3.32it/s]
  5%|▍         | 18254/371472 [1:28:14<29:18:32,  3.35it/s]
  5%|▍         | 18255/371472 [1:28:14<28:10:16,  3.48it/s]
  5%|▍         | 18256/371472 [1:28:14<27:29:52,  3.57it/s]
  5%|▍         | 18257/371472 [1:28:14<26:56:36,  3.64it/s]
  5%|▍         | 18258/371472 [1:28:15<26:46:40,  3.66it/s]
  5%|▍         | 18259/371472 [1:28:15<27:18:55,  3.59it/s]
  5%|▍         | 18260/371472 [1:28:15<26:50:49,  3.65it/s]
                                                           
{'loss': 4.6544, 'learning_rate': 9.562207761425584e-07, 'epoch': 0.79}

  5%|▍         | 18260/371472 [1:28:15<26:50:49,  3.65it/s]
  5%|▍         | 18261/371472 [1:28:15<28:27:12,  3.45it/s]
  5%|▍         | 18262/371472 [1:28:16<27:50:46,  3.52it/s]
  5%|▍         | 18263/371472 [1:28:16<27:01:25,  3.63it/s]
  5%|▍         | 18264/371472 [1:28:16<27:28:30,  3.57it/s]
  5%|▍         | 18265/371472 [1:28:17<26:39:32,  3.68it/s]
  5%|▍         | 18266/371472 [1:28:17<28:23:08,  3.46it/s]
  5%|▍         | 18267/371472 [1:28:17<27:29:34,  3.57it/s]
  5%|▍         | 18268/371472 [1:28:17<26:37:57,  3.68it/s]
  5%|▍         | 18269/371472 [1:28:18<26:39:39,  3.68it/s]
  5%|▍         | 18270/371472 [1:28:18<27:24:37,  3.58it/s]
  5%|▍         | 18271/371472 [1:28:18<26:37:37,  3.68it/s]
  5%|▍         | 18272/371472 [1:28:18<27:32:18,  3.56it/s]
  5%|▍         | 18273/371472 [1:28:19<27:43:20,  3.54it/s]
  5%|▍         | 18274/371472 [1:28:19<27:26:39,  3.57it/s]
  5%|▍         | 18275/371472 [1:28:19<31:05:08,  3.16it/s]
  5%|▍         | 18276/371472 [1:28:20<29:07:40,  3.37it/s]
  5%|▍         | 18277/371472 [1:28:20<28:28:02,  3.45it/s]
  5%|▍         | 18278/371472 [1:28:20<29:34:33,  3.32it/s]
  5%|▍         | 18279/371472 [1:28:21<29:26:01,  3.33it/s]
  5%|▍         | 18280/371472 [1:28:21<28:55:11,  3.39it/s]
                                                           
{'loss': 4.6061, 'learning_rate': 9.561722941670797e-07, 'epoch': 0.79}

  5%|▍         | 18280/371472 [1:28:21<28:55:11,  3.39it/s]
  5%|▍         | 18281/371472 [1:28:21<29:18:57,  3.35it/s]
  5%|▍         | 18282/371472 [1:28:21<28:08:59,  3.49it/s]
  5%|▍         | 18283/371472 [1:28:22<27:22:43,  3.58it/s]
  5%|▍         | 18284/371472 [1:28:22<29:07:16,  3.37it/s]
  5%|▍         | 18285/371472 [1:28:22<29:13:12,  3.36it/s]
  5%|▍         | 18286/371472 [1:28:23<28:02:41,  3.50it/s]
  5%|▍         | 18287/371472 [1:28:23<27:56:16,  3.51it/s]
  5%|▍         | 18288/371472 [1:28:23<28:04:56,  3.49it/s]
  5%|▍         | 18289/371472 [1:28:23<28:34:43,  3.43it/s]
  5%|▍         | 18290/371472 [1:28:24<38:38:12,  2.54it/s]
  5%|▍         | 18291/371472 [1:28:24<36:34:47,  2.68it/s]
  5%|▍         | 18292/371472 [1:28:25<34:05:55,  2.88it/s]
  5%|▍         | 18293/371472 [1:28:25<32:39:42,  3.00it/s]
  5%|▍         | 18294/371472 [1:28:25<30:04:24,  3.26it/s]
  5%|▍         | 18295/371472 [1:28:26<28:54:10,  3.39it/s]
  5%|▍         | 18296/371472 [1:28:26<28:09:47,  3.48it/s]
  5%|▍         | 18297/371472 [1:28:26<27:39:02,  3.55it/s]
  5%|▍         | 18298/371472 [1:28:26<29:03:50,  3.38it/s]
  5%|▍         | 18299/371472 [1:28:27<27:57:50,  3.51it/s]
  5%|▍         | 18300/371472 [1:28:27<28:58:42,  3.39it/s]
                                                           
{'loss': 4.6143, 'learning_rate': 9.561238121916008e-07, 'epoch': 0.79}

  5%|▍         | 18300/371472 [1:28:27<28:58:42,  3.39it/s]
  5%|▍         | 18301/371472 [1:28:27<28:18:27,  3.47it/s]
  5%|▍         | 18302/371472 [1:28:28<28:01:48,  3.50it/s]
  5%|▍         | 18303/371472 [1:28:28<27:15:10,  3.60it/s]
  5%|▍         | 18304/371472 [1:28:28<27:42:32,  3.54it/s]
  5%|▍         | 18305/371472 [1:28:28<27:46:16,  3.53it/s]
  5%|▍         | 18306/371472 [1:28:29<27:20:12,  3.59it/s]
  5%|▍         | 18307/371472 [1:28:29<26:32:47,  3.70it/s]
  5%|▍         | 18308/371472 [1:28:29<27:23:56,  3.58it/s]
  5%|▍         | 18309/371472 [1:28:29<27:08:20,  3.61it/s]
  5%|▍         | 18310/371472 [1:28:30<26:40:29,  3.68it/s]
  5%|▍         | 18311/371472 [1:28:30<26:28:41,  3.70it/s]
  5%|▍         | 18312/371472 [1:28:30<27:04:44,  3.62it/s]
  5%|▍         | 18313/371472 [1:28:31<28:16:08,  3.47it/s]
  5%|▍         | 18314/371472 [1:28:31<28:44:23,  3.41it/s]
  5%|▍         | 18315/371472 [1:28:31<27:44:09,  3.54it/s]
  5%|▍         | 18316/371472 [1:28:31<28:27:36,  3.45it/s]
  5%|▍         | 18317/371472 [1:28:32<27:55:00,  3.51it/s]
  5%|▍         | 18318/371472 [1:28:32<28:18:47,  3.46it/s]
  5%|▍         | 18319/371472 [1:28:32<27:57:47,  3.51it/s]
  5%|▍         | 18320/371472 [1:28:33<29:45:36,  3.30it/s]
                                                           
{'loss': 4.6983, 'learning_rate': 9.560753302161219e-07, 'epoch': 0.79}

  5%|▍         | 18320/371472 [1:28:33<29:45:36,  3.30it/s]
  5%|▍         | 18321/371472 [1:28:33<29:17:27,  3.35it/s]
  5%|▍         | 18322/371472 [1:28:33<29:47:49,  3.29it/s]
  5%|▍         | 18323/371472 [1:28:34<29:38:54,  3.31it/s]
  5%|▍         | 18324/371472 [1:28:34<28:27:07,  3.45it/s]
  5%|▍         | 18325/371472 [1:28:34<27:35:30,  3.56it/s]
  5%|▍         | 18326/371472 [1:28:34<27:06:20,  3.62it/s]
  5%|▍         | 18327/371472 [1:28:35<26:52:16,  3.65it/s]
  5%|▍         | 18328/371472 [1:28:35<26:09:46,  3.75it/s]
  5%|▍         | 18329/371472 [1:28:35<26:15:09,  3.74it/s]
  5%|▍         | 18330/371472 [1:28:35<25:38:57,  3.82it/s]
  5%|▍         | 18331/371472 [1:28:36<25:59:17,  3.77it/s]
  5%|▍         | 18332/371472 [1:28:36<25:57:20,  3.78it/s]
  5%|▍         | 18333/371472 [1:28:36<27:13:06,  3.60it/s]
  5%|▍         | 18334/371472 [1:28:36<26:41:54,  3.67it/s]
  5%|▍         | 18335/371472 [1:28:37<25:55:03,  3.78it/s]
  5%|▍         | 18336/371472 [1:28:37<26:46:21,  3.66it/s]
  5%|▍         | 18337/371472 [1:28:37<27:59:22,  3.50it/s]
  5%|▍         | 18338/371472 [1:28:38<27:32:14,  3.56it/s]
  5%|▍         | 18339/371472 [1:28:38<26:44:20,  3.67it/s]
  5%|▍         | 18340/371472 [1:28:38<26:57:36,  3.64it/s]
                                                           
{'loss': 4.7628, 'learning_rate': 9.56026848240643e-07, 'epoch': 0.79}

  5%|▍         | 18340/371472 [1:28:38<26:57:36,  3.64it/s]
  5%|▍         | 18341/371472 [1:28:38<27:04:49,  3.62it/s]
  5%|▍         | 18342/371472 [1:28:39<26:57:00,  3.64it/s]
  5%|▍         | 18343/371472 [1:28:39<27:06:11,  3.62it/s]
  5%|▍         | 18344/371472 [1:28:39<27:41:35,  3.54it/s]
  5%|▍         | 18345/371472 [1:28:40<27:38:35,  3.55it/s]
  5%|▍         | 18346/371472 [1:28:40<28:34:07,  3.43it/s]
  5%|▍         | 18347/371472 [1:28:40<27:42:16,  3.54it/s]
  5%|▍         | 18348/371472 [1:28:40<28:35:42,  3.43it/s]
  5%|▍         | 18349/371472 [1:28:41<28:26:08,  3.45it/s]
  5%|▍         | 18350/371472 [1:28:41<27:24:21,  3.58it/s]
  5%|▍         | 18351/371472 [1:28:41<28:10:01,  3.48it/s]
  5%|▍         | 18352/371472 [1:28:42<27:16:40,  3.60it/s]
  5%|▍         | 18353/371472 [1:28:42<28:08:41,  3.49it/s]
  5%|▍         | 18354/371472 [1:28:42<27:38:56,  3.55it/s]
  5%|▍         | 18355/371472 [1:28:42<28:05:09,  3.49it/s]
  5%|▍         | 18356/371472 [1:28:43<27:58:34,  3.51it/s]
  5%|▍         | 18357/371472 [1:28:43<27:07:13,  3.62it/s]
  5%|▍         | 18358/371472 [1:28:43<28:22:44,  3.46it/s]
  5%|▍         | 18359/371472 [1:28:44<27:57:04,  3.51it/s]
  5%|▍         | 18360/371472 [1:28:44<30:09:42,  3.25it/s]
                                                           
{'loss': 4.629, 'learning_rate': 9.55978366265164e-07, 'epoch': 0.79}

  5%|▍         | 18360/371472 [1:28:44<30:09:42,  3.25it/s]
  5%|▍         | 18361/371472 [1:28:44<29:35:27,  3.31it/s]
  5%|▍         | 18362/371472 [1:28:44<28:23:46,  3.45it/s]
  5%|▍         | 18363/371472 [1:28:45<29:17:27,  3.35it/s]
  5%|▍         | 18364/371472 [1:28:45<28:36:03,  3.43it/s]
  5%|▍         | 18365/371472 [1:28:45<28:53:51,  3.39it/s]
  5%|▍         | 18366/371472 [1:28:46<28:15:01,  3.47it/s]
  5%|▍         | 18367/371472 [1:28:46<27:34:38,  3.56it/s]
  5%|▍         | 18368/371472 [1:28:46<26:48:50,  3.66it/s]
  5%|▍         | 18369/371472 [1:28:46<27:04:47,  3.62it/s]
  5%|▍         | 18370/371472 [1:28:47<26:49:33,  3.66it/s]
  5%|▍         | 18371/371472 [1:28:47<27:19:50,  3.59it/s]
  5%|▍         | 18372/371472 [1:28:47<28:04:59,  3.49it/s]
  5%|▍         | 18373/371472 [1:28:48<27:31:13,  3.56it/s]
  5%|▍         | 18374/371472 [1:28:48<26:48:13,  3.66it/s]
  5%|▍         | 18375/371472 [1:28:48<26:17:27,  3.73it/s]
  5%|▍         | 18376/371472 [1:28:48<27:10:19,  3.61it/s]
  5%|▍         | 18377/371472 [1:28:49<27:25:00,  3.58it/s]
  5%|▍         | 18378/371472 [1:28:49<28:11:14,  3.48it/s]
  5%|▍         | 18379/371472 [1:28:49<27:27:19,  3.57it/s]
  5%|▍         | 18380/371472 [1:28:49<27:12:02,  3.61it/s]
                                                           
{'loss': 4.643, 'learning_rate': 9.559298842896853e-07, 'epoch': 0.79}

  5%|▍         | 18380/371472 [1:28:49<27:12:02,  3.61it/s]
  5%|▍         | 18381/371472 [1:28:50<26:58:56,  3.63it/s]
  5%|▍         | 18382/371472 [1:28:50<28:38:34,  3.42it/s]
  5%|▍         | 18383/371472 [1:28:50<27:28:37,  3.57it/s]
  5%|▍         | 18384/371472 [1:28:51<27:34:24,  3.56it/s]
  5%|▍         | 18385/371472 [1:28:51<28:51:09,  3.40it/s]
  5%|▍         | 18386/371472 [1:28:51<28:57:26,  3.39it/s]
  5%|▍         | 18387/371472 [1:28:52<30:18:46,  3.24it/s]
  5%|▍         | 18388/371472 [1:28:52<29:09:23,  3.36it/s]
  5%|▍         | 18389/371472 [1:28:52<29:26:29,  3.33it/s]
  5%|▍         | 18390/371472 [1:28:52<28:31:19,  3.44it/s]
  5%|▍         | 18391/371472 [1:28:53<27:38:55,  3.55it/s]
  5%|▍         | 18392/371472 [1:28:53<29:41:21,  3.30it/s]
  5%|▍         | 18393/371472 [1:28:53<30:12:39,  3.25it/s]
  5%|▍         | 18394/371472 [1:28:54<30:17:02,  3.24it/s]
  5%|▍         | 18395/371472 [1:28:54<28:51:47,  3.40it/s]
  5%|▍         | 18396/371472 [1:28:54<28:29:18,  3.44it/s]
  5%|▍         | 18397/371472 [1:28:54<27:28:12,  3.57it/s]
  5%|▍         | 18398/371472 [1:28:55<28:23:30,  3.45it/s]
  5%|▍         | 18399/371472 [1:28:55<28:02:46,  3.50it/s]
  5%|▍         | 18400/371472 [1:28:55<28:09:44,  3.48it/s]
                                                           
{'loss': 4.6185, 'learning_rate': 9.558814023142061e-07, 'epoch': 0.79}

  5%|▍         | 18400/371472 [1:28:55<28:09:44,  3.48it/s]
  5%|▍         | 18401/371472 [1:28:56<30:50:08,  3.18it/s]
  5%|▍         | 18402/371472 [1:28:56<32:08:09,  3.05it/s]
  5%|▍         | 18403/371472 [1:28:56<32:39:27,  3.00it/s]
  5%|▍         | 18404/371472 [1:28:57<30:52:56,  3.18it/s]
  5%|▍         | 18405/371472 [1:28:57<29:28:39,  3.33it/s]
  5%|▍         | 18406/371472 [1:28:57<29:00:33,  3.38it/s]
  5%|▍         | 18407/371472 [1:28:58<29:16:14,  3.35it/s]
  5%|▍         | 18408/371472 [1:28:58<28:01:12,  3.50it/s]
  5%|▍         | 18409/371472 [1:28:58<29:40:28,  3.30it/s]
  5%|▍         | 18410/371472 [1:28:58<29:15:30,  3.35it/s]
  5%|▍         | 18411/371472 [1:28:59<28:26:31,  3.45it/s]
  5%|▍         | 18412/371472 [1:28:59<27:32:01,  3.56it/s]
  5%|▍         | 18413/371472 [1:28:59<26:40:06,  3.68it/s]
  5%|▍         | 18414/371472 [1:29:00<27:34:31,  3.56it/s]
  5%|▍         | 18415/371472 [1:29:00<26:47:23,  3.66it/s]
  5%|▍         | 18416/371472 [1:29:00<27:04:11,  3.62it/s]
  5%|▍         | 18417/371472 [1:29:00<27:00:48,  3.63it/s]
  5%|▍         | 18418/371472 [1:29:01<29:37:28,  3.31it/s]
  5%|▍         | 18419/371472 [1:29:01<29:52:10,  3.28it/s]
  5%|▍         | 18420/371472 [1:29:01<28:30:40,  3.44it/s]
                                                           
{'loss': 4.5335, 'learning_rate': 9.558329203387274e-07, 'epoch': 0.79}

  5%|▍         | 18420/371472 [1:29:01<28:30:40,  3.44it/s]
  5%|▍         | 18421/371472 [1:29:02<30:37:46,  3.20it/s]
  5%|▍         | 18422/371472 [1:29:02<29:34:40,  3.32it/s]
  5%|▍         | 18423/371472 [1:29:02<28:29:11,  3.44it/s]
  5%|▍         | 18424/371472 [1:29:03<33:30:03,  2.93it/s]
  5%|▍         | 18425/371472 [1:29:03<30:28:23,  3.22it/s]
  5%|▍         | 18426/371472 [1:29:03<30:13:38,  3.24it/s]
  5%|▍         | 18427/371472 [1:29:03<30:07:47,  3.25it/s]
  5%|▍         | 18428/371472 [1:29:04<29:29:35,  3.33it/s]
  5%|▍         | 18429/371472 [1:29:04<31:08:31,  3.15it/s]
  5%|▍         | 18430/371472 [1:29:04<30:28:50,  3.22it/s]
  5%|▍         | 18431/371472 [1:29:05<28:26:27,  3.45it/s]
  5%|▍         | 18432/371472 [1:29:05<27:53:57,  3.52it/s]
  5%|▍         | 18433/371472 [1:29:05<27:51:53,  3.52it/s]
  5%|▍         | 18434/371472 [1:29:05<27:19:30,  3.59it/s]
  5%|▍         | 18435/371472 [1:29:06<27:20:01,  3.59it/s]
  5%|▍         | 18436/371472 [1:29:06<27:39:34,  3.55it/s]
  5%|▍         | 18437/371472 [1:29:06<26:49:57,  3.65it/s]
  5%|▍         | 18438/371472 [1:29:07<27:57:13,  3.51it/s]
  5%|▍         | 18439/371472 [1:29:07<27:40:11,  3.54it/s]
  5%|▍         | 18440/371472 [1:29:07<27:07:02,  3.62it/s]
                                                           
{'loss': 4.6082, 'learning_rate': 9.557844383632485e-07, 'epoch': 0.79}

  5%|▍         | 18440/371472 [1:29:07<27:07:02,  3.62it/s]
  5%|▍         | 18441/371472 [1:29:07<27:37:39,  3.55it/s]
  5%|▍         | 18442/371472 [1:29:08<28:01:39,  3.50it/s]
  5%|▍         | 18443/371472 [1:29:08<27:27:29,  3.57it/s]
  5%|▍         | 18444/371472 [1:29:08<27:58:27,  3.51it/s]
  5%|▍         | 18445/371472 [1:29:09<27:30:01,  3.57it/s]
  5%|▍         | 18446/371472 [1:29:09<28:04:52,  3.49it/s]
  5%|▍         | 18447/371472 [1:29:09<28:19:37,  3.46it/s]
  5%|▍         | 18448/371472 [1:29:09<27:04:59,  3.62it/s]
  5%|▍         | 18449/371472 [1:29:10<28:31:17,  3.44it/s]
  5%|▍         | 18450/371472 [1:29:10<28:38:51,  3.42it/s]
  5%|▍         | 18451/371472 [1:29:10<28:37:04,  3.43it/s]
  5%|▍         | 18452/371472 [1:29:11<28:41:12,  3.42it/s]
  5%|▍         | 18453/371472 [1:29:11<28:24:24,  3.45it/s]
  5%|▍         | 18454/371472 [1:29:11<27:53:17,  3.52it/s]
  5%|▍         | 18455/371472 [1:29:11<28:15:52,  3.47it/s]
  5%|▍         | 18456/371472 [1:29:12<28:08:18,  3.48it/s]
  5%|▍         | 18457/371472 [1:29:12<29:26:50,  3.33it/s]
  5%|▍         | 18458/371472 [1:29:12<28:09:29,  3.48it/s]
  5%|▍         | 18459/371472 [1:29:13<27:34:35,  3.56it/s]
  5%|▍         | 18460/371472 [1:29:13<26:54:00,  3.65it/s]
                                                           
{'loss': 4.5302, 'learning_rate': 9.557359563877696e-07, 'epoch': 0.8}

  5%|▍         | 18460/371472 [1:29:13<26:54:00,  3.65it/s]
  5%|▍         | 18461/371472 [1:29:13<26:57:49,  3.64it/s]
  5%|▍         | 18462/371472 [1:29:13<27:20:53,  3.59it/s]
  5%|▍         | 18463/371472 [1:29:14<28:06:01,  3.49it/s]
  5%|▍         | 18464/371472 [1:29:14<31:06:45,  3.15it/s]
  5%|▍         | 18465/371472 [1:29:14<29:16:58,  3.35it/s]
  5%|▍         | 18466/371472 [1:29:15<28:36:09,  3.43it/s]
  5%|▍         | 18467/371472 [1:29:15<27:45:40,  3.53it/s]
  5%|▍         | 18468/371472 [1:29:15<27:29:52,  3.57it/s]
  5%|▍         | 18469/371472 [1:29:16<29:07:33,  3.37it/s]
  5%|▍         | 18470/371472 [1:29:16<30:54:00,  3.17it/s]
  5%|▍         | 18471/371472 [1:29:16<31:10:09,  3.15it/s]
  5%|▍         | 18472/371472 [1:29:17<30:46:20,  3.19it/s]
  5%|▍         | 18473/371472 [1:29:17<29:30:53,  3.32it/s]
  5%|▍         | 18474/371472 [1:29:17<31:08:10,  3.15it/s]
  5%|▍         | 18475/371472 [1:29:17<29:22:27,  3.34it/s]
  5%|▍         | 18476/371472 [1:29:18<28:12:54,  3.48it/s]
  5%|▍         | 18477/371472 [1:29:18<27:47:43,  3.53it/s]
  5%|▍         | 18478/371472 [1:29:18<26:59:31,  3.63it/s]
  5%|▍         | 18479/371472 [1:29:18<26:26:40,  3.71it/s]
  5%|▍         | 18480/371472 [1:29:19<25:47:29,  3.80it/s]
                                                           
{'loss': 4.9049, 'learning_rate': 9.556874744122906e-07, 'epoch': 0.8}

  5%|▍         | 18480/371472 [1:29:19<25:47:29,  3.80it/s]
  5%|▍         | 18481/371472 [1:29:19<28:04:52,  3.49it/s]
  5%|▍         | 18482/371472 [1:29:19<29:36:54,  3.31it/s]
  5%|▍         | 18483/371472 [1:29:20<29:49:58,  3.29it/s]
  5%|▍         | 18484/371472 [1:29:20<29:26:55,  3.33it/s]
  5%|▍         | 18485/371472 [1:29:20<28:49:05,  3.40it/s]
  5%|▍         | 18486/371472 [1:29:21<27:32:26,  3.56it/s]
  5%|▍         | 18487/371472 [1:29:21<26:52:20,  3.65it/s]
  5%|▍         | 18488/371472 [1:29:21<26:25:54,  3.71it/s]
  5%|▍         | 18489/371472 [1:29:21<27:56:17,  3.51it/s]
  5%|▍         | 18490/371472 [1:29:22<27:24:43,  3.58it/s]
  5%|▍         | 18491/371472 [1:29:22<26:57:34,  3.64it/s]
  5%|▍         | 18492/371472 [1:29:22<29:45:36,  3.29it/s]
  5%|▍         | 18493/371472 [1:29:23<29:15:25,  3.35it/s]
  5%|▍         | 18494/371472 [1:29:23<28:27:19,  3.45it/s]
  5%|▍         | 18495/371472 [1:29:23<27:41:44,  3.54it/s]
  5%|▍         | 18496/371472 [1:29:23<27:51:02,  3.52it/s]
  5%|▍         | 18497/371472 [1:29:24<28:02:58,  3.50it/s]
  5%|▍         | 18498/371472 [1:29:24<29:02:14,  3.38it/s]
  5%|▍         | 18499/371472 [1:29:24<28:34:22,  3.43it/s]
  5%|▍         | 18500/371472 [1:29:25<29:25:03,  3.33it/s]
                                                           
{'loss': 4.5565, 'learning_rate': 9.556389924368117e-07, 'epoch': 0.8}

  5%|▍         | 18500/371472 [1:29:25<29:25:03,  3.33it/s]
  5%|▍         | 18501/371472 [1:29:25<28:50:27,  3.40it/s]
  5%|▍         | 18502/371472 [1:29:25<29:26:34,  3.33it/s]
  5%|▍         | 18503/371472 [1:29:25<28:39:05,  3.42it/s]
  5%|▍         | 18504/371472 [1:29:26<29:13:00,  3.36it/s]
  5%|▍         | 18505/371472 [1:29:26<30:58:58,  3.16it/s]
  5%|▍         | 18506/371472 [1:29:26<30:48:34,  3.18it/s]
  5%|▍         | 18507/371472 [1:29:27<29:13:27,  3.35it/s]
  5%|▍         | 18508/371472 [1:29:27<29:48:27,  3.29it/s]
  5%|▍         | 18509/371472 [1:29:27<29:25:47,  3.33it/s]
  5%|▍         | 18510/371472 [1:29:28<29:29:42,  3.32it/s]
  5%|▍         | 18511/371472 [1:29:28<29:16:56,  3.35it/s]
  5%|▍         | 18512/371472 [1:29:28<30:38:12,  3.20it/s]
  5%|▍         | 18513/371472 [1:29:29<29:23:30,  3.34it/s]
  5%|▍         | 18514/371472 [1:29:29<30:07:33,  3.25it/s]
  5%|▍         | 18515/371472 [1:29:29<31:00:13,  3.16it/s]
  5%|▍         | 18516/371472 [1:29:29<30:02:42,  3.26it/s]
  5%|▍         | 18517/371472 [1:29:30<29:37:12,  3.31it/s]
  5%|▍         | 18518/371472 [1:29:30<29:10:34,  3.36it/s]
  5%|▍         | 18519/371472 [1:29:30<28:28:36,  3.44it/s]
  5%|▍         | 18520/371472 [1:29:31<27:34:32,  3.56it/s]
                                                           
{'loss': 4.5934, 'learning_rate': 9.55590510461333e-07, 'epoch': 0.8}

  5%|▍         | 18520/371472 [1:29:31<27:34:32,  3.56it/s]
  5%|▍         | 18521/371472 [1:29:31<28:17:39,  3.47it/s]
  5%|▍         | 18522/371472 [1:29:31<27:42:32,  3.54it/s]
  5%|▍         | 18523/371472 [1:29:31<26:51:21,  3.65it/s]
  5%|▍         | 18524/371472 [1:29:32<26:19:23,  3.72it/s]
  5%|▍         | 18525/371472 [1:29:32<27:06:07,  3.62it/s]
  5%|▍         | 18526/371472 [1:29:32<27:34:43,  3.55it/s]
  5%|▍         | 18527/371472 [1:29:33<29:01:43,  3.38it/s]
  5%|▍         | 18528/371472 [1:29:33<28:17:05,  3.47it/s]
  5%|▍         | 18529/371472 [1:29:33<27:30:41,  3.56it/s]
  5%|▍         | 18530/371472 [1:29:33<29:12:49,  3.36it/s]
  5%|▍         | 18531/371472 [1:29:34<28:10:23,  3.48it/s]
  5%|▍         | 18532/371472 [1:29:34<27:54:49,  3.51it/s]
  5%|▍         | 18533/371472 [1:29:34<28:07:47,  3.49it/s]
  5%|▍         | 18534/371472 [1:29:35<28:15:05,  3.47it/s]
  5%|▍         | 18535/371472 [1:29:35<28:37:19,  3.43it/s]
  5%|▍         | 18536/371472 [1:29:35<30:25:55,  3.22it/s]
  5%|▍         | 18537/371472 [1:29:35<29:23:02,  3.34it/s]
  5%|▍         | 18538/371472 [1:29:36<29:27:54,  3.33it/s]
  5%|▍         | 18539/371472 [1:29:36<28:51:23,  3.40it/s]
  5%|▍         | 18540/371472 [1:29:36<28:49:13,  3.40it/s]
                                                           
{'loss': 4.498, 'learning_rate': 9.555420284858539e-07, 'epoch': 0.8}

  5%|▍         | 18540/371472 [1:29:36<28:49:13,  3.40it/s]
  5%|▍         | 18541/371472 [1:29:37<30:08:02,  3.25it/s]
  5%|▍         | 18542/371472 [1:29:37<29:21:27,  3.34it/s]
  5%|▍         | 18543/371472 [1:29:37<28:31:01,  3.44it/s]
  5%|▍         | 18544/371472 [1:29:38<28:29:43,  3.44it/s]
  5%|▍         | 18545/371472 [1:29:38<28:13:59,  3.47it/s]
  5%|▍         | 18546/371472 [1:29:38<27:08:46,  3.61it/s]
  5%|▍         | 18547/371472 [1:29:38<27:15:17,  3.60it/s]
  5%|▍         | 18548/371472 [1:29:39<28:56:30,  3.39it/s]
  5%|▍         | 18549/371472 [1:29:39<29:41:01,  3.30it/s]
  5%|▍         | 18550/371472 [1:29:39<28:43:06,  3.41it/s]
  5%|▍         | 18551/371472 [1:29:40<28:55:19,  3.39it/s]
  5%|▍         | 18552/371472 [1:29:40<28:00:45,  3.50it/s]
  5%|▍         | 18553/371472 [1:29:40<28:20:26,  3.46it/s]
  5%|▍         | 18554/371472 [1:29:40<27:37:55,  3.55it/s]
  5%|▍         | 18555/371472 [1:29:41<27:06:40,  3.62it/s]
  5%|▍         | 18556/371472 [1:29:41<27:30:28,  3.56it/s]
  5%|▍         | 18557/371472 [1:29:41<28:23:39,  3.45it/s]
  5%|▍         | 18558/371472 [1:29:42<28:15:37,  3.47it/s]
  5%|▍         | 18559/371472 [1:29:42<27:30:23,  3.56it/s]
  5%|▍         | 18560/371472 [1:29:42<27:19:28,  3.59it/s]
                                                           
{'loss': 4.8571, 'learning_rate': 9.554935465103751e-07, 'epoch': 0.8}

  5%|▍         | 18560/371472 [1:29:42<27:19:28,  3.59it/s]
  5%|▍         | 18561/371472 [1:29:42<26:42:25,  3.67it/s]
  5%|▍         | 18562/371472 [1:29:43<27:29:33,  3.57it/s]
  5%|▍         | 18563/371472 [1:29:43<29:15:27,  3.35it/s]
  5%|▍         | 18564/371472 [1:29:43<31:09:16,  3.15it/s]
  5%|▍         | 18565/371472 [1:29:44<30:06:18,  3.26it/s]
  5%|▍         | 18566/371472 [1:29:44<29:25:22,  3.33it/s]
  5%|▍         | 18567/371472 [1:29:44<28:22:27,  3.45it/s]
  5%|▍         | 18568/371472 [1:29:45<29:12:13,  3.36it/s]
  5%|▍         | 18569/371472 [1:29:45<29:09:41,  3.36it/s]
  5%|▍         | 18570/371472 [1:29:45<29:34:56,  3.31it/s]
  5%|▍         | 18571/371472 [1:29:45<28:13:07,  3.47it/s]
  5%|▍         | 18572/371472 [1:29:46<27:34:22,  3.56it/s]
  5%|▍         | 18573/371472 [1:29:46<27:38:44,  3.55it/s]
  5%|▌         | 18574/371472 [1:29:46<27:16:17,  3.59it/s]
  5%|▌         | 18575/371472 [1:29:46<27:24:57,  3.58it/s]
  5%|▌         | 18576/371472 [1:29:47<26:34:17,  3.69it/s]
  5%|▌         | 18577/371472 [1:29:47<26:18:07,  3.73it/s]
  5%|▌         | 18578/371472 [1:29:47<27:07:44,  3.61it/s]
  5%|▌         | 18579/371472 [1:29:48<27:07:06,  3.61it/s]
  5%|▌         | 18580/371472 [1:29:48<26:31:06,  3.70it/s]
                                                           
{'loss': 4.5185, 'learning_rate': 9.554450645348962e-07, 'epoch': 0.8}

  5%|▌         | 18580/371472 [1:29:48<26:31:06,  3.70it/s]
  5%|▌         | 18581/371472 [1:29:48<27:11:09,  3.61it/s]
  5%|▌         | 18582/371472 [1:29:48<27:51:59,  3.52it/s]
  5%|▌         | 18583/371472 [1:29:49<27:12:01,  3.60it/s]
  5%|▌         | 18584/371472 [1:29:49<28:13:51,  3.47it/s]
  5%|▌         | 18585/371472 [1:29:49<28:15:54,  3.47it/s]
  5%|▌         | 18586/371472 [1:29:50<28:28:48,  3.44it/s]
  5%|▌         | 18587/371472 [1:29:50<28:50:29,  3.40it/s]
  5%|▌         | 18588/371472 [1:29:50<30:04:40,  3.26it/s]
  5%|▌         | 18589/371472 [1:29:51<29:25:39,  3.33it/s]
  5%|▌         | 18590/371472 [1:29:51<29:32:57,  3.32it/s]
  5%|▌         | 18591/371472 [1:29:51<32:00:40,  3.06it/s]
  5%|▌         | 18592/371472 [1:29:51<30:17:28,  3.24it/s]
  5%|▌         | 18593/371472 [1:29:52<29:58:49,  3.27it/s]
  5%|▌         | 18594/371472 [1:29:52<29:10:54,  3.36it/s]
  5%|▌         | 18595/371472 [1:29:52<27:58:56,  3.50it/s]
  5%|▌         | 18596/371472 [1:29:53<28:17:33,  3.46it/s]
  5%|▌         | 18597/371472 [1:29:53<27:51:08,  3.52it/s]
  5%|▌         | 18598/371472 [1:29:53<28:55:51,  3.39it/s]
  5%|▌         | 18599/371472 [1:29:53<28:02:36,  3.50it/s]
  5%|▌         | 18600/371472 [1:29:54<28:35:53,  3.43it/s]
                                                           
{'loss': 4.5657, 'learning_rate': 9.553965825594173e-07, 'epoch': 0.8}

  5%|▌         | 18600/371472 [1:29:54<28:35:53,  3.43it/s]
  5%|▌         | 18601/371472 [1:29:54<28:22:28,  3.45it/s]
  5%|▌         | 18602/371472 [1:29:54<29:44:52,  3.30it/s]
  5%|▌         | 18603/371472 [1:29:55<30:37:00,  3.20it/s]
  5%|▌         | 18604/371472 [1:29:55<29:57:36,  3.27it/s]
  5%|▌         | 18605/371472 [1:29:55<29:36:56,  3.31it/s]
  5%|▌         | 18606/371472 [1:29:56<29:40:10,  3.30it/s]
  5%|▌         | 18607/371472 [1:29:56<28:47:44,  3.40it/s]
  5%|▌         | 18608/371472 [1:29:56<28:37:17,  3.42it/s]
  5%|▌         | 18609/371472 [1:29:56<28:16:34,  3.47it/s]
  5%|▌         | 18610/371472 [1:29:57<27:48:33,  3.52it/s]
  5%|▌         | 18611/371472 [1:29:57<28:45:36,  3.41it/s]
  5%|▌         | 18612/371472 [1:29:57<28:02:09,  3.50it/s]
  5%|▌         | 18613/371472 [1:29:58<30:09:31,  3.25it/s]
  5%|▌         | 18614/371472 [1:29:58<28:49:38,  3.40it/s]
  5%|▌         | 18615/371472 [1:29:58<28:44:59,  3.41it/s]
  5%|▌         | 18616/371472 [1:29:58<27:17:32,  3.59it/s]
  5%|▌         | 18617/371472 [1:29:59<28:31:57,  3.44it/s]
  5%|▌         | 18618/371472 [1:29:59<28:20:18,  3.46it/s]
  5%|▌         | 18619/371472 [1:29:59<27:33:11,  3.56it/s]
  5%|▌         | 18620/371472 [1:30:00<27:15:40,  3.60it/s]
                                                           
{'loss': 4.4812, 'learning_rate': 9.553481005839384e-07, 'epoch': 0.8}

  5%|▌         | 18620/371472 [1:30:00<27:15:40,  3.60it/s]
  5%|▌         | 18621/371472 [1:30:00<27:10:05,  3.61it/s]
  5%|▌         | 18622/371472 [1:30:00<26:48:26,  3.66it/s]
  5%|▌         | 18623/371472 [1:30:00<26:57:47,  3.64it/s]
  5%|▌         | 18624/371472 [1:30:01<28:54:12,  3.39it/s]
  5%|▌         | 18625/371472 [1:30:01<28:37:51,  3.42it/s]
  5%|▌         | 18626/371472 [1:30:01<27:40:00,  3.54it/s]
  5%|▌         | 18627/371472 [1:30:02<27:09:59,  3.61it/s]
  5%|▌         | 18628/371472 [1:30:02<27:24:12,  3.58it/s]
  5%|▌         | 18629/371472 [1:30:02<26:56:25,  3.64it/s]
  5%|▌         | 18630/371472 [1:30:02<27:21:45,  3.58it/s]
  5%|▌         | 18631/371472 [1:30:03<27:45:05,  3.53it/s]
  5%|▌         | 18632/371472 [1:30:03<29:46:26,  3.29it/s]
  5%|▌         | 18633/371472 [1:30:03<32:10:36,  3.05it/s]
  5%|▌         | 18634/371472 [1:30:04<29:56:23,  3.27it/s]
  5%|▌         | 18635/371472 [1:30:04<29:59:15,  3.27it/s]
  5%|▌         | 18636/371472 [1:30:04<29:31:33,  3.32it/s]
  5%|▌         | 18637/371472 [1:30:05<29:04:26,  3.37it/s]
  5%|▌         | 18638/371472 [1:30:05<31:46:16,  3.08it/s]
  5%|▌         | 18639/371472 [1:30:05<30:12:41,  3.24it/s]
  5%|▌         | 18640/371472 [1:30:05<28:32:27,  3.43it/s]
                                                           
{'loss': 4.6503, 'learning_rate': 9.552996186084594e-07, 'epoch': 0.8}

  5%|▌         | 18640/371472 [1:30:05<28:32:27,  3.43it/s]
  5%|▌         | 18641/371472 [1:30:06<28:54:58,  3.39it/s]
  5%|▌         | 18642/371472 [1:30:06<29:06:30,  3.37it/s]
  5%|▌         | 18643/371472 [1:30:06<28:13:56,  3.47it/s]
  5%|▌         | 18644/371472 [1:30:07<28:46:26,  3.41it/s]
  5%|▌         | 18645/371472 [1:30:07<28:24:07,  3.45it/s]
  5%|▌         | 18646/371472 [1:30:07<28:12:12,  3.48it/s]
  5%|▌         | 18647/371472 [1:30:07<27:39:39,  3.54it/s]
  5%|▌         | 18648/371472 [1:30:08<27:16:52,  3.59it/s]
  5%|▌         | 18649/371472 [1:30:08<26:55:54,  3.64it/s]
  5%|▌         | 18650/371472 [1:30:08<26:21:44,  3.72it/s]
  5%|▌         | 18651/371472 [1:30:09<26:49:40,  3.65it/s]
  5%|▌         | 18652/371472 [1:30:09<26:36:31,  3.68it/s]
  5%|▌         | 18653/371472 [1:30:09<27:36:20,  3.55it/s]
  5%|▌         | 18654/371472 [1:30:09<28:05:08,  3.49it/s]
  5%|▌         | 18655/371472 [1:30:10<28:57:16,  3.38it/s]
  5%|▌         | 18656/371472 [1:30:10<28:37:08,  3.42it/s]
  5%|▌         | 18657/371472 [1:30:10<27:48:40,  3.52it/s]
  5%|▌         | 18658/371472 [1:30:11<26:51:54,  3.65it/s]
  5%|▌         | 18659/371472 [1:30:11<27:23:03,  3.58it/s]
  5%|▌         | 18660/371472 [1:30:11<26:47:31,  3.66it/s]
                                                           
{'loss': 4.8931, 'learning_rate': 9.552511366329807e-07, 'epoch': 0.8}

  5%|▌         | 18660/371472 [1:30:11<26:47:31,  3.66it/s]
  5%|▌         | 18661/371472 [1:30:11<28:12:55,  3.47it/s]
  5%|▌         | 18662/371472 [1:30:12<26:55:19,  3.64it/s]
  5%|▌         | 18663/371472 [1:30:12<25:58:33,  3.77it/s]
  5%|▌         | 18664/371472 [1:30:12<27:32:07,  3.56it/s]
  5%|▌         | 18665/371472 [1:30:13<29:48:02,  3.29it/s]
  5%|▌         | 18666/371472 [1:30:13<28:42:22,  3.41it/s]
  5%|▌         | 18667/371472 [1:30:13<29:03:43,  3.37it/s]
  5%|▌         | 18668/371472 [1:30:13<29:17:38,  3.35it/s]
  5%|▌         | 18669/371472 [1:30:14<29:42:05,  3.30it/s]
  5%|▌         | 18670/371472 [1:30:14<30:10:12,  3.25it/s]
  5%|▌         | 18671/371472 [1:30:14<28:51:02,  3.40it/s]
  5%|▌         | 18672/371472 [1:30:15<28:35:33,  3.43it/s]
  5%|▌         | 18673/371472 [1:30:15<28:14:20,  3.47it/s]
  5%|▌         | 18674/371472 [1:30:15<27:55:13,  3.51it/s]
  5%|▌         | 18675/371472 [1:30:16<29:04:40,  3.37it/s]
  5%|▌         | 18676/371472 [1:30:16<29:08:12,  3.36it/s]
  5%|▌         | 18677/371472 [1:30:16<28:01:21,  3.50it/s]
  5%|▌         | 18678/371472 [1:30:16<29:30:16,  3.32it/s]
  5%|▌         | 18679/371472 [1:30:17<28:22:45,  3.45it/s]
  5%|▌         | 18680/371472 [1:30:17<28:18:11,  3.46it/s]
                                                           
{'loss': 4.8269, 'learning_rate': 9.552026546575018e-07, 'epoch': 0.8}

  5%|▌         | 18680/371472 [1:30:17<28:18:11,  3.46it/s]
  5%|▌         | 18681/371472 [1:30:17<28:15:22,  3.47it/s]
  5%|▌         | 18682/371472 [1:30:18<27:49:32,  3.52it/s]
  5%|▌         | 18683/371472 [1:30:18<27:26:36,  3.57it/s]
  5%|▌         | 18684/371472 [1:30:18<28:00:15,  3.50it/s]
  5%|▌         | 18685/371472 [1:30:18<27:34:01,  3.55it/s]
  5%|▌         | 18686/371472 [1:30:19<27:27:46,  3.57it/s]
  5%|▌         | 18687/371472 [1:30:19<28:11:45,  3.48it/s]
  5%|▌         | 18688/371472 [1:30:19<29:15:03,  3.35it/s]
  5%|▌         | 18689/371472 [1:30:20<28:46:29,  3.41it/s]
  5%|▌         | 18690/371472 [1:30:20<29:39:45,  3.30it/s]
  5%|▌         | 18691/371472 [1:30:20<28:35:00,  3.43it/s]
  5%|▌         | 18692/371472 [1:30:20<27:31:24,  3.56it/s]
  5%|▌         | 18693/371472 [1:30:21<27:35:15,  3.55it/s]
  5%|▌         | 18694/371472 [1:30:21<26:53:36,  3.64it/s]
  5%|▌         | 18695/371472 [1:30:21<26:52:42,  3.65it/s]
  5%|▌         | 18696/371472 [1:30:21<26:20:05,  3.72it/s]
  5%|▌         | 18697/371472 [1:30:22<25:34:44,  3.83it/s]
  5%|▌         | 18698/371472 [1:30:22<26:35:47,  3.68it/s]
  5%|▌         | 18699/371472 [1:30:22<26:47:56,  3.66it/s]
  5%|▌         | 18700/371472 [1:30:23<26:32:35,  3.69it/s]
                                                           
{'loss': 4.7274, 'learning_rate': 9.551541726820228e-07, 'epoch': 0.81}

  5%|▌         | 18700/371472 [1:30:23<26:32:35,  3.69it/s]
  5%|▌         | 18701/371472 [1:30:23<26:55:32,  3.64it/s]
  5%|▌         | 18702/371472 [1:30:23<27:40:28,  3.54it/s]
  5%|▌         | 18703/371472 [1:30:23<27:02:27,  3.62it/s]
  5%|▌         | 18704/371472 [1:30:24<26:29:17,  3.70it/s]
  5%|▌         | 18705/371472 [1:30:24<26:35:25,  3.69it/s]
  5%|▌         | 18706/371472 [1:30:24<26:18:45,  3.72it/s]
  5%|▌         | 18707/371472 [1:30:24<25:50:16,  3.79it/s]
  5%|▌         | 18708/371472 [1:30:25<25:43:55,  3.81it/s]
  5%|▌         | 18709/371472 [1:30:25<28:30:10,  3.44it/s]
  5%|▌         | 18710/371472 [1:30:25<28:31:42,  3.43it/s]
  5%|▌         | 18711/371472 [1:30:26<28:27:21,  3.44it/s]
  5%|▌         | 18712/371472 [1:30:26<28:59:48,  3.38it/s]
  5%|▌         | 18713/371472 [1:30:26<28:52:15,  3.39it/s]
  5%|▌         | 18714/371472 [1:30:27<30:25:25,  3.22it/s]
  5%|▌         | 18715/371472 [1:30:27<28:48:56,  3.40it/s]
  5%|▌         | 18716/371472 [1:30:27<29:00:54,  3.38it/s]
  5%|▌         | 18717/371472 [1:30:27<29:00:49,  3.38it/s]
  5%|▌         | 18718/371472 [1:30:28<27:47:40,  3.53it/s]
  5%|▌         | 18719/371472 [1:30:28<27:16:15,  3.59it/s]
  5%|▌         | 18720/371472 [1:30:28<28:10:19,  3.48it/s]
                                                           
{'loss': 4.4974, 'learning_rate': 9.55105690706544e-07, 'epoch': 0.81}

  5%|▌         | 18720/371472 [1:30:28<28:10:19,  3.48it/s]
  5%|▌         | 18721/371472 [1:30:29<27:51:52,  3.52it/s]
  5%|▌         | 18722/371472 [1:30:29<28:13:48,  3.47it/s]
  5%|▌         | 18723/371472 [1:30:29<27:56:59,  3.51it/s]
  5%|▌         | 18724/371472 [1:30:29<28:11:54,  3.47it/s]
  5%|▌         | 18725/371472 [1:30:30<27:46:00,  3.53it/s]
  5%|▌         | 18726/371472 [1:30:30<28:22:04,  3.45it/s]
  5%|▌         | 18727/371472 [1:30:30<27:32:42,  3.56it/s]
  5%|▌         | 18728/371472 [1:30:31<26:54:34,  3.64it/s]
  5%|▌         | 18729/371472 [1:30:31<28:15:45,  3.47it/s]
  5%|▌         | 18730/371472 [1:30:31<29:20:15,  3.34it/s]
  5%|▌         | 18731/371472 [1:30:31<29:31:00,  3.32it/s]
  5%|▌         | 18732/371472 [1:30:32<28:47:44,  3.40it/s]
  5%|▌         | 18733/371472 [1:30:32<28:06:42,  3.49it/s]
  5%|▌         | 18734/371472 [1:30:32<30:05:29,  3.26it/s]
  5%|▌         | 18735/371472 [1:30:33<31:10:20,  3.14it/s]
  5%|▌         | 18736/371472 [1:30:33<31:17:40,  3.13it/s]
  5%|▌         | 18737/371472 [1:30:33<30:09:24,  3.25it/s]
  5%|▌         | 18738/371472 [1:30:34<29:36:55,  3.31it/s]
  5%|▌         | 18739/371472 [1:30:34<28:37:13,  3.42it/s]
  5%|▌         | 18740/371472 [1:30:34<27:19:27,  3.59it/s]
                                                           
{'loss': 4.5903, 'learning_rate': 9.55057208731065e-07, 'epoch': 0.81}

  5%|▌         | 18740/371472 [1:30:34<27:19:27,  3.59it/s]
  5%|▌         | 18741/371472 [1:30:34<27:36:44,  3.55it/s]
  5%|▌         | 18742/371472 [1:30:35<27:36:29,  3.55it/s]
  5%|▌         | 18743/371472 [1:30:35<26:38:50,  3.68it/s]
  5%|▌         | 18744/371472 [1:30:35<27:32:09,  3.56it/s]
  5%|▌         | 18745/371472 [1:30:36<28:47:47,  3.40it/s]
  5%|▌         | 18746/371472 [1:30:36<28:06:53,  3.48it/s]
  5%|▌         | 18747/371472 [1:30:36<27:56:25,  3.51it/s]
  5%|▌         | 18748/371472 [1:30:36<27:44:14,  3.53it/s]
  5%|▌         | 18749/371472 [1:30:37<27:43:11,  3.53it/s]
  5%|▌         | 18750/371472 [1:30:37<27:35:43,  3.55it/s]
  5%|▌         | 18751/371472 [1:30:37<26:54:43,  3.64it/s]
  5%|▌         | 18752/371472 [1:30:38<28:08:53,  3.48it/s]
  5%|▌         | 18753/371472 [1:30:38<27:04:25,  3.62it/s]
  5%|▌         | 18754/371472 [1:30:38<29:44:18,  3.29it/s]
  5%|▌         | 18755/371472 [1:30:39<31:30:25,  3.11it/s]
  5%|▌         | 18756/371472 [1:30:39<30:12:01,  3.24it/s]
  5%|▌         | 18757/371472 [1:30:39<28:26:57,  3.44it/s]
  5%|▌         | 18758/371472 [1:30:39<28:44:43,  3.41it/s]
  5%|▌         | 18759/371472 [1:30:40<27:57:03,  3.51it/s]
  5%|▌         | 18760/371472 [1:30:40<26:58:38,  3.63it/s]
                                                           
{'loss': 4.4657, 'learning_rate': 9.550087267555863e-07, 'epoch': 0.81}

  5%|▌         | 18760/371472 [1:30:40<26:58:38,  3.63it/s]
  5%|▌         | 18761/371472 [1:30:40<26:24:14,  3.71it/s]
  5%|▌         | 18762/371472 [1:30:40<25:49:41,  3.79it/s]
  5%|▌         | 18763/371472 [1:30:41<30:54:17,  3.17it/s]
  5%|▌         | 18764/371472 [1:30:41<30:37:44,  3.20it/s]
  5%|▌         | 18765/371472 [1:30:41<31:01:50,  3.16it/s]
  5%|▌         | 18766/371472 [1:30:42<29:47:49,  3.29it/s]
  5%|▌         | 18767/371472 [1:30:42<29:41:13,  3.30it/s]
  5%|▌         | 18768/371472 [1:30:42<28:32:06,  3.43it/s]
  5%|▌         | 18769/371472 [1:30:43<27:11:17,  3.60it/s]
  5%|▌         | 18770/371472 [1:30:43<29:46:48,  3.29it/s]
  5%|▌         | 18771/371472 [1:30:43<31:06:40,  3.15it/s]
  5%|▌         | 18772/371472 [1:30:44<31:12:33,  3.14it/s]
  5%|▌         | 18773/371472 [1:30:44<29:16:26,  3.35it/s]
  5%|▌         | 18774/371472 [1:30:44<29:46:25,  3.29it/s]
  5%|▌         | 18775/371472 [1:30:45<40:08:17,  2.44it/s]
  5%|▌         | 18776/371472 [1:30:45<35:40:04,  2.75it/s]
  5%|▌         | 18777/371472 [1:30:45<33:16:33,  2.94it/s]
  5%|▌         | 18778/371472 [1:30:46<32:54:37,  2.98it/s]
  5%|▌         | 18779/371472 [1:30:46<30:44:05,  3.19it/s]
  5%|▌         | 18780/371472 [1:30:46<30:29:59,  3.21it/s]
                                                           
{'loss': 4.5626, 'learning_rate': 9.549602447801071e-07, 'epoch': 0.81}

  5%|▌         | 18780/371472 [1:30:46<30:29:59,  3.21it/s]
  5%|▌         | 18781/371472 [1:30:46<29:00:54,  3.38it/s]
  5%|▌         | 18782/371472 [1:30:47<29:53:51,  3.28it/s]
  5%|▌         | 18783/371472 [1:30:47<32:30:44,  3.01it/s]
  5%|▌         | 18784/371472 [1:30:47<30:41:15,  3.19it/s]
  5%|▌         | 18785/371472 [1:30:48<29:31:13,  3.32it/s]
  5%|▌         | 18786/371472 [1:30:48<28:47:50,  3.40it/s]
  5%|▌         | 18787/371472 [1:30:48<28:23:26,  3.45it/s]
  5%|▌         | 18788/371472 [1:30:49<32:52:09,  2.98it/s]
  5%|▌         | 18789/371472 [1:30:49<30:53:14,  3.17it/s]
  5%|▌         | 18790/371472 [1:30:49<29:14:48,  3.35it/s]
  5%|▌         | 18791/371472 [1:30:50<29:54:18,  3.28it/s]
  5%|▌         | 18792/371472 [1:30:50<28:52:23,  3.39it/s]
  5%|▌         | 18793/371472 [1:30:50<28:20:26,  3.46it/s]
  5%|▌         | 18794/371472 [1:30:50<28:07:15,  3.48it/s]
  5%|▌         | 18795/371472 [1:30:51<27:16:22,  3.59it/s]
  5%|▌         | 18796/371472 [1:30:51<26:54:54,  3.64it/s]
  5%|▌         | 18797/371472 [1:30:51<27:40:20,  3.54it/s]
  5%|▌         | 18798/371472 [1:30:52<29:26:41,  3.33it/s]
  5%|▌         | 18799/371472 [1:30:52<29:26:04,  3.33it/s]
  5%|▌         | 18800/371472 [1:30:52<27:47:18,  3.53it/s]
                                                           
{'loss': 4.6358, 'learning_rate': 9.549117628046284e-07, 'epoch': 0.81}

  5%|▌         | 18800/371472 [1:30:52<27:47:18,  3.53it/s]
  5%|▌         | 18801/371472 [1:30:52<27:21:20,  3.58it/s]
  5%|▌         | 18802/371472 [1:30:53<26:52:44,  3.64it/s]
  5%|▌         | 18803/371472 [1:30:53<26:11:53,  3.74it/s]
  5%|▌         | 18804/371472 [1:30:53<28:23:04,  3.45it/s]
  5%|▌         | 18805/371472 [1:30:54<27:28:44,  3.57it/s]
  5%|▌         | 18806/371472 [1:30:54<28:26:37,  3.44it/s]
  5%|▌         | 18807/371472 [1:30:54<28:39:48,  3.42it/s]
  5%|▌         | 18808/371472 [1:30:54<29:09:57,  3.36it/s]
  5%|▌         | 18809/371472 [1:30:55<28:31:18,  3.43it/s]
  5%|▌         | 18810/371472 [1:30:55<28:22:37,  3.45it/s]
  5%|▌         | 18811/371472 [1:30:55<27:40:21,  3.54it/s]
  5%|▌         | 18812/371472 [1:30:56<26:50:55,  3.65it/s]
  5%|▌         | 18813/371472 [1:30:56<28:32:07,  3.43it/s]
  5%|▌         | 18814/371472 [1:30:56<28:20:41,  3.46it/s]
  5%|▌         | 18815/371472 [1:30:56<28:08:41,  3.48it/s]
  5%|▌         | 18816/371472 [1:30:57<29:50:56,  3.28it/s]
  5%|▌         | 18817/371472 [1:30:57<29:23:31,  3.33it/s]
  5%|▌         | 18818/371472 [1:30:57<29:02:47,  3.37it/s]
  5%|▌         | 18819/371472 [1:30:58<28:11:21,  3.48it/s]
  5%|▌         | 18820/371472 [1:30:58<29:37:37,  3.31it/s]
                                                           
{'loss': 4.5517, 'learning_rate': 9.548632808291495e-07, 'epoch': 0.81}

  5%|▌         | 18820/371472 [1:30:58<29:37:37,  3.31it/s]
  5%|▌         | 18821/371472 [1:30:58<31:31:50,  3.11it/s]
  5%|▌         | 18822/371472 [1:30:59<29:25:29,  3.33it/s]
  5%|▌         | 18823/371472 [1:30:59<28:49:28,  3.40it/s]
  5%|▌         | 18824/371472 [1:30:59<28:02:33,  3.49it/s]
  5%|▌         | 18825/371472 [1:30:59<27:11:07,  3.60it/s]
  5%|▌         | 18826/371472 [1:31:00<27:06:35,  3.61it/s]
  5%|▌         | 18827/371472 [1:31:00<26:59:09,  3.63it/s]
  5%|▌         | 18828/371472 [1:31:00<26:46:13,  3.66it/s]
  5%|▌         | 18829/371472 [1:31:00<26:49:57,  3.65it/s]
  5%|▌         | 18830/371472 [1:31:01<26:33:12,  3.69it/s]
  5%|▌         | 18831/371472 [1:31:01<28:13:25,  3.47it/s]
  5%|▌         | 18832/371472 [1:31:01<28:04:28,  3.49it/s]
  5%|▌         | 18833/371472 [1:31:02<27:51:46,  3.52it/s]
  5%|▌         | 18834/371472 [1:31:02<27:34:33,  3.55it/s]
  5%|▌         | 18835/371472 [1:31:02<27:54:48,  3.51it/s]
  5%|▌         | 18836/371472 [1:31:02<27:31:07,  3.56it/s]
  5%|▌         | 18837/371472 [1:31:03<27:51:34,  3.52it/s]
  5%|▌         | 18838/371472 [1:31:03<27:00:10,  3.63it/s]
  5%|▌         | 18839/371472 [1:31:03<27:37:18,  3.55it/s]
  5%|▌         | 18840/371472 [1:31:04<27:49:05,  3.52it/s]
                                                           
{'loss': 4.7087, 'learning_rate': 9.548147988536706e-07, 'epoch': 0.81}

  5%|▌         | 18840/371472 [1:31:04<27:49:05,  3.52it/s]
  5%|▌         | 18841/371472 [1:31:04<27:23:42,  3.58it/s]
  5%|▌         | 18842/371472 [1:31:04<27:03:13,  3.62it/s]
  5%|▌         | 18843/371472 [1:31:04<27:29:40,  3.56it/s]
  5%|▌         | 18844/371472 [1:31:05<27:18:21,  3.59it/s]
  5%|▌         | 18845/371472 [1:31:05<28:14:24,  3.47it/s]
  5%|▌         | 18846/371472 [1:31:05<28:12:52,  3.47it/s]
  5%|▌         | 18847/371472 [1:31:06<27:21:06,  3.58it/s]
  5%|▌         | 18848/371472 [1:31:06<26:58:31,  3.63it/s]
  5%|▌         | 18849/371472 [1:31:06<26:41:14,  3.67it/s]
  5%|▌         | 18850/371472 [1:31:06<29:15:55,  3.35it/s]
  5%|▌         | 18851/371472 [1:31:07<28:17:03,  3.46it/s]
  5%|▌         | 18852/371472 [1:31:07<28:31:04,  3.43it/s]
  5%|▌         | 18853/371472 [1:31:07<28:11:28,  3.47it/s]
  5%|▌         | 18854/371472 [1:31:08<27:47:00,  3.53it/s]
  5%|▌         | 18855/371472 [1:31:08<27:17:31,  3.59it/s]
  5%|▌         | 18856/371472 [1:31:08<27:25:58,  3.57it/s]
  5%|▌         | 18857/371472 [1:31:08<26:40:38,  3.67it/s]
  5%|▌         | 18858/371472 [1:31:09<28:41:22,  3.41it/s]
  5%|▌         | 18859/371472 [1:31:09<29:36:00,  3.31it/s]
  5%|▌         | 18860/371472 [1:31:09<29:19:28,  3.34it/s]
                                                           
{'loss': 4.3492, 'learning_rate': 9.547663168781916e-07, 'epoch': 0.81}

  5%|▌         | 18860/371472 [1:31:09<29:19:28,  3.34it/s]
  5%|▌         | 18861/371472 [1:31:10<27:50:01,  3.52it/s]
  5%|▌         | 18862/371472 [1:31:10<29:58:10,  3.27it/s]
  5%|▌         | 18863/371472 [1:31:10<28:46:42,  3.40it/s]
  5%|▌         | 18864/371472 [1:31:10<28:06:15,  3.49it/s]
  5%|▌         | 18865/371472 [1:31:11<28:04:16,  3.49it/s]
  5%|▌         | 18866/371472 [1:31:11<28:01:30,  3.49it/s]
  5%|▌         | 18867/371472 [1:31:11<28:07:04,  3.48it/s]
  5%|▌         | 18868/371472 [1:31:12<30:19:22,  3.23it/s]
  5%|▌         | 18869/371472 [1:31:12<29:10:33,  3.36it/s]
  5%|▌         | 18870/371472 [1:31:12<28:57:14,  3.38it/s]
  5%|▌         | 18871/371472 [1:31:13<28:21:31,  3.45it/s]
  5%|▌         | 18872/371472 [1:31:13<28:07:18,  3.48it/s]
  5%|▌         | 18873/371472 [1:31:13<28:44:22,  3.41it/s]
  5%|▌         | 18874/371472 [1:31:13<28:30:13,  3.44it/s]
  5%|▌         | 18875/371472 [1:31:14<27:39:59,  3.54it/s]
  5%|▌         | 18876/371472 [1:31:14<26:44:15,  3.66it/s]
  5%|▌         | 18877/371472 [1:31:14<26:50:15,  3.65it/s]
  5%|▌         | 18878/371472 [1:31:15<28:53:27,  3.39it/s]
  5%|▌         | 18879/371472 [1:31:15<29:00:46,  3.38it/s]
  5%|▌         | 18880/371472 [1:31:15<29:53:59,  3.28it/s]
                                                           
{'loss': 4.4344, 'learning_rate': 9.547178349027127e-07, 'epoch': 0.81}

  5%|▌         | 18880/371472 [1:31:15<29:53:59,  3.28it/s]
  5%|▌         | 18881/371472 [1:31:15<29:25:51,  3.33it/s]
  5%|▌         | 18882/371472 [1:31:16<29:16:10,  3.35it/s]
  5%|▌         | 18883/371472 [1:31:16<29:07:25,  3.36it/s]
  5%|▌         | 18884/371472 [1:31:16<29:11:23,  3.36it/s]
  5%|▌         | 18885/371472 [1:31:17<28:26:23,  3.44it/s]
  5%|▌         | 18886/371472 [1:31:17<29:17:34,  3.34it/s]
  5%|▌         | 18887/371472 [1:31:17<27:51:07,  3.52it/s]
  5%|▌         | 18888/371472 [1:31:17<27:09:17,  3.61it/s]
  5%|▌         | 18889/371472 [1:31:18<28:43:58,  3.41it/s]
  5%|▌         | 18890/371472 [1:31:18<28:27:37,  3.44it/s]
  5%|▌         | 18891/371472 [1:31:18<28:04:25,  3.49it/s]
  5%|▌         | 18892/371472 [1:31:19<27:04:51,  3.62it/s]
  5%|▌         | 18893/371472 [1:31:19<26:50:39,  3.65it/s]
  5%|▌         | 18894/371472 [1:31:19<26:56:01,  3.64it/s]
  5%|▌         | 18895/371472 [1:31:19<26:53:34,  3.64it/s]
  5%|▌         | 18896/371472 [1:31:20<27:10:45,  3.60it/s]
  5%|▌         | 18897/371472 [1:31:20<27:45:03,  3.53it/s]
  5%|▌         | 18898/371472 [1:31:20<26:50:36,  3.65it/s]
  5%|▌         | 18899/371472 [1:31:20<26:31:46,  3.69it/s]
  5%|▌         | 18900/371472 [1:31:21<28:08:56,  3.48it/s]
                                                           
{'loss': 4.3568, 'learning_rate': 9.54669352927234e-07, 'epoch': 0.81}

  5%|▌         | 18900/371472 [1:31:21<28:08:56,  3.48it/s]
  5%|▌         | 18901/371472 [1:31:21<30:47:08,  3.18it/s]
  5%|▌         | 18902/371472 [1:31:21<29:33:22,  3.31it/s]
  5%|▌         | 18903/371472 [1:31:22<28:28:31,  3.44it/s]
  5%|▌         | 18904/371472 [1:31:22<29:13:11,  3.35it/s]
  5%|▌         | 18905/371472 [1:31:22<27:53:39,  3.51it/s]
  5%|▌         | 18906/371472 [1:31:23<27:37:12,  3.55it/s]
  5%|▌         | 18907/371472 [1:31:23<27:35:43,  3.55it/s]
  5%|▌         | 18908/371472 [1:31:23<28:50:20,  3.40it/s]
  5%|▌         | 18909/371472 [1:31:24<31:15:10,  3.13it/s]
  5%|▌         | 18910/371472 [1:31:24<29:37:15,  3.31it/s]
  5%|▌         | 18911/371472 [1:31:24<29:41:07,  3.30it/s]
  5%|▌         | 18912/371472 [1:31:24<29:46:58,  3.29it/s]
  5%|▌         | 18913/371472 [1:31:25<29:32:51,  3.31it/s]
  5%|▌         | 18914/371472 [1:31:25<29:06:12,  3.36it/s]
  5%|▌         | 18915/371472 [1:31:25<28:16:25,  3.46it/s]
  5%|▌         | 18916/371472 [1:31:26<28:27:07,  3.44it/s]
  5%|▌         | 18917/371472 [1:31:26<27:41:38,  3.54it/s]
  5%|▌         | 18918/371472 [1:31:26<28:45:22,  3.41it/s]
  5%|▌         | 18919/371472 [1:31:26<28:20:28,  3.46it/s]
  5%|▌         | 18920/371472 [1:31:27<27:54:39,  3.51it/s]
                                                           
{'loss': 4.685, 'learning_rate': 9.54620870951755e-07, 'epoch': 0.81}

  5%|▌         | 18920/371472 [1:31:27<27:54:39,  3.51it/s]
  5%|▌         | 18921/371472 [1:31:27<27:04:21,  3.62it/s]
  5%|▌         | 18922/371472 [1:31:27<28:58:01,  3.38it/s]
  5%|▌         | 18923/371472 [1:31:28<29:37:08,  3.31it/s]
  5%|▌         | 18924/371472 [1:31:28<29:28:40,  3.32it/s]
  5%|▌         | 18925/371472 [1:31:28<28:50:01,  3.40it/s]
  5%|▌         | 18926/371472 [1:31:28<27:29:45,  3.56it/s]
  5%|▌         | 18927/371472 [1:31:29<27:28:12,  3.56it/s]
  5%|▌         | 18928/371472 [1:31:29<26:42:41,  3.67it/s]
  5%|▌         | 18929/371472 [1:31:29<26:54:20,  3.64it/s]
  5%|▌         | 18930/371472 [1:31:30<27:29:42,  3.56it/s]
  5%|▌         | 18931/371472 [1:31:30<26:53:49,  3.64it/s]
  5%|▌         | 18932/371472 [1:31:30<26:40:52,  3.67it/s]
  5%|▌         | 18933/371472 [1:31:30<27:12:59,  3.60it/s]
  5%|▌         | 18934/371472 [1:31:31<27:07:36,  3.61it/s]
  5%|▌         | 18935/371472 [1:31:31<26:31:41,  3.69it/s]
  5%|▌         | 18936/371472 [1:31:31<27:21:28,  3.58it/s]
  5%|▌         | 18937/371472 [1:31:31<26:35:03,  3.68it/s]
  5%|▌         | 18938/371472 [1:31:32<26:03:46,  3.76it/s]
  5%|▌         | 18939/371472 [1:31:32<25:45:43,  3.80it/s]
  5%|▌         | 18940/371472 [1:31:32<26:04:01,  3.76it/s]
                                                           
{'loss': 4.6504, 'learning_rate': 9.545723889762761e-07, 'epoch': 0.82}

  5%|▌         | 18940/371472 [1:31:32<26:04:01,  3.76it/s]
  5%|▌         | 18941/371472 [1:31:33<26:02:59,  3.76it/s]
  5%|▌         | 18942/371472 [1:31:33<26:24:37,  3.71it/s]
  5%|▌         | 18943/371472 [1:31:33<25:41:28,  3.81it/s]
  5%|▌         | 18944/371472 [1:31:33<26:50:00,  3.65it/s]
  5%|▌         | 18945/371472 [1:31:34<26:30:43,  3.69it/s]
  5%|▌         | 18946/371472 [1:31:34<30:16:31,  3.23it/s]
  5%|▌         | 18947/371472 [1:31:34<29:09:16,  3.36it/s]
  5%|▌         | 18948/371472 [1:31:35<28:24:22,  3.45it/s]
  5%|▌         | 18949/371472 [1:31:35<27:33:09,  3.55it/s]
  5%|▌         | 18950/371472 [1:31:35<28:43:31,  3.41it/s]
  5%|▌         | 18951/371472 [1:31:35<28:32:58,  3.43it/s]
  5%|▌         | 18952/371472 [1:31:36<27:26:16,  3.57it/s]
  5%|▌         | 18953/371472 [1:31:36<29:46:15,  3.29it/s]
  5%|▌         | 18954/371472 [1:31:36<29:37:53,  3.30it/s]
  5%|▌         | 18955/371472 [1:31:37<28:40:24,  3.42it/s]
  5%|▌         | 18956/371472 [1:31:37<28:06:58,  3.48it/s]
  5%|▌         | 18957/371472 [1:31:37<28:02:51,  3.49it/s]
  5%|▌         | 18958/371472 [1:31:37<28:47:09,  3.40it/s]
  5%|▌         | 18959/371472 [1:31:38<29:11:04,  3.36it/s]
  5%|▌         | 18960/371472 [1:31:38<28:05:53,  3.48it/s]
                                                           
{'loss': 4.5637, 'learning_rate': 9.545239070007974e-07, 'epoch': 0.82}

  5%|▌         | 18960/371472 [1:31:38<28:05:53,  3.48it/s]
  5%|▌         | 18961/371472 [1:31:38<27:06:02,  3.61it/s]
  5%|▌         | 18962/371472 [1:31:39<30:24:39,  3.22it/s]
  5%|▌         | 18963/371472 [1:31:39<29:31:06,  3.32it/s]
  5%|▌         | 18964/371472 [1:31:39<29:44:36,  3.29it/s]
  5%|▌         | 18965/371472 [1:31:40<31:46:24,  3.08it/s]
  5%|▌         | 18966/371472 [1:31:40<29:43:34,  3.29it/s]
  5%|▌         | 18967/371472 [1:31:40<28:44:34,  3.41it/s]
  5%|▌         | 18968/371472 [1:31:41<30:27:07,  3.22it/s]
  5%|▌         | 18969/371472 [1:31:41<30:04:52,  3.26it/s]
  5%|▌         | 18970/371472 [1:31:41<28:18:01,  3.46it/s]
  5%|▌         | 18971/371472 [1:31:41<28:26:54,  3.44it/s]
  5%|▌         | 18972/371472 [1:31:42<27:23:01,  3.58it/s]
  5%|▌         | 18973/371472 [1:31:42<26:24:47,  3.71it/s]
  5%|▌         | 18974/371472 [1:31:42<26:12:54,  3.74it/s]
  5%|▌         | 18975/371472 [1:31:42<26:09:40,  3.74it/s]
  5%|▌         | 18976/371472 [1:31:43<26:14:50,  3.73it/s]
  5%|▌         | 18977/371472 [1:31:43<26:11:45,  3.74it/s]
  5%|▌         | 18978/371472 [1:31:43<27:32:36,  3.55it/s]
  5%|▌         | 18979/371472 [1:31:44<27:42:10,  3.53it/s]
  5%|▌         | 18980/371472 [1:31:44<27:39:28,  3.54it/s]
                                                           
{'loss': 4.4504, 'learning_rate': 9.544754250253183e-07, 'epoch': 0.82}

  5%|▌         | 18980/371472 [1:31:44<27:39:28,  3.54it/s]
  5%|▌         | 18981/371472 [1:31:44<27:35:40,  3.55it/s]
  5%|▌         | 18982/371472 [1:31:44<27:12:56,  3.60it/s]
  5%|▌         | 18983/371472 [1:31:45<28:10:45,  3.47it/s]
  5%|▌         | 18984/371472 [1:31:45<26:51:47,  3.64it/s]
  5%|▌         | 18985/371472 [1:31:45<27:43:44,  3.53it/s]
  5%|▌         | 18986/371472 [1:31:45<27:19:16,  3.58it/s]
  5%|▌         | 18987/371472 [1:31:46<29:28:10,  3.32it/s]
  5%|▌         | 18988/371472 [1:31:46<28:41:26,  3.41it/s]
  5%|▌         | 18989/371472 [1:31:46<28:21:03,  3.45it/s]
  5%|▌         | 18990/371472 [1:31:47<27:44:19,  3.53it/s]
  5%|▌         | 18991/371472 [1:31:47<28:08:25,  3.48it/s]
  5%|▌         | 18992/371472 [1:31:47<31:35:27,  3.10it/s]
  5%|▌         | 18993/371472 [1:31:48<30:06:24,  3.25it/s]
  5%|▌         | 18994/371472 [1:31:48<30:40:21,  3.19it/s]
  5%|▌         | 18995/371472 [1:31:48<29:11:46,  3.35it/s]
  5%|▌         | 18996/371472 [1:31:48<28:34:50,  3.43it/s]
  5%|▌         | 18997/371472 [1:31:49<27:53:57,  3.51it/s]
  5%|▌         | 18998/371472 [1:31:49<27:44:44,  3.53it/s]
  5%|▌         | 18999/371472 [1:31:49<26:58:48,  3.63it/s]
  5%|▌         | 19000/371472 [1:31:50<26:21:45,  3.71it/s]
                                                           
{'loss': 4.6673, 'learning_rate': 9.544269430498396e-07, 'epoch': 0.82}

  5%|▌         | 19000/371472 [1:31:50<26:21:45,  3.71it/s]
  5%|▌         | 19001/371472 [1:31:50<25:59:58,  3.77it/s]
  5%|▌         | 19002/371472 [1:31:50<25:41:32,  3.81it/s]
  5%|▌         | 19003/371472 [1:31:50<28:04:58,  3.49it/s]
  5%|▌         | 19004/371472 [1:31:51<28:24:20,  3.45it/s]
  5%|▌         | 19005/371472 [1:31:51<27:27:37,  3.57it/s]
  5%|▌         | 19006/371472 [1:31:51<27:14:37,  3.59it/s]
  5%|▌         | 19007/371472 [1:31:51<26:20:15,  3.72it/s]
  5%|▌         | 19008/371472 [1:31:52<28:12:28,  3.47it/s]
  5%|▌         | 19009/371472 [1:31:52<28:10:55,  3.47it/s]
  5%|▌         | 19010/371472 [1:31:52<28:44:16,  3.41it/s]
  5%|▌         | 19011/371472 [1:31:53<30:11:09,  3.24it/s]
  5%|▌         | 19012/371472 [1:31:53<29:14:00,  3.35it/s]
  5%|▌         | 19013/371472 [1:31:53<29:22:33,  3.33it/s]
  5%|▌         | 19014/371472 [1:31:54<27:52:22,  3.51it/s]
  5%|▌         | 19015/371472 [1:31:54<27:34:47,  3.55it/s]
  5%|▌         | 19016/371472 [1:31:54<27:09:33,  3.60it/s]
  5%|▌         | 19017/371472 [1:31:54<27:44:08,  3.53it/s]
  5%|▌         | 19018/371472 [1:31:55<27:52:59,  3.51it/s]
  5%|▌         | 19019/371472 [1:31:55<26:58:11,  3.63it/s]
  5%|▌         | 19020/371472 [1:31:55<26:20:12,  3.72it/s]
                                                           
{'loss': 4.7172, 'learning_rate': 9.543784610743604e-07, 'epoch': 0.82}

  5%|▌         | 19020/371472 [1:31:55<26:20:12,  3.72it/s]
  5%|▌         | 19021/371472 [1:31:55<25:58:01,  3.77it/s]
  5%|▌         | 19022/371472 [1:31:56<25:35:46,  3.82it/s]
  5%|▌         | 19023/371472 [1:31:56<25:17:13,  3.87it/s]
  5%|▌         | 19024/371472 [1:31:56<25:38:39,  3.82it/s]
  5%|▌         | 19025/371472 [1:31:57<26:09:02,  3.74it/s]
  5%|▌         | 19026/371472 [1:31:57<27:14:40,  3.59it/s]
  5%|▌         | 19027/371472 [1:31:57<27:21:10,  3.58it/s]
  5%|▌         | 19028/371472 [1:31:57<27:31:29,  3.56it/s]
  5%|▌         | 19029/371472 [1:31:58<29:30:06,  3.32it/s]
  5%|▌         | 19030/371472 [1:31:58<28:38:02,  3.42it/s]
  5%|▌         | 19031/371472 [1:31:58<27:16:52,  3.59it/s]
  5%|▌         | 19032/371472 [1:31:59<28:44:24,  3.41it/s]
  5%|▌         | 19033/371472 [1:31:59<29:42:35,  3.30it/s]
  5%|▌         | 19034/371472 [1:31:59<28:12:27,  3.47it/s]
  5%|▌         | 19035/371472 [1:31:59<27:47:32,  3.52it/s]
  5%|▌         | 19036/371472 [1:32:00<27:12:15,  3.60it/s]
  5%|▌         | 19037/371472 [1:32:00<27:13:37,  3.60it/s]
  5%|▌         | 19038/371472 [1:32:00<28:12:28,  3.47it/s]
  5%|▌         | 19039/371472 [1:32:01<30:19:18,  3.23it/s]
  5%|▌         | 19040/371472 [1:32:01<28:27:55,  3.44it/s]
                                                           
{'loss': 4.6677, 'learning_rate': 9.543299790988817e-07, 'epoch': 0.82}

  5%|▌         | 19040/371472 [1:32:01<28:27:55,  3.44it/s]
  5%|▌         | 19041/371472 [1:32:01<27:57:53,  3.50it/s]
  5%|▌         | 19042/371472 [1:32:01<27:44:47,  3.53it/s]
  5%|▌         | 19043/371472 [1:32:02<29:07:03,  3.36it/s]
  5%|▌         | 19044/371472 [1:32:02<28:49:27,  3.40it/s]
  5%|▌         | 19045/371472 [1:32:02<28:59:54,  3.38it/s]
  5%|▌         | 19046/371472 [1:32:03<28:44:57,  3.41it/s]
  5%|▌         | 19047/371472 [1:32:03<29:05:40,  3.36it/s]
  5%|▌         | 19048/371472 [1:32:03<28:32:58,  3.43it/s]
  5%|▌         | 19049/371472 [1:32:04<27:40:25,  3.54it/s]
  5%|▌         | 19050/371472 [1:32:04<28:05:30,  3.48it/s]
  5%|▌         | 19051/371472 [1:32:04<27:29:28,  3.56it/s]
  5%|▌         | 19052/371472 [1:32:04<28:00:51,  3.49it/s]
  5%|▌         | 19053/371472 [1:32:05<28:00:39,  3.49it/s]
  5%|▌         | 19054/371472 [1:32:05<29:37:10,  3.31it/s]
  5%|▌         | 19055/371472 [1:32:05<28:11:46,  3.47it/s]
  5%|▌         | 19056/371472 [1:32:06<29:38:59,  3.30it/s]
  5%|▌         | 19057/371472 [1:32:06<28:13:46,  3.47it/s]
  5%|▌         | 19058/371472 [1:32:06<27:58:28,  3.50it/s]
  5%|▌         | 19059/371472 [1:32:06<29:01:10,  3.37it/s]
  5%|▌         | 19060/371472 [1:32:07<28:13:10,  3.47it/s]
                                                           
{'loss': 4.5032, 'learning_rate': 9.542814971234028e-07, 'epoch': 0.82}

  5%|▌         | 19060/371472 [1:32:07<28:13:10,  3.47it/s]
  5%|▌         | 19061/371472 [1:32:07<30:12:09,  3.24it/s]
  5%|▌         | 19062/371472 [1:32:07<29:21:50,  3.33it/s]
  5%|▌         | 19063/371472 [1:32:08<29:35:31,  3.31it/s]
  5%|▌         | 19064/371472 [1:32:08<28:14:27,  3.47it/s]
  5%|▌         | 19065/371472 [1:32:08<28:04:30,  3.49it/s]
  5%|▌         | 19066/371472 [1:32:08<28:15:45,  3.46it/s]
  5%|▌         | 19067/371472 [1:32:09<28:00:18,  3.50it/s]
  5%|▌         | 19068/371472 [1:32:09<26:57:26,  3.63it/s]
  5%|▌         | 19069/371472 [1:32:09<25:53:13,  3.78it/s]
  5%|▌         | 19070/371472 [1:32:10<26:53:22,  3.64it/s]
  5%|▌         | 19071/371472 [1:32:10<25:53:20,  3.78it/s]
  5%|▌         | 19072/371472 [1:32:10<26:04:03,  3.76it/s]
  5%|▌         | 19073/371472 [1:32:10<25:52:18,  3.78it/s]
  5%|▌         | 19074/371472 [1:32:11<27:22:10,  3.58it/s]
  5%|▌         | 19075/371472 [1:32:11<27:39:40,  3.54it/s]
  5%|▌         | 19076/371472 [1:32:11<28:01:38,  3.49it/s]
  5%|▌         | 19077/371472 [1:32:12<28:04:47,  3.49it/s]
  5%|▌         | 19078/371472 [1:32:12<27:11:33,  3.60it/s]
  5%|▌         | 19079/371472 [1:32:12<26:58:41,  3.63it/s]
  5%|▌         | 19080/371472 [1:32:12<27:33:26,  3.55it/s]
                                                           
{'loss': 4.6686, 'learning_rate': 9.542330151479238e-07, 'epoch': 0.82}

  5%|▌         | 19080/371472 [1:32:12<27:33:26,  3.55it/s]
  5%|▌         | 19081/371472 [1:32:13<27:53:38,  3.51it/s]
  5%|▌         | 19082/371472 [1:32:13<28:01:47,  3.49it/s]
  5%|▌         | 19083/371472 [1:32:13<29:09:32,  3.36it/s]
  5%|▌         | 19084/371472 [1:32:14<30:02:18,  3.26it/s]
  5%|▌         | 19085/371472 [1:32:14<30:13:00,  3.24it/s]
  5%|▌         | 19086/371472 [1:32:14<28:54:59,  3.39it/s]
  5%|▌         | 19087/371472 [1:32:14<27:48:41,  3.52it/s]
  5%|▌         | 19088/371472 [1:32:15<26:59:40,  3.63it/s]
  5%|▌         | 19089/371472 [1:32:15<28:34:01,  3.43it/s]
  5%|▌         | 19090/371472 [1:32:15<28:04:09,  3.49it/s]
  5%|▌         | 19091/371472 [1:32:16<27:41:24,  3.53it/s]
  5%|▌         | 19092/371472 [1:32:16<27:05:36,  3.61it/s]
  5%|▌         | 19093/371472 [1:32:16<27:44:57,  3.53it/s]
  5%|▌         | 19094/371472 [1:32:16<27:35:45,  3.55it/s]
  5%|▌         | 19095/371472 [1:32:17<26:38:53,  3.67it/s]
  5%|▌         | 19096/371472 [1:32:17<28:45:52,  3.40it/s]
  5%|▌         | 19097/371472 [1:32:17<28:44:04,  3.41it/s]
  5%|▌         | 19098/371472 [1:32:18<27:22:08,  3.58it/s]
  5%|▌         | 19099/371472 [1:32:18<29:37:38,  3.30it/s]
  5%|▌         | 19100/371472 [1:32:18<29:20:31,  3.34it/s]
                                                           
{'loss': 4.5099, 'learning_rate': 9.54184533172445e-07, 'epoch': 0.82}

  5%|▌         | 19100/371472 [1:32:18<29:20:31,  3.34it/s]
  5%|▌         | 19101/371472 [1:32:18<29:00:35,  3.37it/s]
  5%|▌         | 19102/371472 [1:32:19<30:01:41,  3.26it/s]
  5%|▌         | 19103/371472 [1:32:19<29:40:12,  3.30it/s]
  5%|▌         | 19104/371472 [1:32:19<28:58:49,  3.38it/s]
  5%|▌         | 19105/371472 [1:32:20<29:35:18,  3.31it/s]
  5%|▌         | 19106/371472 [1:32:20<30:12:38,  3.24it/s]
  5%|▌         | 19107/371472 [1:32:20<28:39:32,  3.42it/s]
  5%|▌         | 19108/371472 [1:32:21<27:31:27,  3.56it/s]
  5%|▌         | 19109/371472 [1:32:21<27:58:54,  3.50it/s]
  5%|▌         | 19110/371472 [1:32:21<27:29:06,  3.56it/s]
  5%|▌         | 19111/371472 [1:32:21<27:03:04,  3.62it/s]
  5%|▌         | 19112/371472 [1:32:22<26:15:31,  3.73it/s]
  5%|▌         | 19113/371472 [1:32:22<27:11:28,  3.60it/s]
  5%|▌         | 19114/371472 [1:32:22<26:27:54,  3.70it/s]
  5%|▌         | 19115/371472 [1:32:23<28:47:34,  3.40it/s]
  5%|▌         | 19116/371472 [1:32:23<29:38:24,  3.30it/s]
  5%|▌         | 19117/371472 [1:32:23<28:06:39,  3.48it/s]
  5%|▌         | 19118/371472 [1:32:23<28:12:57,  3.47it/s]
  5%|▌         | 19119/371472 [1:32:24<27:50:20,  3.52it/s]
  5%|▌         | 19120/371472 [1:32:24<27:33:11,  3.55it/s]
                                                           
{'loss': 4.5959, 'learning_rate': 9.54136051196966e-07, 'epoch': 0.82}

  5%|▌         | 19120/371472 [1:32:24<27:33:11,  3.55it/s]
  5%|▌         | 19121/371472 [1:32:24<27:22:21,  3.58it/s]
  5%|▌         | 19122/371472 [1:32:24<27:15:51,  3.59it/s]
  5%|▌         | 19123/371472 [1:32:25<28:42:26,  3.41it/s]
  5%|▌         | 19124/371472 [1:32:25<28:20:13,  3.45it/s]
  5%|▌         | 19125/371472 [1:32:25<28:15:59,  3.46it/s]
  5%|▌         | 19126/371472 [1:32:26<28:22:01,  3.45it/s]
  5%|▌         | 19127/371472 [1:32:26<27:38:35,  3.54it/s]
  5%|▌         | 19128/371472 [1:32:26<30:12:01,  3.24it/s]
  5%|▌         | 19129/371472 [1:32:27<28:29:24,  3.44it/s]
  5%|▌         | 19130/371472 [1:32:27<28:50:32,  3.39it/s]
  5%|▌         | 19131/371472 [1:32:27<27:47:05,  3.52it/s]
  5%|▌         | 19132/371472 [1:32:27<27:24:45,  3.57it/s]
  5%|▌         | 19133/371472 [1:32:28<29:26:58,  3.32it/s]
  5%|▌         | 19134/371472 [1:32:28<29:55:40,  3.27it/s]
  5%|▌         | 19135/371472 [1:32:28<29:01:59,  3.37it/s]
  5%|▌         | 19136/371472 [1:32:29<27:24:42,  3.57it/s]
  5%|▌         | 19137/371472 [1:32:29<28:35:46,  3.42it/s]
  5%|▌         | 19138/371472 [1:32:29<27:35:12,  3.55it/s]
  5%|▌         | 19139/371472 [1:32:29<28:21:06,  3.45it/s]
  5%|▌         | 19140/371472 [1:32:30<28:08:55,  3.48it/s]
                                                           
{'loss': 4.757, 'learning_rate': 9.540875692214873e-07, 'epoch': 0.82}

  5%|▌         | 19140/371472 [1:32:30<28:08:55,  3.48it/s]
  5%|▌         | 19141/371472 [1:32:30<29:37:15,  3.30it/s]
  5%|▌         | 19142/371472 [1:32:30<28:22:38,  3.45it/s]
  5%|▌         | 19143/371472 [1:32:31<29:35:48,  3.31it/s]
  5%|▌         | 19144/371472 [1:32:31<29:28:54,  3.32it/s]
  5%|▌         | 19145/371472 [1:32:31<29:01:17,  3.37it/s]
  5%|▌         | 19146/371472 [1:32:32<28:55:28,  3.38it/s]
  5%|▌         | 19147/371472 [1:32:32<28:15:33,  3.46it/s]
  5%|▌         | 19148/371472 [1:32:32<28:37:35,  3.42it/s]
  5%|▌         | 19149/371472 [1:32:32<28:15:11,  3.46it/s]
  5%|▌         | 19150/371472 [1:32:33<27:59:35,  3.50it/s]
  5%|▌         | 19151/371472 [1:32:33<26:57:50,  3.63it/s]
  5%|▌         | 19152/371472 [1:32:33<28:02:30,  3.49it/s]
  5%|▌         | 19153/371472 [1:32:34<29:03:55,  3.37it/s]
  5%|▌         | 19154/371472 [1:32:34<28:09:24,  3.48it/s]
  5%|▌         | 19155/371472 [1:32:34<27:26:25,  3.57it/s]
  5%|▌         | 19156/371472 [1:32:34<26:45:30,  3.66it/s]
  5%|▌         | 19157/371472 [1:32:35<28:08:00,  3.48it/s]
  5%|▌         | 19158/371472 [1:32:35<28:50:52,  3.39it/s]
  5%|▌         | 19159/371472 [1:32:35<28:17:40,  3.46it/s]
  5%|▌         | 19160/371472 [1:32:36<27:20:17,  3.58it/s]
                                                           
{'loss': 4.6209, 'learning_rate': 9.540390872460081e-07, 'epoch': 0.83}

  5%|▌         | 19160/371472 [1:32:36<27:20:17,  3.58it/s]
  5%|▌         | 19161/371472 [1:32:36<27:50:03,  3.52it/s]
  5%|▌         | 19162/371472 [1:32:36<28:08:00,  3.48it/s]
  5%|▌         | 19163/371472 [1:32:36<28:37:05,  3.42it/s]
  5%|▌         | 19164/371472 [1:32:37<28:05:38,  3.48it/s]
  5%|▌         | 19165/371472 [1:32:37<27:58:48,  3.50it/s]
  5%|▌         | 19166/371472 [1:32:37<27:23:29,  3.57it/s]
  5%|▌         | 19167/371472 [1:32:38<27:36:34,  3.54it/s]
  5%|▌         | 19168/371472 [1:32:38<28:53:58,  3.39it/s]
  5%|▌         | 19169/371472 [1:32:38<27:32:41,  3.55it/s]
  5%|▌         | 19170/371472 [1:32:38<27:31:50,  3.55it/s]
  5%|▌         | 19171/371472 [1:32:39<26:49:53,  3.65it/s]
  5%|▌         | 19172/371472 [1:32:39<27:58:01,  3.50it/s]
  5%|▌         | 19173/371472 [1:32:39<27:30:49,  3.56it/s]
  5%|▌         | 19174/371472 [1:32:40<29:19:08,  3.34it/s]
  5%|▌         | 19175/371472 [1:32:40<29:21:21,  3.33it/s]
  5%|▌         | 19176/371472 [1:32:40<29:26:23,  3.32it/s]
  5%|▌         | 19177/371472 [1:32:40<29:57:27,  3.27it/s]
  5%|▌         | 19178/371472 [1:32:41<28:40:17,  3.41it/s]
  5%|▌         | 19179/371472 [1:32:41<29:01:35,  3.37it/s]
  5%|▌         | 19180/371472 [1:32:41<30:24:27,  3.22it/s]
                                                           
{'loss': 4.6562, 'learning_rate': 9.539906052705294e-07, 'epoch': 0.83}

  5%|▌         | 19180/371472 [1:32:41<30:24:27,  3.22it/s]
  5%|▌         | 19181/371472 [1:32:42<29:31:02,  3.32it/s]
  5%|▌         | 19182/371472 [1:32:42<30:03:19,  3.26it/s]
  5%|▌         | 19183/371472 [1:32:42<31:37:15,  3.09it/s]
  5%|▌         | 19184/371472 [1:32:43<33:28:01,  2.92it/s]
  5%|▌         | 19185/371472 [1:32:43<32:15:09,  3.03it/s]
  5%|▌         | 19186/371472 [1:32:43<30:57:13,  3.16it/s]
  5%|▌         | 19187/371472 [1:32:44<29:20:17,  3.34it/s]
  5%|▌         | 19188/371472 [1:32:44<28:47:57,  3.40it/s]
  5%|▌         | 19189/371472 [1:32:44<30:16:31,  3.23it/s]
  5%|▌         | 19190/371472 [1:32:44<29:31:56,  3.31it/s]
  5%|▌         | 19191/371472 [1:32:45<29:10:57,  3.35it/s]
  5%|▌         | 19192/371472 [1:32:45<28:27:30,  3.44it/s]
  5%|▌         | 19193/371472 [1:32:45<28:16:39,  3.46it/s]
  5%|▌         | 19194/371472 [1:32:46<27:29:58,  3.56it/s]
  5%|▌         | 19195/371472 [1:32:46<27:12:48,  3.60it/s]
  5%|▌         | 19196/371472 [1:32:46<28:36:18,  3.42it/s]
  5%|▌         | 19197/371472 [1:32:46<28:43:08,  3.41it/s]
  5%|▌         | 19198/371472 [1:32:47<27:26:45,  3.57it/s]
  5%|▌         | 19199/371472 [1:32:47<27:03:19,  3.62it/s]
  5%|▌         | 19200/371472 [1:32:47<26:33:57,  3.68it/s]
                                                           
{'loss': 4.5569, 'learning_rate': 9.539421232950505e-07, 'epoch': 0.83}

  5%|▌         | 19200/371472 [1:32:47<26:33:57,  3.68it/s]
  5%|▌         | 19201/371472 [1:32:48<26:34:23,  3.68it/s]
  5%|▌         | 19202/371472 [1:32:48<29:30:39,  3.32it/s]
  5%|▌         | 19203/371472 [1:32:48<28:18:34,  3.46it/s]
  5%|▌         | 19204/371472 [1:32:48<27:15:20,  3.59it/s]
  5%|▌         | 19205/371472 [1:32:49<26:33:09,  3.69it/s]
  5%|▌         | 19206/371472 [1:32:49<26:36:15,  3.68it/s]
  5%|▌         | 19207/371472 [1:32:49<27:56:54,  3.50it/s]
  5%|▌         | 19208/371472 [1:32:50<27:48:21,  3.52it/s]
  5%|▌         | 19209/371472 [1:32:50<28:29:11,  3.43it/s]
  5%|▌         | 19210/371472 [1:32:50<28:11:01,  3.47it/s]
  5%|▌         | 19211/371472 [1:32:50<27:46:25,  3.52it/s]
  5%|▌         | 19212/371472 [1:32:51<28:15:25,  3.46it/s]
  5%|▌         | 19213/371472 [1:32:51<28:23:16,  3.45it/s]
  5%|▌         | 19214/371472 [1:32:51<27:45:45,  3.52it/s]
  5%|▌         | 19215/371472 [1:32:52<30:36:10,  3.20it/s]
  5%|▌         | 19216/371472 [1:32:52<31:55:19,  3.07it/s]
  5%|▌         | 19217/371472 [1:32:52<30:21:31,  3.22it/s]
  5%|▌         | 19218/371472 [1:32:53<28:35:28,  3.42it/s]
  5%|▌         | 19219/371472 [1:32:53<27:58:10,  3.50it/s]
  5%|▌         | 19220/371472 [1:32:53<27:16:38,  3.59it/s]
                                                           
{'loss': 4.5734, 'learning_rate': 9.538936413195716e-07, 'epoch': 0.83}

  5%|▌         | 19220/371472 [1:32:53<27:16:38,  3.59it/s]
  5%|▌         | 19221/371472 [1:32:53<28:01:47,  3.49it/s]
  5%|▌         | 19222/371472 [1:32:54<26:47:28,  3.65it/s]
  5%|▌         | 19223/371472 [1:32:54<26:37:51,  3.67it/s]
  5%|▌         | 19224/371472 [1:32:54<26:43:53,  3.66it/s]
  5%|▌         | 19225/371472 [1:32:54<26:54:34,  3.64it/s]
  5%|▌         | 19226/371472 [1:32:55<27:16:04,  3.59it/s]
  5%|▌         | 19227/371472 [1:32:55<27:43:17,  3.53it/s]
  5%|▌         | 19228/371472 [1:32:55<27:40:55,  3.53it/s]
  5%|▌         | 19229/371472 [1:32:56<27:29:17,  3.56it/s]
  5%|▌         | 19230/371472 [1:32:56<27:41:32,  3.53it/s]
  5%|▌         | 19231/371472 [1:32:56<27:03:39,  3.62it/s]
  5%|▌         | 19232/371472 [1:32:56<28:33:52,  3.43it/s]
  5%|▌         | 19233/371472 [1:32:57<30:10:49,  3.24it/s]
  5%|▌         | 19234/371472 [1:32:57<29:59:52,  3.26it/s]
  5%|▌         | 19235/371472 [1:32:57<28:17:17,  3.46it/s]
  5%|▌         | 19236/371472 [1:32:58<31:36:23,  3.10it/s]
  5%|▌         | 19237/371472 [1:32:58<30:33:34,  3.20it/s]
  5%|▌         | 19238/371472 [1:32:58<29:43:24,  3.29it/s]
  5%|▌         | 19239/371472 [1:32:59<29:29:49,  3.32it/s]
  5%|▌         | 19240/371472 [1:32:59<28:13:14,  3.47it/s]
                                                           
{'loss': 4.4665, 'learning_rate': 9.538451593440926e-07, 'epoch': 0.83}

  5%|▌         | 19240/371472 [1:32:59<28:13:14,  3.47it/s]
  5%|▌         | 19241/371472 [1:32:59<27:45:59,  3.52it/s]
  5%|▌         | 19242/371472 [1:32:59<27:54:41,  3.51it/s]
  5%|▌         | 19243/371472 [1:33:00<28:35:56,  3.42it/s]
  5%|▌         | 19244/371472 [1:33:00<27:58:32,  3.50it/s]
  5%|▌         | 19245/371472 [1:33:00<27:27:04,  3.56it/s]
  5%|▌         | 19246/371472 [1:33:01<27:11:27,  3.60it/s]
  5%|▌         | 19247/371472 [1:33:01<28:07:11,  3.48it/s]
  5%|▌         | 19248/371472 [1:33:01<29:07:32,  3.36it/s]
  5%|▌         | 19249/371472 [1:33:01<27:47:27,  3.52it/s]
  5%|▌         | 19250/371472 [1:33:02<27:44:40,  3.53it/s]
  5%|▌         | 19251/371472 [1:33:02<31:06:01,  3.15it/s]
  5%|▌         | 19252/371472 [1:33:02<29:17:27,  3.34it/s]
  5%|▌         | 19253/371472 [1:33:03<30:54:24,  3.17it/s]
  5%|▌         | 19254/371472 [1:33:03<32:14:56,  3.03it/s]
  5%|▌         | 19255/371472 [1:33:03<30:37:08,  3.20it/s]
  5%|▌         | 19256/371472 [1:33:04<29:21:08,  3.33it/s]
  5%|▌         | 19257/371472 [1:33:04<29:01:15,  3.37it/s]
  5%|▌         | 19258/371472 [1:33:04<28:59:30,  3.37it/s]
  5%|▌         | 19259/371472 [1:33:05<29:59:09,  3.26it/s]
  5%|▌         | 19260/371472 [1:33:05<30:02:32,  3.26it/s]
                                                           
{'loss': 4.8744, 'learning_rate': 9.537966773686137e-07, 'epoch': 0.83}

  5%|▌         | 19260/371472 [1:33:05<30:02:32,  3.26it/s]
  5%|▌         | 19261/371472 [1:33:05<28:44:57,  3.40it/s]
  5%|▌         | 19262/371472 [1:33:05<28:31:51,  3.43it/s]
  5%|▌         | 19263/371472 [1:33:06<27:45:56,  3.52it/s]
  5%|▌         | 19264/371472 [1:33:06<27:35:47,  3.55it/s]
  5%|▌         | 19265/371472 [1:33:06<27:11:27,  3.60it/s]
  5%|▌         | 19266/371472 [1:33:07<27:00:41,  3.62it/s]
  5%|▌         | 19267/371472 [1:33:07<28:02:49,  3.49it/s]
  5%|▌         | 19268/371472 [1:33:07<29:00:19,  3.37it/s]
  5%|▌         | 19269/371472 [1:33:07<28:52:17,  3.39it/s]
  5%|▌         | 19270/371472 [1:33:08<27:53:16,  3.51it/s]
  5%|▌         | 19271/371472 [1:33:08<27:37:53,  3.54it/s]
  5%|▌         | 19272/371472 [1:33:08<27:00:21,  3.62it/s]
  5%|▌         | 19273/371472 [1:33:08<26:43:25,  3.66it/s]
  5%|▌         | 19274/371472 [1:33:09<26:26:41,  3.70it/s]
  5%|▌         | 19275/371472 [1:33:09<26:00:33,  3.76it/s]
  5%|▌         | 19276/371472 [1:33:09<26:53:36,  3.64it/s]
  5%|▌         | 19277/371472 [1:33:10<27:20:09,  3.58it/s]
  5%|▌         | 19278/371472 [1:33:10<27:34:28,  3.55it/s]
  5%|▌         | 19279/371472 [1:33:10<28:41:20,  3.41it/s]
  5%|▌         | 19280/371472 [1:33:11<28:53:00,  3.39it/s]
                                                           
{'loss': 4.7477, 'learning_rate': 9.53748195393135e-07, 'epoch': 0.83}

  5%|▌         | 19280/371472 [1:33:11<28:53:00,  3.39it/s]
  5%|▌         | 19281/371472 [1:33:11<27:36:44,  3.54it/s]
  5%|▌         | 19282/371472 [1:33:11<27:26:29,  3.57it/s]
  5%|▌         | 19283/371472 [1:33:11<27:16:17,  3.59it/s]
  5%|▌         | 19284/371472 [1:33:12<26:44:20,  3.66it/s]
  5%|▌         | 19285/371472 [1:33:12<27:08:27,  3.60it/s]
  5%|▌         | 19286/371472 [1:33:12<27:58:55,  3.50it/s]
  5%|▌         | 19287/371472 [1:33:12<26:59:40,  3.62it/s]
  5%|▌         | 19288/371472 [1:33:13<28:12:29,  3.47it/s]
  5%|▌         | 19289/371472 [1:33:13<29:49:04,  3.28it/s]
  5%|▌         | 19290/371472 [1:33:13<29:22:38,  3.33it/s]
  5%|▌         | 19291/371472 [1:33:14<30:17:47,  3.23it/s]
  5%|▌         | 19292/371472 [1:33:14<28:16:25,  3.46it/s]
  5%|▌         | 19293/371472 [1:33:14<28:13:52,  3.47it/s]
  5%|▌         | 19294/371472 [1:33:14<27:55:38,  3.50it/s]
  5%|▌         | 19295/371472 [1:33:15<27:26:40,  3.56it/s]
  5%|▌         | 19296/371472 [1:33:15<28:13:33,  3.47it/s]
  5%|▌         | 19297/371472 [1:33:15<27:57:24,  3.50it/s]
  5%|▌         | 19298/371472 [1:33:16<27:54:59,  3.50it/s]
  5%|▌         | 19299/371472 [1:33:16<27:30:17,  3.56it/s]
  5%|▌         | 19300/371472 [1:33:16<27:06:18,  3.61it/s]
                                                           
{'loss': 4.4835, 'learning_rate': 9.53699713417656e-07, 'epoch': 0.83}

  5%|▌         | 19300/371472 [1:33:16<27:06:18,  3.61it/s]
  5%|▌         | 19301/371472 [1:33:17<30:01:53,  3.26it/s]
  5%|▌         | 19302/371472 [1:33:17<28:41:21,  3.41it/s]
  5%|▌         | 19303/371472 [1:33:17<28:06:20,  3.48it/s]
  5%|▌         | 19304/371472 [1:33:17<27:46:30,  3.52it/s]
  5%|▌         | 19305/371472 [1:33:18<29:10:05,  3.35it/s]
  5%|▌         | 19306/371472 [1:33:18<28:43:16,  3.41it/s]
  5%|▌         | 19307/371472 [1:33:18<28:39:28,  3.41it/s]
  5%|▌         | 19308/371472 [1:33:19<28:07:29,  3.48it/s]
  5%|▌         | 19309/371472 [1:33:19<27:02:06,  3.62it/s]
  5%|▌         | 19310/371472 [1:33:19<26:51:15,  3.64it/s]
  5%|▌         | 19311/371472 [1:33:19<26:31:49,  3.69it/s]
  5%|▌         | 19312/371472 [1:33:20<26:10:23,  3.74it/s]
  5%|▌         | 19313/371472 [1:33:20<26:02:33,  3.76it/s]
  5%|▌         | 19314/371472 [1:33:20<26:23:24,  3.71it/s]
  5%|▌         | 19315/371472 [1:33:20<25:59:01,  3.76it/s]
  5%|▌         | 19316/371472 [1:33:21<27:39:38,  3.54it/s]
  5%|▌         | 19317/371472 [1:33:21<28:09:51,  3.47it/s]
  5%|▌         | 19318/371472 [1:33:21<28:50:35,  3.39it/s]
  5%|▌         | 19319/371472 [1:33:22<29:50:36,  3.28it/s]
  5%|▌         | 19320/371472 [1:33:22<30:47:32,  3.18it/s]
                                                           
{'loss': 4.7603, 'learning_rate': 9.536512314421771e-07, 'epoch': 0.83}

  5%|▌         | 19320/371472 [1:33:22<30:47:32,  3.18it/s]
  5%|▌         | 19321/371472 [1:33:22<29:20:44,  3.33it/s]
  5%|▌         | 19322/371472 [1:33:23<28:09:41,  3.47it/s]
  5%|▌         | 19323/371472 [1:33:23<28:25:34,  3.44it/s]
  5%|▌         | 19324/371472 [1:33:23<27:22:51,  3.57it/s]
  5%|▌         | 19325/371472 [1:33:23<27:42:54,  3.53it/s]
  5%|▌         | 19326/371472 [1:33:24<27:16:05,  3.59it/s]
  5%|▌         | 19327/371472 [1:33:24<28:03:31,  3.49it/s]
  5%|▌         | 19328/371472 [1:33:24<27:37:43,  3.54it/s]
  5%|▌         | 19329/371472 [1:33:25<28:08:19,  3.48it/s]
  5%|▌         | 19330/371472 [1:33:25<27:41:11,  3.53it/s]
  5%|▌         | 19331/371472 [1:33:25<27:56:29,  3.50it/s]
  5%|▌         | 19332/371472 [1:33:25<27:24:57,  3.57it/s]
  5%|▌         | 19333/371472 [1:33:26<26:35:11,  3.68it/s]
  5%|▌         | 19334/371472 [1:33:26<30:53:06,  3.17it/s]
  5%|▌         | 19335/371472 [1:33:26<29:26:50,  3.32it/s]
  5%|▌         | 19336/371472 [1:33:27<30:12:25,  3.24it/s]
  5%|▌         | 19337/371472 [1:33:27<28:28:05,  3.44it/s]
  5%|▌         | 19338/371472 [1:33:27<28:34:30,  3.42it/s]
  5%|▌         | 19339/371472 [1:33:27<29:09:52,  3.35it/s]
  5%|▌         | 19340/371472 [1:33:28<31:19:25,  3.12it/s]
                                                           
{'loss': 4.6376, 'learning_rate': 9.536027494666983e-07, 'epoch': 0.83}

  5%|▌         | 19340/371472 [1:33:28<31:19:25,  3.12it/s]
  5%|▌         | 19341/371472 [1:33:28<29:59:06,  3.26it/s]
  5%|▌         | 19342/371472 [1:33:28<28:56:05,  3.38it/s]
  5%|▌         | 19343/371472 [1:33:29<27:36:55,  3.54it/s]
  5%|▌         | 19344/371472 [1:33:29<27:17:31,  3.58it/s]
  5%|▌         | 19345/371472 [1:33:29<27:05:35,  3.61it/s]
  5%|▌         | 19346/371472 [1:33:29<28:43:36,  3.40it/s]
  5%|▌         | 19347/371472 [1:33:30<27:51:53,  3.51it/s]
  5%|▌         | 19348/371472 [1:33:30<27:04:43,  3.61it/s]
  5%|▌         | 19349/371472 [1:33:30<28:08:07,  3.48it/s]
  5%|▌         | 19350/371472 [1:33:31<27:08:41,  3.60it/s]
  5%|▌         | 19351/371472 [1:33:31<27:20:13,  3.58it/s]
  5%|▌         | 19352/371472 [1:33:31<27:07:59,  3.60it/s]
  5%|▌         | 19353/371472 [1:33:31<27:37:40,  3.54it/s]
  5%|▌         | 19354/371472 [1:33:32<27:44:57,  3.52it/s]
  5%|▌         | 19355/371472 [1:33:32<28:23:40,  3.44it/s]
  5%|▌         | 19356/371472 [1:33:32<27:45:54,  3.52it/s]
  5%|▌         | 19357/371472 [1:33:33<28:04:40,  3.48it/s]
  5%|▌         | 19358/371472 [1:33:33<29:26:24,  3.32it/s]
  5%|▌         | 19359/371472 [1:33:33<29:06:35,  3.36it/s]
  5%|▌         | 19360/371472 [1:33:33<28:20:38,  3.45it/s]
                                                           
{'loss': 4.688, 'learning_rate': 9.535542674912193e-07, 'epoch': 0.83}

  5%|▌         | 19360/371472 [1:33:33<28:20:38,  3.45it/s]
  5%|▌         | 19361/371472 [1:33:34<27:23:26,  3.57it/s]
  5%|▌         | 19362/371472 [1:33:34<28:36:44,  3.42it/s]
  5%|▌         | 19363/371472 [1:33:34<27:27:55,  3.56it/s]
  5%|▌         | 19364/371472 [1:33:35<27:48:22,  3.52it/s]
  5%|▌         | 19365/371472 [1:33:35<28:45:03,  3.40it/s]
  5%|▌         | 19366/371472 [1:33:35<28:07:56,  3.48it/s]
  5%|▌         | 19367/371472 [1:33:35<28:09:03,  3.47it/s]
  5%|▌         | 19368/371472 [1:33:36<29:09:29,  3.35it/s]
  5%|▌         | 19369/371472 [1:33:36<28:02:27,  3.49it/s]
  5%|▌         | 19370/371472 [1:33:36<27:40:05,  3.53it/s]
  5%|▌         | 19371/371472 [1:33:37<27:11:26,  3.60it/s]
  5%|▌         | 19372/371472 [1:33:37<27:20:35,  3.58it/s]
  5%|▌         | 19373/371472 [1:33:37<28:45:37,  3.40it/s]
  5%|▌         | 19374/371472 [1:33:38<29:33:27,  3.31it/s]
  5%|▌         | 19375/371472 [1:33:38<28:08:39,  3.48it/s]
  5%|▌         | 19376/371472 [1:33:38<28:42:26,  3.41it/s]
  5%|▌         | 19377/371472 [1:33:39<33:43:54,  2.90it/s]
  5%|▌         | 19378/371472 [1:33:39<33:20:09,  2.93it/s]
  5%|▌         | 19379/371472 [1:33:39<31:46:57,  3.08it/s]
  5%|▌         | 19380/371472 [1:33:39<30:14:52,  3.23it/s]
                                                           
{'loss': 4.4329, 'learning_rate': 9.535057855157404e-07, 'epoch': 0.83}

  5%|▌         | 19380/371472 [1:33:39<30:14:52,  3.23it/s]
  5%|▌         | 19381/371472 [1:33:40<29:19:14,  3.34it/s]
  5%|▌         | 19382/371472 [1:33:40<28:03:36,  3.49it/s]
  5%|▌         | 19383/371472 [1:33:40<27:23:57,  3.57it/s]
  5%|▌         | 19384/371472 [1:33:41<27:04:49,  3.61it/s]
  5%|▌         | 19385/371472 [1:33:41<27:47:28,  3.52it/s]
  5%|▌         | 19386/371472 [1:33:41<28:16:14,  3.46it/s]
  5%|▌         | 19387/371472 [1:33:41<29:41:57,  3.29it/s]
  5%|▌         | 19388/371472 [1:33:42<28:24:47,  3.44it/s]
  5%|▌         | 19389/371472 [1:33:42<26:58:44,  3.63it/s]
  5%|▌         | 19390/371472 [1:33:42<26:14:57,  3.73it/s]
  5%|▌         | 19391/371472 [1:33:42<26:29:45,  3.69it/s]
  5%|▌         | 19392/371472 [1:33:43<27:01:29,  3.62it/s]
  5%|▌         | 19393/371472 [1:33:43<28:28:45,  3.43it/s]
  5%|▌         | 19394/371472 [1:33:43<28:08:52,  3.47it/s]
  5%|▌         | 19395/371472 [1:33:44<26:56:17,  3.63it/s]
  5%|▌         | 19396/371472 [1:33:44<26:09:07,  3.74it/s]
  5%|▌         | 19397/371472 [1:33:44<25:50:06,  3.79it/s]
  5%|▌         | 19398/371472 [1:33:44<26:04:50,  3.75it/s]
  5%|▌         | 19399/371472 [1:33:45<25:47:05,  3.79it/s]
  5%|▌         | 19400/371472 [1:33:45<27:21:14,  3.58it/s]
                                                           
{'loss': 4.7792, 'learning_rate': 9.534573035402615e-07, 'epoch': 0.84}

  5%|▌         | 19400/371472 [1:33:45<27:21:14,  3.58it/s]
  5%|▌         | 19401/371472 [1:33:45<27:05:50,  3.61it/s]
  5%|▌         | 19402/371472 [1:33:46<27:34:00,  3.55it/s]
  5%|▌         | 19403/371472 [1:33:46<26:47:52,  3.65it/s]
  5%|▌         | 19404/371472 [1:33:46<27:33:41,  3.55it/s]
  5%|▌         | 19405/371472 [1:33:46<27:04:07,  3.61it/s]
  5%|▌         | 19406/371472 [1:33:47<27:04:23,  3.61it/s]
  5%|▌         | 19407/371472 [1:33:47<27:16:14,  3.59it/s]
  5%|▌         | 19408/371472 [1:33:47<28:06:47,  3.48it/s]
  5%|▌         | 19409/371472 [1:33:48<28:25:13,  3.44it/s]
  5%|▌         | 19410/371472 [1:33:48<28:41:03,  3.41it/s]
  5%|▌         | 19411/371472 [1:33:48<28:15:25,  3.46it/s]
  5%|▌         | 19412/371472 [1:33:48<28:44:51,  3.40it/s]
  5%|▌         | 19413/371472 [1:33:49<28:22:42,  3.45it/s]
  5%|▌         | 19414/371472 [1:33:49<27:06:34,  3.61it/s]
  5%|▌         | 19415/371472 [1:33:49<26:33:16,  3.68it/s]
  5%|▌         | 19416/371472 [1:33:49<26:21:01,  3.71it/s]
  5%|▌         | 19417/371472 [1:33:50<25:54:30,  3.77it/s]
  5%|▌         | 19418/371472 [1:33:50<26:01:30,  3.76it/s]
  5%|▌         | 19419/371472 [1:33:50<26:32:19,  3.68it/s]
  5%|▌         | 19420/371472 [1:33:51<26:03:50,  3.75it/s]
                                                           
{'loss': 4.6019, 'learning_rate': 9.534088215647826e-07, 'epoch': 0.84}

  5%|▌         | 19420/371472 [1:33:51<26:03:50,  3.75it/s]
  5%|▌         | 19421/371472 [1:33:51<28:02:33,  3.49it/s]
  5%|▌         | 19422/371472 [1:33:51<27:27:10,  3.56it/s]
  5%|▌         | 19423/371472 [1:33:51<27:19:51,  3.58it/s]
  5%|▌         | 19424/371472 [1:33:52<27:38:41,  3.54it/s]
  5%|▌         | 19425/371472 [1:33:52<27:00:29,  3.62it/s]
  5%|▌         | 19426/371472 [1:33:52<26:38:53,  3.67it/s]
  5%|▌         | 19427/371472 [1:33:53<26:36:26,  3.68it/s]
  5%|▌         | 19428/371472 [1:33:53<27:30:53,  3.55it/s]
  5%|▌         | 19429/371472 [1:33:53<28:15:11,  3.46it/s]
  5%|▌         | 19430/371472 [1:33:53<28:54:40,  3.38it/s]
  5%|▌         | 19431/371472 [1:33:54<28:46:35,  3.40it/s]
  5%|▌         | 19432/371472 [1:33:54<28:24:13,  3.44it/s]
  5%|▌         | 19433/371472 [1:33:54<27:42:31,  3.53it/s]
  5%|▌         | 19434/371472 [1:33:55<27:11:45,  3.60it/s]
  5%|▌         | 19435/371472 [1:33:55<26:46:45,  3.65it/s]
  5%|▌         | 19436/371472 [1:33:55<27:04:16,  3.61it/s]
  5%|▌         | 19437/371472 [1:33:55<27:11:37,  3.60it/s]
  5%|▌         | 19438/371472 [1:33:56<28:36:06,  3.42it/s]
  5%|▌         | 19439/371472 [1:33:56<29:57:59,  3.26it/s]
  5%|▌         | 19440/371472 [1:33:56<28:11:44,  3.47it/s]
                                                           
{'loss': 4.6412, 'learning_rate': 9.533603395893038e-07, 'epoch': 0.84}

  5%|▌         | 19440/371472 [1:33:56<28:11:44,  3.47it/s]
  5%|▌         | 19441/371472 [1:33:57<28:32:47,  3.43it/s]
  5%|▌         | 19442/371472 [1:33:57<28:32:54,  3.43it/s]
  5%|▌         | 19443/371472 [1:33:57<27:38:37,  3.54it/s]
  5%|▌         | 19444/371472 [1:33:57<26:54:50,  3.63it/s]
  5%|▌         | 19445/371472 [1:33:58<26:33:40,  3.68it/s]
  5%|▌         | 19446/371472 [1:33:58<26:10:57,  3.73it/s]
  5%|▌         | 19447/371472 [1:33:58<26:48:09,  3.65it/s]
  5%|▌         | 19448/371472 [1:33:58<26:28:13,  3.69it/s]
  5%|▌         | 19449/371472 [1:33:59<26:19:22,  3.71it/s]
  5%|▌         | 19450/371472 [1:33:59<26:28:15,  3.69it/s]
  5%|▌         | 19451/371472 [1:33:59<26:32:11,  3.68it/s]
  5%|▌         | 19452/371472 [1:34:00<26:17:07,  3.72it/s]
  5%|▌         | 19453/371472 [1:34:00<26:37:35,  3.67it/s]
  5%|▌         | 19454/371472 [1:34:00<26:31:32,  3.69it/s]
  5%|▌         | 19455/371472 [1:34:00<27:22:38,  3.57it/s]
  5%|▌         | 19456/371472 [1:34:01<27:17:35,  3.58it/s]
  5%|▌         | 19457/371472 [1:34:01<27:26:51,  3.56it/s]
  5%|▌         | 19458/371472 [1:34:01<26:30:38,  3.69it/s]
  5%|▌         | 19459/371472 [1:34:01<27:27:45,  3.56it/s]
  5%|▌         | 19460/371472 [1:34:02<27:15:13,  3.59it/s]
                                                           
{'loss': 4.8209, 'learning_rate': 9.533118576138249e-07, 'epoch': 0.84}

  5%|▌         | 19460/371472 [1:34:02<27:15:13,  3.59it/s]
  5%|▌         | 19461/371472 [1:34:02<27:34:35,  3.55it/s]
  5%|▌         | 19462/371472 [1:34:02<27:13:46,  3.59it/s]
  5%|▌         | 19463/371472 [1:34:03<26:58:46,  3.62it/s]
  5%|▌         | 19464/371472 [1:34:03<28:59:44,  3.37it/s]
  5%|▌         | 19465/371472 [1:34:03<29:58:17,  3.26it/s]
  5%|▌         | 19466/371472 [1:34:04<28:24:58,  3.44it/s]
  5%|▌         | 19467/371472 [1:34:04<28:16:23,  3.46it/s]
  5%|▌         | 19468/371472 [1:34:04<30:04:27,  3.25it/s]
  5%|▌         | 19469/371472 [1:34:04<29:05:55,  3.36it/s]
  5%|▌         | 19470/371472 [1:34:05<28:13:55,  3.46it/s]
  5%|▌         | 19471/371472 [1:34:05<28:06:42,  3.48it/s]
  5%|▌         | 19472/371472 [1:34:05<27:54:38,  3.50it/s]
  5%|▌         | 19473/371472 [1:34:06<27:32:53,  3.55it/s]
  5%|▌         | 19474/371472 [1:34:06<27:12:50,  3.59it/s]
  5%|▌         | 19475/371472 [1:34:06<27:17:19,  3.58it/s]
  5%|▌         | 19476/371472 [1:34:06<27:52:41,  3.51it/s]
  5%|▌         | 19477/371472 [1:34:07<27:35:28,  3.54it/s]
  5%|▌         | 19478/371472 [1:34:07<26:51:01,  3.64it/s]
  5%|▌         | 19479/371472 [1:34:07<26:33:20,  3.68it/s]
  5%|▌         | 19480/371472 [1:34:07<26:54:54,  3.63it/s]
                                                           
{'loss': 4.7257, 'learning_rate': 9.532633756383459e-07, 'epoch': 0.84}

  5%|▌         | 19480/371472 [1:34:07<26:54:54,  3.63it/s]
  5%|▌         | 19481/371472 [1:34:08<26:36:14,  3.68it/s]
  5%|▌         | 19482/371472 [1:34:08<28:15:54,  3.46it/s]
  5%|▌         | 19483/371472 [1:34:08<29:01:09,  3.37it/s]
  5%|▌         | 19484/371472 [1:34:09<28:17:34,  3.46it/s]
  5%|▌         | 19485/371472 [1:34:09<27:24:17,  3.57it/s]
  5%|▌         | 19486/371472 [1:34:09<26:53:27,  3.64it/s]
  5%|▌         | 19487/371472 [1:34:09<26:19:01,  3.72it/s]
  5%|▌         | 19488/371472 [1:34:10<26:44:40,  3.66it/s]
  5%|▌         | 19489/371472 [1:34:10<28:28:21,  3.43it/s]
  5%|▌         | 19490/371472 [1:34:10<28:06:38,  3.48it/s]
  5%|▌         | 19491/371472 [1:34:11<28:12:11,  3.47it/s]
  5%|▌         | 19492/371472 [1:34:11<28:35:22,  3.42it/s]
  5%|▌         | 19493/371472 [1:34:11<27:56:23,  3.50it/s]
  5%|▌         | 19494/371472 [1:34:11<27:00:22,  3.62it/s]
  5%|▌         | 19495/371472 [1:34:12<28:25:27,  3.44it/s]
  5%|▌         | 19496/371472 [1:34:12<28:00:30,  3.49it/s]
  5%|▌         | 19497/371472 [1:34:12<28:06:11,  3.48it/s]
  5%|▌         | 19498/371472 [1:34:13<29:39:32,  3.30it/s]
  5%|▌         | 19499/371472 [1:34:13<31:24:47,  3.11it/s]
  5%|▌         | 19500/371472 [1:34:13<33:32:46,  2.91it/s]
                                                           
{'loss': 4.5974, 'learning_rate': 9.532148936628671e-07, 'epoch': 0.84}

  5%|▌         | 19500/371472 [1:34:13<33:32:46,  2.91it/s]
  5%|▌         | 19501/371472 [1:34:14<32:04:47,  3.05it/s]
  5%|▌         | 19502/371472 [1:34:14<30:15:30,  3.23it/s]
  5%|▌         | 19503/371472 [1:34:14<30:02:28,  3.25it/s]
  5%|▌         | 19504/371472 [1:34:15<30:01:31,  3.26it/s]
  5%|▌         | 19505/371472 [1:34:15<29:03:49,  3.36it/s]
  5%|▌         | 19506/371472 [1:34:15<28:45:01,  3.40it/s]
  5%|▌         | 19507/371472 [1:34:15<29:59:15,  3.26it/s]
  5%|▌         | 19508/371472 [1:34:16<31:10:24,  3.14it/s]
  5%|▌         | 19509/371472 [1:34:16<29:25:44,  3.32it/s]
  5%|▌         | 19510/371472 [1:34:16<29:26:27,  3.32it/s]
  5%|▌         | 19511/371472 [1:34:17<27:49:06,  3.51it/s]
  5%|▌         | 19512/371472 [1:34:17<30:05:39,  3.25it/s]
  5%|▌         | 19513/371472 [1:34:17<28:38:09,  3.41it/s]
  5%|▌         | 19514/371472 [1:34:18<27:59:50,  3.49it/s]
  5%|▌         | 19515/371472 [1:34:18<27:04:15,  3.61it/s]
  5%|▌         | 19516/371472 [1:34:18<26:20:47,  3.71it/s]
  5%|▌         | 19517/371472 [1:34:18<26:13:06,  3.73it/s]
  5%|▌         | 19518/371472 [1:34:19<26:14:49,  3.72it/s]
  5%|▌         | 19519/371472 [1:34:19<26:46:30,  3.65it/s]
  5%|▌         | 19520/371472 [1:34:19<27:32:34,  3.55it/s]
                                                           
{'loss': 4.7499, 'learning_rate': 9.531664116873882e-07, 'epoch': 0.84}

  5%|▌         | 19520/371472 [1:34:19<27:32:34,  3.55it/s]
  5%|▌         | 19521/371472 [1:34:19<27:48:25,  3.52it/s]
  5%|▌         | 19522/371472 [1:34:20<28:01:58,  3.49it/s]
  5%|▌         | 19523/371472 [1:34:20<29:07:07,  3.36it/s]
  5%|▌         | 19524/371472 [1:34:20<28:05:34,  3.48it/s]
  5%|▌         | 19525/371472 [1:34:21<29:50:29,  3.28it/s]
  5%|▌         | 19526/371472 [1:34:21<28:53:51,  3.38it/s]
  5%|▌         | 19527/371472 [1:34:21<27:59:49,  3.49it/s]
  5%|▌         | 19528/371472 [1:34:21<27:23:14,  3.57it/s]
  5%|▌         | 19529/371472 [1:34:22<26:45:54,  3.65it/s]
  5%|▌         | 19530/371472 [1:34:22<26:12:17,  3.73it/s]
  5%|▌         | 19531/371472 [1:34:22<26:02:46,  3.75it/s]
  5%|▌         | 19532/371472 [1:34:23<26:19:32,  3.71it/s]
  5%|▌         | 19533/371472 [1:34:23<25:46:41,  3.79it/s]
  5%|▌         | 19534/371472 [1:34:23<25:58:33,  3.76it/s]
  5%|▌         | 19535/371472 [1:34:23<27:09:57,  3.60it/s]
  5%|▌         | 19536/371472 [1:34:24<26:19:54,  3.71it/s]
  5%|▌         | 19537/371472 [1:34:24<26:08:04,  3.74it/s]
  5%|▌         | 19538/371472 [1:34:24<26:43:30,  3.66it/s]
  5%|▌         | 19539/371472 [1:34:24<27:31:41,  3.55it/s]
  5%|▌         | 19540/371472 [1:34:25<28:07:18,  3.48it/s]
                                                           
{'loss': 4.8645, 'learning_rate': 9.531179297119093e-07, 'epoch': 0.84}

  5%|▌         | 19540/371472 [1:34:25<28:07:18,  3.48it/s]
  5%|▌         | 19541/371472 [1:34:25<28:53:46,  3.38it/s]
  5%|▌         | 19542/371472 [1:34:25<28:07:40,  3.48it/s]
  5%|▌         | 19543/371472 [1:34:26<27:14:48,  3.59it/s]
  5%|▌         | 19544/371472 [1:34:26<26:15:03,  3.72it/s]
  5%|▌         | 19545/371472 [1:34:26<26:43:50,  3.66it/s]
  5%|▌         | 19546/371472 [1:34:26<26:34:12,  3.68it/s]
  5%|▌         | 19547/371472 [1:34:27<27:05:43,  3.61it/s]
  5%|▌         | 19548/371472 [1:34:27<27:26:12,  3.56it/s]
  5%|▌         | 19549/371472 [1:34:27<27:45:52,  3.52it/s]
  5%|▌         | 19550/371472 [1:34:28<27:45:32,  3.52it/s]
  5%|▌         | 19551/371472 [1:34:28<27:52:22,  3.51it/s]
  5%|▌         | 19552/371472 [1:34:28<27:15:56,  3.59it/s]
  5%|▌         | 19553/371472 [1:34:28<27:33:37,  3.55it/s]
  5%|▌         | 19554/371472 [1:34:29<27:08:37,  3.60it/s]
  5%|▌         | 19555/371472 [1:34:29<27:33:55,  3.55it/s]
  5%|▌         | 19556/371472 [1:34:29<26:40:02,  3.67it/s]
  5%|▌         | 19557/371472 [1:34:29<26:33:28,  3.68it/s]
  5%|▌         | 19558/371472 [1:34:30<28:02:27,  3.49it/s]
  5%|▌         | 19559/371472 [1:34:30<27:44:24,  3.52it/s]
  5%|▌         | 19560/371472 [1:34:30<27:44:38,  3.52it/s]
                                                           
{'loss': 4.5787, 'learning_rate': 9.530694477364304e-07, 'epoch': 0.84}

  5%|▌         | 19560/371472 [1:34:30<27:44:38,  3.52it/s]
  5%|▌         | 19561/371472 [1:34:31<28:09:46,  3.47it/s]
  5%|▌         | 19562/371472 [1:34:31<29:44:04,  3.29it/s]
  5%|▌         | 19563/371472 [1:34:31<28:39:02,  3.41it/s]
  5%|▌         | 19564/371472 [1:34:32<27:46:05,  3.52it/s]
  5%|▌         | 19565/371472 [1:34:32<27:33:43,  3.55it/s]
  5%|▌         | 19566/371472 [1:34:32<28:14:58,  3.46it/s]
  5%|▌         | 19567/371472 [1:34:32<27:20:21,  3.58it/s]
  5%|▌         | 19568/371472 [1:34:33<26:38:50,  3.67it/s]
  5%|▌         | 19569/371472 [1:34:33<27:01:34,  3.62it/s]
  5%|▌         | 19570/371472 [1:34:33<27:33:51,  3.55it/s]
  5%|▌         | 19571/371472 [1:34:33<26:50:23,  3.64it/s]
  5%|▌         | 19572/371472 [1:34:34<26:19:13,  3.71it/s]
  5%|▌         | 19573/371472 [1:34:34<28:23:04,  3.44it/s]
  5%|▌         | 19574/371472 [1:34:34<29:24:55,  3.32it/s]
  5%|▌         | 19575/371472 [1:34:35<31:15:05,  3.13it/s]
  5%|▌         | 19576/371472 [1:34:35<30:26:33,  3.21it/s]
  5%|▌         | 19577/371472 [1:34:35<29:09:39,  3.35it/s]
  5%|▌         | 19578/371472 [1:34:36<28:04:15,  3.48it/s]
  5%|▌         | 19579/371472 [1:34:36<30:57:08,  3.16it/s]
  5%|▌         | 19580/371472 [1:34:36<29:23:44,  3.33it/s]
                                                           
{'loss': 4.4854, 'learning_rate': 9.530209657609516e-07, 'epoch': 0.84}

  5%|▌         | 19580/371472 [1:34:36<29:23:44,  3.33it/s]
  5%|▌         | 19581/371472 [1:34:37<30:37:12,  3.19it/s]
  5%|▌         | 19582/371472 [1:34:37<29:39:42,  3.30it/s]
  5%|▌         | 19583/371472 [1:34:37<28:29:18,  3.43it/s]
  5%|▌         | 19584/371472 [1:34:37<27:54:15,  3.50it/s]
  5%|▌         | 19585/371472 [1:34:38<26:53:45,  3.63it/s]
  5%|▌         | 19586/371472 [1:34:38<26:21:44,  3.71it/s]
  5%|▌         | 19587/371472 [1:34:38<25:57:38,  3.77it/s]
  5%|▌         | 19588/371472 [1:34:38<25:37:02,  3.82it/s]
  5%|▌         | 19589/371472 [1:34:39<27:45:28,  3.52it/s]
  5%|▌         | 19590/371472 [1:34:39<27:51:41,  3.51it/s]
  5%|▌         | 19591/371472 [1:34:39<28:05:28,  3.48it/s]
  5%|▌         | 19592/371472 [1:34:40<27:40:17,  3.53it/s]
  5%|▌         | 19593/371472 [1:34:40<27:57:47,  3.50it/s]
  5%|▌         | 19594/371472 [1:34:40<28:14:24,  3.46it/s]
  5%|▌         | 19595/371472 [1:34:40<28:20:46,  3.45it/s]
  5%|▌         | 19596/371472 [1:34:41<28:24:21,  3.44it/s]
  5%|▌         | 19597/371472 [1:34:41<28:03:27,  3.48it/s]
  5%|▌         | 19598/371472 [1:34:41<29:29:55,  3.31it/s]
  5%|▌         | 19599/371472 [1:34:42<28:52:42,  3.38it/s]
  5%|▌         | 19600/371472 [1:34:42<27:51:09,  3.51it/s]
                                                           
{'loss': 4.7621, 'learning_rate': 9.529724837854727e-07, 'epoch': 0.84}

  5%|▌         | 19600/371472 [1:34:42<27:51:09,  3.51it/s]
  5%|▌         | 19601/371472 [1:34:42<28:23:13,  3.44it/s]
  5%|▌         | 19602/371472 [1:34:42<26:57:09,  3.63it/s]
  5%|▌         | 19603/371472 [1:34:43<26:16:32,  3.72it/s]
  5%|▌         | 19604/371472 [1:34:43<26:20:07,  3.71it/s]
  5%|▌         | 19605/371472 [1:34:43<27:41:05,  3.53it/s]
  5%|▌         | 19606/371472 [1:34:44<27:10:21,  3.60it/s]
  5%|▌         | 19607/371472 [1:34:44<27:05:34,  3.61it/s]
  5%|▌         | 19608/371472 [1:34:44<26:36:18,  3.67it/s]
  5%|▌         | 19609/371472 [1:34:44<26:04:58,  3.75it/s]
  5%|▌         | 19610/371472 [1:34:45<26:31:06,  3.69it/s]
  5%|▌         | 19611/371472 [1:34:45<28:02:32,  3.49it/s]
  5%|▌         | 19612/371472 [1:34:45<28:07:36,  3.47it/s]
  5%|▌         | 19613/371472 [1:34:46<27:20:53,  3.57it/s]
  5%|▌         | 19614/371472 [1:34:46<26:58:26,  3.62it/s]
  5%|▌         | 19615/371472 [1:34:46<26:57:54,  3.62it/s]
  5%|▌         | 19616/371472 [1:34:46<26:36:13,  3.67it/s]
  5%|▌         | 19617/371472 [1:34:47<26:26:43,  3.70it/s]
  5%|▌         | 19618/371472 [1:34:47<27:18:00,  3.58it/s]
  5%|▌         | 19619/371472 [1:34:47<26:25:58,  3.70it/s]
  5%|▌         | 19620/371472 [1:34:47<26:17:59,  3.72it/s]
                                                           
{'loss': 4.7263, 'learning_rate': 9.529240018099936e-07, 'epoch': 0.85}

  5%|▌         | 19620/371472 [1:34:47<26:17:59,  3.72it/s]
  5%|▌         | 19621/371472 [1:34:48<26:14:49,  3.72it/s]
  5%|▌         | 19622/371472 [1:34:48<26:38:23,  3.67it/s]
  5%|▌         | 19623/371472 [1:34:48<26:26:50,  3.70it/s]
  5%|▌         | 19624/371472 [1:34:48<26:30:06,  3.69it/s]
  5%|▌         | 19625/371472 [1:34:49<26:21:12,  3.71it/s]
  5%|▌         | 19626/371472 [1:34:49<27:26:14,  3.56it/s]
  5%|▌         | 19627/371472 [1:34:49<27:31:45,  3.55it/s]
  5%|▌         | 19628/371472 [1:34:50<28:20:20,  3.45it/s]
  5%|▌         | 19629/371472 [1:34:50<30:21:03,  3.22it/s]
  5%|▌         | 19630/371472 [1:34:50<30:57:43,  3.16it/s]
  5%|▌         | 19631/371472 [1:34:51<29:17:24,  3.34it/s]
  5%|▌         | 19632/371472 [1:34:51<28:14:24,  3.46it/s]
  5%|▌         | 19633/371472 [1:34:51<28:12:37,  3.46it/s]
  5%|▌         | 19634/371472 [1:34:51<27:08:18,  3.60it/s]
  5%|▌         | 19635/371472 [1:34:52<26:28:51,  3.69it/s]
  5%|▌         | 19636/371472 [1:34:52<26:39:19,  3.67it/s]
  5%|▌         | 19637/371472 [1:34:52<29:37:42,  3.30it/s]
  5%|▌         | 19638/371472 [1:34:53<28:11:05,  3.47it/s]
  5%|▌         | 19639/371472 [1:34:53<27:40:26,  3.53it/s]
  5%|▌         | 19640/371472 [1:34:53<29:57:47,  3.26it/s]
                                                           
{'loss': 4.7101, 'learning_rate': 9.528755198345148e-07, 'epoch': 0.85}

  5%|▌         | 19640/371472 [1:34:53<29:57:47,  3.26it/s]
  5%|▌         | 19641/371472 [1:34:54<30:04:06,  3.25it/s]
  5%|▌         | 19642/371472 [1:34:54<29:25:32,  3.32it/s]
  5%|▌         | 19643/371472 [1:34:54<29:55:24,  3.27it/s]
  5%|▌         | 19644/371472 [1:34:54<29:26:56,  3.32it/s]
  5%|▌         | 19645/371472 [1:34:55<28:18:22,  3.45it/s]
  5%|▌         | 19646/371472 [1:34:55<27:34:41,  3.54it/s]
  5%|▌         | 19647/371472 [1:34:55<27:13:05,  3.59it/s]
  5%|▌         | 19648/371472 [1:34:55<27:22:59,  3.57it/s]
  5%|▌         | 19649/371472 [1:34:56<28:05:47,  3.48it/s]
  5%|▌         | 19650/371472 [1:34:56<28:56:26,  3.38it/s]
  5%|▌         | 19651/371472 [1:34:56<28:05:57,  3.48it/s]
  5%|▌         | 19652/371472 [1:34:57<27:58:45,  3.49it/s]
  5%|▌         | 19653/371472 [1:34:57<28:19:26,  3.45it/s]
  5%|▌         | 19654/371472 [1:34:57<28:13:58,  3.46it/s]
  5%|▌         | 19655/371472 [1:34:58<30:31:39,  3.20it/s]
  5%|▌         | 19656/371472 [1:34:58<28:37:23,  3.41it/s]
  5%|▌         | 19657/371472 [1:34:58<30:19:14,  3.22it/s]
  5%|▌         | 19658/371472 [1:34:59<30:27:10,  3.21it/s]
  5%|▌         | 19659/371472 [1:34:59<31:19:09,  3.12it/s]
  5%|▌         | 19660/371472 [1:34:59<31:01:26,  3.15it/s]
                                                           
{'loss': 4.3076, 'learning_rate': 9.528270378590359e-07, 'epoch': 0.85}

  5%|▌         | 19660/371472 [1:34:59<31:01:26,  3.15it/s]
  5%|▌         | 19661/371472 [1:35:00<34:03:15,  2.87it/s]
  5%|▌         | 19662/371472 [1:35:00<31:39:38,  3.09it/s]
  5%|▌         | 19663/371472 [1:35:00<30:50:43,  3.17it/s]
  5%|▌         | 19664/371472 [1:35:00<29:45:40,  3.28it/s]
  5%|▌         | 19665/371472 [1:35:01<30:33:47,  3.20it/s]
  5%|▌         | 19666/371472 [1:35:01<28:55:12,  3.38it/s]
  5%|▌         | 19667/371472 [1:35:01<27:41:05,  3.53it/s]
  5%|▌         | 19668/371472 [1:35:02<27:10:26,  3.60it/s]
  5%|▌         | 19669/371472 [1:35:02<26:50:07,  3.64it/s]
  5%|▌         | 19670/371472 [1:35:02<26:35:22,  3.68it/s]
  5%|▌         | 19671/371472 [1:35:02<28:20:21,  3.45it/s]
  5%|▌         | 19672/371472 [1:35:03<28:21:35,  3.45it/s]
  5%|▌         | 19673/371472 [1:35:03<27:37:30,  3.54it/s]
  5%|▌         | 19674/371472 [1:35:03<26:57:34,  3.62it/s]
  5%|▌         | 19675/371472 [1:35:04<26:55:25,  3.63it/s]
  5%|▌         | 19676/371472 [1:35:04<28:59:48,  3.37it/s]
  5%|▌         | 19677/371472 [1:35:04<27:46:52,  3.52it/s]
  5%|▌         | 19678/371472 [1:35:04<26:58:13,  3.62it/s]
  5%|▌         | 19679/371472 [1:35:05<27:02:42,  3.61it/s]
  5%|▌         | 19680/371472 [1:35:05<28:13:59,  3.46it/s]
                                                           
{'loss': 4.5904, 'learning_rate': 9.52778555883557e-07, 'epoch': 0.85}

  5%|▌         | 19680/371472 [1:35:05<28:13:59,  3.46it/s]
  5%|▌         | 19681/371472 [1:35:05<28:12:12,  3.46it/s]
  5%|▌         | 19682/371472 [1:35:06<28:03:31,  3.48it/s]
  5%|▌         | 19683/371472 [1:35:06<27:28:38,  3.56it/s]
  5%|▌         | 19684/371472 [1:35:06<27:22:23,  3.57it/s]
  5%|▌         | 19685/371472 [1:35:06<27:29:43,  3.55it/s]
  5%|▌         | 19686/371472 [1:35:07<27:15:17,  3.59it/s]
  5%|▌         | 19687/371472 [1:35:07<27:27:26,  3.56it/s]
  5%|▌         | 19688/371472 [1:35:07<27:33:23,  3.55it/s]
  5%|▌         | 19689/371472 [1:35:08<28:22:08,  3.44it/s]
  5%|▌         | 19690/371472 [1:35:08<28:47:01,  3.39it/s]
  5%|▌         | 19691/371472 [1:35:08<29:46:54,  3.28it/s]
  5%|▌         | 19692/371472 [1:35:08<30:44:30,  3.18it/s]
  5%|▌         | 19693/371472 [1:35:09<30:33:18,  3.20it/s]
  5%|▌         | 19694/371472 [1:35:09<29:08:30,  3.35it/s]
  5%|▌         | 19695/371472 [1:35:09<28:42:44,  3.40it/s]
  5%|▌         | 19696/371472 [1:35:10<29:41:51,  3.29it/s]
  5%|▌         | 19697/371472 [1:35:10<29:59:09,  3.26it/s]
  5%|▌         | 19698/371472 [1:35:10<30:05:48,  3.25it/s]
  5%|▌         | 19699/371472 [1:35:11<29:38:49,  3.30it/s]
  5%|▌         | 19700/371472 [1:35:11<28:27:40,  3.43it/s]
                                                           
{'loss': 4.4537, 'learning_rate': 9.527300739080781e-07, 'epoch': 0.85}

  5%|▌         | 19700/371472 [1:35:11<28:27:40,  3.43it/s]
  5%|▌         | 19701/371472 [1:35:11<29:49:08,  3.28it/s]
  5%|▌         | 19702/371472 [1:35:11<28:03:17,  3.48it/s]
  5%|▌         | 19703/371472 [1:35:12<27:48:52,  3.51it/s]
  5%|▌         | 19704/371472 [1:35:12<27:22:20,  3.57it/s]
  5%|▌         | 19705/371472 [1:35:12<28:15:18,  3.46it/s]
  5%|▌         | 19706/371472 [1:35:13<29:06:05,  3.36it/s]
  5%|▌         | 19707/371472 [1:35:13<29:08:56,  3.35it/s]
  5%|▌         | 19708/371472 [1:35:13<28:49:15,  3.39it/s]
  5%|▌         | 19709/371472 [1:35:13<28:41:57,  3.40it/s]
  5%|▌         | 19710/371472 [1:35:14<27:50:27,  3.51it/s]
  5%|▌         | 19711/371472 [1:35:14<26:43:09,  3.66it/s]
  5%|▌         | 19712/371472 [1:35:14<26:14:40,  3.72it/s]
  5%|▌         | 19713/371472 [1:35:14<25:26:33,  3.84it/s]
  5%|▌         | 19714/371472 [1:35:15<27:38:37,  3.53it/s]
  5%|▌         | 19715/371472 [1:35:15<26:29:49,  3.69it/s]
  5%|▌         | 19716/371472 [1:35:15<26:54:58,  3.63it/s]
  5%|▌         | 19717/371472 [1:35:16<26:14:41,  3.72it/s]
  5%|▌         | 19718/371472 [1:35:16<26:52:57,  3.63it/s]
  5%|▌         | 19719/371472 [1:35:16<26:32:36,  3.68it/s]
  5%|▌         | 19720/371472 [1:35:16<26:39:13,  3.67it/s]
                                                           
{'loss': 4.5525, 'learning_rate': 9.526815919325993e-07, 'epoch': 0.85}

  5%|▌         | 19720/371472 [1:35:16<26:39:13,  3.67it/s]
  5%|▌         | 19721/371472 [1:35:17<30:15:39,  3.23it/s]
  5%|▌         | 19722/371472 [1:35:17<28:37:48,  3.41it/s]
  5%|▌         | 19723/371472 [1:35:17<27:19:06,  3.58it/s]
  5%|▌         | 19724/371472 [1:35:18<27:26:54,  3.56it/s]
  5%|▌         | 19725/371472 [1:35:18<26:58:35,  3.62it/s]
  5%|▌         | 19726/371472 [1:35:18<30:12:47,  3.23it/s]
  5%|▌         | 19727/371472 [1:35:19<29:46:09,  3.28it/s]
  5%|▌         | 19728/371472 [1:35:19<32:08:49,  3.04it/s]
  5%|▌         | 19729/371472 [1:35:19<30:53:59,  3.16it/s]
  5%|▌         | 19730/371472 [1:35:19<28:50:08,  3.39it/s]
  5%|▌         | 19731/371472 [1:35:20<29:45:17,  3.28it/s]
  5%|▌         | 19732/371472 [1:35:20<28:40:08,  3.41it/s]
  5%|▌         | 19733/371472 [1:35:20<28:21:46,  3.44it/s]
  5%|▌         | 19734/371472 [1:35:21<28:42:01,  3.40it/s]
  5%|▌         | 19735/371472 [1:35:21<28:14:58,  3.46it/s]
  5%|▌         | 19736/371472 [1:35:21<27:34:53,  3.54it/s]
  5%|▌         | 19737/371472 [1:35:21<26:36:21,  3.67it/s]
  5%|▌         | 19738/371472 [1:35:22<27:34:28,  3.54it/s]
  5%|▌         | 19739/371472 [1:35:22<27:08:21,  3.60it/s]
  5%|▌         | 19740/371472 [1:35:22<27:15:00,  3.59it/s]
                                                           
{'loss': 4.4868, 'learning_rate': 9.526331099571202e-07, 'epoch': 0.85}

  5%|▌         | 19740/371472 [1:35:22<27:15:00,  3.59it/s]
  5%|▌         | 19741/371472 [1:35:23<27:39:25,  3.53it/s]
  5%|▌         | 19742/371472 [1:35:23<29:57:29,  3.26it/s]
  5%|▌         | 19743/371472 [1:35:23<30:00:58,  3.25it/s]
  5%|▌         | 19744/371472 [1:35:24<29:01:14,  3.37it/s]
  5%|▌         | 19745/371472 [1:35:24<28:30:36,  3.43it/s]
  5%|▌         | 19746/371472 [1:35:24<27:20:56,  3.57it/s]
  5%|▌         | 19747/371472 [1:35:24<27:20:07,  3.57it/s]
  5%|▌         | 19748/371472 [1:35:25<27:16:22,  3.58it/s]
  5%|▌         | 19749/371472 [1:35:25<28:02:13,  3.48it/s]
  5%|▌         | 19750/371472 [1:35:25<28:59:41,  3.37it/s]
  5%|▌         | 19751/371472 [1:35:26<29:53:22,  3.27it/s]
  5%|▌         | 19752/371472 [1:35:26<29:20:18,  3.33it/s]
  5%|▌         | 19753/371472 [1:35:26<28:02:44,  3.48it/s]
  5%|▌         | 19754/371472 [1:35:26<27:45:39,  3.52it/s]
  5%|▌         | 19755/371472 [1:35:27<28:19:19,  3.45it/s]
  5%|▌         | 19756/371472 [1:35:27<27:50:12,  3.51it/s]
  5%|▌         | 19757/371472 [1:35:27<28:14:17,  3.46it/s]
  5%|▌         | 19758/371472 [1:35:28<30:37:46,  3.19it/s]
  5%|▌         | 19759/371472 [1:35:28<30:02:26,  3.25it/s]
  5%|▌         | 19760/371472 [1:35:28<28:54:11,  3.38it/s]
                                                           
{'loss': 4.7816, 'learning_rate': 9.525846279816414e-07, 'epoch': 0.85}

  5%|▌         | 19760/371472 [1:35:28<28:54:11,  3.38it/s]
  5%|▌         | 19761/371472 [1:35:29<28:42:51,  3.40it/s]
  5%|▌         | 19762/371472 [1:35:29<28:15:59,  3.46it/s]
  5%|▌         | 19763/371472 [1:35:29<29:50:02,  3.27it/s]
  5%|▌         | 19764/371472 [1:35:29<29:26:14,  3.32it/s]
  5%|▌         | 19765/371472 [1:35:30<29:18:23,  3.33it/s]
  5%|▌         | 19766/371472 [1:35:30<29:26:06,  3.32it/s]
  5%|▌         | 19767/371472 [1:35:30<27:53:37,  3.50it/s]
  5%|▌         | 19768/371472 [1:35:31<28:23:08,  3.44it/s]
  5%|▌         | 19769/371472 [1:35:31<27:27:11,  3.56it/s]
  5%|▌         | 19770/371472 [1:35:31<27:19:16,  3.58it/s]
  5%|▌         | 19771/371472 [1:35:31<28:54:23,  3.38it/s]
  5%|▌         | 19772/371472 [1:35:32<28:42:17,  3.40it/s]
  5%|▌         | 19773/371472 [1:35:32<28:14:58,  3.46it/s]
  5%|▌         | 19774/371472 [1:35:32<29:29:50,  3.31it/s]
  5%|▌         | 19775/371472 [1:35:33<30:34:12,  3.20it/s]
  5%|▌         | 19776/371472 [1:35:33<30:20:42,  3.22it/s]
  5%|▌         | 19777/371472 [1:35:33<29:24:55,  3.32it/s]
  5%|▌         | 19778/371472 [1:35:34<27:46:51,  3.52it/s]
  5%|▌         | 19779/371472 [1:35:34<27:54:14,  3.50it/s]
  5%|▌         | 19780/371472 [1:35:34<30:03:33,  3.25it/s]
                                                           
{'loss': 4.5658, 'learning_rate': 9.525361460061625e-07, 'epoch': 0.85}

  5%|▌         | 19780/371472 [1:35:34<30:03:33,  3.25it/s]
  5%|▌         | 19781/371472 [1:35:34<29:20:17,  3.33it/s]
  5%|▌         | 19782/371472 [1:35:35<28:26:01,  3.44it/s]
  5%|▌         | 19783/371472 [1:35:35<27:11:10,  3.59it/s]
  5%|▌         | 19784/371472 [1:35:35<27:04:52,  3.61it/s]
  5%|▌         | 19785/371472 [1:35:36<28:37:40,  3.41it/s]
  5%|▌         | 19786/371472 [1:35:36<31:19:18,  3.12it/s]
  5%|▌         | 19787/371472 [1:35:36<30:52:36,  3.16it/s]
  5%|▌         | 19788/371472 [1:35:37<29:30:52,  3.31it/s]
  5%|▌         | 19789/371472 [1:35:37<28:02:49,  3.48it/s]
  5%|▌         | 19790/371472 [1:35:37<27:16:34,  3.58it/s]
  5%|▌         | 19791/371472 [1:35:37<28:00:38,  3.49it/s]
  5%|▌         | 19792/371472 [1:35:38<27:44:38,  3.52it/s]
  5%|▌         | 19793/371472 [1:35:38<28:20:54,  3.45it/s]
  5%|▌         | 19794/371472 [1:35:38<27:42:28,  3.53it/s]
  5%|▌         | 19795/371472 [1:35:38<27:00:07,  3.62it/s]
  5%|▌         | 19796/371472 [1:35:39<27:11:16,  3.59it/s]
  5%|▌         | 19797/371472 [1:35:39<27:21:24,  3.57it/s]
  5%|▌         | 19798/371472 [1:35:39<27:51:05,  3.51it/s]
  5%|▌         | 19799/371472 [1:35:40<27:14:30,  3.59it/s]
  5%|▌         | 19800/371472 [1:35:40<27:06:30,  3.60it/s]
                                                           
{'loss': 4.574, 'learning_rate': 9.524876640306837e-07, 'epoch': 0.85}

  5%|▌         | 19800/371472 [1:35:40<27:06:30,  3.60it/s]
  5%|▌         | 19801/371472 [1:35:40<28:29:01,  3.43it/s]
  5%|▌         | 19802/371472 [1:35:40<28:09:12,  3.47it/s]
  5%|▌         | 19803/371472 [1:35:41<27:19:01,  3.58it/s]
  5%|▌         | 19804/371472 [1:35:41<27:41:57,  3.53it/s]
  5%|▌         | 19805/371472 [1:35:41<28:28:48,  3.43it/s]
  5%|▌         | 19806/371472 [1:35:42<27:47:23,  3.52it/s]
  5%|▌         | 19807/371472 [1:35:42<28:18:52,  3.45it/s]
  5%|▌         | 19808/371472 [1:35:42<27:34:43,  3.54it/s]
  5%|▌         | 19809/371472 [1:35:42<27:37:38,  3.54it/s]
  5%|▌         | 19810/371472 [1:35:43<28:22:33,  3.44it/s]
  5%|▌         | 19811/371472 [1:35:43<30:06:50,  3.24it/s]
  5%|▌         | 19812/371472 [1:35:43<29:14:56,  3.34it/s]
  5%|▌         | 19813/371472 [1:35:44<28:21:18,  3.44it/s]
  5%|▌         | 19814/371472 [1:35:44<28:16:30,  3.45it/s]
  5%|▌         | 19815/371472 [1:35:44<27:41:24,  3.53it/s]
  5%|▌         | 19816/371472 [1:35:44<26:52:26,  3.63it/s]
  5%|▌         | 19817/371472 [1:35:45<27:04:01,  3.61it/s]
  5%|▌         | 19818/371472 [1:35:45<28:07:53,  3.47it/s]
  5%|▌         | 19819/371472 [1:35:45<27:16:55,  3.58it/s]
  5%|▌         | 19820/371472 [1:35:46<27:23:27,  3.57it/s]
                                                           
{'loss': 4.7047, 'learning_rate': 9.524391820552048e-07, 'epoch': 0.85}

  5%|▌         | 19820/371472 [1:35:46<27:23:27,  3.57it/s]
  5%|▌         | 19821/371472 [1:35:46<28:14:43,  3.46it/s]
  5%|▌         | 19822/371472 [1:35:46<28:27:45,  3.43it/s]
  5%|▌         | 19823/371472 [1:35:46<28:21:05,  3.45it/s]
  5%|▌         | 19824/371472 [1:35:47<27:26:15,  3.56it/s]
  5%|▌         | 19825/371472 [1:35:47<28:13:51,  3.46it/s]
  5%|▌         | 19826/371472 [1:35:47<28:02:27,  3.48it/s]
  5%|▌         | 19827/371472 [1:35:48<28:05:27,  3.48it/s]
  5%|▌         | 19828/371472 [1:35:48<28:02:29,  3.48it/s]
  5%|▌         | 19829/371472 [1:35:48<27:56:48,  3.50it/s]
  5%|▌         | 19830/371472 [1:35:48<27:46:25,  3.52it/s]
  5%|▌         | 19831/371472 [1:35:49<27:18:27,  3.58it/s]
  5%|▌         | 19832/371472 [1:35:49<26:59:23,  3.62it/s]
  5%|▌         | 19833/371472 [1:35:49<27:05:02,  3.61it/s]
  5%|▌         | 19834/371472 [1:35:50<26:05:30,  3.74it/s]
  5%|▌         | 19835/371472 [1:35:50<26:17:37,  3.71it/s]
  5%|▌         | 19836/371472 [1:35:50<26:51:25,  3.64it/s]
  5%|▌         | 19837/371472 [1:35:50<27:50:07,  3.51it/s]
  5%|▌         | 19838/371472 [1:35:51<27:40:05,  3.53it/s]
  5%|▌         | 19839/371472 [1:35:51<27:08:17,  3.60it/s]
  5%|▌         | 19840/371472 [1:35:51<26:07:48,  3.74it/s]
                                                           
{'loss': 4.353, 'learning_rate': 9.523907000797259e-07, 'epoch': 0.85}

  5%|▌         | 19840/371472 [1:35:51<26:07:48,  3.74it/s]
  5%|▌         | 19841/371472 [1:35:51<26:03:09,  3.75it/s]
  5%|▌         | 19842/371472 [1:35:52<25:34:09,  3.82it/s]
  5%|▌         | 19843/371472 [1:35:52<26:11:50,  3.73it/s]
  5%|▌         | 19844/371472 [1:35:52<25:58:10,  3.76it/s]
  5%|▌         | 19845/371472 [1:35:53<25:24:45,  3.84it/s]
  5%|▌         | 19846/371472 [1:35:53<26:01:53,  3.75it/s]
  5%|▌         | 19847/371472 [1:35:53<26:09:26,  3.73it/s]
  5%|▌         | 19848/371472 [1:35:53<27:35:51,  3.54it/s]
  5%|▌         | 19849/371472 [1:35:54<31:18:53,  3.12it/s]
  5%|▌         | 19850/371472 [1:35:54<29:16:36,  3.34it/s]
  5%|▌         | 19851/371472 [1:35:54<28:09:11,  3.47it/s]
  5%|▌         | 19852/371472 [1:35:55<28:14:48,  3.46it/s]
  5%|▌         | 19853/371472 [1:35:55<29:16:59,  3.34it/s]
  5%|▌         | 19854/371472 [1:35:55<28:51:44,  3.38it/s]
  5%|▌         | 19855/371472 [1:35:55<27:56:12,  3.50it/s]
  5%|▌         | 19856/371472 [1:35:56<29:43:08,  3.29it/s]
  5%|▌         | 19857/371472 [1:35:56<31:04:05,  3.14it/s]
  5%|▌         | 19858/371472 [1:35:56<30:28:59,  3.20it/s]
  5%|▌         | 19859/371472 [1:35:57<30:57:46,  3.15it/s]
  5%|▌         | 19860/371472 [1:35:57<30:07:44,  3.24it/s]
                                                           
{'loss': 4.6372, 'learning_rate': 9.523422181042469e-07, 'epoch': 0.86}

  5%|▌         | 19860/371472 [1:35:57<30:07:44,  3.24it/s]
  5%|▌         | 19861/371472 [1:35:57<29:15:01,  3.34it/s]
  5%|▌         | 19862/371472 [1:35:58<28:09:08,  3.47it/s]
  5%|▌         | 19863/371472 [1:35:58<27:06:57,  3.60it/s]
  5%|▌         | 19864/371472 [1:35:58<27:24:51,  3.56it/s]
  5%|▌         | 19865/371472 [1:35:58<27:01:17,  3.61it/s]
  5%|▌         | 19866/371472 [1:35:59<26:30:41,  3.68it/s]
  5%|▌         | 19867/371472 [1:35:59<26:14:24,  3.72it/s]
  5%|▌         | 19868/371472 [1:35:59<26:23:09,  3.70it/s]
  5%|▌         | 19869/371472 [1:35:59<25:51:57,  3.78it/s]
  5%|▌         | 19870/371472 [1:36:00<25:47:55,  3.79it/s]
  5%|▌         | 19871/371472 [1:36:00<25:51:51,  3.78it/s]
  5%|▌         | 19872/371472 [1:36:00<26:56:43,  3.62it/s]
  5%|▌         | 19873/371472 [1:36:01<26:18:39,  3.71it/s]
  5%|▌         | 19874/371472 [1:36:01<25:57:56,  3.76it/s]
  5%|▌         | 19875/371472 [1:36:01<29:14:01,  3.34it/s]
  5%|▌         | 19876/371472 [1:36:01<29:10:56,  3.35it/s]
  5%|▌         | 19877/371472 [1:36:02<27:45:16,  3.52it/s]
  5%|▌         | 19878/371472 [1:36:02<27:10:50,  3.59it/s]
  5%|▌         | 19879/371472 [1:36:02<27:35:16,  3.54it/s]
  5%|▌         | 19880/371472 [1:36:03<28:50:03,  3.39it/s]
                                                           
{'loss': 4.563, 'learning_rate': 9.522937361287681e-07, 'epoch': 0.86}

  5%|▌         | 19880/371472 [1:36:03<28:50:03,  3.39it/s]
  5%|▌         | 19881/371472 [1:36:03<27:59:33,  3.49it/s]
  5%|▌         | 19882/371472 [1:36:03<28:08:06,  3.47it/s]
  5%|▌         | 19883/371472 [1:36:03<27:54:23,  3.50it/s]
  5%|▌         | 19884/371472 [1:36:04<26:41:55,  3.66it/s]
  5%|▌         | 19885/371472 [1:36:04<26:21:14,  3.71it/s]
  5%|▌         | 19886/371472 [1:36:04<27:29:58,  3.55it/s]
  5%|▌         | 19887/371472 [1:36:05<28:20:38,  3.45it/s]
  5%|▌         | 19888/371472 [1:36:05<28:10:30,  3.47it/s]
  5%|▌         | 19889/371472 [1:36:05<27:17:51,  3.58it/s]
  5%|▌         | 19890/371472 [1:36:05<26:58:39,  3.62it/s]
  5%|▌         | 19891/371472 [1:36:06<26:33:53,  3.68it/s]
  5%|▌         | 19892/371472 [1:36:06<26:12:44,  3.73it/s]
  5%|▌         | 19893/371472 [1:36:06<26:13:29,  3.72it/s]
  5%|▌         | 19894/371472 [1:36:06<27:00:28,  3.62it/s]
  5%|▌         | 19895/371472 [1:36:07<26:54:06,  3.63it/s]
  5%|▌         | 19896/371472 [1:36:07<31:44:09,  3.08it/s]
  5%|▌         | 19897/371472 [1:36:07<30:27:15,  3.21it/s]
  5%|▌         | 19898/371472 [1:36:08<29:04:39,  3.36it/s]
  5%|▌         | 19899/371472 [1:36:08<27:46:45,  3.52it/s]
  5%|▌         | 19900/371472 [1:36:08<27:47:59,  3.51it/s]
                                                           
{'loss': 4.7784, 'learning_rate': 9.522452541532892e-07, 'epoch': 0.86}

  5%|▌         | 19900/371472 [1:36:08<27:47:59,  3.51it/s]
  5%|▌         | 19901/371472 [1:36:09<27:06:00,  3.60it/s]
  5%|▌         | 19902/371472 [1:36:09<26:50:16,  3.64it/s]
  5%|▌         | 19903/371472 [1:36:09<28:00:18,  3.49it/s]
  5%|▌         | 19904/371472 [1:36:09<28:07:26,  3.47it/s]
  5%|▌         | 19905/371472 [1:36:10<28:46:27,  3.39it/s]
  5%|▌         | 19906/371472 [1:36:10<28:12:43,  3.46it/s]
  5%|▌         | 19907/371472 [1:36:10<28:03:21,  3.48it/s]
  5%|▌         | 19908/371472 [1:36:11<27:38:52,  3.53it/s]
  5%|▌         | 19909/371472 [1:36:11<27:26:35,  3.56it/s]
  5%|▌         | 19910/371472 [1:36:11<27:19:50,  3.57it/s]
  5%|▌         | 19911/371472 [1:36:11<28:41:15,  3.40it/s]
  5%|▌         | 19912/371472 [1:36:12<27:52:09,  3.50it/s]
  5%|▌         | 19913/371472 [1:36:12<27:02:55,  3.61it/s]
  5%|▌         | 19914/371472 [1:36:12<26:37:45,  3.67it/s]
  5%|▌         | 19915/371472 [1:36:12<26:31:41,  3.68it/s]
  5%|▌         | 19916/371472 [1:36:13<26:46:32,  3.65it/s]
  5%|▌         | 19917/371472 [1:36:13<26:54:52,  3.63it/s]
  5%|▌         | 19918/371472 [1:36:13<27:05:37,  3.60it/s]
  5%|▌         | 19919/371472 [1:36:14<27:30:59,  3.55it/s]
  5%|▌         | 19920/371472 [1:36:14<26:50:08,  3.64it/s]
                                                           
{'loss': 4.8083, 'learning_rate': 9.521967721778103e-07, 'epoch': 0.86}

  5%|▌         | 19920/371472 [1:36:14<26:50:08,  3.64it/s]
  5%|▌         | 19921/371472 [1:36:14<27:09:08,  3.60it/s]
  5%|▌         | 19922/371472 [1:36:14<27:10:15,  3.59it/s]
  5%|▌         | 19923/371472 [1:36:15<26:42:19,  3.66it/s]
  5%|▌         | 19924/371472 [1:36:15<26:23:55,  3.70it/s]
  5%|▌         | 19925/371472 [1:36:15<27:05:00,  3.61it/s]
  5%|▌         | 19926/371472 [1:36:16<26:36:07,  3.67it/s]
  5%|▌         | 19927/371472 [1:36:16<27:02:19,  3.61it/s]
  5%|▌         | 19928/371472 [1:36:16<27:25:06,  3.56it/s]
  5%|▌         | 19929/371472 [1:36:16<27:18:13,  3.58it/s]
  5%|▌         | 19930/371472 [1:36:17<27:29:33,  3.55it/s]
  5%|▌         | 19931/371472 [1:36:17<27:44:32,  3.52it/s]
  5%|▌         | 19932/371472 [1:36:17<29:37:38,  3.30it/s]
  5%|▌         | 19933/371472 [1:36:18<28:19:47,  3.45it/s]
  5%|▌         | 19934/371472 [1:36:18<28:02:36,  3.48it/s]
  5%|▌         | 19935/371472 [1:36:18<27:18:38,  3.58it/s]
  5%|▌         | 19936/371472 [1:36:18<26:54:11,  3.63it/s]
  5%|▌         | 19937/371472 [1:36:19<27:53:30,  3.50it/s]
  5%|▌         | 19938/371472 [1:36:19<27:57:09,  3.49it/s]
  5%|▌         | 19939/371472 [1:36:19<27:27:14,  3.56it/s]
  5%|▌         | 19940/371472 [1:36:20<27:39:21,  3.53it/s]
                                                           
{'loss': 4.7428, 'learning_rate': 9.521482902023314e-07, 'epoch': 0.86}

  5%|▌         | 19940/371472 [1:36:20<27:39:21,  3.53it/s]
  5%|▌         | 19941/371472 [1:36:20<27:36:52,  3.54it/s]
  5%|▌         | 19942/371472 [1:36:20<26:43:09,  3.65it/s]
  5%|▌         | 19943/371472 [1:36:20<26:52:18,  3.63it/s]
  5%|▌         | 19944/371472 [1:36:21<28:52:31,  3.38it/s]
  5%|▌         | 19945/371472 [1:36:21<29:09:48,  3.35it/s]
  5%|▌         | 19946/371472 [1:36:21<28:06:01,  3.47it/s]
  5%|▌         | 19947/371472 [1:36:22<28:09:42,  3.47it/s]
  5%|▌         | 19948/371472 [1:36:22<28:18:13,  3.45it/s]
  5%|▌         | 19949/371472 [1:36:22<28:50:24,  3.39it/s]
  5%|▌         | 19950/371472 [1:36:22<28:55:39,  3.38it/s]
  5%|▌         | 19951/371472 [1:36:23<29:14:26,  3.34it/s]
  5%|▌         | 19952/371472 [1:36:23<29:15:23,  3.34it/s]
  5%|▌         | 19953/371472 [1:36:23<30:09:31,  3.24it/s]
  5%|▌         | 19954/371472 [1:36:24<30:55:59,  3.16it/s]
  5%|▌         | 19955/371472 [1:36:24<29:48:19,  3.28it/s]
  5%|▌         | 19956/371472 [1:36:24<28:48:45,  3.39it/s]
  5%|▌         | 19957/371472 [1:36:25<27:40:41,  3.53it/s]
  5%|▌         | 19958/371472 [1:36:25<27:13:29,  3.59it/s]
  5%|▌         | 19959/371472 [1:36:25<29:16:50,  3.33it/s]
  5%|▌         | 19960/371472 [1:36:25<28:20:44,  3.44it/s]
                                                           
{'loss': 4.6361, 'learning_rate': 9.520998082268526e-07, 'epoch': 0.86}

  5%|▌         | 19960/371472 [1:36:25<28:20:44,  3.44it/s]
  5%|▌         | 19961/371472 [1:36:26<29:46:50,  3.28it/s]
  5%|▌         | 19962/371472 [1:36:26<29:53:46,  3.27it/s]
  5%|▌         | 19963/371472 [1:36:26<29:44:40,  3.28it/s]
  5%|▌         | 19964/371472 [1:36:27<30:25:36,  3.21it/s]
  5%|▌         | 19965/371472 [1:36:27<30:52:55,  3.16it/s]
  5%|▌         | 19966/371472 [1:36:27<29:25:58,  3.32it/s]
  5%|▌         | 19967/371472 [1:36:28<28:11:12,  3.46it/s]
  5%|▌         | 19968/371472 [1:36:28<28:58:28,  3.37it/s]
  5%|▌         | 19969/371472 [1:36:28<29:14:27,  3.34it/s]
  5%|▌         | 19970/371472 [1:36:28<28:29:08,  3.43it/s]
  5%|▌         | 19971/371472 [1:36:29<27:58:47,  3.49it/s]
  5%|▌         | 19972/371472 [1:36:29<27:53:42,  3.50it/s]
  5%|▌         | 19973/371472 [1:36:29<28:21:43,  3.44it/s]
  5%|▌         | 19974/371472 [1:36:30<29:02:12,  3.36it/s]
  5%|▌         | 19975/371472 [1:36:30<27:46:40,  3.51it/s]
  5%|▌         | 19976/371472 [1:36:30<26:28:54,  3.69it/s]
  5%|▌         | 19977/371472 [1:36:30<28:37:49,  3.41it/s]
  5%|▌         | 19978/371472 [1:36:31<29:34:34,  3.30it/s]
  5%|▌         | 19979/371472 [1:36:31<29:51:34,  3.27it/s]
  5%|▌         | 19980/371472 [1:36:31<28:43:18,  3.40it/s]
                                                           
{'loss': 4.2954, 'learning_rate': 9.520513262513736e-07, 'epoch': 0.86}

  5%|▌         | 19980/371472 [1:36:31<28:43:18,  3.40it/s]
  5%|▌         | 19981/371472 [1:36:32<27:51:08,  3.51it/s]
  5%|▌         | 19982/371472 [1:36:32<27:28:14,  3.55it/s]
  5%|▌         | 19983/371472 [1:36:32<28:17:55,  3.45it/s]
  5%|▌         | 19984/371472 [1:36:32<27:13:41,  3.59it/s]
  5%|▌         | 19985/371472 [1:36:33<27:43:13,  3.52it/s]
  5%|▌         | 19986/371472 [1:36:33<27:42:41,  3.52it/s]
  5%|▌         | 19987/371472 [1:36:33<28:36:24,  3.41it/s]
  5%|▌         | 19988/371472 [1:36:34<27:52:47,  3.50it/s]
  5%|▌         | 19989/371472 [1:36:34<28:23:05,  3.44it/s]
  5%|▌         | 19990/371472 [1:36:34<29:35:19,  3.30it/s]
  5%|▌         | 19991/371472 [1:36:34<28:16:37,  3.45it/s]
  5%|▌         | 19992/371472 [1:36:35<27:39:56,  3.53it/s]
  5%|▌         | 19993/371472 [1:36:35<27:27:09,  3.56it/s]
  5%|▌         | 19994/371472 [1:36:35<27:54:48,  3.50it/s]
  5%|▌         | 19995/371472 [1:36:36<27:08:19,  3.60it/s]
  5%|▌         | 19996/371472 [1:36:36<27:15:19,  3.58it/s]
  5%|▌         | 19997/371472 [1:36:36<28:00:35,  3.49it/s]
  5%|▌         | 19998/371472 [1:36:37<29:50:25,  3.27it/s]
  5%|▌         | 19999/371472 [1:36:37<31:23:33,  3.11it/s]
  5%|▌         | 20000/371472 [1:36:37<31:11:43,  3.13it/s]
                                                           
{'loss': 4.3637, 'learning_rate': 9.520028442758947e-07, 'epoch': 0.86}

  5%|▌         | 20000/371472 [1:36:37<31:11:43,  3.13it/s]
  5%|▌         | 20001/371472 [1:36:38<31:00:47,  3.15it/s]
  5%|▌         | 20002/371472 [1:36:38<30:24:37,  3.21it/s]
  5%|▌         | 20003/371472 [1:36:38<29:04:35,  3.36it/s]
  5%|▌         | 20004/371472 [1:36:38<28:55:55,  3.37it/s]
  5%|▌         | 20005/371472 [1:36:39<28:03:56,  3.48it/s]
  5%|▌         | 20006/371472 [1:36:39<27:58:30,  3.49it/s]
  5%|▌         | 20007/371472 [1:36:39<27:24:45,  3.56it/s]
  5%|▌         | 20008/371472 [1:36:40<28:22:38,  3.44it/s]
  5%|▌         | 20009/371472 [1:36:40<27:38:28,  3.53it/s]
  5%|▌         | 20010/371472 [1:36:40<27:46:46,  3.51it/s]
  5%|▌         | 20011/371472 [1:36:40<27:19:06,  3.57it/s]
  5%|▌         | 20012/371472 [1:36:41<27:10:56,  3.59it/s]
  5%|▌         | 20013/371472 [1:36:41<27:47:38,  3.51it/s]
  5%|▌         | 20014/371472 [1:36:41<29:06:56,  3.35it/s]
  5%|▌         | 20015/371472 [1:36:42<29:25:13,  3.32it/s]
  5%|▌         | 20016/371472 [1:36:42<29:29:55,  3.31it/s]
  5%|▌         | 20017/371472 [1:36:42<28:21:45,  3.44it/s]
  5%|▌         | 20018/371472 [1:36:42<29:37:44,  3.29it/s]
  5%|▌         | 20019/371472 [1:36:43<28:20:46,  3.44it/s]
  5%|▌         | 20020/371472 [1:36:43<27:29:26,  3.55it/s]
                                                           
{'loss': 4.6597, 'learning_rate': 9.519543623004158e-07, 'epoch': 0.86}

  5%|▌         | 20020/371472 [1:36:43<27:29:26,  3.55it/s]
  5%|▌         | 20021/371472 [1:36:43<27:40:56,  3.53it/s]
  5%|▌         | 20022/371472 [1:36:44<27:21:51,  3.57it/s]
  5%|▌         | 20023/371472 [1:36:44<28:52:54,  3.38it/s]
  5%|▌         | 20024/371472 [1:36:44<27:43:00,  3.52it/s]
  5%|▌         | 20025/371472 [1:36:44<27:06:13,  3.60it/s]
  5%|▌         | 20026/371472 [1:36:45<27:05:12,  3.60it/s]
  5%|▌         | 20027/371472 [1:36:45<26:26:21,  3.69it/s]
  5%|▌         | 20028/371472 [1:36:45<25:43:01,  3.80it/s]
  5%|▌         | 20029/371472 [1:36:46<28:45:07,  3.40it/s]
  5%|▌         | 20030/371472 [1:36:46<28:22:17,  3.44it/s]
  5%|▌         | 20031/371472 [1:36:46<27:30:38,  3.55it/s]
  5%|▌         | 20032/371472 [1:36:46<26:42:29,  3.66it/s]
  5%|▌         | 20033/371472 [1:36:47<27:07:56,  3.60it/s]
  5%|▌         | 20034/371472 [1:36:47<27:26:00,  3.56it/s]
  5%|▌         | 20035/371472 [1:36:47<26:42:45,  3.65it/s]
  5%|▌         | 20036/371472 [1:36:47<27:52:32,  3.50it/s]
  5%|▌         | 20037/371472 [1:36:48<26:53:22,  3.63it/s]
  5%|▌         | 20038/371472 [1:36:48<28:26:10,  3.43it/s]
  5%|▌         | 20039/371472 [1:36:48<27:22:58,  3.57it/s]
  5%|▌         | 20040/371472 [1:36:49<27:06:00,  3.60it/s]
                                                           
{'loss': 4.5807, 'learning_rate': 9.51905880324937e-07, 'epoch': 0.86}

  5%|▌         | 20040/371472 [1:36:49<27:06:00,  3.60it/s]
  5%|▌         | 20041/371472 [1:36:49<29:35:24,  3.30it/s]
  5%|▌         | 20042/371472 [1:36:49<28:23:17,  3.44it/s]
  5%|▌         | 20043/371472 [1:36:49<27:46:32,  3.51it/s]
  5%|▌         | 20044/371472 [1:36:50<27:48:42,  3.51it/s]
  5%|▌         | 20045/371472 [1:36:50<28:14:01,  3.46it/s]
  5%|▌         | 20046/371472 [1:36:50<30:17:45,  3.22it/s]
  5%|▌         | 20047/371472 [1:36:51<29:14:28,  3.34it/s]
  5%|▌         | 20048/371472 [1:36:51<28:45:30,  3.39it/s]
  5%|▌         | 20049/371472 [1:36:51<28:09:38,  3.47it/s]
  5%|▌         | 20050/371472 [1:36:52<27:47:23,  3.51it/s]
  5%|▌         | 20051/371472 [1:36:52<29:31:30,  3.31it/s]
  5%|▌         | 20052/371472 [1:36:53<41:12:12,  2.37it/s]
  5%|▌         | 20053/371472 [1:36:53<38:36:27,  2.53it/s]
  5%|▌         | 20054/371472 [1:36:53<35:35:20,  2.74it/s]
  5%|▌         | 20055/371472 [1:36:53<32:47:14,  2.98it/s]
  5%|▌         | 20056/371472 [1:36:54<32:12:52,  3.03it/s]
  5%|▌         | 20057/371472 [1:36:54<32:14:03,  3.03it/s]
  5%|▌         | 20058/371472 [1:36:54<32:45:01,  2.98it/s]
  5%|▌         | 20059/371472 [1:36:55<31:07:10,  3.14it/s]
  5%|▌         | 20060/371472 [1:36:55<30:28:14,  3.20it/s]
                                                           
{'loss': 4.4035, 'learning_rate': 9.51857398349458e-07, 'epoch': 0.86}

  5%|▌         | 20060/371472 [1:36:55<30:28:14,  3.20it/s]
  5%|▌         | 20061/371472 [1:36:55<28:13:44,  3.46it/s]
  5%|▌         | 20062/371472 [1:36:56<27:16:51,  3.58it/s]
  5%|▌         | 20063/371472 [1:36:56<28:08:39,  3.47it/s]
  5%|▌         | 20064/371472 [1:36:56<29:02:57,  3.36it/s]
  5%|▌         | 20065/371472 [1:36:56<28:00:48,  3.48it/s]
  5%|▌         | 20066/371472 [1:36:57<27:32:55,  3.54it/s]
  5%|▌         | 20067/371472 [1:36:57<26:39:33,  3.66it/s]
  5%|▌         | 20068/371472 [1:36:57<27:19:51,  3.57it/s]
  5%|▌         | 20069/371472 [1:36:58<27:00:53,  3.61it/s]
  5%|▌         | 20070/371472 [1:36:58<27:08:10,  3.60it/s]
  5%|▌         | 20071/371472 [1:36:58<26:24:22,  3.70it/s]
  5%|▌         | 20072/371472 [1:36:58<27:04:06,  3.61it/s]
  5%|▌         | 20073/371472 [1:36:59<27:23:08,  3.56it/s]
  5%|▌         | 20074/371472 [1:36:59<26:53:48,  3.63it/s]
  5%|▌         | 20075/371472 [1:36:59<26:40:08,  3.66it/s]
  5%|▌         | 20076/371472 [1:36:59<26:16:39,  3.71it/s]
  5%|▌         | 20077/371472 [1:37:00<26:45:57,  3.65it/s]
  5%|▌         | 20078/371472 [1:37:00<26:01:57,  3.75it/s]
  5%|▌         | 20079/371472 [1:37:00<26:25:45,  3.69it/s]
  5%|▌         | 20080/371472 [1:37:00<26:24:32,  3.70it/s]
                                                           
{'loss': 4.5505, 'learning_rate': 9.518089163739792e-07, 'epoch': 0.86}

  5%|▌         | 20080/371472 [1:37:00<26:24:32,  3.70it/s]
  5%|▌         | 20081/371472 [1:37:01<26:39:37,  3.66it/s]
  5%|▌         | 20082/371472 [1:37:01<26:47:10,  3.64it/s]
  5%|▌         | 20083/371472 [1:37:01<27:00:14,  3.61it/s]
  5%|▌         | 20084/371472 [1:37:02<31:11:04,  3.13it/s]
  5%|▌         | 20085/371472 [1:37:02<31:43:21,  3.08it/s]
  5%|▌         | 20086/371472 [1:37:02<30:01:18,  3.25it/s]
  5%|▌         | 20087/371472 [1:37:03<28:51:54,  3.38it/s]
  5%|▌         | 20088/371472 [1:37:03<30:02:23,  3.25it/s]
  5%|▌         | 20089/371472 [1:37:03<28:54:38,  3.38it/s]
  5%|▌         | 20090/371472 [1:37:03<27:19:37,  3.57it/s]
  5%|▌         | 20091/371472 [1:37:04<27:35:52,  3.54it/s]
  5%|▌         | 20092/371472 [1:37:04<29:01:32,  3.36it/s]
  5%|▌         | 20093/371472 [1:37:04<28:12:04,  3.46it/s]
  5%|▌         | 20094/371472 [1:37:05<28:16:55,  3.45it/s]
  5%|▌         | 20095/371472 [1:37:05<27:52:34,  3.50it/s]
  5%|▌         | 20096/371472 [1:37:05<27:46:18,  3.51it/s]
  5%|▌         | 20097/371472 [1:37:05<27:12:03,  3.59it/s]
  5%|▌         | 20098/371472 [1:37:06<27:22:31,  3.57it/s]
  5%|▌         | 20099/371472 [1:37:06<26:49:20,  3.64it/s]
  5%|▌         | 20100/371472 [1:37:06<27:23:34,  3.56it/s]
                                                           
{'loss': 4.4001, 'learning_rate': 9.517604343985003e-07, 'epoch': 0.87}

  5%|▌         | 20100/371472 [1:37:06<27:23:34,  3.56it/s]
  5%|▌         | 20101/371472 [1:37:07<27:20:19,  3.57it/s]
  5%|▌         | 20102/371472 [1:37:07<26:58:42,  3.62it/s]
  5%|▌         | 20103/371472 [1:37:07<28:30:48,  3.42it/s]
  5%|▌         | 20104/371472 [1:37:07<27:38:48,  3.53it/s]
  5%|▌         | 20105/371472 [1:37:08<27:57:22,  3.49it/s]
  5%|▌         | 20106/371472 [1:37:08<26:52:32,  3.63it/s]
  5%|▌         | 20107/371472 [1:37:08<26:36:14,  3.67it/s]
  5%|▌         | 20108/371472 [1:37:09<27:14:38,  3.58it/s]
  5%|▌         | 20109/371472 [1:37:09<27:09:19,  3.59it/s]
  5%|▌         | 20110/371472 [1:37:09<26:43:46,  3.65it/s]
  5%|▌         | 20111/371472 [1:37:09<26:27:34,  3.69it/s]
  5%|▌         | 20112/371472 [1:37:10<26:29:15,  3.68it/s]
  5%|▌         | 20113/371472 [1:37:10<29:32:03,  3.30it/s]
  5%|▌         | 20114/371472 [1:37:10<33:18:59,  2.93it/s]
  5%|▌         | 20115/371472 [1:37:11<32:15:39,  3.03it/s]
  5%|▌         | 20116/371472 [1:37:11<31:04:20,  3.14it/s]
  5%|▌         | 20117/371472 [1:37:11<28:47:55,  3.39it/s]
  5%|▌         | 20118/371472 [1:37:12<28:30:13,  3.42it/s]
  5%|▌         | 20119/371472 [1:37:12<29:30:11,  3.31it/s]
  5%|▌         | 20120/371472 [1:37:12<28:01:29,  3.48it/s]
                                                           
{'loss': 4.5568, 'learning_rate': 9.517119524230214e-07, 'epoch': 0.87}

  5%|▌         | 20120/371472 [1:37:12<28:01:29,  3.48it/s]
  5%|▌         | 20121/371472 [1:37:12<26:42:22,  3.65it/s]
  5%|▌         | 20122/371472 [1:37:13<28:23:12,  3.44it/s]
  5%|▌         | 20123/371472 [1:37:13<28:00:43,  3.48it/s]
  5%|▌         | 20124/371472 [1:37:13<28:04:52,  3.48it/s]
  5%|▌         | 20125/371472 [1:37:14<27:30:06,  3.55it/s]
  5%|▌         | 20126/371472 [1:37:14<29:40:17,  3.29it/s]
  5%|▌         | 20127/371472 [1:37:14<29:38:49,  3.29it/s]
  5%|▌         | 20128/371472 [1:37:15<30:58:06,  3.15it/s]
  5%|▌         | 20129/371472 [1:37:15<28:42:21,  3.40it/s]
  5%|▌         | 20130/371472 [1:37:15<28:28:50,  3.43it/s]
  5%|▌         | 20131/371472 [1:37:15<27:46:13,  3.51it/s]
  5%|▌         | 20132/371472 [1:37:16<29:28:46,  3.31it/s]
  5%|▌         | 20133/371472 [1:37:16<28:34:21,  3.42it/s]
  5%|▌         | 20134/371472 [1:37:16<28:29:57,  3.42it/s]
  5%|▌         | 20135/371472 [1:37:17<28:24:35,  3.44it/s]
  5%|▌         | 20136/371472 [1:37:17<29:34:34,  3.30it/s]
  5%|▌         | 20137/371472 [1:37:17<29:16:15,  3.33it/s]
  5%|▌         | 20138/371472 [1:37:17<28:18:29,  3.45it/s]
  5%|▌         | 20139/371472 [1:37:18<28:58:33,  3.37it/s]
  5%|▌         | 20140/371472 [1:37:18<28:09:01,  3.47it/s]
                                                           
{'loss': 4.5367, 'learning_rate': 9.516634704475424e-07, 'epoch': 0.87}

  5%|▌         | 20140/371472 [1:37:18<28:09:01,  3.47it/s]
  5%|▌         | 20141/371472 [1:37:18<27:43:17,  3.52it/s]
  5%|▌         | 20142/371472 [1:37:19<28:32:50,  3.42it/s]
  5%|▌         | 20143/371472 [1:37:19<27:52:49,  3.50it/s]
  5%|▌         | 20144/371472 [1:37:19<26:51:43,  3.63it/s]
  5%|▌         | 20145/371472 [1:37:19<27:06:50,  3.60it/s]
  5%|▌         | 20146/371472 [1:37:20<27:05:38,  3.60it/s]
  5%|▌         | 20147/371472 [1:37:20<28:22:31,  3.44it/s]
  5%|▌         | 20148/371472 [1:37:20<27:02:36,  3.61it/s]
  5%|▌         | 20149/371472 [1:37:21<26:19:03,  3.71it/s]
  5%|▌         | 20150/371472 [1:37:21<27:14:41,  3.58it/s]
  5%|▌         | 20151/371472 [1:37:21<27:09:50,  3.59it/s]
  5%|▌         | 20152/371472 [1:37:21<28:55:13,  3.37it/s]
  5%|▌         | 20153/371472 [1:37:22<30:58:28,  3.15it/s]
  5%|▌         | 20154/371472 [1:37:22<32:14:28,  3.03it/s]
  5%|▌         | 20155/371472 [1:37:22<30:47:16,  3.17it/s]
  5%|▌         | 20156/371472 [1:37:23<31:28:36,  3.10it/s]
  5%|▌         | 20157/371472 [1:37:23<30:18:04,  3.22it/s]
  5%|▌         | 20158/371472 [1:37:23<33:05:06,  2.95it/s]
  5%|▌         | 20159/371472 [1:37:24<31:39:02,  3.08it/s]
  5%|▌         | 20160/371472 [1:37:24<30:23:16,  3.21it/s]
                                                           
{'loss': 4.1851, 'learning_rate': 9.516149884720635e-07, 'epoch': 0.87}

  5%|▌         | 20160/371472 [1:37:24<30:23:16,  3.21it/s]
  5%|▌         | 20161/371472 [1:37:24<29:38:07,  3.29it/s]
  5%|▌         | 20162/371472 [1:37:25<30:01:56,  3.25it/s]
  5%|▌         | 20163/371472 [1:37:25<29:54:56,  3.26it/s]
  5%|▌         | 20164/371472 [1:37:25<28:19:57,  3.44it/s]
  5%|▌         | 20165/371472 [1:37:25<28:03:48,  3.48it/s]
  5%|▌         | 20166/371472 [1:37:26<27:33:04,  3.54it/s]
  5%|▌         | 20167/371472 [1:37:26<26:37:47,  3.66it/s]
  5%|▌         | 20168/371472 [1:37:26<26:28:51,  3.69it/s]
  5%|▌         | 20169/371472 [1:37:27<26:18:16,  3.71it/s]
  5%|▌         | 20170/371472 [1:37:27<25:51:05,  3.77it/s]
  5%|▌         | 20171/371472 [1:37:27<25:38:49,  3.80it/s]
  5%|▌         | 20172/371472 [1:37:27<26:30:41,  3.68it/s]
  5%|▌         | 20173/371472 [1:37:28<27:09:15,  3.59it/s]
  5%|▌         | 20174/371472 [1:37:28<26:30:40,  3.68it/s]
  5%|▌         | 20175/371472 [1:37:28<27:18:08,  3.57it/s]
  5%|▌         | 20176/371472 [1:37:28<28:07:40,  3.47it/s]
  5%|▌         | 20177/371472 [1:37:29<27:55:26,  3.49it/s]
  5%|▌         | 20178/371472 [1:37:29<27:47:13,  3.51it/s]
  5%|▌         | 20179/371472 [1:37:29<27:10:29,  3.59it/s]
  5%|▌         | 20180/371472 [1:37:30<27:43:21,  3.52it/s]
                                                           
{'loss': 4.6914, 'learning_rate': 9.515665064965847e-07, 'epoch': 0.87}

  5%|▌         | 20180/371472 [1:37:30<27:43:21,  3.52it/s]
  5%|▌         | 20181/371472 [1:37:30<27:45:12,  3.52it/s]
  5%|▌         | 20182/371472 [1:37:30<28:46:17,  3.39it/s]
  5%|▌         | 20183/371472 [1:37:30<28:17:28,  3.45it/s]
  5%|▌         | 20184/371472 [1:37:31<27:32:05,  3.54it/s]
  5%|▌         | 20185/371472 [1:37:31<27:10:14,  3.59it/s]
  5%|▌         | 20186/371472 [1:37:31<27:39:14,  3.53it/s]
  5%|▌         | 20187/371472 [1:37:32<28:59:08,  3.37it/s]
  5%|▌         | 20188/371472 [1:37:32<27:19:39,  3.57it/s]
  5%|▌         | 20189/371472 [1:37:32<26:40:52,  3.66it/s]
  5%|▌         | 20190/371472 [1:37:32<27:12:09,  3.59it/s]
  5%|▌         | 20191/371472 [1:37:33<27:00:11,  3.61it/s]
  5%|▌         | 20192/371472 [1:37:33<27:09:35,  3.59it/s]
  5%|▌         | 20193/371472 [1:37:33<27:57:05,  3.49it/s]
  5%|▌         | 20194/371472 [1:37:34<28:01:32,  3.48it/s]
  5%|▌         | 20195/371472 [1:37:34<29:12:58,  3.34it/s]
  5%|▌         | 20196/371472 [1:37:34<28:06:23,  3.47it/s]
  5%|▌         | 20197/371472 [1:37:34<28:28:18,  3.43it/s]
  5%|▌         | 20198/371472 [1:37:35<27:59:25,  3.49it/s]
  5%|▌         | 20199/371472 [1:37:35<27:17:24,  3.58it/s]
  5%|▌         | 20200/371472 [1:37:35<28:57:30,  3.37it/s]
                                                           
{'loss': 4.4509, 'learning_rate': 9.515180245211058e-07, 'epoch': 0.87}

  5%|▌         | 20200/371472 [1:37:35<28:57:30,  3.37it/s]
  5%|▌         | 20201/371472 [1:37:36<27:38:16,  3.53it/s]
  5%|▌         | 20202/371472 [1:37:36<28:21:55,  3.44it/s]
  5%|▌         | 20203/371472 [1:37:36<31:41:14,  3.08it/s]
  5%|▌         | 20204/371472 [1:37:37<30:15:06,  3.23it/s]
  5%|▌         | 20205/371472 [1:37:37<29:41:23,  3.29it/s]
  5%|▌         | 20206/371472 [1:37:37<28:22:08,  3.44it/s]
  5%|▌         | 20207/371472 [1:37:37<28:57:10,  3.37it/s]
  5%|▌         | 20208/371472 [1:37:38<30:06:07,  3.24it/s]
  5%|▌         | 20209/371472 [1:37:38<30:17:23,  3.22it/s]
  5%|▌         | 20210/371472 [1:37:38<31:07:38,  3.13it/s]
  5%|▌         | 20211/371472 [1:37:39<29:34:23,  3.30it/s]
  5%|▌         | 20212/371472 [1:37:39<29:27:25,  3.31it/s]
  5%|▌         | 20213/371472 [1:37:39<28:19:28,  3.44it/s]
  5%|▌         | 20214/371472 [1:37:40<30:12:27,  3.23it/s]
  5%|▌         | 20215/371472 [1:37:40<28:52:04,  3.38it/s]
  5%|▌         | 20216/371472 [1:37:40<30:01:09,  3.25it/s]
  5%|▌         | 20217/371472 [1:37:41<30:55:30,  3.16it/s]
  5%|▌         | 20218/371472 [1:37:41<30:36:56,  3.19it/s]
  5%|▌         | 20219/371472 [1:37:41<29:15:34,  3.33it/s]
  5%|▌         | 20220/371472 [1:37:41<29:20:09,  3.33it/s]
                                                           
{'loss': 4.6518, 'learning_rate': 9.514695425456269e-07, 'epoch': 0.87}

  5%|▌         | 20220/371472 [1:37:41<29:20:09,  3.33it/s]
  5%|▌         | 20221/371472 [1:37:42<28:15:17,  3.45it/s]
  5%|▌         | 20222/371472 [1:37:42<27:19:02,  3.57it/s]
  5%|▌         | 20223/371472 [1:37:42<26:41:31,  3.66it/s]
  5%|▌         | 20224/371472 [1:37:43<26:57:05,  3.62it/s]
  5%|▌         | 20225/371472 [1:37:43<27:07:52,  3.60it/s]
  5%|▌         | 20226/371472 [1:37:43<27:11:32,  3.59it/s]
  5%|▌         | 20227/371472 [1:37:43<27:18:32,  3.57it/s]
  5%|▌         | 20228/371472 [1:37:44<26:56:03,  3.62it/s]
  5%|▌         | 20229/371472 [1:37:44<28:00:25,  3.48it/s]
  5%|▌         | 20230/371472 [1:37:44<28:47:39,  3.39it/s]
  5%|▌         | 20231/371472 [1:37:45<31:43:58,  3.07it/s]
  5%|▌         | 20232/371472 [1:37:45<29:49:38,  3.27it/s]
  5%|▌         | 20233/371472 [1:37:45<28:22:16,  3.44it/s]
  5%|▌         | 20234/371472 [1:37:45<28:42:02,  3.40it/s]
  5%|▌         | 20235/371472 [1:37:46<27:27:12,  3.55it/s]
  5%|▌         | 20236/371472 [1:37:46<28:34:54,  3.41it/s]
  5%|▌         | 20237/371472 [1:37:46<27:32:29,  3.54it/s]
  5%|▌         | 20238/371472 [1:37:47<27:46:53,  3.51it/s]
  5%|▌         | 20239/371472 [1:37:47<26:58:26,  3.62it/s]
  5%|▌         | 20240/371472 [1:37:47<27:50:41,  3.50it/s]
                                                           
{'loss': 4.5476, 'learning_rate': 9.51421060570148e-07, 'epoch': 0.87}

  5%|▌         | 20240/371472 [1:37:47<27:50:41,  3.50it/s]
  5%|▌         | 20241/371472 [1:37:47<27:38:43,  3.53it/s]
  5%|▌         | 20242/371472 [1:37:48<30:19:42,  3.22it/s]
  5%|▌         | 20243/371472 [1:37:48<29:24:30,  3.32it/s]
  5%|▌         | 20244/371472 [1:37:48<28:48:48,  3.39it/s]
  5%|▌         | 20245/371472 [1:37:49<28:29:51,  3.42it/s]
  5%|▌         | 20246/371472 [1:37:49<27:23:41,  3.56it/s]
  5%|▌         | 20247/371472 [1:37:49<27:22:39,  3.56it/s]
  5%|▌         | 20248/371472 [1:37:49<27:00:29,  3.61it/s]
  5%|▌         | 20249/371472 [1:37:50<26:41:15,  3.66it/s]
  5%|▌         | 20250/371472 [1:37:50<26:26:37,  3.69it/s]
  5%|▌         | 20251/371472 [1:37:50<27:39:14,  3.53it/s]
  5%|▌         | 20252/371472 [1:37:51<29:11:44,  3.34it/s]
  5%|▌         | 20253/371472 [1:37:51<28:49:29,  3.38it/s]
  5%|▌         | 20254/371472 [1:37:51<28:25:05,  3.43it/s]
  5%|▌         | 20255/371472 [1:37:51<28:22:57,  3.44it/s]
  5%|▌         | 20256/371472 [1:37:52<27:34:42,  3.54it/s]
  5%|▌         | 20257/371472 [1:37:52<27:16:57,  3.58it/s]
  5%|▌         | 20258/371472 [1:37:52<27:04:02,  3.60it/s]
  5%|▌         | 20259/371472 [1:37:53<28:27:39,  3.43it/s]
  5%|▌         | 20260/371472 [1:37:53<27:52:51,  3.50it/s]
                                                           
{'loss': 4.4285, 'learning_rate': 9.51372578594669e-07, 'epoch': 0.87}

  5%|▌         | 20260/371472 [1:37:53<27:52:51,  3.50it/s]
  5%|▌         | 20261/371472 [1:37:53<28:38:22,  3.41it/s]
  5%|▌         | 20262/371472 [1:37:53<28:22:51,  3.44it/s]
  5%|▌         | 20263/371472 [1:37:54<29:52:10,  3.27it/s]
  5%|▌         | 20264/371472 [1:37:54<29:22:58,  3.32it/s]
  5%|▌         | 20265/371472 [1:37:54<28:22:14,  3.44it/s]
  5%|▌         | 20266/371472 [1:37:55<28:08:02,  3.47it/s]
  5%|▌         | 20267/371472 [1:37:55<27:03:43,  3.60it/s]
  5%|▌         | 20268/371472 [1:37:55<26:28:55,  3.68it/s]
  5%|▌         | 20269/371472 [1:37:55<27:14:15,  3.58it/s]
  5%|▌         | 20270/371472 [1:37:56<27:12:20,  3.59it/s]
  5%|▌         | 20271/371472 [1:37:56<30:38:02,  3.18it/s]
  5%|▌         | 20272/371472 [1:37:56<29:42:31,  3.28it/s]
  5%|▌         | 20273/371472 [1:37:57<28:46:26,  3.39it/s]
  5%|▌         | 20274/371472 [1:37:57<27:47:16,  3.51it/s]
  5%|▌         | 20275/371472 [1:37:57<26:47:16,  3.64it/s]
  5%|▌         | 20276/371472 [1:37:58<28:05:44,  3.47it/s]
  5%|▌         | 20277/371472 [1:37:58<27:31:01,  3.55it/s]
  5%|▌         | 20278/371472 [1:37:58<27:49:50,  3.51it/s]
  5%|▌         | 20279/371472 [1:37:58<27:12:17,  3.59it/s]
  5%|▌         | 20280/371472 [1:37:59<28:49:53,  3.38it/s]
                                                           
{'loss': 4.4528, 'learning_rate': 9.513240966191901e-07, 'epoch': 0.87}

  5%|▌         | 20280/371472 [1:37:59<28:49:53,  3.38it/s]
  5%|▌         | 20281/371472 [1:37:59<27:40:46,  3.52it/s]
  5%|▌         | 20282/371472 [1:37:59<29:25:54,  3.31it/s]
  5%|▌         | 20283/371472 [1:38:00<27:58:35,  3.49it/s]
  5%|▌         | 20284/371472 [1:38:00<32:47:22,  2.98it/s]
  5%|▌         | 20285/371472 [1:38:00<31:07:52,  3.13it/s]
  5%|▌         | 20286/371472 [1:38:01<30:06:45,  3.24it/s]
  5%|▌         | 20287/371472 [1:38:01<29:46:07,  3.28it/s]
  5%|▌         | 20288/371472 [1:38:01<28:44:42,  3.39it/s]
  5%|▌         | 20289/371472 [1:38:01<29:39:36,  3.29it/s]
  5%|▌         | 20290/371472 [1:38:02<28:25:38,  3.43it/s]
  5%|▌         | 20291/371472 [1:38:02<27:41:58,  3.52it/s]
  5%|▌         | 20292/371472 [1:38:02<27:39:13,  3.53it/s]
  5%|▌         | 20293/371472 [1:38:03<28:26:23,  3.43it/s]
  5%|▌         | 20294/371472 [1:38:03<27:20:46,  3.57it/s]
  5%|▌         | 20295/371472 [1:38:03<27:21:48,  3.56it/s]
  5%|▌         | 20296/371472 [1:38:03<27:57:52,  3.49it/s]
  5%|▌         | 20297/371472 [1:38:04<26:41:46,  3.65it/s]
  5%|▌         | 20298/371472 [1:38:04<27:03:41,  3.60it/s]
  5%|▌         | 20299/371472 [1:38:04<27:15:20,  3.58it/s]
  5%|▌         | 20300/371472 [1:38:04<26:28:45,  3.68it/s]
                                                           
{'loss': 4.4412, 'learning_rate': 9.512756146437113e-07, 'epoch': 0.87}

  5%|▌         | 20300/371472 [1:38:04<26:28:45,  3.68it/s]
  5%|▌         | 20301/371472 [1:38:05<26:15:28,  3.71it/s]
  5%|▌         | 20302/371472 [1:38:05<27:43:18,  3.52it/s]
  5%|▌         | 20303/371472 [1:38:05<28:44:57,  3.39it/s]
  5%|▌         | 20304/371472 [1:38:06<30:20:49,  3.21it/s]
  5%|▌         | 20305/371472 [1:38:06<29:26:38,  3.31it/s]
  5%|▌         | 20306/371472 [1:38:06<28:06:23,  3.47it/s]
  5%|▌         | 20307/371472 [1:38:07<27:33:42,  3.54it/s]
  5%|▌         | 20308/371472 [1:38:07<31:20:01,  3.11it/s]
  5%|▌         | 20309/371472 [1:38:07<30:41:29,  3.18it/s]
  5%|▌         | 20310/371472 [1:38:08<30:14:59,  3.22it/s]
  5%|▌         | 20311/371472 [1:38:08<30:27:15,  3.20it/s]
  5%|▌         | 20312/371472 [1:38:08<29:33:31,  3.30it/s]
  5%|▌         | 20313/371472 [1:38:08<28:36:21,  3.41it/s]
  5%|▌         | 20314/371472 [1:38:09<28:22:49,  3.44it/s]
  5%|▌         | 20315/371472 [1:38:09<27:20:06,  3.57it/s]
  5%|▌         | 20316/371472 [1:38:09<26:53:27,  3.63it/s]
  5%|▌         | 20317/371472 [1:38:10<28:33:01,  3.42it/s]
  5%|▌         | 20318/371472 [1:38:10<27:33:28,  3.54it/s]
  5%|▌         | 20319/371472 [1:38:10<27:22:02,  3.56it/s]
  5%|▌         | 20320/371472 [1:38:10<26:56:55,  3.62it/s]
                                                           
{'loss': 4.6117, 'learning_rate': 9.512271326682324e-07, 'epoch': 0.88}

  5%|▌         | 20320/371472 [1:38:10<26:56:55,  3.62it/s]
  5%|▌         | 20321/371472 [1:38:11<26:51:07,  3.63it/s]
  5%|▌         | 20322/371472 [1:38:11<27:21:59,  3.56it/s]
  5%|▌         | 20323/371472 [1:38:11<26:45:30,  3.65it/s]
  5%|▌         | 20324/371472 [1:38:11<26:48:02,  3.64it/s]
  5%|▌         | 20325/371472 [1:38:12<27:18:32,  3.57it/s]
  5%|▌         | 20326/371472 [1:38:12<27:00:19,  3.61it/s]
  5%|▌         | 20327/371472 [1:38:12<27:22:06,  3.56it/s]
  5%|▌         | 20328/371472 [1:38:13<26:55:41,  3.62it/s]
  5%|▌         | 20329/371472 [1:38:13<26:33:11,  3.67it/s]
  5%|▌         | 20330/371472 [1:38:13<26:06:33,  3.74it/s]
  5%|▌         | 20331/371472 [1:38:13<26:23:59,  3.69it/s]
  5%|▌         | 20332/371472 [1:38:14<26:32:37,  3.67it/s]
  5%|▌         | 20333/371472 [1:38:14<26:37:04,  3.66it/s]
  5%|▌         | 20334/371472 [1:38:14<27:09:08,  3.59it/s]
  5%|▌         | 20335/371472 [1:38:14<26:32:31,  3.67it/s]
  5%|▌         | 20336/371472 [1:38:15<26:16:52,  3.71it/s]
  5%|▌         | 20337/371472 [1:38:15<26:31:38,  3.68it/s]
  5%|▌         | 20338/371472 [1:38:15<26:32:45,  3.67it/s]
  5%|▌         | 20339/371472 [1:38:16<26:13:21,  3.72it/s]
  5%|▌         | 20340/371472 [1:38:16<27:09:05,  3.59it/s]
                                                           
{'loss': 4.5079, 'learning_rate': 9.511786506927536e-07, 'epoch': 0.88}

  5%|▌         | 20340/371472 [1:38:16<27:09:05,  3.59it/s]
  5%|▌         | 20341/371472 [1:38:16<29:25:58,  3.31it/s]
  5%|▌         | 20342/371472 [1:38:16<28:46:28,  3.39it/s]
  5%|▌         | 20343/371472 [1:38:17<28:03:06,  3.48it/s]
  5%|▌         | 20344/371472 [1:38:17<28:36:42,  3.41it/s]
  5%|▌         | 20345/371472 [1:38:17<27:55:05,  3.49it/s]
  5%|▌         | 20346/371472 [1:38:18<26:38:08,  3.66it/s]
  5%|▌         | 20347/371472 [1:38:18<27:32:23,  3.54it/s]
  5%|▌         | 20348/371472 [1:38:18<27:40:21,  3.52it/s]
  5%|▌         | 20349/371472 [1:38:18<28:42:33,  3.40it/s]
  5%|▌         | 20350/371472 [1:38:19<27:32:38,  3.54it/s]
  5%|▌         | 20351/371472 [1:38:19<28:35:51,  3.41it/s]
  5%|▌         | 20352/371472 [1:38:19<27:17:06,  3.57it/s]
  5%|▌         | 20353/371472 [1:38:20<26:54:24,  3.62it/s]
  5%|▌         | 20354/371472 [1:38:20<27:11:53,  3.59it/s]
  5%|▌         | 20355/371472 [1:38:20<30:33:03,  3.19it/s]
  5%|▌         | 20356/371472 [1:38:21<30:21:07,  3.21it/s]
  5%|▌         | 20357/371472 [1:38:21<29:57:42,  3.26it/s]
  5%|▌         | 20358/371472 [1:38:21<29:46:05,  3.28it/s]
  5%|▌         | 20359/371472 [1:38:21<29:05:08,  3.35it/s]
  5%|▌         | 20360/371472 [1:38:22<28:14:18,  3.45it/s]
                                                           
{'loss': 4.5531, 'learning_rate': 9.511301687172747e-07, 'epoch': 0.88}

  5%|▌         | 20360/371472 [1:38:22<28:14:18,  3.45it/s]
  5%|▌         | 20361/371472 [1:38:22<27:28:34,  3.55it/s]
  5%|▌         | 20362/371472 [1:38:22<27:55:15,  3.49it/s]
  5%|▌         | 20363/371472 [1:38:23<28:01:25,  3.48it/s]
  5%|▌         | 20364/371472 [1:38:23<27:30:35,  3.55it/s]
  5%|▌         | 20365/371472 [1:38:23<27:12:35,  3.58it/s]
  5%|▌         | 20366/371472 [1:38:23<27:26:20,  3.55it/s]
  5%|▌         | 20367/371472 [1:38:24<27:05:45,  3.60it/s]
  5%|▌         | 20368/371472 [1:38:24<26:58:46,  3.61it/s]
  5%|▌         | 20369/371472 [1:38:24<26:44:18,  3.65it/s]
  5%|▌         | 20370/371472 [1:38:24<26:24:16,  3.69it/s]
  5%|▌         | 20371/371472 [1:38:25<26:38:52,  3.66it/s]
  5%|▌         | 20372/371472 [1:38:25<27:18:59,  3.57it/s]
  5%|▌         | 20373/371472 [1:38:25<27:50:57,  3.50it/s]
  5%|▌         | 20374/371472 [1:38:26<28:40:15,  3.40it/s]
  5%|▌         | 20375/371472 [1:38:26<27:21:50,  3.56it/s]
  5%|▌         | 20376/371472 [1:38:26<28:17:57,  3.45it/s]
  5%|▌         | 20377/371472 [1:38:26<28:05:37,  3.47it/s]
  5%|▌         | 20378/371472 [1:38:27<28:10:09,  3.46it/s]
  5%|▌         | 20379/371472 [1:38:27<27:12:03,  3.59it/s]
  5%|▌         | 20380/371472 [1:38:27<29:02:41,  3.36it/s]
                                                           
{'loss': 4.5672, 'learning_rate': 9.510816867417957e-07, 'epoch': 0.88}

  5%|▌         | 20380/371472 [1:38:27<29:02:41,  3.36it/s]
  5%|▌         | 20381/371472 [1:38:28<28:53:48,  3.37it/s]
  5%|▌         | 20382/371472 [1:38:28<29:02:53,  3.36it/s]
  5%|▌         | 20383/371472 [1:38:28<28:00:29,  3.48it/s]
  5%|▌         | 20384/371472 [1:38:29<28:30:47,  3.42it/s]
  5%|▌         | 20385/371472 [1:38:29<27:23:49,  3.56it/s]
  5%|▌         | 20386/371472 [1:38:29<28:06:21,  3.47it/s]
  5%|▌         | 20387/371472 [1:38:29<27:59:09,  3.48it/s]
  5%|▌         | 20388/371472 [1:38:30<27:12:33,  3.58it/s]
  5%|▌         | 20389/371472 [1:38:30<27:58:51,  3.49it/s]
  5%|▌         | 20390/371472 [1:38:30<27:56:15,  3.49it/s]
  5%|▌         | 20391/371472 [1:38:30<27:12:43,  3.58it/s]
  5%|▌         | 20392/371472 [1:38:31<26:51:38,  3.63it/s]
  5%|▌         | 20393/371472 [1:38:31<26:24:30,  3.69it/s]
  5%|▌         | 20394/371472 [1:38:31<26:51:27,  3.63it/s]
  5%|▌         | 20395/371472 [1:38:32<26:06:30,  3.74it/s]
  5%|▌         | 20396/371472 [1:38:32<28:07:18,  3.47it/s]
  5%|▌         | 20397/371472 [1:38:32<27:38:29,  3.53it/s]
  5%|▌         | 20398/371472 [1:38:32<28:26:25,  3.43it/s]
  5%|▌         | 20399/371472 [1:38:33<28:16:30,  3.45it/s]
  5%|▌         | 20400/371472 [1:38:33<28:05:31,  3.47it/s]
                                                           
{'loss': 4.581, 'learning_rate': 9.510332047663168e-07, 'epoch': 0.88}

  5%|▌         | 20400/371472 [1:38:33<28:05:31,  3.47it/s]
  5%|▌         | 20401/371472 [1:38:33<30:21:57,  3.21it/s]
  5%|▌         | 20402/371472 [1:38:34<29:00:38,  3.36it/s]
  5%|▌         | 20403/371472 [1:38:34<27:22:53,  3.56it/s]
  5%|▌         | 20404/371472 [1:38:34<27:07:34,  3.60it/s]
  5%|▌         | 20405/371472 [1:38:34<26:41:18,  3.65it/s]
  5%|▌         | 20406/371472 [1:38:35<27:20:21,  3.57it/s]
  5%|▌         | 20407/371472 [1:38:35<28:17:08,  3.45it/s]
  5%|▌         | 20408/371472 [1:38:35<27:41:58,  3.52it/s]
  5%|▌         | 20409/371472 [1:38:36<30:36:21,  3.19it/s]
  5%|▌         | 20410/371472 [1:38:36<30:44:48,  3.17it/s]
  5%|▌         | 20411/371472 [1:38:36<30:33:32,  3.19it/s]
  5%|▌         | 20412/371472 [1:38:37<30:49:10,  3.16it/s]
  5%|▌         | 20413/371472 [1:38:37<31:36:25,  3.09it/s]
  5%|▌         | 20414/371472 [1:38:37<31:22:19,  3.11it/s]
  5%|▌         | 20415/371472 [1:38:38<30:17:39,  3.22it/s]
  5%|▌         | 20416/371472 [1:38:38<30:13:05,  3.23it/s]
  5%|▌         | 20417/371472 [1:38:38<28:55:41,  3.37it/s]
  5%|▌         | 20418/371472 [1:38:38<27:39:09,  3.53it/s]
  5%|▌         | 20419/371472 [1:38:39<29:32:27,  3.30it/s]
  5%|▌         | 20420/371472 [1:38:39<29:20:10,  3.32it/s]
                                                           
{'loss': 4.8276, 'learning_rate': 9.50984722790838e-07, 'epoch': 0.88}

  5%|▌         | 20420/371472 [1:38:39<29:20:10,  3.32it/s]
  5%|▌         | 20421/371472 [1:38:39<30:28:16,  3.20it/s]
  5%|▌         | 20422/371472 [1:38:40<29:33:35,  3.30it/s]
  5%|▌         | 20423/371472 [1:38:40<28:55:14,  3.37it/s]
  5%|▌         | 20424/371472 [1:38:40<30:20:41,  3.21it/s]
  5%|▌         | 20425/371472 [1:38:41<29:08:36,  3.35it/s]
  5%|▌         | 20426/371472 [1:38:41<29:46:53,  3.27it/s]
  5%|▌         | 20427/371472 [1:38:41<28:06:21,  3.47it/s]
  5%|▌         | 20428/371472 [1:38:41<26:55:46,  3.62it/s]
  5%|▌         | 20429/371472 [1:38:42<26:11:43,  3.72it/s]
  5%|▌         | 20430/371472 [1:38:42<28:28:56,  3.42it/s]
  6%|▌         | 20431/371472 [1:38:42<28:27:24,  3.43it/s]
  6%|▌         | 20432/371472 [1:38:43<29:14:58,  3.33it/s]
  6%|▌         | 20433/371472 [1:38:43<29:15:44,  3.33it/s]
  6%|▌         | 20434/371472 [1:38:43<30:02:14,  3.25it/s]
  6%|▌         | 20435/371472 [1:38:44<29:23:09,  3.32it/s]
  6%|▌         | 20436/371472 [1:38:44<28:03:37,  3.48it/s]
  6%|▌         | 20437/371472 [1:38:44<27:27:26,  3.55it/s]
  6%|▌         | 20438/371472 [1:38:44<28:01:40,  3.48it/s]
  6%|▌         | 20439/371472 [1:38:45<27:01:58,  3.61it/s]
  6%|▌         | 20440/371472 [1:38:45<26:54:59,  3.62it/s]
                                                           
{'loss': 4.5643, 'learning_rate': 9.50936240815359e-07, 'epoch': 0.88}

  6%|▌         | 20440/371472 [1:38:45<26:54:59,  3.62it/s]
  6%|▌         | 20441/371472 [1:38:45<27:20:49,  3.57it/s]
  6%|▌         | 20442/371472 [1:38:45<26:26:07,  3.69it/s]
  6%|▌         | 20443/371472 [1:38:46<26:07:15,  3.73it/s]
  6%|▌         | 20444/371472 [1:38:46<26:04:18,  3.74it/s]
  6%|▌         | 20445/371472 [1:38:46<27:36:04,  3.53it/s]
  6%|▌         | 20446/371472 [1:38:47<26:54:06,  3.62it/s]
  6%|▌         | 20447/371472 [1:38:47<26:08:17,  3.73it/s]
  6%|▌         | 20448/371472 [1:38:47<25:52:58,  3.77it/s]
  6%|▌         | 20449/371472 [1:38:47<26:00:17,  3.75it/s]
  6%|▌         | 20450/371472 [1:38:48<25:44:35,  3.79it/s]
  6%|▌         | 20451/371472 [1:38:48<26:29:36,  3.68it/s]
  6%|▌         | 20452/371472 [1:38:48<27:18:17,  3.57it/s]
  6%|▌         | 20453/371472 [1:38:48<27:38:45,  3.53it/s]
  6%|▌         | 20454/371472 [1:38:49<26:44:49,  3.65it/s]
  6%|▌         | 20455/371472 [1:38:49<26:54:03,  3.62it/s]
  6%|▌         | 20456/371472 [1:38:49<27:23:45,  3.56it/s]
  6%|▌         | 20457/371472 [1:38:50<27:16:54,  3.57it/s]
  6%|▌         | 20458/371472 [1:38:50<27:24:27,  3.56it/s]
  6%|▌         | 20459/371472 [1:38:50<26:37:09,  3.66it/s]
  6%|▌         | 20460/371472 [1:38:50<26:24:50,  3.69it/s]
                                                           
{'loss': 4.7807, 'learning_rate': 9.508877588398802e-07, 'epoch': 0.88}

  6%|▌         | 20460/371472 [1:38:50<26:24:50,  3.69it/s]
  6%|▌         | 20461/371472 [1:38:51<28:06:28,  3.47it/s]
  6%|▌         | 20462/371472 [1:38:51<28:03:32,  3.47it/s]
  6%|▌         | 20463/371472 [1:38:51<27:49:52,  3.50it/s]
  6%|▌         | 20464/371472 [1:38:51<26:49:53,  3.63it/s]
  6%|▌         | 20465/371472 [1:38:52<28:14:31,  3.45it/s]
  6%|▌         | 20466/371472 [1:38:52<28:18:02,  3.45it/s]
  6%|▌         | 20467/371472 [1:38:52<28:21:11,  3.44it/s]
  6%|▌         | 20468/371472 [1:38:53<27:13:21,  3.58it/s]
  6%|▌         | 20469/371472 [1:38:53<27:27:10,  3.55it/s]
  6%|▌         | 20470/371472 [1:38:53<27:41:31,  3.52it/s]
  6%|▌         | 20471/371472 [1:38:53<26:45:48,  3.64it/s]
  6%|▌         | 20472/371472 [1:38:54<27:16:28,  3.57it/s]
  6%|▌         | 20473/371472 [1:38:54<28:24:15,  3.43it/s]
  6%|▌         | 20474/371472 [1:38:54<28:05:52,  3.47it/s]
  6%|▌         | 20475/371472 [1:38:55<27:20:43,  3.57it/s]
  6%|▌         | 20476/371472 [1:38:55<26:58:15,  3.61it/s]
  6%|▌         | 20477/371472 [1:38:55<26:50:51,  3.63it/s]
  6%|▌         | 20478/371472 [1:38:55<26:30:29,  3.68it/s]
  6%|▌         | 20479/371472 [1:38:56<27:01:15,  3.61it/s]
  6%|▌         | 20480/371472 [1:38:56<28:56:54,  3.37it/s]
                                                           
{'loss': 4.5882, 'learning_rate': 9.508392768644013e-07, 'epoch': 0.88}

  6%|▌         | 20480/371472 [1:38:56<28:56:54,  3.37it/s]
  6%|▌         | 20481/371472 [1:38:56<27:56:55,  3.49it/s]
  6%|▌         | 20482/371472 [1:38:57<26:28:37,  3.68it/s]
  6%|▌         | 20483/371472 [1:38:57<26:46:59,  3.64it/s]
  6%|▌         | 20484/371472 [1:38:57<26:52:31,  3.63it/s]
  6%|▌         | 20485/371472 [1:38:57<25:57:34,  3.76it/s]
  6%|▌         | 20486/371472 [1:38:58<26:58:00,  3.62it/s]
  6%|▌         | 20487/371472 [1:38:58<28:34:59,  3.41it/s]
  6%|▌         | 20488/371472 [1:38:58<30:08:19,  3.23it/s]
  6%|▌         | 20489/371472 [1:38:59<28:44:21,  3.39it/s]
  6%|▌         | 20490/371472 [1:38:59<30:32:37,  3.19it/s]
  6%|▌         | 20491/371472 [1:38:59<29:43:47,  3.28it/s]
  6%|▌         | 20492/371472 [1:39:00<29:20:02,  3.32it/s]
  6%|▌         | 20493/371472 [1:39:00<28:40:48,  3.40it/s]
  6%|▌         | 20494/371472 [1:39:00<27:31:43,  3.54it/s]
  6%|▌         | 20495/371472 [1:39:00<27:38:32,  3.53it/s]
  6%|▌         | 20496/371472 [1:39:01<26:31:47,  3.67it/s]
  6%|▌         | 20497/371472 [1:39:01<27:13:07,  3.58it/s]
  6%|▌         | 20498/371472 [1:39:01<26:54:27,  3.62it/s]
  6%|▌         | 20499/371472 [1:39:01<26:21:53,  3.70it/s]
  6%|▌         | 20500/371472 [1:39:02<26:28:20,  3.68it/s]
                                                           
{'loss': 4.5565, 'learning_rate': 9.507907948889224e-07, 'epoch': 0.88}

  6%|▌         | 20500/371472 [1:39:02<26:28:20,  3.68it/s]
  6%|▌         | 20501/371472 [1:39:02<27:34:40,  3.54it/s]
  6%|▌         | 20502/371472 [1:39:02<26:30:57,  3.68it/s]
  6%|▌         | 20503/371472 [1:39:03<26:49:35,  3.63it/s]
  6%|▌         | 20504/371472 [1:39:03<29:27:57,  3.31it/s]
  6%|▌         | 20505/371472 [1:39:03<28:38:37,  3.40it/s]
  6%|▌         | 20506/371472 [1:39:03<28:25:22,  3.43it/s]
  6%|▌         | 20507/371472 [1:39:04<27:47:43,  3.51it/s]
  6%|▌         | 20508/371472 [1:39:04<27:57:38,  3.49it/s]
  6%|▌         | 20509/371472 [1:39:04<27:27:23,  3.55it/s]
  6%|▌         | 20510/371472 [1:39:05<27:11:51,  3.58it/s]
  6%|▌         | 20511/371472 [1:39:05<26:51:31,  3.63it/s]
  6%|▌         | 20512/371472 [1:39:05<26:52:02,  3.63it/s]
  6%|▌         | 20513/371472 [1:39:05<26:06:14,  3.73it/s]
  6%|▌         | 20514/371472 [1:39:06<25:33:19,  3.81it/s]
  6%|▌         | 20515/371472 [1:39:06<25:32:35,  3.82it/s]
  6%|▌         | 20516/371472 [1:39:06<25:46:24,  3.78it/s]
  6%|▌         | 20517/371472 [1:39:06<26:22:44,  3.70it/s]
  6%|▌         | 20518/371472 [1:39:07<27:04:44,  3.60it/s]
  6%|▌         | 20519/371472 [1:39:07<26:25:54,  3.69it/s]
  6%|▌         | 20520/371472 [1:39:07<29:12:30,  3.34it/s]
                                                           
{'loss': 4.3398, 'learning_rate': 9.507423129134434e-07, 'epoch': 0.88}

  6%|▌         | 20520/371472 [1:39:07<29:12:30,  3.34it/s]
  6%|▌         | 20521/371472 [1:39:08<28:56:21,  3.37it/s]
  6%|▌         | 20522/371472 [1:39:08<29:08:17,  3.35it/s]
  6%|▌         | 20523/371472 [1:39:08<30:30:48,  3.19it/s]
  6%|▌         | 20524/371472 [1:39:09<29:52:07,  3.26it/s]
  6%|▌         | 20525/371472 [1:39:09<30:36:57,  3.18it/s]
  6%|▌         | 20526/371472 [1:39:09<29:03:25,  3.35it/s]
  6%|▌         | 20527/371472 [1:39:09<28:10:09,  3.46it/s]
  6%|▌         | 20528/371472 [1:39:10<27:34:41,  3.53it/s]
  6%|▌         | 20529/371472 [1:39:10<28:00:41,  3.48it/s]
  6%|▌         | 20530/371472 [1:39:10<26:58:28,  3.61it/s]
  6%|▌         | 20531/371472 [1:39:11<27:44:46,  3.51it/s]
  6%|▌         | 20532/371472 [1:39:11<26:41:36,  3.65it/s]
  6%|▌         | 20533/371472 [1:39:11<26:35:30,  3.67it/s]
  6%|▌         | 20534/371472 [1:39:11<26:41:32,  3.65it/s]
  6%|▌         | 20535/371472 [1:39:12<28:00:39,  3.48it/s]
  6%|▌         | 20536/371472 [1:39:12<27:41:24,  3.52it/s]
  6%|▌         | 20537/371472 [1:39:12<30:07:25,  3.24it/s]
  6%|▌         | 20538/371472 [1:39:13<29:14:18,  3.33it/s]
  6%|▌         | 20539/371472 [1:39:13<28:27:08,  3.43it/s]
  6%|▌         | 20540/371472 [1:39:13<30:57:20,  3.15it/s]
                                                           
{'loss': 4.6346, 'learning_rate': 9.506938309379646e-07, 'epoch': 0.88}

  6%|▌         | 20540/371472 [1:39:13<30:57:20,  3.15it/s]
  6%|▌         | 20541/371472 [1:39:14<29:16:04,  3.33it/s]
  6%|▌         | 20542/371472 [1:39:14<27:49:14,  3.50it/s]
  6%|▌         | 20543/371472 [1:39:14<27:18:03,  3.57it/s]
  6%|▌         | 20544/371472 [1:39:14<27:12:57,  3.58it/s]
  6%|▌         | 20545/371472 [1:39:15<26:37:29,  3.66it/s]
  6%|▌         | 20546/371472 [1:39:15<29:01:28,  3.36it/s]
  6%|▌         | 20547/371472 [1:39:15<28:43:02,  3.39it/s]
  6%|▌         | 20548/371472 [1:39:16<29:11:46,  3.34it/s]
  6%|▌         | 20549/371472 [1:39:16<28:13:53,  3.45it/s]
  6%|▌         | 20550/371472 [1:39:16<28:17:07,  3.45it/s]
  6%|▌         | 20551/371472 [1:39:16<28:18:29,  3.44it/s]
  6%|▌         | 20552/371472 [1:39:17<28:30:56,  3.42it/s]
  6%|▌         | 20553/371472 [1:39:17<29:19:17,  3.32it/s]
  6%|▌         | 20554/371472 [1:39:17<28:27:43,  3.42it/s]
  6%|▌         | 20555/371472 [1:39:18<27:21:47,  3.56it/s]
  6%|▌         | 20556/371472 [1:39:18<26:48:33,  3.64it/s]
  6%|▌         | 20557/371472 [1:39:18<27:22:19,  3.56it/s]
  6%|▌         | 20558/371472 [1:39:18<27:38:37,  3.53it/s]
  6%|▌         | 20559/371472 [1:39:19<27:27:09,  3.55it/s]
  6%|▌         | 20560/371472 [1:39:19<26:58:53,  3.61it/s]
                                                           
{'loss': 4.7336, 'learning_rate': 9.506453489624857e-07, 'epoch': 0.89}

  6%|▌         | 20560/371472 [1:39:19<26:58:53,  3.61it/s]
  6%|▌         | 20561/371472 [1:39:19<27:42:56,  3.52it/s]
  6%|▌         | 20562/371472 [1:39:19<27:36:22,  3.53it/s]
  6%|▌         | 20563/371472 [1:39:20<27:43:30,  3.52it/s]
  6%|▌         | 20564/371472 [1:39:20<26:55:25,  3.62it/s]
  6%|▌         | 20565/371472 [1:39:20<27:09:35,  3.59it/s]
  6%|▌         | 20566/371472 [1:39:21<27:02:34,  3.60it/s]
  6%|▌         | 20567/371472 [1:39:21<26:23:00,  3.69it/s]
  6%|▌         | 20568/371472 [1:39:21<25:53:33,  3.76it/s]
  6%|▌         | 20569/371472 [1:39:21<26:49:19,  3.63it/s]
  6%|▌         | 20570/371472 [1:39:22<26:25:12,  3.69it/s]
  6%|▌         | 20571/371472 [1:39:22<26:55:17,  3.62it/s]
  6%|▌         | 20572/371472 [1:39:22<26:42:52,  3.65it/s]
  6%|▌         | 20573/371472 [1:39:22<26:24:51,  3.69it/s]
  6%|▌         | 20574/371472 [1:39:23<32:50:26,  2.97it/s]
  6%|▌         | 20575/371472 [1:39:23<33:41:48,  2.89it/s]
  6%|▌         | 20576/371472 [1:39:24<31:01:11,  3.14it/s]
  6%|▌         | 20577/371472 [1:39:24<29:33:46,  3.30it/s]
  6%|▌         | 20578/371472 [1:39:24<29:53:01,  3.26it/s]
  6%|▌         | 20579/371472 [1:39:24<28:27:07,  3.43it/s]
  6%|▌         | 20580/371472 [1:39:25<28:12:41,  3.45it/s]
                                                           
{'loss': 4.6375, 'learning_rate': 9.505968669870069e-07, 'epoch': 0.89}

  6%|▌         | 20580/371472 [1:39:25<28:12:41,  3.45it/s]
  6%|▌         | 20581/371472 [1:39:25<27:53:18,  3.49it/s]
  6%|▌         | 20582/371472 [1:39:25<27:54:37,  3.49it/s]
  6%|▌         | 20583/371472 [1:39:26<27:31:37,  3.54it/s]
  6%|▌         | 20584/371472 [1:39:26<26:56:48,  3.62it/s]
  6%|▌         | 20585/371472 [1:39:26<28:21:49,  3.44it/s]
  6%|▌         | 20586/371472 [1:39:27<30:29:29,  3.20it/s]
  6%|▌         | 20587/371472 [1:39:27<29:28:50,  3.31it/s]
  6%|▌         | 20588/371472 [1:39:27<29:13:06,  3.34it/s]
  6%|▌         | 20589/371472 [1:39:27<28:16:25,  3.45it/s]
  6%|▌         | 20590/371472 [1:39:28<27:58:28,  3.48it/s]
  6%|▌         | 20591/371472 [1:39:28<28:29:34,  3.42it/s]
  6%|▌         | 20592/371472 [1:39:28<27:36:19,  3.53it/s]
  6%|▌         | 20593/371472 [1:39:28<27:18:07,  3.57it/s]
  6%|▌         | 20594/371472 [1:39:29<27:02:38,  3.60it/s]
  6%|▌         | 20595/371472 [1:39:29<30:10:09,  3.23it/s]
  6%|▌         | 20596/371472 [1:39:29<29:13:06,  3.34it/s]
  6%|▌         | 20597/371472 [1:39:30<27:50:03,  3.50it/s]
  6%|▌         | 20598/371472 [1:39:30<27:11:53,  3.58it/s]
  6%|▌         | 20599/371472 [1:39:30<27:17:58,  3.57it/s]
  6%|▌         | 20600/371472 [1:39:31<28:38:08,  3.40it/s]
                                                           
{'loss': 4.1946, 'learning_rate': 9.505483850115279e-07, 'epoch': 0.89}

  6%|▌         | 20600/371472 [1:39:31<28:38:08,  3.40it/s]
  6%|▌         | 20601/371472 [1:39:31<31:56:47,  3.05it/s]
  6%|▌         | 20602/371472 [1:39:31<30:20:24,  3.21it/s]
  6%|▌         | 20603/371472 [1:39:31<28:54:45,  3.37it/s]
  6%|▌         | 20604/371472 [1:39:32<28:50:18,  3.38it/s]
  6%|▌         | 20605/371472 [1:39:32<30:33:15,  3.19it/s]
  6%|▌         | 20606/371472 [1:39:32<29:15:20,  3.33it/s]
  6%|▌         | 20607/371472 [1:39:33<29:52:30,  3.26it/s]
  6%|▌         | 20608/371472 [1:39:33<30:02:40,  3.24it/s]
  6%|▌         | 20609/371472 [1:39:33<31:05:58,  3.13it/s]
  6%|▌         | 20610/371472 [1:39:34<29:19:22,  3.32it/s]
  6%|▌         | 20611/371472 [1:39:34<28:59:09,  3.36it/s]
  6%|▌         | 20612/371472 [1:39:34<29:07:41,  3.35it/s]
  6%|▌         | 20613/371472 [1:39:34<28:11:16,  3.46it/s]
  6%|▌         | 20614/371472 [1:39:35<28:20:19,  3.44it/s]
  6%|▌         | 20615/371472 [1:39:35<27:40:16,  3.52it/s]
  6%|▌         | 20616/371472 [1:39:35<27:10:33,  3.59it/s]
  6%|▌         | 20617/371472 [1:39:36<28:16:32,  3.45it/s]
  6%|▌         | 20618/371472 [1:39:36<28:04:07,  3.47it/s]
  6%|▌         | 20619/371472 [1:39:36<27:52:44,  3.50it/s]
  6%|▌         | 20620/371472 [1:39:37<29:24:46,  3.31it/s]
                                                           
{'loss': 4.5503, 'learning_rate': 9.50499903036049e-07, 'epoch': 0.89}

  6%|▌         | 20620/371472 [1:39:37<29:24:46,  3.31it/s]
  6%|▌         | 20621/371472 [1:39:37<29:26:21,  3.31it/s]
  6%|▌         | 20622/371472 [1:39:37<29:15:15,  3.33it/s]
  6%|▌         | 20623/371472 [1:39:37<30:45:16,  3.17it/s]
  6%|▌         | 20624/371472 [1:39:38<30:20:36,  3.21it/s]
  6%|▌         | 20625/371472 [1:39:38<28:46:43,  3.39it/s]
  6%|▌         | 20626/371472 [1:39:38<28:32:24,  3.41it/s]
  6%|▌         | 20627/371472 [1:39:39<27:39:48,  3.52it/s]
  6%|▌         | 20628/371472 [1:39:39<27:12:30,  3.58it/s]
  6%|▌         | 20629/371472 [1:39:39<27:43:14,  3.52it/s]
  6%|▌         | 20630/371472 [1:39:39<28:44:40,  3.39it/s]
  6%|▌         | 20631/371472 [1:39:40<28:31:39,  3.42it/s]
  6%|▌         | 20632/371472 [1:39:40<28:42:28,  3.39it/s]
  6%|▌         | 20633/371472 [1:39:40<28:33:56,  3.41it/s]
  6%|▌         | 20634/371472 [1:39:41<29:32:54,  3.30it/s]
  6%|▌         | 20635/371472 [1:39:41<30:35:20,  3.19it/s]
  6%|▌         | 20636/371472 [1:39:41<31:05:31,  3.13it/s]
  6%|▌         | 20637/371472 [1:39:42<29:37:05,  3.29it/s]
  6%|▌         | 20638/371472 [1:39:42<28:44:29,  3.39it/s]
  6%|▌         | 20639/371472 [1:39:42<35:35:20,  2.74it/s]
  6%|▌         | 20640/371472 [1:39:43<33:31:35,  2.91it/s]
                                                           
{'loss': 4.6196, 'learning_rate': 9.504514210605701e-07, 'epoch': 0.89}

  6%|▌         | 20640/371472 [1:39:43<33:31:35,  2.91it/s]
  6%|▌         | 20641/371472 [1:39:43<32:11:27,  3.03it/s]
  6%|▌         | 20642/371472 [1:39:43<30:56:50,  3.15it/s]
  6%|▌         | 20643/371472 [1:39:44<30:12:38,  3.23it/s]
  6%|▌         | 20644/371472 [1:39:44<29:44:21,  3.28it/s]
  6%|▌         | 20645/371472 [1:39:44<28:40:39,  3.40it/s]
  6%|▌         | 20646/371472 [1:39:44<27:41:55,  3.52it/s]
  6%|▌         | 20647/371472 [1:39:45<26:58:32,  3.61it/s]
  6%|▌         | 20648/371472 [1:39:45<27:33:52,  3.54it/s]
  6%|▌         | 20649/371472 [1:39:45<26:46:54,  3.64it/s]
  6%|▌         | 20650/371472 [1:39:46<27:42:33,  3.52it/s]
  6%|▌         | 20651/371472 [1:39:46<26:59:38,  3.61it/s]
  6%|▌         | 20652/371472 [1:39:46<26:29:08,  3.68it/s]
  6%|▌         | 20653/371472 [1:39:46<26:30:59,  3.68it/s]
  6%|▌         | 20654/371472 [1:39:47<26:58:39,  3.61it/s]
  6%|▌         | 20655/371472 [1:39:47<27:46:43,  3.51it/s]
  6%|▌         | 20656/371472 [1:39:47<29:12:21,  3.34it/s]
  6%|▌         | 20657/371472 [1:39:48<28:36:07,  3.41it/s]
  6%|▌         | 20658/371472 [1:39:48<30:35:45,  3.19it/s]
  6%|▌         | 20659/371472 [1:39:48<28:59:07,  3.36it/s]
  6%|▌         | 20660/371472 [1:39:48<28:18:50,  3.44it/s]
                                                           
{'loss': 4.657, 'learning_rate': 9.504029390850912e-07, 'epoch': 0.89}

  6%|▌         | 20660/371472 [1:39:48<28:18:50,  3.44it/s]
  6%|▌         | 20661/371472 [1:39:49<27:32:32,  3.54it/s]
  6%|▌         | 20662/371472 [1:39:49<26:45:54,  3.64it/s]
  6%|▌         | 20663/371472 [1:39:49<26:23:06,  3.69it/s]
  6%|▌         | 20664/371472 [1:39:49<26:36:57,  3.66it/s]
  6%|▌         | 20665/371472 [1:39:50<28:53:14,  3.37it/s]
  6%|▌         | 20666/371472 [1:39:50<27:53:56,  3.49it/s]
  6%|▌         | 20667/371472 [1:39:50<28:30:37,  3.42it/s]
  6%|▌         | 20668/371472 [1:39:51<28:26:34,  3.43it/s]
  6%|▌         | 20669/371472 [1:39:51<27:29:54,  3.54it/s]
  6%|▌         | 20670/371472 [1:39:51<27:34:41,  3.53it/s]
  6%|▌         | 20671/371472 [1:39:51<26:48:12,  3.64it/s]
  6%|▌         | 20672/371472 [1:39:52<26:12:02,  3.72it/s]
  6%|▌         | 20673/371472 [1:39:52<27:45:03,  3.51it/s]
  6%|▌         | 20674/371472 [1:39:52<26:34:47,  3.67it/s]
  6%|▌         | 20675/371472 [1:39:53<26:06:54,  3.73it/s]
  6%|▌         | 20676/371472 [1:39:53<26:30:14,  3.68it/s]
  6%|▌         | 20677/371472 [1:39:53<27:37:45,  3.53it/s]
  6%|▌         | 20678/371472 [1:39:53<27:23:40,  3.56it/s]
  6%|▌         | 20679/371472 [1:39:54<26:46:42,  3.64it/s]
  6%|▌         | 20680/371472 [1:39:54<26:19:07,  3.70it/s]
                                                           
{'loss': 4.7372, 'learning_rate': 9.503544571096123e-07, 'epoch': 0.89}

  6%|▌         | 20680/371472 [1:39:54<26:19:07,  3.70it/s]
  6%|▌         | 20681/371472 [1:39:54<27:52:37,  3.50it/s]
  6%|▌         | 20682/371472 [1:39:55<27:56:15,  3.49it/s]
  6%|▌         | 20683/371472 [1:39:55<27:23:32,  3.56it/s]
  6%|▌         | 20684/371472 [1:39:55<26:23:06,  3.69it/s]
  6%|▌         | 20685/371472 [1:39:55<26:42:17,  3.65it/s]
  6%|▌         | 20686/371472 [1:39:56<26:48:56,  3.63it/s]
  6%|▌         | 20687/371472 [1:39:56<27:49:30,  3.50it/s]
  6%|▌         | 20688/371472 [1:39:56<26:59:04,  3.61it/s]
  6%|▌         | 20689/371472 [1:39:56<26:19:52,  3.70it/s]
  6%|▌         | 20690/371472 [1:39:57<26:02:14,  3.74it/s]
  6%|▌         | 20691/371472 [1:39:57<26:36:07,  3.66it/s]
  6%|▌         | 20692/371472 [1:39:57<26:33:00,  3.67it/s]
  6%|▌         | 20693/371472 [1:39:58<25:54:52,  3.76it/s]
  6%|▌         | 20694/371472 [1:39:58<26:26:08,  3.69it/s]
  6%|▌         | 20695/371472 [1:39:58<25:59:39,  3.75it/s]
  6%|▌         | 20696/371472 [1:39:58<27:14:24,  3.58it/s]
  6%|▌         | 20697/371472 [1:39:59<26:09:53,  3.72it/s]
  6%|▌         | 20698/371472 [1:39:59<25:53:22,  3.76it/s]
  6%|▌         | 20699/371472 [1:39:59<27:14:41,  3.58it/s]
  6%|▌         | 20700/371472 [1:39:59<27:44:14,  3.51it/s]
                                                           
{'loss': 4.7459, 'learning_rate': 9.503059751341334e-07, 'epoch': 0.89}

  6%|▌         | 20700/371472 [1:39:59<27:44:14,  3.51it/s]
  6%|▌         | 20701/371472 [1:40:00<27:03:59,  3.60it/s]
  6%|▌         | 20702/371472 [1:40:00<26:55:35,  3.62it/s]
  6%|▌         | 20703/371472 [1:40:00<31:33:06,  3.09it/s]
  6%|▌         | 20704/371472 [1:40:01<31:23:02,  3.10it/s]
  6%|▌         | 20705/371472 [1:40:01<30:08:28,  3.23it/s]
  6%|▌         | 20706/371472 [1:40:01<30:52:58,  3.15it/s]
  6%|▌         | 20707/371472 [1:40:02<29:36:39,  3.29it/s]
  6%|▌         | 20708/371472 [1:40:02<28:28:39,  3.42it/s]
  6%|▌         | 20709/371472 [1:40:02<28:49:35,  3.38it/s]
  6%|▌         | 20710/371472 [1:40:03<30:39:04,  3.18it/s]
  6%|▌         | 20711/371472 [1:40:03<29:24:19,  3.31it/s]
  6%|▌         | 20712/371472 [1:40:03<29:27:45,  3.31it/s]
  6%|▌         | 20713/371472 [1:40:03<29:14:09,  3.33it/s]
  6%|▌         | 20714/371472 [1:40:04<27:56:27,  3.49it/s]
  6%|▌         | 20715/371472 [1:40:04<28:44:44,  3.39it/s]
  6%|▌         | 20716/371472 [1:40:04<28:20:19,  3.44it/s]
  6%|▌         | 20717/371472 [1:40:05<27:55:09,  3.49it/s]
  6%|▌         | 20718/371472 [1:40:05<26:48:11,  3.64it/s]
  6%|▌         | 20719/371472 [1:40:05<26:50:05,  3.63it/s]
  6%|▌         | 20720/371472 [1:40:05<26:16:06,  3.71it/s]
                                                           
{'loss': 4.275, 'learning_rate': 9.502574931586546e-07, 'epoch': 0.89}

  6%|▌         | 20720/371472 [1:40:05<26:16:06,  3.71it/s]
  6%|▌         | 20721/371472 [1:40:06<29:59:03,  3.25it/s]
  6%|▌         | 20722/371472 [1:40:06<29:35:44,  3.29it/s]
  6%|▌         | 20723/371472 [1:40:06<31:44:53,  3.07it/s]
  6%|▌         | 20724/371472 [1:40:07<29:33:44,  3.30it/s]
  6%|▌         | 20725/371472 [1:40:07<28:23:00,  3.43it/s]
  6%|▌         | 20726/371472 [1:40:07<28:15:26,  3.45it/s]
  6%|▌         | 20727/371472 [1:40:08<27:45:57,  3.51it/s]
  6%|▌         | 20728/371472 [1:40:08<27:02:57,  3.60it/s]
  6%|▌         | 20729/371472 [1:40:08<26:53:52,  3.62it/s]
  6%|▌         | 20730/371472 [1:40:08<26:13:12,  3.72it/s]
  6%|▌         | 20731/371472 [1:40:09<26:18:36,  3.70it/s]
  6%|▌         | 20732/371472 [1:40:09<26:10:21,  3.72it/s]
  6%|▌         | 20733/371472 [1:40:09<26:45:34,  3.64it/s]
  6%|▌         | 20734/371472 [1:40:09<28:10:02,  3.46it/s]
  6%|▌         | 20735/371472 [1:40:10<28:16:02,  3.45it/s]
  6%|▌         | 20736/371472 [1:40:10<27:28:31,  3.55it/s]
  6%|▌         | 20737/371472 [1:40:10<26:51:51,  3.63it/s]
  6%|▌         | 20738/371472 [1:40:11<26:39:56,  3.65it/s]
  6%|▌         | 20739/371472 [1:40:11<26:57:02,  3.61it/s]
  6%|▌         | 20740/371472 [1:40:11<28:03:51,  3.47it/s]
                                                           
{'loss': 4.4509, 'learning_rate': 9.502090111831756e-07, 'epoch': 0.89}

  6%|▌         | 20740/371472 [1:40:11<28:03:51,  3.47it/s]
  6%|▌         | 20741/371472 [1:40:11<27:17:38,  3.57it/s]
  6%|▌         | 20742/371472 [1:40:12<29:18:45,  3.32it/s]
  6%|▌         | 20743/371472 [1:40:12<28:59:54,  3.36it/s]
  6%|▌         | 20744/371472 [1:40:12<29:50:58,  3.26it/s]
  6%|▌         | 20745/371472 [1:40:13<31:33:00,  3.09it/s]
  6%|▌         | 20746/371472 [1:40:13<29:48:52,  3.27it/s]
  6%|▌         | 20747/371472 [1:40:13<29:45:57,  3.27it/s]
  6%|▌         | 20748/371472 [1:40:14<28:34:17,  3.41it/s]
  6%|▌         | 20749/371472 [1:40:14<29:40:07,  3.28it/s]
  6%|▌         | 20750/371472 [1:40:14<28:45:27,  3.39it/s]
  6%|▌         | 20751/371472 [1:40:14<27:26:56,  3.55it/s]
  6%|▌         | 20752/371472 [1:40:15<26:34:27,  3.67it/s]
  6%|▌         | 20753/371472 [1:40:15<27:10:22,  3.59it/s]
  6%|▌         | 20754/371472 [1:40:15<26:26:03,  3.69it/s]
  6%|▌         | 20755/371472 [1:40:15<26:40:08,  3.65it/s]
  6%|▌         | 20756/371472 [1:40:16<31:17:03,  3.11it/s]
  6%|▌         | 20757/371472 [1:40:16<29:41:33,  3.28it/s]
  6%|▌         | 20758/371472 [1:40:16<28:35:10,  3.41it/s]
  6%|▌         | 20759/371472 [1:40:17<27:30:46,  3.54it/s]
  6%|▌         | 20760/371472 [1:40:17<27:18:49,  3.57it/s]
                                                           
{'loss': 4.8113, 'learning_rate': 9.501605292076967e-07, 'epoch': 0.89}

  6%|▌         | 20760/371472 [1:40:17<27:18:49,  3.57it/s]
  6%|▌         | 20761/371472 [1:40:17<26:47:26,  3.64it/s]
  6%|▌         | 20762/371472 [1:40:18<28:17:31,  3.44it/s]
  6%|▌         | 20763/371472 [1:40:18<28:24:07,  3.43it/s]
  6%|▌         | 20764/371472 [1:40:18<28:31:57,  3.41it/s]
  6%|▌         | 20765/371472 [1:40:18<28:21:07,  3.44it/s]
  6%|▌         | 20766/371472 [1:40:19<29:56:17,  3.25it/s]
  6%|▌         | 20767/371472 [1:40:19<28:14:28,  3.45it/s]
  6%|▌         | 20768/371472 [1:40:19<28:01:24,  3.48it/s]
  6%|▌         | 20769/371472 [1:40:20<28:03:44,  3.47it/s]
  6%|▌         | 20770/371472 [1:40:20<28:46:48,  3.38it/s]
  6%|▌         | 20771/371472 [1:40:20<28:02:20,  3.47it/s]
  6%|▌         | 20772/371472 [1:40:20<27:44:21,  3.51it/s]
  6%|▌         | 20773/371472 [1:40:21<27:28:52,  3.54it/s]
  6%|▌         | 20774/371472 [1:40:21<27:06:38,  3.59it/s]
  6%|▌         | 20775/371472 [1:40:21<27:47:37,  3.50it/s]
  6%|▌         | 20776/371472 [1:40:22<30:41:58,  3.17it/s]
  6%|▌         | 20777/371472 [1:40:22<30:07:36,  3.23it/s]
  6%|▌         | 20778/371472 [1:40:22<29:42:54,  3.28it/s]
  6%|▌         | 20779/371472 [1:40:23<29:20:28,  3.32it/s]
  6%|▌         | 20780/371472 [1:40:23<30:25:27,  3.20it/s]
                                                           
{'loss': 4.5494, 'learning_rate': 9.501120472322178e-07, 'epoch': 0.9}

  6%|▌         | 20780/371472 [1:40:23<30:25:27,  3.20it/s]
  6%|▌         | 20781/371472 [1:40:23<30:30:34,  3.19it/s]
  6%|▌         | 20782/371472 [1:40:24<29:20:07,  3.32it/s]
  6%|▌         | 20783/371472 [1:40:24<28:52:05,  3.37it/s]
  6%|▌         | 20784/371472 [1:40:24<28:11:00,  3.46it/s]
  6%|▌         | 20785/371472 [1:40:24<29:05:59,  3.35it/s]
  6%|▌         | 20786/371472 [1:40:25<28:14:32,  3.45it/s]
  6%|▌         | 20787/371472 [1:40:25<27:21:34,  3.56it/s]
  6%|▌         | 20788/371472 [1:40:25<27:58:53,  3.48it/s]
  6%|▌         | 20789/371472 [1:40:26<29:11:19,  3.34it/s]
  6%|▌         | 20790/371472 [1:40:26<28:22:14,  3.43it/s]
  6%|▌         | 20791/371472 [1:40:26<30:15:06,  3.22it/s]
  6%|▌         | 20792/371472 [1:40:27<30:28:08,  3.20it/s]
  6%|▌         | 20793/371472 [1:40:27<29:39:48,  3.28it/s]
  6%|▌         | 20794/371472 [1:40:27<28:24:48,  3.43it/s]
  6%|▌         | 20795/371472 [1:40:27<27:30:33,  3.54it/s]
  6%|▌         | 20796/371472 [1:40:28<26:58:28,  3.61it/s]
  6%|▌         | 20797/371472 [1:40:28<27:46:45,  3.51it/s]
  6%|▌         | 20798/371472 [1:40:28<27:11:21,  3.58it/s]
  6%|▌         | 20799/371472 [1:40:29<29:44:10,  3.28it/s]
  6%|▌         | 20800/371472 [1:40:29<29:17:15,  3.33it/s]
                                                           
{'loss': 4.4905, 'learning_rate': 9.50063565256739e-07, 'epoch': 0.9}

  6%|▌         | 20800/371472 [1:40:29<29:17:15,  3.33it/s]
  6%|▌         | 20801/371472 [1:40:29<28:45:59,  3.39it/s]
  6%|▌         | 20802/371472 [1:40:29<28:38:55,  3.40it/s]
  6%|▌         | 20803/371472 [1:40:30<27:39:56,  3.52it/s]
  6%|▌         | 20804/371472 [1:40:30<29:09:44,  3.34it/s]
  6%|▌         | 20805/371472 [1:40:30<30:07:45,  3.23it/s]
  6%|▌         | 20806/371472 [1:40:31<29:56:40,  3.25it/s]
  6%|▌         | 20807/371472 [1:40:31<28:30:45,  3.42it/s]
  6%|▌         | 20808/371472 [1:40:31<28:08:38,  3.46it/s]
  6%|▌         | 20809/371472 [1:40:31<26:50:48,  3.63it/s]
  6%|▌         | 20810/371472 [1:40:32<26:35:40,  3.66it/s]
  6%|▌         | 20811/371472 [1:40:32<28:33:24,  3.41it/s]
  6%|▌         | 20812/371472 [1:40:32<27:21:30,  3.56it/s]
  6%|▌         | 20813/371472 [1:40:33<29:09:15,  3.34it/s]
  6%|▌         | 20814/371472 [1:40:33<27:41:14,  3.52it/s]
  6%|▌         | 20815/371472 [1:40:33<26:46:47,  3.64it/s]
  6%|▌         | 20816/371472 [1:40:33<27:30:39,  3.54it/s]
  6%|▌         | 20817/371472 [1:40:34<30:31:10,  3.19it/s]
  6%|▌         | 20818/371472 [1:40:34<31:30:33,  3.09it/s]
  6%|▌         | 20819/371472 [1:40:34<32:25:48,  3.00it/s]
  6%|▌         | 20820/371472 [1:40:35<32:00:14,  3.04it/s]
                                                           
{'loss': 4.5792, 'learning_rate': 9.5001508328126e-07, 'epoch': 0.9}

  6%|▌         | 20820/371472 [1:40:35<32:00:14,  3.04it/s]
  6%|▌         | 20821/371472 [1:40:35<31:16:37,  3.11it/s]
  6%|▌         | 20822/371472 [1:40:35<31:31:58,  3.09it/s]
  6%|▌         | 20823/371472 [1:40:36<33:07:24,  2.94it/s]
  6%|▌         | 20824/371472 [1:40:36<30:34:40,  3.19it/s]
  6%|▌         | 20825/371472 [1:40:36<30:48:08,  3.16it/s]
  6%|▌         | 20826/371472 [1:40:37<29:55:05,  3.26it/s]
  6%|▌         | 20827/371472 [1:40:37<30:05:28,  3.24it/s]
  6%|▌         | 20828/371472 [1:40:37<29:14:55,  3.33it/s]
  6%|▌         | 20829/371472 [1:40:38<28:36:04,  3.41it/s]
  6%|▌         | 20830/371472 [1:40:38<27:30:52,  3.54it/s]
  6%|▌         | 20831/371472 [1:40:38<30:49:32,  3.16it/s]
  6%|▌         | 20832/371472 [1:40:39<32:25:11,  3.00it/s]
  6%|▌         | 20833/371472 [1:40:39<31:27:58,  3.10it/s]
  6%|▌         | 20834/371472 [1:40:39<30:38:50,  3.18it/s]
  6%|▌         | 20835/371472 [1:40:39<30:26:37,  3.20it/s]
  6%|▌         | 20836/371472 [1:40:40<28:48:11,  3.38it/s]
  6%|▌         | 20837/371472 [1:40:40<28:11:44,  3.45it/s]
  6%|▌         | 20838/371472 [1:40:40<28:11:59,  3.45it/s]
  6%|▌         | 20839/371472 [1:40:41<27:19:32,  3.56it/s]
  6%|▌         | 20840/371472 [1:40:41<26:15:56,  3.71it/s]
                                                           
{'loss': 4.3705, 'learning_rate': 9.499666013057812e-07, 'epoch': 0.9}

  6%|▌         | 20840/371472 [1:40:41<26:15:56,  3.71it/s]
  6%|▌         | 20841/371472 [1:40:41<25:54:00,  3.76it/s]
  6%|▌         | 20842/371472 [1:40:41<26:22:25,  3.69it/s]
  6%|▌         | 20843/371472 [1:40:42<27:50:07,  3.50it/s]
  6%|▌         | 20844/371472 [1:40:42<27:33:34,  3.53it/s]
  6%|▌         | 20845/371472 [1:40:42<27:11:46,  3.58it/s]
  6%|▌         | 20846/371472 [1:40:42<26:49:26,  3.63it/s]
  6%|▌         | 20847/371472 [1:40:43<26:57:42,  3.61it/s]
  6%|▌         | 20848/371472 [1:40:43<26:24:24,  3.69it/s]
  6%|▌         | 20849/371472 [1:40:43<27:57:30,  3.48it/s]
  6%|▌         | 20850/371472 [1:40:44<28:30:51,  3.42it/s]
  6%|▌         | 20851/371472 [1:40:44<27:56:03,  3.49it/s]
  6%|▌         | 20852/371472 [1:40:44<27:12:36,  3.58it/s]
  6%|▌         | 20853/371472 [1:40:45<29:22:37,  3.32it/s]
  6%|▌         | 20854/371472 [1:40:45<28:42:42,  3.39it/s]
  6%|▌         | 20855/371472 [1:40:45<28:15:54,  3.45it/s]
  6%|▌         | 20856/371472 [1:40:45<28:44:53,  3.39it/s]
  6%|▌         | 20857/371472 [1:40:46<30:00:35,  3.25it/s]
  6%|▌         | 20858/371472 [1:40:46<29:48:33,  3.27it/s]
  6%|▌         | 20859/371472 [1:40:46<28:44:43,  3.39it/s]
  6%|▌         | 20860/371472 [1:40:47<29:53:45,  3.26it/s]
                                                           
{'loss': 4.5957, 'learning_rate': 9.499181193303023e-07, 'epoch': 0.9}

  6%|▌         | 20860/371472 [1:40:47<29:53:45,  3.26it/s]
  6%|▌         | 20861/371472 [1:40:47<29:35:40,  3.29it/s]
  6%|▌         | 20862/371472 [1:40:47<30:33:26,  3.19it/s]
  6%|▌         | 20863/371472 [1:40:48<29:58:33,  3.25it/s]
  6%|▌         | 20864/371472 [1:40:48<28:56:19,  3.37it/s]
  6%|▌         | 20865/371472 [1:40:48<30:20:50,  3.21it/s]
  6%|▌         | 20866/371472 [1:40:49<31:55:01,  3.05it/s]
  6%|▌         | 20867/371472 [1:40:49<30:12:21,  3.22it/s]
  6%|▌         | 20868/371472 [1:40:49<28:59:15,  3.36it/s]
  6%|▌         | 20869/371472 [1:40:49<28:02:36,  3.47it/s]
  6%|▌         | 20870/371472 [1:40:50<27:19:05,  3.56it/s]
  6%|▌         | 20871/371472 [1:40:50<29:02:52,  3.35it/s]
  6%|▌         | 20872/371472 [1:40:50<27:44:21,  3.51it/s]
  6%|▌         | 20873/371472 [1:40:50<27:43:42,  3.51it/s]
  6%|▌         | 20874/371472 [1:40:51<27:50:46,  3.50it/s]
  6%|▌         | 20875/371472 [1:40:51<26:40:15,  3.65it/s]
  6%|▌         | 20876/371472 [1:40:51<27:29:58,  3.54it/s]
  6%|▌         | 20877/371472 [1:40:52<27:49:52,  3.50it/s]
  6%|▌         | 20878/371472 [1:40:52<28:14:38,  3.45it/s]
  6%|▌         | 20879/371472 [1:40:52<27:46:31,  3.51it/s]
  6%|▌         | 20880/371472 [1:40:52<27:22:12,  3.56it/s]
                                                           
{'loss': 4.5509, 'learning_rate': 9.498696373548233e-07, 'epoch': 0.9}

  6%|▌         | 20880/371472 [1:40:52<27:22:12,  3.56it/s]
  6%|▌         | 20881/371472 [1:40:53<28:11:35,  3.45it/s]
  6%|▌         | 20882/371472 [1:40:53<27:27:23,  3.55it/s]
  6%|▌         | 20883/371472 [1:40:53<28:00:05,  3.48it/s]
  6%|▌         | 20884/371472 [1:40:54<29:51:04,  3.26it/s]
  6%|▌         | 20885/371472 [1:40:54<31:46:07,  3.07it/s]
  6%|▌         | 20886/371472 [1:40:54<30:08:23,  3.23it/s]
  6%|▌         | 20887/371472 [1:40:55<30:26:33,  3.20it/s]
  6%|▌         | 20888/371472 [1:40:55<28:52:48,  3.37it/s]
  6%|▌         | 20889/371472 [1:40:55<28:55:41,  3.37it/s]
  6%|▌         | 20890/371472 [1:40:56<29:16:09,  3.33it/s]
  6%|▌         | 20891/371472 [1:40:56<29:37:08,  3.29it/s]
  6%|▌         | 20892/371472 [1:40:56<28:47:14,  3.38it/s]
  6%|▌         | 20893/371472 [1:40:56<27:12:37,  3.58it/s]
  6%|▌         | 20894/371472 [1:40:57<27:16:37,  3.57it/s]
  6%|▌         | 20895/371472 [1:40:57<27:05:25,  3.59it/s]
  6%|▌         | 20896/371472 [1:40:57<27:27:44,  3.55it/s]
  6%|▌         | 20897/371472 [1:40:57<27:21:02,  3.56it/s]
  6%|▌         | 20898/371472 [1:40:58<26:31:08,  3.67it/s]
  6%|▌         | 20899/371472 [1:40:58<26:42:26,  3.65it/s]
  6%|▌         | 20900/371472 [1:40:58<27:30:01,  3.54it/s]
                                                           
{'loss': 4.6055, 'learning_rate': 9.498211553793444e-07, 'epoch': 0.9}

  6%|▌         | 20900/371472 [1:40:58<27:30:01,  3.54it/s]
  6%|▌         | 20901/371472 [1:40:59<26:41:02,  3.65it/s]
  6%|▌         | 20902/371472 [1:40:59<26:23:52,  3.69it/s]
  6%|▌         | 20903/371472 [1:40:59<26:02:54,  3.74it/s]
  6%|▌         | 20904/371472 [1:40:59<28:50:59,  3.38it/s]
  6%|▌         | 20905/371472 [1:41:00<28:44:34,  3.39it/s]
  6%|▌         | 20906/371472 [1:41:00<29:22:53,  3.31it/s]
  6%|▌         | 20907/371472 [1:41:00<29:02:48,  3.35it/s]
  6%|▌         | 20908/371472 [1:41:01<27:44:11,  3.51it/s]
  6%|▌         | 20909/371472 [1:41:01<27:49:00,  3.50it/s]
  6%|▌         | 20910/371472 [1:41:01<27:52:46,  3.49it/s]
  6%|▌         | 20911/371472 [1:41:01<26:42:36,  3.65it/s]
  6%|▌         | 20912/371472 [1:41:02<27:05:07,  3.60it/s]
  6%|▌         | 20913/371472 [1:41:02<26:59:44,  3.61it/s]
  6%|▌         | 20914/371472 [1:41:02<28:15:05,  3.45it/s]
  6%|▌         | 20915/371472 [1:41:03<29:00:17,  3.36it/s]
  6%|▌         | 20916/371472 [1:41:03<30:17:37,  3.21it/s]
  6%|▌         | 20917/371472 [1:41:03<30:35:54,  3.18it/s]
  6%|▌         | 20918/371472 [1:41:04<29:05:18,  3.35it/s]
  6%|▌         | 20919/371472 [1:41:04<27:56:49,  3.48it/s]
  6%|▌         | 20920/371472 [1:41:04<26:55:40,  3.62it/s]
                                                           
{'loss': 4.5213, 'learning_rate': 9.497726734038656e-07, 'epoch': 0.9}

  6%|▌         | 20920/371472 [1:41:04<26:55:40,  3.62it/s]
  6%|▌         | 20921/371472 [1:41:04<27:18:33,  3.57it/s]
  6%|▌         | 20922/371472 [1:41:05<26:59:23,  3.61it/s]
  6%|▌         | 20923/371472 [1:41:05<27:24:19,  3.55it/s]
  6%|▌         | 20924/371472 [1:41:05<27:28:10,  3.54it/s]
  6%|▌         | 20925/371472 [1:41:06<28:47:20,  3.38it/s]
  6%|▌         | 20926/371472 [1:41:06<28:19:50,  3.44it/s]
  6%|▌         | 20927/371472 [1:41:06<27:35:00,  3.53it/s]
  6%|▌         | 20928/371472 [1:41:06<27:24:14,  3.55it/s]
  6%|▌         | 20929/371472 [1:41:07<27:18:00,  3.57it/s]
  6%|▌         | 20930/371472 [1:41:07<26:47:07,  3.64it/s]
  6%|▌         | 20931/371472 [1:41:07<28:26:45,  3.42it/s]
  6%|▌         | 20932/371472 [1:41:07<27:56:29,  3.48it/s]
  6%|▌         | 20933/371472 [1:41:08<28:51:55,  3.37it/s]
  6%|▌         | 20934/371472 [1:41:08<28:16:42,  3.44it/s]
  6%|▌         | 20935/371472 [1:41:08<27:49:21,  3.50it/s]
  6%|▌         | 20936/371472 [1:41:09<27:11:00,  3.58it/s]
  6%|▌         | 20937/371472 [1:41:09<26:40:54,  3.65it/s]
  6%|▌         | 20938/371472 [1:41:09<27:41:54,  3.52it/s]
  6%|▌         | 20939/371472 [1:41:09<28:15:12,  3.45it/s]
  6%|▌         | 20940/371472 [1:41:10<27:16:01,  3.57it/s]
                                                           
{'loss': 4.5847, 'learning_rate': 9.497241914283867e-07, 'epoch': 0.9}

  6%|▌         | 20940/371472 [1:41:10<27:16:01,  3.57it/s]
  6%|▌         | 20941/371472 [1:41:10<28:09:39,  3.46it/s]
  6%|▌         | 20942/371472 [1:41:10<27:36:04,  3.53it/s]
  6%|▌         | 20943/371472 [1:41:11<27:28:30,  3.54it/s]
  6%|▌         | 20944/371472 [1:41:11<27:32:29,  3.54it/s]
  6%|▌         | 20945/371472 [1:41:11<27:28:32,  3.54it/s]
  6%|▌         | 20946/371472 [1:41:11<27:17:20,  3.57it/s]
  6%|▌         | 20947/371472 [1:41:12<28:16:37,  3.44it/s]
  6%|▌         | 20948/371472 [1:41:12<28:09:53,  3.46it/s]
  6%|▌         | 20949/371472 [1:41:12<27:17:31,  3.57it/s]
  6%|▌         | 20950/371472 [1:41:13<27:56:33,  3.48it/s]
  6%|▌         | 20951/371472 [1:41:13<30:06:54,  3.23it/s]
  6%|▌         | 20952/371472 [1:41:13<29:18:29,  3.32it/s]
  6%|▌         | 20953/371472 [1:41:14<30:01:28,  3.24it/s]
  6%|▌         | 20954/371472 [1:41:14<31:01:46,  3.14it/s]
  6%|▌         | 20955/371472 [1:41:14<30:54:50,  3.15it/s]
  6%|▌         | 20956/371472 [1:41:15<29:42:07,  3.28it/s]
  6%|▌         | 20957/371472 [1:41:15<31:22:52,  3.10it/s]
  6%|▌         | 20958/371472 [1:41:15<29:58:26,  3.25it/s]
  6%|▌         | 20959/371472 [1:41:15<30:13:38,  3.22it/s]
  6%|▌         | 20960/371472 [1:41:16<30:29:53,  3.19it/s]
                                                           
{'loss': 4.2846, 'learning_rate': 9.496757094529078e-07, 'epoch': 0.9}

  6%|▌         | 20960/371472 [1:41:16<30:29:53,  3.19it/s]
  6%|▌         | 20961/371472 [1:41:16<28:55:43,  3.37it/s]
  6%|▌         | 20962/371472 [1:41:16<28:47:25,  3.38it/s]
  6%|▌         | 20963/371472 [1:41:17<28:16:53,  3.44it/s]
  6%|▌         | 20964/371472 [1:41:17<28:32:15,  3.41it/s]
  6%|▌         | 20965/371472 [1:41:17<28:48:55,  3.38it/s]
  6%|▌         | 20966/371472 [1:41:17<27:39:08,  3.52it/s]
  6%|▌         | 20967/371472 [1:41:18<26:48:39,  3.63it/s]
  6%|▌         | 20968/371472 [1:41:18<26:40:17,  3.65it/s]
  6%|▌         | 20969/371472 [1:41:18<27:24:56,  3.55it/s]
  6%|▌         | 20970/371472 [1:41:19<26:59:01,  3.61it/s]
  6%|▌         | 20971/371472 [1:41:19<26:05:36,  3.73it/s]
  6%|▌         | 20972/371472 [1:41:19<25:44:49,  3.78it/s]
  6%|▌         | 20973/371472 [1:41:19<26:06:45,  3.73it/s]
  6%|▌         | 20974/371472 [1:41:20<26:23:54,  3.69it/s]
  6%|▌         | 20975/371472 [1:41:20<26:34:53,  3.66it/s]
  6%|▌         | 20976/371472 [1:41:20<27:38:35,  3.52it/s]
  6%|▌         | 20977/371472 [1:41:20<27:20:53,  3.56it/s]
  6%|▌         | 20978/371472 [1:41:21<27:58:58,  3.48it/s]
  6%|▌         | 20979/371472 [1:41:21<28:47:51,  3.38it/s]
  6%|▌         | 20980/371472 [1:41:21<27:35:25,  3.53it/s]
                                                           
{'loss': 4.6234, 'learning_rate': 9.496272274774289e-07, 'epoch': 0.9}

  6%|▌         | 20980/371472 [1:41:21<27:35:25,  3.53it/s]
  6%|▌         | 20981/371472 [1:41:22<27:27:17,  3.55it/s]
  6%|▌         | 20982/371472 [1:41:22<27:13:32,  3.58it/s]
  6%|▌         | 20983/371472 [1:41:22<26:54:03,  3.62it/s]
  6%|▌         | 20984/371472 [1:41:23<35:13:00,  2.76it/s]
  6%|▌         | 20985/371472 [1:41:23<32:00:17,  3.04it/s]
  6%|▌         | 20986/371472 [1:41:23<31:18:25,  3.11it/s]
  6%|▌         | 20987/371472 [1:41:24<29:51:16,  3.26it/s]
  6%|▌         | 20988/371472 [1:41:24<28:19:27,  3.44it/s]
  6%|▌         | 20989/371472 [1:41:24<27:37:20,  3.52it/s]
  6%|▌         | 20990/371472 [1:41:24<27:06:07,  3.59it/s]
  6%|▌         | 20991/371472 [1:41:25<27:20:58,  3.56it/s]
  6%|▌         | 20992/371472 [1:41:25<26:55:47,  3.62it/s]
  6%|▌         | 20993/371472 [1:41:25<28:02:13,  3.47it/s]
  6%|▌         | 20994/371472 [1:41:25<27:25:20,  3.55it/s]
  6%|▌         | 20995/371472 [1:41:26<27:43:44,  3.51it/s]
  6%|▌         | 20996/371472 [1:41:26<29:35:30,  3.29it/s]
  6%|▌         | 20997/371472 [1:41:26<28:29:30,  3.42it/s]
  6%|▌         | 20998/371472 [1:41:27<27:24:45,  3.55it/s]
  6%|▌         | 20999/371472 [1:41:27<28:25:56,  3.42it/s]
  6%|▌         | 21000/371472 [1:41:27<27:32:12,  3.54it/s]
                                                           
{'loss': 4.6808, 'learning_rate': 9.4957874550195e-07, 'epoch': 0.9}

  6%|▌         | 21000/371472 [1:41:27<27:32:12,  3.54it/s]
  6%|▌         | 21001/371472 [1:41:27<26:21:26,  3.69it/s]
  6%|▌         | 21002/371472 [1:41:28<26:59:21,  3.61it/s]
  6%|▌         | 21003/371472 [1:41:28<27:33:05,  3.53it/s]
  6%|▌         | 21004/371472 [1:41:28<27:26:47,  3.55it/s]
  6%|▌         | 21005/371472 [1:41:29<27:07:14,  3.59it/s]
  6%|▌         | 21006/371472 [1:41:29<27:13:21,  3.58it/s]
  6%|▌         | 21007/371472 [1:41:29<27:05:04,  3.59it/s]
  6%|▌         | 21008/371472 [1:41:29<26:25:18,  3.68it/s]
  6%|▌         | 21009/371472 [1:41:30<26:22:58,  3.69it/s]
  6%|▌         | 21010/371472 [1:41:30<26:24:03,  3.69it/s]
  6%|▌         | 21011/371472 [1:41:30<27:42:16,  3.51it/s]
  6%|▌         | 21012/371472 [1:41:31<27:11:06,  3.58it/s]
  6%|▌         | 21013/371472 [1:41:31<28:00:55,  3.47it/s]
  6%|▌         | 21014/371472 [1:41:31<27:07:59,  3.59it/s]
  6%|▌         | 21015/371472 [1:41:32<30:15:27,  3.22it/s]
  6%|▌         | 21016/371472 [1:41:32<30:42:26,  3.17it/s]
  6%|▌         | 21017/371472 [1:41:32<30:15:35,  3.22it/s]
  6%|▌         | 21018/371472 [1:41:32<30:16:07,  3.22it/s]
  6%|▌         | 21019/371472 [1:41:33<31:53:47,  3.05it/s]
  6%|▌         | 21020/371472 [1:41:33<30:37:58,  3.18it/s]
                                                           
{'loss': 4.3551, 'learning_rate': 9.495302635264711e-07, 'epoch': 0.91}

  6%|▌         | 21020/371472 [1:41:33<30:37:58,  3.18it/s]
  6%|▌         | 21021/371472 [1:41:33<29:54:31,  3.25it/s]
  6%|▌         | 21022/371472 [1:41:34<29:36:33,  3.29it/s]
  6%|▌         | 21023/371472 [1:41:34<28:55:08,  3.37it/s]
  6%|▌         | 21024/371472 [1:41:34<27:37:34,  3.52it/s]
  6%|▌         | 21025/371472 [1:41:34<27:18:29,  3.56it/s]
  6%|▌         | 21026/371472 [1:41:35<27:10:22,  3.58it/s]
  6%|▌         | 21027/371472 [1:41:35<26:58:17,  3.61it/s]
  6%|▌         | 21028/371472 [1:41:35<30:15:42,  3.22it/s]
  6%|▌         | 21029/371472 [1:41:36<29:35:03,  3.29it/s]
  6%|▌         | 21030/371472 [1:41:36<30:41:21,  3.17it/s]
  6%|▌         | 21031/371472 [1:41:36<29:11:47,  3.33it/s]
  6%|▌         | 21032/371472 [1:41:37<28:11:37,  3.45it/s]
  6%|▌         | 21033/371472 [1:41:37<27:54:26,  3.49it/s]
  6%|▌         | 21034/371472 [1:41:37<26:36:37,  3.66it/s]
  6%|▌         | 21035/371472 [1:41:37<26:11:26,  3.72it/s]
  6%|▌         | 21036/371472 [1:41:38<27:43:51,  3.51it/s]
  6%|▌         | 21037/371472 [1:41:38<29:28:36,  3.30it/s]
  6%|▌         | 21038/371472 [1:41:38<29:34:51,  3.29it/s]
  6%|▌         | 21039/371472 [1:41:39<28:50:50,  3.37it/s]
  6%|▌         | 21040/371472 [1:41:39<28:24:06,  3.43it/s]
                                                           
{'loss': 4.738, 'learning_rate': 9.494817815509922e-07, 'epoch': 0.91}

  6%|▌         | 21040/371472 [1:41:39<28:24:06,  3.43it/s]
  6%|▌         | 21041/371472 [1:41:39<28:21:00,  3.43it/s]
  6%|▌         | 21042/371472 [1:41:39<27:01:09,  3.60it/s]
  6%|▌         | 21043/371472 [1:41:40<28:00:32,  3.48it/s]
  6%|▌         | 21044/371472 [1:41:40<27:33:55,  3.53it/s]
  6%|▌         | 21045/371472 [1:41:40<26:27:42,  3.68it/s]
  6%|▌         | 21046/371472 [1:41:41<26:09:36,  3.72it/s]
  6%|▌         | 21047/371472 [1:41:41<25:53:34,  3.76it/s]
  6%|▌         | 21048/371472 [1:41:41<26:04:40,  3.73it/s]
  6%|▌         | 21049/371472 [1:41:41<27:33:52,  3.53it/s]
  6%|▌         | 21050/371472 [1:41:42<27:58:24,  3.48it/s]
  6%|▌         | 21051/371472 [1:41:42<28:30:22,  3.41it/s]
  6%|▌         | 21052/371472 [1:41:42<31:42:49,  3.07it/s]
  6%|▌         | 21053/371472 [1:41:43<30:13:34,  3.22it/s]
  6%|▌         | 21054/371472 [1:41:43<29:46:10,  3.27it/s]
  6%|▌         | 21055/371472 [1:41:43<28:44:11,  3.39it/s]
  6%|▌         | 21056/371472 [1:41:44<28:12:55,  3.45it/s]
  6%|▌         | 21057/371472 [1:41:44<28:24:09,  3.43it/s]
  6%|▌         | 21058/371472 [1:41:44<27:08:50,  3.59it/s]
  6%|▌         | 21059/371472 [1:41:44<26:43:20,  3.64it/s]
  6%|▌         | 21060/371472 [1:41:45<26:07:55,  3.72it/s]
                                                           
{'loss': 4.7525, 'learning_rate': 9.494332995755133e-07, 'epoch': 0.91}

  6%|▌         | 21060/371472 [1:41:45<26:07:55,  3.72it/s]
  6%|▌         | 21061/371472 [1:41:45<27:19:32,  3.56it/s]
  6%|▌         | 21062/371472 [1:41:45<26:31:55,  3.67it/s]
  6%|▌         | 21063/371472 [1:41:45<28:58:28,  3.36it/s]
  6%|▌         | 21064/371472 [1:41:46<30:01:23,  3.24it/s]
  6%|▌         | 21065/371472 [1:41:46<29:10:52,  3.34it/s]
  6%|▌         | 21066/371472 [1:41:46<29:59:46,  3.24it/s]
  6%|▌         | 21067/371472 [1:41:47<30:27:22,  3.20it/s]
  6%|▌         | 21068/371472 [1:41:47<28:30:42,  3.41it/s]
  6%|▌         | 21069/371472 [1:41:47<27:36:22,  3.53it/s]
  6%|▌         | 21070/371472 [1:41:48<27:29:49,  3.54it/s]
  6%|▌         | 21071/371472 [1:41:48<30:22:10,  3.20it/s]
  6%|▌         | 21072/371472 [1:41:48<31:06:30,  3.13it/s]
  6%|▌         | 21073/371472 [1:41:49<29:15:41,  3.33it/s]
  6%|▌         | 21074/371472 [1:41:49<28:52:03,  3.37it/s]
  6%|▌         | 21075/371472 [1:41:49<29:40:40,  3.28it/s]
  6%|▌         | 21076/371472 [1:41:49<30:47:34,  3.16it/s]
  6%|▌         | 21077/371472 [1:41:50<31:02:16,  3.14it/s]
  6%|▌         | 21078/371472 [1:41:50<30:24:55,  3.20it/s]
  6%|▌         | 21079/371472 [1:41:50<29:25:25,  3.31it/s]
  6%|▌         | 21080/371472 [1:41:51<29:20:01,  3.32it/s]
                                                           
{'loss': 4.4851, 'learning_rate': 9.493848176000345e-07, 'epoch': 0.91}

  6%|▌         | 21080/371472 [1:41:51<29:20:01,  3.32it/s]
  6%|▌         | 21081/371472 [1:41:51<27:33:38,  3.53it/s]
  6%|▌         | 21082/371472 [1:41:51<27:53:24,  3.49it/s]
  6%|▌         | 21083/371472 [1:41:51<27:11:17,  3.58it/s]
  6%|▌         | 21084/371472 [1:41:52<26:32:49,  3.67it/s]
  6%|▌         | 21085/371472 [1:41:52<26:42:18,  3.64it/s]
  6%|▌         | 21086/371472 [1:41:52<29:30:53,  3.30it/s]
  6%|▌         | 21087/371472 [1:41:53<29:27:28,  3.30it/s]
  6%|▌         | 21088/371472 [1:41:53<28:41:46,  3.39it/s]
  6%|▌         | 21089/371472 [1:41:53<28:21:54,  3.43it/s]
  6%|▌         | 21090/371472 [1:41:54<27:50:01,  3.50it/s]
  6%|▌         | 21091/371472 [1:41:54<28:03:22,  3.47it/s]
  6%|▌         | 21092/371472 [1:41:54<28:45:36,  3.38it/s]
  6%|▌         | 21093/371472 [1:41:54<27:14:04,  3.57it/s]
  6%|▌         | 21094/371472 [1:41:55<30:11:40,  3.22it/s]
  6%|▌         | 21095/371472 [1:41:55<29:57:01,  3.25it/s]
  6%|▌         | 21096/371472 [1:41:55<28:32:31,  3.41it/s]
  6%|▌         | 21097/371472 [1:41:56<27:47:37,  3.50it/s]
  6%|▌         | 21098/371472 [1:41:56<28:07:00,  3.46it/s]
  6%|▌         | 21099/371472 [1:41:56<26:59:35,  3.61it/s]
  6%|▌         | 21100/371472 [1:41:56<26:45:04,  3.64it/s]
                                                           
{'loss': 4.5402, 'learning_rate': 9.493363356245556e-07, 'epoch': 0.91}

  6%|▌         | 21100/371472 [1:41:56<26:45:04,  3.64it/s]
  6%|▌         | 21101/371472 [1:41:57<26:09:02,  3.72it/s]
  6%|▌         | 21102/371472 [1:41:57<28:32:11,  3.41it/s]
  6%|▌         | 21103/371472 [1:41:57<29:01:47,  3.35it/s]
  6%|▌         | 21104/371472 [1:41:58<28:50:49,  3.37it/s]
  6%|▌         | 21105/371472 [1:41:58<29:47:04,  3.27it/s]
  6%|▌         | 21106/371472 [1:41:58<29:04:41,  3.35it/s]
  6%|▌         | 21107/371472 [1:41:58<29:06:54,  3.34it/s]
  6%|▌         | 21108/371472 [1:41:59<29:17:35,  3.32it/s]
  6%|▌         | 21109/371472 [1:41:59<29:36:06,  3.29it/s]
  6%|▌         | 21110/371472 [1:41:59<28:11:44,  3.45it/s]
  6%|▌         | 21111/371472 [1:42:00<27:02:23,  3.60it/s]
  6%|▌         | 21112/371472 [1:42:00<26:14:03,  3.71it/s]
  6%|▌         | 21113/371472 [1:42:00<25:42:57,  3.78it/s]
  6%|▌         | 21114/371472 [1:42:00<25:36:29,  3.80it/s]
  6%|▌         | 21115/371472 [1:42:01<25:14:43,  3.85it/s]
  6%|▌         | 21116/371472 [1:42:01<25:12:24,  3.86it/s]
  6%|▌         | 21117/371472 [1:42:01<26:05:08,  3.73it/s]
  6%|▌         | 21118/371472 [1:42:01<26:59:40,  3.61it/s]
  6%|▌         | 21119/371472 [1:42:02<26:53:56,  3.62it/s]
  6%|▌         | 21120/371472 [1:42:02<26:18:05,  3.70it/s]
                                                           
{'loss': 4.5958, 'learning_rate': 9.492878536490767e-07, 'epoch': 0.91}

  6%|▌         | 21120/371472 [1:42:02<26:18:05,  3.70it/s]
  6%|▌         | 21121/371472 [1:42:02<25:41:29,  3.79it/s]
  6%|▌         | 21122/371472 [1:42:03<26:09:51,  3.72it/s]
  6%|▌         | 21123/371472 [1:42:03<27:07:24,  3.59it/s]
  6%|▌         | 21124/371472 [1:42:03<27:39:07,  3.52it/s]
  6%|▌         | 21125/371472 [1:42:03<27:48:34,  3.50it/s]
  6%|▌         | 21126/371472 [1:42:04<27:43:35,  3.51it/s]
  6%|▌         | 21127/371472 [1:42:04<27:25:56,  3.55it/s]
  6%|▌         | 21128/371472 [1:42:04<28:02:25,  3.47it/s]
  6%|▌         | 21129/371472 [1:42:05<30:31:40,  3.19it/s]
  6%|▌         | 21130/371472 [1:42:05<30:04:37,  3.24it/s]
  6%|▌         | 21131/371472 [1:42:05<28:38:55,  3.40it/s]
  6%|▌         | 21132/371472 [1:42:05<27:15:59,  3.57it/s]
  6%|▌         | 21133/371472 [1:42:06<27:13:31,  3.57it/s]
  6%|▌         | 21134/371472 [1:42:06<27:21:03,  3.56it/s]
  6%|▌         | 21135/371472 [1:42:06<27:35:47,  3.53it/s]
  6%|▌         | 21136/371472 [1:42:07<27:58:28,  3.48it/s]
  6%|▌         | 21137/371472 [1:42:07<27:50:10,  3.50it/s]
  6%|▌         | 21138/371472 [1:42:07<28:03:37,  3.47it/s]
  6%|▌         | 21139/371472 [1:42:07<27:04:10,  3.59it/s]
  6%|▌         | 21140/371472 [1:42:08<27:22:39,  3.55it/s]
                                                           
{'loss': 4.5298, 'learning_rate': 9.492393716735977e-07, 'epoch': 0.91}

  6%|▌         | 21140/371472 [1:42:08<27:22:39,  3.55it/s]
  6%|▌         | 21141/371472 [1:42:08<27:06:31,  3.59it/s]
  6%|▌         | 21142/371472 [1:42:08<27:02:13,  3.60it/s]
  6%|▌         | 21143/371472 [1:42:09<27:22:52,  3.55it/s]
  6%|▌         | 21144/371472 [1:42:09<28:08:58,  3.46it/s]
  6%|▌         | 21145/371472 [1:42:09<29:42:39,  3.28it/s]
  6%|▌         | 21146/371472 [1:42:09<28:30:24,  3.41it/s]
  6%|▌         | 21147/371472 [1:42:10<28:47:33,  3.38it/s]
  6%|▌         | 21148/371472 [1:42:10<27:56:21,  3.48it/s]
  6%|▌         | 21149/371472 [1:42:10<28:21:33,  3.43it/s]
  6%|▌         | 21150/371472 [1:42:11<28:03:52,  3.47it/s]
  6%|▌         | 21151/371472 [1:42:11<27:52:42,  3.49it/s]
  6%|▌         | 21152/371472 [1:42:11<27:24:23,  3.55it/s]
  6%|▌         | 21153/371472 [1:42:11<27:24:07,  3.55it/s]
  6%|▌         | 21154/371472 [1:42:12<27:04:16,  3.59it/s]
  6%|▌         | 21155/371472 [1:42:12<28:40:18,  3.39it/s]
  6%|▌         | 21156/371472 [1:42:12<28:26:21,  3.42it/s]
  6%|▌         | 21157/371472 [1:42:13<30:01:07,  3.24it/s]
  6%|▌         | 21158/371472 [1:42:13<30:06:27,  3.23it/s]
  6%|▌         | 21159/371472 [1:42:13<29:41:54,  3.28it/s]
  6%|▌         | 21160/371472 [1:42:14<27:55:40,  3.48it/s]
                                                           
{'loss': 4.3762, 'learning_rate': 9.491908896981189e-07, 'epoch': 0.91}

  6%|▌         | 21160/371472 [1:42:14<27:55:40,  3.48it/s]
  6%|▌         | 21161/371472 [1:42:14<27:41:34,  3.51it/s]
  6%|▌         | 21162/371472 [1:42:14<27:19:42,  3.56it/s]
  6%|▌         | 21163/371472 [1:42:14<27:51:18,  3.49it/s]
  6%|▌         | 21164/371472 [1:42:15<28:12:07,  3.45it/s]
  6%|▌         | 21165/371472 [1:42:15<27:16:57,  3.57it/s]
  6%|▌         | 21166/371472 [1:42:15<29:07:59,  3.34it/s]
  6%|▌         | 21167/371472 [1:42:16<29:55:36,  3.25it/s]
  6%|▌         | 21168/371472 [1:42:16<29:08:14,  3.34it/s]
  6%|▌         | 21169/371472 [1:42:16<28:14:00,  3.45it/s]
  6%|▌         | 21170/371472 [1:42:16<27:23:49,  3.55it/s]
  6%|▌         | 21171/371472 [1:42:17<27:45:31,  3.51it/s]
  6%|▌         | 21172/371472 [1:42:17<26:56:36,  3.61it/s]
  6%|▌         | 21173/371472 [1:42:17<28:07:39,  3.46it/s]
  6%|▌         | 21174/371472 [1:42:18<28:56:43,  3.36it/s]
  6%|▌         | 21175/371472 [1:42:18<28:58:28,  3.36it/s]
  6%|▌         | 21176/371472 [1:42:18<28:39:44,  3.39it/s]
  6%|▌         | 21177/371472 [1:42:19<29:27:21,  3.30it/s]
  6%|▌         | 21178/371472 [1:42:19<29:20:53,  3.32it/s]
  6%|▌         | 21179/371472 [1:42:19<28:02:17,  3.47it/s]
  6%|▌         | 21180/371472 [1:42:19<27:03:59,  3.59it/s]
                                                           
{'loss': 4.5817, 'learning_rate': 9.4914240772264e-07, 'epoch': 0.91}

  6%|▌         | 21180/371472 [1:42:19<27:03:59,  3.59it/s]
  6%|▌         | 21181/371472 [1:42:20<26:13:27,  3.71it/s]
  6%|▌         | 21182/371472 [1:42:20<26:55:23,  3.61it/s]
  6%|▌         | 21183/371472 [1:42:20<26:13:05,  3.71it/s]
  6%|▌         | 21184/371472 [1:42:20<26:03:47,  3.73it/s]
  6%|▌         | 21185/371472 [1:42:21<25:50:45,  3.76it/s]
  6%|▌         | 21186/371472 [1:42:21<26:26:51,  3.68it/s]
  6%|▌         | 21187/371472 [1:42:21<27:26:28,  3.55it/s]
  6%|▌         | 21188/371472 [1:42:22<27:05:08,  3.59it/s]
  6%|▌         | 21189/371472 [1:42:22<26:51:15,  3.62it/s]
  6%|▌         | 21190/371472 [1:42:22<30:19:45,  3.21it/s]
  6%|▌         | 21191/371472 [1:42:23<32:30:14,  2.99it/s]
  6%|▌         | 21192/371472 [1:42:23<31:27:00,  3.09it/s]
  6%|▌         | 21193/371472 [1:42:23<29:49:20,  3.26it/s]
  6%|▌         | 21194/371472 [1:42:23<29:15:22,  3.33it/s]
  6%|▌         | 21195/371472 [1:42:24<28:47:25,  3.38it/s]
  6%|▌         | 21196/371472 [1:42:24<27:29:55,  3.54it/s]
  6%|▌         | 21197/371472 [1:42:24<27:32:32,  3.53it/s]
  6%|▌         | 21198/371472 [1:42:25<26:38:18,  3.65it/s]
  6%|▌         | 21199/371472 [1:42:25<27:47:00,  3.50it/s]
  6%|▌         | 21200/371472 [1:42:25<28:45:06,  3.38it/s]
                                                           
{'loss': 4.6998, 'learning_rate': 9.49093925747161e-07, 'epoch': 0.91}

  6%|▌         | 21200/371472 [1:42:25<28:45:06,  3.38it/s]
  6%|▌         | 21201/371472 [1:42:25<27:58:02,  3.48it/s]
  6%|▌         | 21202/371472 [1:42:26<28:01:14,  3.47it/s]
  6%|▌         | 21203/371472 [1:42:26<28:46:54,  3.38it/s]
  6%|▌         | 21204/371472 [1:42:26<27:39:42,  3.52it/s]
  6%|▌         | 21205/371472 [1:42:27<26:42:57,  3.64it/s]
  6%|▌         | 21206/371472 [1:42:27<26:37:59,  3.65it/s]
  6%|▌         | 21207/371472 [1:42:27<26:33:49,  3.66it/s]
  6%|▌         | 21208/371472 [1:42:27<28:14:00,  3.45it/s]
  6%|▌         | 21209/371472 [1:42:28<27:55:27,  3.48it/s]
  6%|▌         | 21210/371472 [1:42:28<27:07:52,  3.59it/s]
  6%|▌         | 21211/371472 [1:42:28<26:31:39,  3.67it/s]
  6%|▌         | 21212/371472 [1:42:28<26:00:40,  3.74it/s]
  6%|▌         | 21213/371472 [1:42:29<26:51:27,  3.62it/s]
  6%|▌         | 21214/371472 [1:42:29<26:23:59,  3.69it/s]
  6%|▌         | 21215/371472 [1:42:29<27:18:48,  3.56it/s]
  6%|▌         | 21216/371472 [1:42:30<26:37:24,  3.65it/s]
  6%|▌         | 21217/371472 [1:42:30<28:39:01,  3.40it/s]
  6%|▌         | 21218/371472 [1:42:30<29:56:04,  3.25it/s]
  6%|▌         | 21219/371472 [1:42:31<29:48:25,  3.26it/s]
  6%|▌         | 21220/371472 [1:42:31<28:17:17,  3.44it/s]
                                                           
{'loss': 4.6316, 'learning_rate': 9.490454437716822e-07, 'epoch': 0.91}

  6%|▌         | 21220/371472 [1:42:31<28:17:17,  3.44it/s]
  6%|▌         | 21221/371472 [1:42:31<29:14:32,  3.33it/s]
  6%|▌         | 21222/371472 [1:42:31<28:48:59,  3.38it/s]
  6%|▌         | 21223/371472 [1:42:32<28:01:36,  3.47it/s]
  6%|▌         | 21224/371472 [1:42:32<29:28:00,  3.30it/s]
  6%|▌         | 21225/371472 [1:42:32<28:40:04,  3.39it/s]
  6%|▌         | 21226/371472 [1:42:33<28:23:47,  3.43it/s]
  6%|▌         | 21227/371472 [1:42:33<28:34:49,  3.40it/s]
  6%|▌         | 21228/371472 [1:42:33<28:08:27,  3.46it/s]
  6%|▌         | 21229/371472 [1:42:33<28:13:31,  3.45it/s]
  6%|▌         | 21230/371472 [1:42:34<28:10:09,  3.45it/s]
  6%|▌         | 21231/371472 [1:42:34<27:32:17,  3.53it/s]
  6%|▌         | 21232/371472 [1:42:34<27:01:09,  3.60it/s]
  6%|▌         | 21233/371472 [1:42:35<29:52:07,  3.26it/s]
  6%|▌         | 21234/371472 [1:42:35<28:41:03,  3.39it/s]
  6%|▌         | 21235/371472 [1:42:35<32:03:03,  3.04it/s]
  6%|▌         | 21236/371472 [1:42:36<30:40:06,  3.17it/s]
  6%|▌         | 21237/371472 [1:42:36<28:52:07,  3.37it/s]
  6%|▌         | 21238/371472 [1:42:36<27:49:59,  3.50it/s]
  6%|▌         | 21239/371472 [1:42:36<27:29:13,  3.54it/s]
  6%|▌         | 21240/371472 [1:42:37<26:59:29,  3.60it/s]
                                                           
{'loss': 4.5339, 'learning_rate': 9.489969617962033e-07, 'epoch': 0.91}

  6%|▌         | 21240/371472 [1:42:37<26:59:29,  3.60it/s]
  6%|▌         | 21241/371472 [1:42:37<26:36:47,  3.66it/s]
  6%|▌         | 21242/371472 [1:42:37<26:03:54,  3.73it/s]
  6%|▌         | 21243/371472 [1:42:37<26:34:40,  3.66it/s]
  6%|▌         | 21244/371472 [1:42:38<27:44:49,  3.51it/s]
  6%|▌         | 21245/371472 [1:42:38<27:25:49,  3.55it/s]
  6%|▌         | 21246/371472 [1:42:38<27:21:52,  3.56it/s]
  6%|▌         | 21247/371472 [1:42:39<26:41:35,  3.64it/s]
  6%|▌         | 21248/371472 [1:42:39<28:35:00,  3.40it/s]
  6%|▌         | 21249/371472 [1:42:39<27:29:26,  3.54it/s]
  6%|▌         | 21250/371472 [1:42:39<27:22:26,  3.55it/s]
  6%|▌         | 21251/371472 [1:42:40<28:22:38,  3.43it/s]
  6%|▌         | 21252/371472 [1:42:40<29:10:27,  3.33it/s]
  6%|▌         | 21253/371472 [1:42:40<29:45:39,  3.27it/s]
  6%|▌         | 21254/371472 [1:42:41<28:54:56,  3.36it/s]
  6%|▌         | 21255/371472 [1:42:41<28:31:57,  3.41it/s]
  6%|▌         | 21256/371472 [1:42:41<27:55:29,  3.48it/s]
  6%|▌         | 21257/371472 [1:42:42<26:58:50,  3.61it/s]
  6%|▌         | 21258/371472 [1:42:42<27:06:49,  3.59it/s]
  6%|▌         | 21259/371472 [1:42:42<26:50:12,  3.62it/s]
  6%|▌         | 21260/371472 [1:42:42<26:34:27,  3.66it/s]
                                                           
{'loss': 4.5119, 'learning_rate': 9.489484798207243e-07, 'epoch': 0.92}

  6%|▌         | 21260/371472 [1:42:42<26:34:27,  3.66it/s]
  6%|▌         | 21261/371472 [1:42:43<26:08:36,  3.72it/s]
  6%|▌         | 21262/371472 [1:42:43<25:59:32,  3.74it/s]
  6%|▌         | 21263/371472 [1:42:43<26:36:38,  3.66it/s]
  6%|▌         | 21264/371472 [1:42:43<28:17:54,  3.44it/s]
  6%|▌         | 21265/371472 [1:42:44<27:02:58,  3.60it/s]
  6%|▌         | 21266/371472 [1:42:44<27:49:49,  3.50it/s]
  6%|▌         | 21267/371472 [1:42:44<29:28:49,  3.30it/s]
  6%|▌         | 21268/371472 [1:42:45<29:19:05,  3.32it/s]
  6%|▌         | 21269/371472 [1:42:45<28:58:47,  3.36it/s]
  6%|▌         | 21270/371472 [1:42:45<28:13:49,  3.45it/s]
  6%|▌         | 21271/371472 [1:42:45<27:20:21,  3.56it/s]
  6%|▌         | 21272/371472 [1:42:46<31:50:11,  3.06it/s]
  6%|▌         | 21273/371472 [1:42:46<30:16:58,  3.21it/s]
  6%|▌         | 21274/371472 [1:42:46<29:13:11,  3.33it/s]
  6%|▌         | 21275/371472 [1:42:47<29:15:13,  3.33it/s]
  6%|▌         | 21276/371472 [1:42:47<27:52:11,  3.49it/s]
  6%|▌         | 21277/371472 [1:42:47<27:09:41,  3.58it/s]
  6%|▌         | 21278/371472 [1:42:48<27:04:18,  3.59it/s]
  6%|▌         | 21279/371472 [1:42:48<26:57:55,  3.61it/s]
  6%|▌         | 21280/371472 [1:42:48<27:10:48,  3.58it/s]
                                                           
{'loss': 4.674, 'learning_rate': 9.488999978452454e-07, 'epoch': 0.92}

  6%|▌         | 21280/371472 [1:42:48<27:10:48,  3.58it/s]
  6%|▌         | 21281/371472 [1:42:48<27:09:39,  3.58it/s]
  6%|▌         | 21282/371472 [1:42:49<26:41:08,  3.65it/s]
  6%|▌         | 21283/371472 [1:42:49<29:01:08,  3.35it/s]
  6%|▌         | 21284/371472 [1:42:49<31:11:53,  3.12it/s]
  6%|▌         | 21285/371472 [1:42:50<29:56:00,  3.25it/s]
  6%|▌         | 21286/371472 [1:42:50<29:08:39,  3.34it/s]
  6%|▌         | 21287/371472 [1:42:50<28:38:22,  3.40it/s]
  6%|▌         | 21288/371472 [1:42:50<27:41:04,  3.51it/s]
  6%|▌         | 21289/371472 [1:42:51<27:32:25,  3.53it/s]
  6%|▌         | 21290/371472 [1:42:51<27:57:39,  3.48it/s]
  6%|▌         | 21291/371472 [1:42:51<26:45:36,  3.63it/s]
  6%|▌         | 21292/371472 [1:42:52<26:18:11,  3.70it/s]
  6%|▌         | 21293/371472 [1:42:52<26:41:50,  3.64it/s]
  6%|▌         | 21294/371472 [1:42:52<26:25:24,  3.68it/s]
  6%|▌         | 21295/371472 [1:42:52<25:31:27,  3.81it/s]
  6%|▌         | 21296/371472 [1:42:53<30:28:01,  3.19it/s]
  6%|▌         | 21297/371472 [1:42:53<31:39:41,  3.07it/s]
  6%|▌         | 21298/371472 [1:42:53<31:00:59,  3.14it/s]
  6%|▌         | 21299/371472 [1:42:54<30:36:54,  3.18it/s]
  6%|▌         | 21300/371472 [1:42:54<28:46:26,  3.38it/s]
                                                           
{'loss': 4.5183, 'learning_rate': 9.488515158697666e-07, 'epoch': 0.92}

  6%|▌         | 21300/371472 [1:42:54<28:46:26,  3.38it/s]
  6%|▌         | 21301/371472 [1:42:54<29:38:26,  3.28it/s]
  6%|▌         | 21302/371472 [1:42:55<28:38:16,  3.40it/s]
  6%|▌         | 21303/371472 [1:42:55<28:58:52,  3.36it/s]
  6%|▌         | 21304/371472 [1:42:55<28:17:53,  3.44it/s]
  6%|▌         | 21305/371472 [1:42:55<28:21:33,  3.43it/s]
  6%|▌         | 21306/371472 [1:42:56<28:16:01,  3.44it/s]
  6%|▌         | 21307/371472 [1:42:56<26:51:54,  3.62it/s]
  6%|▌         | 21308/371472 [1:42:56<26:18:53,  3.70it/s]
  6%|▌         | 21309/371472 [1:42:57<27:20:17,  3.56it/s]
  6%|▌         | 21310/371472 [1:42:57<26:19:55,  3.69it/s]
  6%|▌         | 21311/371472 [1:42:57<26:27:53,  3.68it/s]
  6%|▌         | 21312/371472 [1:42:57<26:08:16,  3.72it/s]
  6%|▌         | 21313/371472 [1:42:58<26:42:20,  3.64it/s]
  6%|▌         | 21314/371472 [1:42:58<27:13:55,  3.57it/s]
  6%|▌         | 21315/371472 [1:42:58<26:23:50,  3.68it/s]
  6%|▌         | 21316/371472 [1:42:58<27:20:54,  3.56it/s]
  6%|▌         | 21317/371472 [1:42:59<27:05:11,  3.59it/s]
  6%|▌         | 21318/371472 [1:42:59<27:48:06,  3.50it/s]
  6%|▌         | 21319/371472 [1:42:59<27:12:48,  3.57it/s]
  6%|▌         | 21320/371472 [1:43:00<27:12:35,  3.57it/s]
                                                           
{'loss': 4.7068, 'learning_rate': 9.488030338942877e-07, 'epoch': 0.92}

  6%|▌         | 21320/371472 [1:43:00<27:12:35,  3.57it/s]
  6%|▌         | 21321/371472 [1:43:00<27:29:15,  3.54it/s]
  6%|▌         | 21322/371472 [1:43:00<26:57:57,  3.61it/s]
  6%|▌         | 21323/371472 [1:43:00<26:19:11,  3.70it/s]
  6%|▌         | 21324/371472 [1:43:01<26:23:31,  3.69it/s]
  6%|▌         | 21325/371472 [1:43:01<27:42:41,  3.51it/s]
  6%|▌         | 21326/371472 [1:43:01<27:49:10,  3.50it/s]
  6%|▌         | 21327/371472 [1:43:02<29:41:51,  3.28it/s]
  6%|▌         | 21328/371472 [1:43:02<28:48:34,  3.38it/s]
  6%|▌         | 21329/371472 [1:43:02<28:41:07,  3.39it/s]
  6%|▌         | 21330/371472 [1:43:03<30:14:23,  3.22it/s]
  6%|▌         | 21331/371472 [1:43:03<28:46:06,  3.38it/s]
  6%|▌         | 21332/371472 [1:43:03<27:22:41,  3.55it/s]
  6%|▌         | 21333/371472 [1:43:03<27:26:46,  3.54it/s]
  6%|▌         | 21334/371472 [1:43:04<27:03:16,  3.59it/s]
  6%|▌         | 21335/371472 [1:43:04<27:12:21,  3.57it/s]
  6%|▌         | 21336/371472 [1:43:04<27:19:45,  3.56it/s]
  6%|▌         | 21337/371472 [1:43:04<27:34:58,  3.53it/s]
  6%|▌         | 21338/371472 [1:43:05<27:55:43,  3.48it/s]
  6%|▌         | 21339/371472 [1:43:05<30:38:35,  3.17it/s]
  6%|▌         | 21340/371472 [1:43:05<30:46:17,  3.16it/s]
                                                           
{'loss': 4.4489, 'learning_rate': 9.487545519188088e-07, 'epoch': 0.92}

  6%|▌         | 21340/371472 [1:43:05<30:46:17,  3.16it/s]
  6%|▌         | 21341/371472 [1:43:06<29:29:41,  3.30it/s]
  6%|▌         | 21342/371472 [1:43:06<28:51:39,  3.37it/s]
  6%|▌         | 21343/371472 [1:43:06<28:40:12,  3.39it/s]
  6%|▌         | 21344/371472 [1:43:07<27:31:16,  3.53it/s]
  6%|▌         | 21345/371472 [1:43:07<27:57:21,  3.48it/s]
  6%|▌         | 21346/371472 [1:43:07<27:39:24,  3.52it/s]
  6%|▌         | 21347/371472 [1:43:07<27:57:26,  3.48it/s]
  6%|▌         | 21348/371472 [1:43:08<27:02:52,  3.60it/s]
  6%|▌         | 21349/371472 [1:43:08<26:50:16,  3.62it/s]
  6%|▌         | 21350/371472 [1:43:08<26:01:42,  3.74it/s]
  6%|▌         | 21351/371472 [1:43:08<25:15:27,  3.85it/s]
  6%|▌         | 21352/371472 [1:43:09<24:56:44,  3.90it/s]
  6%|▌         | 21353/371472 [1:43:09<25:11:09,  3.86it/s]
  6%|▌         | 21354/371472 [1:43:09<25:29:01,  3.82it/s]
  6%|▌         | 21355/371472 [1:43:10<25:51:20,  3.76it/s]
  6%|▌         | 21356/371472 [1:43:10<27:20:59,  3.56it/s]
  6%|▌         | 21357/371472 [1:43:10<26:56:14,  3.61it/s]
  6%|▌         | 21358/371472 [1:43:10<27:38:54,  3.52it/s]
  6%|▌         | 21359/371472 [1:43:11<27:28:22,  3.54it/s]
  6%|▌         | 21360/371472 [1:43:11<28:05:27,  3.46it/s]
                                                           
{'loss': 4.7522, 'learning_rate': 9.487060699433299e-07, 'epoch': 0.92}

  6%|▌         | 21360/371472 [1:43:11<28:05:27,  3.46it/s]
  6%|▌         | 21361/371472 [1:43:11<27:09:47,  3.58it/s]
  6%|▌         | 21362/371472 [1:43:12<29:25:37,  3.30it/s]
  6%|▌         | 21363/371472 [1:43:12<29:39:20,  3.28it/s]
  6%|▌         | 21364/371472 [1:43:12<28:44:05,  3.38it/s]
  6%|▌         | 21365/371472 [1:43:12<27:39:17,  3.52it/s]
  6%|▌         | 21366/371472 [1:43:13<27:20:35,  3.56it/s]
  6%|▌         | 21367/371472 [1:43:13<27:26:07,  3.54it/s]
  6%|▌         | 21368/371472 [1:43:13<27:23:50,  3.55it/s]
  6%|▌         | 21369/371472 [1:43:14<28:29:03,  3.41it/s]
  6%|▌         | 21370/371472 [1:43:14<30:31:17,  3.19it/s]
  6%|▌         | 21371/371472 [1:43:14<29:50:09,  3.26it/s]
  6%|▌         | 21372/371472 [1:43:15<28:24:51,  3.42it/s]
  6%|▌         | 21373/371472 [1:43:15<28:26:57,  3.42it/s]
  6%|▌         | 21374/371472 [1:43:15<28:14:58,  3.44it/s]
  6%|▌         | 21375/371472 [1:43:15<28:38:45,  3.39it/s]
  6%|▌         | 21376/371472 [1:43:16<30:39:50,  3.17it/s]
  6%|▌         | 21377/371472 [1:43:16<29:39:46,  3.28it/s]
  6%|▌         | 21378/371472 [1:43:16<29:25:38,  3.30it/s]
  6%|▌         | 21379/371472 [1:43:17<29:08:44,  3.34it/s]
  6%|▌         | 21380/371472 [1:43:17<28:05:15,  3.46it/s]
                                                           
{'loss': 4.4866, 'learning_rate': 9.486575879678511e-07, 'epoch': 0.92}

  6%|▌         | 21380/371472 [1:43:17<28:05:15,  3.46it/s]
  6%|▌         | 21381/371472 [1:43:17<27:18:57,  3.56it/s]
  6%|▌         | 21382/371472 [1:43:17<27:41:44,  3.51it/s]
  6%|▌         | 21383/371472 [1:43:18<27:06:00,  3.59it/s]
  6%|▌         | 21384/371472 [1:43:18<26:28:08,  3.67it/s]
  6%|▌         | 21385/371472 [1:43:18<26:07:52,  3.72it/s]
  6%|▌         | 21386/371472 [1:43:19<26:22:56,  3.69it/s]
  6%|▌         | 21387/371472 [1:43:19<26:39:20,  3.65it/s]
  6%|▌         | 21388/371472 [1:43:19<28:02:13,  3.47it/s]
  6%|▌         | 21389/371472 [1:43:20<31:01:25,  3.13it/s]
  6%|▌         | 21390/371472 [1:43:20<30:59:54,  3.14it/s]
  6%|▌         | 21391/371472 [1:43:20<29:37:28,  3.28it/s]
  6%|▌         | 21392/371472 [1:43:21<33:01:00,  2.95it/s]
  6%|▌         | 21393/371472 [1:43:21<31:44:11,  3.06it/s]
  6%|▌         | 21394/371472 [1:43:21<29:44:35,  3.27it/s]
  6%|▌         | 21395/371472 [1:43:21<29:40:21,  3.28it/s]
  6%|▌         | 21396/371472 [1:43:22<28:35:00,  3.40it/s]
  6%|▌         | 21397/371472 [1:43:22<27:41:33,  3.51it/s]
  6%|▌         | 21398/371472 [1:43:22<27:48:30,  3.50it/s]
  6%|▌         | 21399/371472 [1:43:23<28:56:22,  3.36it/s]
  6%|▌         | 21400/371472 [1:43:23<28:03:57,  3.46it/s]
                                                           
{'loss': 4.4634, 'learning_rate': 9.486091059923721e-07, 'epoch': 0.92}

  6%|▌         | 21400/371472 [1:43:23<28:03:57,  3.46it/s]
  6%|▌         | 21401/371472 [1:43:23<27:59:39,  3.47it/s]
  6%|▌         | 21402/371472 [1:43:23<27:09:34,  3.58it/s]
  6%|▌         | 21403/371472 [1:43:24<28:00:40,  3.47it/s]
  6%|▌         | 21404/371472 [1:43:24<27:29:19,  3.54it/s]
  6%|▌         | 21405/371472 [1:43:24<26:29:54,  3.67it/s]
  6%|▌         | 21406/371472 [1:43:24<26:20:58,  3.69it/s]
  6%|▌         | 21407/371472 [1:43:25<26:17:49,  3.70it/s]
  6%|▌         | 21408/371472 [1:43:25<26:51:04,  3.62it/s]
  6%|▌         | 21409/371472 [1:43:25<26:41:21,  3.64it/s]
  6%|▌         | 21410/371472 [1:43:26<27:08:48,  3.58it/s]
  6%|▌         | 21411/371472 [1:43:26<27:16:52,  3.56it/s]
  6%|▌         | 21412/371472 [1:43:26<27:01:44,  3.60it/s]
  6%|▌         | 21413/371472 [1:43:26<27:45:04,  3.50it/s]
  6%|▌         | 21414/371472 [1:43:27<27:27:20,  3.54it/s]
  6%|▌         | 21415/371472 [1:43:27<26:55:10,  3.61it/s]
  6%|▌         | 21416/371472 [1:43:27<29:02:32,  3.35it/s]
  6%|▌         | 21417/371472 [1:43:28<28:53:40,  3.37it/s]
  6%|▌         | 21418/371472 [1:43:28<27:48:02,  3.50it/s]
  6%|▌         | 21419/371472 [1:43:28<27:58:24,  3.48it/s]
  6%|▌         | 21420/371472 [1:43:28<29:45:12,  3.27it/s]
                                                           
{'loss': 4.6163, 'learning_rate': 9.485606240168932e-07, 'epoch': 0.92}

  6%|▌         | 21420/371472 [1:43:28<29:45:12,  3.27it/s]
  6%|▌         | 21421/371472 [1:43:29<29:57:28,  3.25it/s]
  6%|▌         | 21422/371472 [1:43:29<28:59:48,  3.35it/s]
  6%|▌         | 21423/371472 [1:43:29<27:57:04,  3.48it/s]
  6%|▌         | 21424/371472 [1:43:30<27:00:43,  3.60it/s]
  6%|▌         | 21425/371472 [1:43:30<27:23:43,  3.55it/s]
  6%|▌         | 21426/371472 [1:43:30<27:30:12,  3.54it/s]
  6%|▌         | 21427/371472 [1:43:30<28:46:10,  3.38it/s]
  6%|▌         | 21428/371472 [1:43:31<27:50:43,  3.49it/s]
  6%|▌         | 21429/371472 [1:43:31<29:02:24,  3.35it/s]
  6%|▌         | 21430/371472 [1:43:31<28:39:36,  3.39it/s]
  6%|▌         | 21431/371472 [1:43:32<27:47:30,  3.50it/s]
  6%|▌         | 21432/371472 [1:43:32<28:43:51,  3.38it/s]
  6%|▌         | 21433/371472 [1:43:32<29:37:49,  3.28it/s]
  6%|▌         | 21434/371472 [1:43:33<28:20:18,  3.43it/s]
  6%|▌         | 21435/371472 [1:43:33<27:57:36,  3.48it/s]
  6%|▌         | 21436/371472 [1:43:33<27:26:33,  3.54it/s]
  6%|▌         | 21437/371472 [1:43:33<27:08:45,  3.58it/s]
  6%|▌         | 21438/371472 [1:43:34<26:43:30,  3.64it/s]
  6%|▌         | 21439/371472 [1:43:34<29:02:39,  3.35it/s]
  6%|▌         | 21440/371472 [1:43:34<31:31:43,  3.08it/s]
                                                           
{'loss': 4.6412, 'learning_rate': 9.485121420414143e-07, 'epoch': 0.92}

  6%|▌         | 21440/371472 [1:43:34<31:31:43,  3.08it/s]
  6%|▌         | 21441/371472 [1:43:35<29:32:25,  3.29it/s]
  6%|▌         | 21442/371472 [1:43:35<28:09:26,  3.45it/s]
  6%|▌         | 21443/371472 [1:43:35<28:42:32,  3.39it/s]
  6%|▌         | 21444/371472 [1:43:35<27:54:13,  3.48it/s]
  6%|▌         | 21445/371472 [1:43:36<27:14:20,  3.57it/s]
  6%|▌         | 21446/371472 [1:43:36<28:37:35,  3.40it/s]
  6%|▌         | 21447/371472 [1:43:36<28:01:24,  3.47it/s]
  6%|▌         | 21448/371472 [1:43:37<29:40:32,  3.28it/s]
  6%|▌         | 21449/371472 [1:43:37<28:46:39,  3.38it/s]
  6%|▌         | 21450/371472 [1:43:37<27:25:47,  3.54it/s]
  6%|▌         | 21451/371472 [1:43:37<27:56:42,  3.48it/s]
  6%|▌         | 21452/371472 [1:43:38<28:22:43,  3.43it/s]
  6%|▌         | 21453/371472 [1:43:38<27:58:00,  3.48it/s]
  6%|▌         | 21454/371472 [1:43:38<26:54:53,  3.61it/s]
  6%|▌         | 21455/371472 [1:43:39<27:28:17,  3.54it/s]
  6%|▌         | 21456/371472 [1:43:39<26:28:02,  3.67it/s]
  6%|▌         | 21457/371472 [1:43:39<27:44:02,  3.51it/s]
  6%|▌         | 21458/371472 [1:43:39<27:52:52,  3.49it/s]
  6%|▌         | 21459/371472 [1:43:40<28:41:36,  3.39it/s]
  6%|▌         | 21460/371472 [1:43:40<27:39:30,  3.52it/s]
                                                           
{'loss': 4.5538, 'learning_rate': 9.484636600659355e-07, 'epoch': 0.92}

  6%|▌         | 21460/371472 [1:43:40<27:39:30,  3.52it/s]
  6%|▌         | 21461/371472 [1:43:40<27:52:57,  3.49it/s]
  6%|▌         | 21462/371472 [1:43:41<27:54:47,  3.48it/s]
  6%|▌         | 21463/371472 [1:43:41<28:26:51,  3.42it/s]
  6%|▌         | 21464/371472 [1:43:41<29:12:08,  3.33it/s]
  6%|▌         | 21465/371472 [1:43:42<27:58:43,  3.47it/s]
  6%|▌         | 21466/371472 [1:43:42<27:49:22,  3.49it/s]
  6%|▌         | 21467/371472 [1:43:42<27:11:10,  3.58it/s]
  6%|▌         | 21468/371472 [1:43:42<27:36:09,  3.52it/s]
  6%|▌         | 21469/371472 [1:43:43<28:06:36,  3.46it/s]
  6%|▌         | 21470/371472 [1:43:43<28:08:57,  3.45it/s]
  6%|▌         | 21471/371472 [1:43:43<27:34:21,  3.53it/s]
  6%|▌         | 21472/371472 [1:43:44<29:40:19,  3.28it/s]
  6%|▌         | 21473/371472 [1:43:44<31:37:26,  3.07it/s]
  6%|▌         | 21474/371472 [1:43:44<30:02:54,  3.24it/s]
  6%|▌         | 21475/371472 [1:43:44<28:36:59,  3.40it/s]
  6%|▌         | 21476/371472 [1:43:45<28:25:36,  3.42it/s]
  6%|▌         | 21477/371472 [1:43:45<28:00:37,  3.47it/s]
  6%|▌         | 21478/371472 [1:43:45<27:58:41,  3.47it/s]
  6%|▌         | 21479/371472 [1:43:46<27:02:48,  3.59it/s]
  6%|▌         | 21480/371472 [1:43:46<28:23:21,  3.42it/s]
                                                           
{'loss': 4.5306, 'learning_rate': 9.484151780904566e-07, 'epoch': 0.93}

  6%|▌         | 21480/371472 [1:43:46<28:23:21,  3.42it/s]
  6%|▌         | 21481/371472 [1:43:46<30:13:03,  3.22it/s]
  6%|▌         | 21482/371472 [1:43:47<28:50:14,  3.37it/s]
  6%|▌         | 21483/371472 [1:43:47<28:05:46,  3.46it/s]
  6%|▌         | 21484/371472 [1:43:47<27:24:44,  3.55it/s]
  6%|▌         | 21485/371472 [1:43:47<26:38:10,  3.65it/s]
  6%|▌         | 21486/371472 [1:43:48<26:18:03,  3.70it/s]
  6%|▌         | 21487/371472 [1:43:48<26:30:50,  3.67it/s]
  6%|▌         | 21488/371472 [1:43:48<26:29:43,  3.67it/s]
  6%|▌         | 21489/371472 [1:43:48<26:47:21,  3.63it/s]
  6%|▌         | 21490/371472 [1:43:49<26:44:19,  3.64it/s]
  6%|▌         | 21491/371472 [1:43:49<26:07:33,  3.72it/s]
  6%|▌         | 21492/371472 [1:43:49<26:33:36,  3.66it/s]
  6%|▌         | 21493/371472 [1:43:50<26:55:24,  3.61it/s]
  6%|▌         | 21494/371472 [1:43:50<27:56:55,  3.48it/s]
  6%|▌         | 21495/371472 [1:43:50<27:09:11,  3.58it/s]
  6%|▌         | 21496/371472 [1:43:50<27:22:41,  3.55it/s]
  6%|▌         | 21497/371472 [1:43:51<26:43:01,  3.64it/s]
  6%|▌         | 21498/371472 [1:43:51<26:34:47,  3.66it/s]
  6%|▌         | 21499/371472 [1:43:51<27:13:09,  3.57it/s]
  6%|▌         | 21500/371472 [1:43:51<27:00:01,  3.60it/s]
                                                           
{'loss': 4.94, 'learning_rate': 9.483666961149777e-07, 'epoch': 0.93}

  6%|▌         | 21500/371472 [1:43:51<27:00:01,  3.60it/s]
  6%|▌         | 21501/371472 [1:43:52<27:47:10,  3.50it/s]
  6%|▌         | 21502/371472 [1:43:52<29:42:58,  3.27it/s]
  6%|▌         | 21503/371472 [1:43:52<29:05:37,  3.34it/s]
  6%|▌         | 21504/371472 [1:43:53<30:21:24,  3.20it/s]
  6%|▌         | 21505/371472 [1:43:53<29:21:06,  3.31it/s]
  6%|▌         | 21506/371472 [1:43:53<29:05:24,  3.34it/s]
  6%|▌         | 21507/371472 [1:43:54<28:22:07,  3.43it/s]
  6%|▌         | 21508/371472 [1:43:54<27:30:57,  3.53it/s]
  6%|▌         | 21509/371472 [1:43:54<27:21:08,  3.55it/s]
  6%|▌         | 21510/371472 [1:43:54<27:31:35,  3.53it/s]
  6%|▌         | 21511/371472 [1:43:55<29:00:01,  3.35it/s]
  6%|▌         | 21512/371472 [1:43:55<28:50:30,  3.37it/s]
  6%|▌         | 21513/371472 [1:43:55<28:05:26,  3.46it/s]
  6%|▌         | 21514/371472 [1:43:56<29:08:54,  3.34it/s]
  6%|▌         | 21515/371472 [1:43:56<28:01:13,  3.47it/s]
  6%|▌         | 21516/371472 [1:43:56<28:56:00,  3.36it/s]
  6%|▌         | 21517/371472 [1:43:57<28:48:47,  3.37it/s]
  6%|▌         | 21518/371472 [1:43:57<31:06:11,  3.13it/s]
  6%|▌         | 21519/371472 [1:43:57<32:10:58,  3.02it/s]
  6%|▌         | 21520/371472 [1:43:58<30:22:08,  3.20it/s]
                                                           
{'loss': 4.3409, 'learning_rate': 9.483182141394986e-07, 'epoch': 0.93}

  6%|▌         | 21520/371472 [1:43:58<30:22:08,  3.20it/s]
  6%|▌         | 21521/371472 [1:43:58<29:36:54,  3.28it/s]
  6%|▌         | 21522/371472 [1:43:58<27:56:21,  3.48it/s]
  6%|▌         | 21523/371472 [1:43:58<26:50:16,  3.62it/s]
  6%|▌         | 21524/371472 [1:43:59<27:28:42,  3.54it/s]
  6%|▌         | 21525/371472 [1:43:59<26:43:05,  3.64it/s]
  6%|▌         | 21526/371472 [1:43:59<27:16:09,  3.56it/s]
  6%|▌         | 21527/371472 [1:43:59<26:57:25,  3.61it/s]
  6%|▌         | 21528/371472 [1:44:00<28:15:38,  3.44it/s]
  6%|▌         | 21529/371472 [1:44:00<28:18:08,  3.43it/s]
  6%|▌         | 21530/371472 [1:44:00<27:27:32,  3.54it/s]
  6%|▌         | 21531/371472 [1:44:01<26:53:16,  3.62it/s]
  6%|▌         | 21532/371472 [1:44:01<26:41:22,  3.64it/s]
  6%|▌         | 21533/371472 [1:44:01<25:43:47,  3.78it/s]
  6%|▌         | 21534/371472 [1:44:01<25:52:40,  3.76it/s]
  6%|▌         | 21535/371472 [1:44:02<26:18:08,  3.70it/s]
  6%|▌         | 21536/371472 [1:44:02<28:12:46,  3.45it/s]
  6%|▌         | 21537/371472 [1:44:02<28:52:20,  3.37it/s]
  6%|▌         | 21538/371472 [1:44:03<27:55:07,  3.48it/s]
  6%|▌         | 21539/371472 [1:44:03<29:38:25,  3.28it/s]
  6%|▌         | 21540/371472 [1:44:03<28:31:53,  3.41it/s]
                                                           
{'loss': 4.9327, 'learning_rate': 9.482697321640199e-07, 'epoch': 0.93}

  6%|▌         | 21540/371472 [1:44:03<28:31:53,  3.41it/s]
  6%|▌         | 21541/371472 [1:44:03<28:09:07,  3.45it/s]
  6%|▌         | 21542/371472 [1:44:04<28:33:45,  3.40it/s]
  6%|▌         | 21543/371472 [1:44:04<28:32:05,  3.41it/s]
  6%|▌         | 21544/371472 [1:44:04<27:53:02,  3.49it/s]
  6%|▌         | 21545/371472 [1:44:05<27:15:23,  3.57it/s]
  6%|▌         | 21546/371472 [1:44:05<27:48:13,  3.50it/s]
  6%|▌         | 21547/371472 [1:44:05<27:05:07,  3.59it/s]
  6%|▌         | 21548/371472 [1:44:05<26:43:43,  3.64it/s]
  6%|▌         | 21549/371472 [1:44:06<27:12:35,  3.57it/s]
  6%|▌         | 21550/371472 [1:44:06<28:46:43,  3.38it/s]
  6%|▌         | 21551/371472 [1:44:06<27:47:13,  3.50it/s]
  6%|▌         | 21552/371472 [1:44:07<27:13:32,  3.57it/s]
  6%|▌         | 21553/371472 [1:44:07<27:49:25,  3.49it/s]
  6%|▌         | 21554/371472 [1:44:07<29:52:52,  3.25it/s]
  6%|▌         | 21555/371472 [1:44:08<30:31:38,  3.18it/s]
  6%|▌         | 21556/371472 [1:44:08<31:27:08,  3.09it/s]
  6%|▌         | 21557/371472 [1:44:08<30:13:12,  3.22it/s]
  6%|▌         | 21558/371472 [1:44:09<33:05:17,  2.94it/s]
  6%|▌         | 21559/371472 [1:44:09<31:25:28,  3.09it/s]
  6%|▌         | 21560/371472 [1:44:09<29:36:54,  3.28it/s]
                                                           
{'loss': 4.6211, 'learning_rate': 9.482212501885409e-07, 'epoch': 0.93}

  6%|▌         | 21560/371472 [1:44:09<29:36:54,  3.28it/s]
  6%|▌         | 21561/371472 [1:44:09<28:44:15,  3.38it/s]
  6%|▌         | 21562/371472 [1:44:10<27:38:36,  3.52it/s]
  6%|▌         | 21563/371472 [1:44:10<26:53:19,  3.61it/s]
  6%|▌         | 21564/371472 [1:44:10<26:27:56,  3.67it/s]
  6%|▌         | 21565/371472 [1:44:10<26:39:26,  3.65it/s]
  6%|▌         | 21566/371472 [1:44:11<26:17:27,  3.70it/s]
  6%|▌         | 21567/371472 [1:44:11<25:38:59,  3.79it/s]
  6%|▌         | 21568/371472 [1:44:11<25:47:05,  3.77it/s]
  6%|▌         | 21569/371472 [1:44:12<28:47:33,  3.38it/s]
  6%|▌         | 21570/371472 [1:44:12<27:56:39,  3.48it/s]
  6%|▌         | 21571/371472 [1:44:12<26:59:08,  3.60it/s]
  6%|▌         | 21572/371472 [1:44:12<26:15:39,  3.70it/s]
  6%|▌         | 21573/371472 [1:44:13<29:54:35,  3.25it/s]
  6%|▌         | 21574/371472 [1:44:13<28:52:38,  3.37it/s]
  6%|▌         | 21575/371472 [1:44:13<29:34:33,  3.29it/s]
  6%|▌         | 21576/371472 [1:44:14<31:35:20,  3.08it/s]
  6%|▌         | 21577/371472 [1:44:14<31:38:55,  3.07it/s]
  6%|▌         | 21578/371472 [1:44:14<30:21:06,  3.20it/s]
  6%|▌         | 21579/371472 [1:44:15<29:25:13,  3.30it/s]
  6%|▌         | 21580/371472 [1:44:15<32:04:28,  3.03it/s]
                                                           
{'loss': 4.3866, 'learning_rate': 9.481727682130621e-07, 'epoch': 0.93}

  6%|▌         | 21580/371472 [1:44:15<32:04:28,  3.03it/s]
  6%|▌         | 21581/371472 [1:44:15<29:34:13,  3.29it/s]
  6%|▌         | 21582/371472 [1:44:16<28:25:28,  3.42it/s]
  6%|▌         | 21583/371472 [1:44:16<27:48:37,  3.49it/s]
  6%|▌         | 21584/371472 [1:44:16<26:53:29,  3.61it/s]
  6%|▌         | 21585/371472 [1:44:16<26:19:19,  3.69it/s]
  6%|▌         | 21586/371472 [1:44:17<28:31:50,  3.41it/s]
  6%|▌         | 21587/371472 [1:44:17<28:10:08,  3.45it/s]
  6%|▌         | 21588/371472 [1:44:17<27:44:34,  3.50it/s]
  6%|▌         | 21589/371472 [1:44:17<27:14:14,  3.57it/s]
  6%|▌         | 21590/371472 [1:44:18<27:26:03,  3.54it/s]
  6%|▌         | 21591/371472 [1:44:18<28:34:50,  3.40it/s]
  6%|▌         | 21592/371472 [1:44:18<29:34:15,  3.29it/s]
  6%|▌         | 21593/371472 [1:44:19<29:26:59,  3.30it/s]
  6%|▌         | 21594/371472 [1:44:19<28:04:02,  3.46it/s]
  6%|▌         | 21595/371472 [1:44:19<28:09:18,  3.45it/s]
  6%|▌         | 21596/371472 [1:44:20<27:26:47,  3.54it/s]
  6%|▌         | 21597/371472 [1:44:20<27:48:59,  3.49it/s]
  6%|▌         | 21598/371472 [1:44:20<27:43:01,  3.51it/s]
  6%|▌         | 21599/371472 [1:44:20<29:38:37,  3.28it/s]
  6%|▌         | 21600/371472 [1:44:21<28:36:32,  3.40it/s]
                                                           
{'loss': 4.4892, 'learning_rate': 9.481242862375832e-07, 'epoch': 0.93}

  6%|▌         | 21600/371472 [1:44:21<28:36:32,  3.40it/s]
  6%|▌         | 21601/371472 [1:44:21<28:08:10,  3.45it/s]
  6%|▌         | 21602/371472 [1:44:21<27:16:01,  3.56it/s]
  6%|▌         | 21603/371472 [1:44:22<27:35:14,  3.52it/s]
  6%|▌         | 21604/371472 [1:44:22<27:08:31,  3.58it/s]
  6%|▌         | 21605/371472 [1:44:22<26:34:51,  3.66it/s]
  6%|▌         | 21606/371472 [1:44:22<27:09:27,  3.58it/s]
  6%|▌         | 21607/371472 [1:44:23<31:37:13,  3.07it/s]
  6%|▌         | 21608/371472 [1:44:23<30:28:12,  3.19it/s]
  6%|▌         | 21609/371472 [1:44:23<32:26:02,  3.00it/s]
  6%|▌         | 21610/371472 [1:44:24<30:41:48,  3.17it/s]
  6%|▌         | 21611/371472 [1:44:24<32:08:45,  3.02it/s]
  6%|▌         | 21612/371472 [1:44:24<30:09:27,  3.22it/s]
  6%|▌         | 21613/371472 [1:44:25<28:30:42,  3.41it/s]
  6%|▌         | 21614/371472 [1:44:25<28:18:35,  3.43it/s]
  6%|▌         | 21615/371472 [1:44:25<27:05:19,  3.59it/s]
  6%|▌         | 21616/371472 [1:44:26<28:55:54,  3.36it/s]
  6%|▌         | 21617/371472 [1:44:26<29:54:19,  3.25it/s]
  6%|▌         | 21618/371472 [1:44:26<28:16:26,  3.44it/s]
  6%|▌         | 21619/371472 [1:44:26<28:07:32,  3.46it/s]
  6%|▌         | 21620/371472 [1:44:27<27:14:06,  3.57it/s]
                                                           
{'loss': 4.7242, 'learning_rate': 9.480758042621044e-07, 'epoch': 0.93}

  6%|▌         | 21620/371472 [1:44:27<27:14:06,  3.57it/s]
  6%|▌         | 21621/371472 [1:44:27<28:00:56,  3.47it/s]
  6%|▌         | 21622/371472 [1:44:27<27:51:51,  3.49it/s]
  6%|▌         | 21623/371472 [1:44:27<27:30:55,  3.53it/s]
  6%|▌         | 21624/371472 [1:44:28<26:16:43,  3.70it/s]
  6%|▌         | 21625/371472 [1:44:28<26:00:42,  3.74it/s]
  6%|▌         | 21626/371472 [1:44:28<29:57:34,  3.24it/s]
  6%|▌         | 21627/371472 [1:44:29<28:19:32,  3.43it/s]
  6%|▌         | 21628/371472 [1:44:29<29:13:34,  3.33it/s]
  6%|▌         | 21629/371472 [1:44:29<29:11:29,  3.33it/s]
  6%|▌         | 21630/371472 [1:44:30<28:58:52,  3.35it/s]
  6%|▌         | 21631/371472 [1:44:30<27:57:00,  3.48it/s]
  6%|▌         | 21632/371472 [1:44:30<27:10:29,  3.58it/s]
  6%|▌         | 21633/371472 [1:44:30<27:37:07,  3.52it/s]
  6%|▌         | 21634/371472 [1:44:31<30:18:54,  3.21it/s]
  6%|▌         | 21635/371472 [1:44:31<28:51:05,  3.37it/s]
  6%|▌         | 21636/371472 [1:44:31<29:25:44,  3.30it/s]
  6%|▌         | 21637/371472 [1:44:32<29:55:48,  3.25it/s]
  6%|▌         | 21638/371472 [1:44:32<28:54:34,  3.36it/s]
  6%|▌         | 21639/371472 [1:44:32<28:43:19,  3.38it/s]
  6%|▌         | 21640/371472 [1:44:33<29:22:33,  3.31it/s]
                                                           
{'loss': 4.789, 'learning_rate': 9.480273222866253e-07, 'epoch': 0.93}

  6%|▌         | 21640/371472 [1:44:33<29:22:33,  3.31it/s]
  6%|▌         | 21641/371472 [1:44:33<30:11:37,  3.22it/s]
  6%|▌         | 21642/371472 [1:44:33<31:23:51,  3.09it/s]
  6%|▌         | 21643/371472 [1:44:34<33:32:31,  2.90it/s]
  6%|▌         | 21644/371472 [1:44:34<31:47:16,  3.06it/s]
  6%|▌         | 21645/371472 [1:44:34<30:24:11,  3.20it/s]
  6%|▌         | 21646/371472 [1:44:34<29:15:00,  3.32it/s]
  6%|▌         | 21647/371472 [1:44:35<31:01:18,  3.13it/s]
  6%|▌         | 21648/371472 [1:44:35<29:11:05,  3.33it/s]
  6%|▌         | 21649/371472 [1:44:35<27:46:18,  3.50it/s]
  6%|▌         | 21650/371472 [1:44:36<27:07:56,  3.58it/s]
  6%|▌         | 21651/371472 [1:44:36<28:35:26,  3.40it/s]
  6%|▌         | 21652/371472 [1:44:36<27:37:03,  3.52it/s]
  6%|▌         | 21653/371472 [1:44:36<26:42:34,  3.64it/s]
  6%|▌         | 21654/371472 [1:44:37<26:13:34,  3.71it/s]
  6%|▌         | 21655/371472 [1:44:37<25:34:45,  3.80it/s]
  6%|▌         | 21656/371472 [1:44:37<26:32:50,  3.66it/s]
  6%|▌         | 21657/371472 [1:44:37<25:56:59,  3.74it/s]
  6%|▌         | 21658/371472 [1:44:38<25:59:38,  3.74it/s]
  6%|▌         | 21659/371472 [1:44:38<25:41:58,  3.78it/s]
  6%|▌         | 21660/371472 [1:44:38<27:28:04,  3.54it/s]
                                                           
{'loss': 4.5236, 'learning_rate': 9.479788403111465e-07, 'epoch': 0.93}

  6%|▌         | 21660/371472 [1:44:38<27:28:04,  3.54it/s]
  6%|▌         | 21661/371472 [1:44:39<27:23:07,  3.55it/s]
  6%|▌         | 21662/371472 [1:44:39<28:26:31,  3.42it/s]
  6%|▌         | 21663/371472 [1:44:39<27:15:28,  3.56it/s]
  6%|▌         | 21664/371472 [1:44:39<27:24:10,  3.55it/s]
  6%|▌         | 21665/371472 [1:44:40<26:48:28,  3.62it/s]
  6%|▌         | 21666/371472 [1:44:40<26:44:45,  3.63it/s]
  6%|▌         | 21667/371472 [1:44:40<26:55:10,  3.61it/s]
  6%|▌         | 21668/371472 [1:44:41<27:40:57,  3.51it/s]
  6%|▌         | 21669/371472 [1:44:41<26:20:12,  3.69it/s]
  6%|▌         | 21670/371472 [1:44:41<29:55:06,  3.25it/s]
  6%|▌         | 21671/371472 [1:44:42<29:34:04,  3.29it/s]
  6%|▌         | 21672/371472 [1:44:42<28:42:19,  3.38it/s]
  6%|▌         | 21673/371472 [1:44:42<29:18:05,  3.32it/s]
  6%|▌         | 21674/371472 [1:44:42<28:32:19,  3.40it/s]
  6%|▌         | 21675/371472 [1:44:43<28:04:17,  3.46it/s]
  6%|▌         | 21676/371472 [1:44:43<28:28:36,  3.41it/s]
  6%|▌         | 21677/371472 [1:44:43<27:12:27,  3.57it/s]
  6%|▌         | 21678/371472 [1:44:44<29:50:11,  3.26it/s]
  6%|▌         | 21679/371472 [1:44:44<28:09:04,  3.45it/s]
  6%|▌         | 21680/371472 [1:44:44<27:42:45,  3.51it/s]
                                                           
{'loss': 4.9787, 'learning_rate': 9.479303583356676e-07, 'epoch': 0.93}

  6%|▌         | 21680/371472 [1:44:44<27:42:45,  3.51it/s]
  6%|▌         | 21681/371472 [1:44:44<27:18:21,  3.56it/s]
  6%|▌         | 21682/371472 [1:44:45<27:26:02,  3.54it/s]
  6%|▌         | 21683/371472 [1:44:45<27:23:27,  3.55it/s]
  6%|▌         | 21684/371472 [1:44:45<26:38:15,  3.65it/s]
  6%|▌         | 21685/371472 [1:44:45<27:04:06,  3.59it/s]
  6%|▌         | 21686/371472 [1:44:46<26:24:09,  3.68it/s]
  6%|▌         | 21687/371472 [1:44:46<27:14:51,  3.57it/s]
  6%|▌         | 21688/371472 [1:44:46<27:14:46,  3.57it/s]
  6%|▌         | 21689/371472 [1:44:47<26:45:58,  3.63it/s]
  6%|▌         | 21690/371472 [1:44:47<26:39:29,  3.64it/s]
  6%|▌         | 21691/371472 [1:44:47<26:02:13,  3.73it/s]
  6%|▌         | 21692/371472 [1:44:47<26:15:22,  3.70it/s]
  6%|▌         | 21693/371472 [1:44:48<27:07:40,  3.58it/s]
  6%|▌         | 21694/371472 [1:44:48<27:06:55,  3.58it/s]
  6%|▌         | 21695/371472 [1:44:48<26:16:08,  3.70it/s]
  6%|▌         | 21696/371472 [1:44:49<27:32:17,  3.53it/s]
  6%|▌         | 21697/371472 [1:44:49<26:51:22,  3.62it/s]
  6%|▌         | 21698/371472 [1:44:49<26:26:11,  3.68it/s]
  6%|▌         | 21699/371472 [1:44:49<26:32:08,  3.66it/s]
  6%|▌         | 21700/371472 [1:44:50<26:19:29,  3.69it/s]
                                                           
{'loss': 4.6006, 'learning_rate': 9.478818763601888e-07, 'epoch': 0.93}

  6%|▌         | 21700/371472 [1:44:50<26:19:29,  3.69it/s]
  6%|▌         | 21701/371472 [1:44:50<27:11:26,  3.57it/s]
  6%|▌         | 21702/371472 [1:44:50<27:30:14,  3.53it/s]
  6%|▌         | 21703/371472 [1:44:51<28:10:38,  3.45it/s]
  6%|▌         | 21704/371472 [1:44:51<27:20:42,  3.55it/s]
  6%|▌         | 21705/371472 [1:44:51<26:50:32,  3.62it/s]
  6%|▌         | 21706/371472 [1:44:51<26:45:33,  3.63it/s]
  6%|▌         | 21707/371472 [1:44:52<27:15:30,  3.56it/s]
  6%|▌         | 21708/371472 [1:44:52<27:35:35,  3.52it/s]
  6%|▌         | 21709/371472 [1:44:52<27:10:22,  3.58it/s]
  6%|▌         | 21710/371472 [1:44:52<27:01:10,  3.60it/s]
  6%|▌         | 21711/371472 [1:44:53<27:40:10,  3.51it/s]
  6%|▌         | 21712/371472 [1:44:53<28:45:41,  3.38it/s]
  6%|▌         | 21713/371472 [1:44:53<32:02:17,  3.03it/s]
  6%|▌         | 21714/371472 [1:44:54<29:59:55,  3.24it/s]
  6%|▌         | 21715/371472 [1:44:54<29:00:04,  3.35it/s]
  6%|▌         | 21716/371472 [1:44:54<28:58:06,  3.35it/s]
  6%|▌         | 21717/371472 [1:44:55<27:58:45,  3.47it/s]
  6%|▌         | 21718/371472 [1:44:55<27:56:34,  3.48it/s]
  6%|▌         | 21719/371472 [1:44:55<31:32:13,  3.08it/s]
  6%|▌         | 21720/371472 [1:44:56<29:28:15,  3.30it/s]
                                                           
{'loss': 4.5336, 'learning_rate': 9.478333943847098e-07, 'epoch': 0.94}

  6%|▌         | 21720/371472 [1:44:56<29:28:15,  3.30it/s]
  6%|▌         | 21721/371472 [1:44:56<28:53:16,  3.36it/s]
  6%|▌         | 21722/371472 [1:44:56<28:00:57,  3.47it/s]
  6%|▌         | 21723/371472 [1:44:56<27:54:36,  3.48it/s]
  6%|▌         | 21724/371472 [1:44:57<27:58:08,  3.47it/s]
  6%|▌         | 21725/371472 [1:44:57<27:20:30,  3.55it/s]
  6%|▌         | 21726/371472 [1:44:57<29:02:44,  3.34it/s]
  6%|▌         | 21727/371472 [1:44:58<28:18:49,  3.43it/s]
  6%|▌         | 21728/371472 [1:44:58<26:54:49,  3.61it/s]
  6%|▌         | 21729/371472 [1:44:58<27:04:21,  3.59it/s]
  6%|▌         | 21730/371472 [1:44:58<29:13:29,  3.32it/s]
  6%|▌         | 21731/371472 [1:44:59<28:22:54,  3.42it/s]
  6%|▌         | 21732/371472 [1:44:59<28:15:42,  3.44it/s]
  6%|▌         | 21733/371472 [1:44:59<27:48:46,  3.49it/s]
  6%|▌         | 21734/371472 [1:45:00<28:21:28,  3.43it/s]
  6%|▌         | 21735/371472 [1:45:00<27:40:15,  3.51it/s]
  6%|▌         | 21736/371472 [1:45:00<28:11:47,  3.45it/s]
  6%|▌         | 21737/371472 [1:45:00<29:06:25,  3.34it/s]
  6%|▌         | 21738/371472 [1:45:01<28:32:59,  3.40it/s]
  6%|▌         | 21739/371472 [1:45:01<27:39:13,  3.51it/s]
  6%|▌         | 21740/371472 [1:45:01<27:16:08,  3.56it/s]
                                                           
{'loss': 4.6637, 'learning_rate': 9.47784912409231e-07, 'epoch': 0.94}

  6%|▌         | 21740/371472 [1:45:01<27:16:08,  3.56it/s]
  6%|▌         | 21741/371472 [1:45:02<29:52:36,  3.25it/s]
  6%|▌         | 21742/371472 [1:45:02<28:52:12,  3.36it/s]
  6%|▌         | 21743/371472 [1:45:02<27:51:02,  3.49it/s]
  6%|▌         | 21744/371472 [1:45:02<27:18:59,  3.56it/s]
  6%|▌         | 21745/371472 [1:45:03<26:50:58,  3.62it/s]
  6%|▌         | 21746/371472 [1:45:03<26:14:52,  3.70it/s]
  6%|▌         | 21747/371472 [1:45:03<26:21:40,  3.69it/s]
  6%|▌         | 21748/371472 [1:45:04<28:43:52,  3.38it/s]
  6%|▌         | 21749/371472 [1:45:04<27:37:19,  3.52it/s]
  6%|▌         | 21750/371472 [1:45:04<28:23:26,  3.42it/s]
  6%|▌         | 21751/371472 [1:45:04<27:26:57,  3.54it/s]
  6%|▌         | 21752/371472 [1:45:05<26:35:32,  3.65it/s]
  6%|▌         | 21753/371472 [1:45:05<27:17:50,  3.56it/s]
  6%|▌         | 21754/371472 [1:45:05<26:48:19,  3.62it/s]
  6%|▌         | 21755/371472 [1:45:06<27:55:17,  3.48it/s]
  6%|▌         | 21756/371472 [1:45:06<27:09:30,  3.58it/s]
  6%|▌         | 21757/371472 [1:45:06<27:43:44,  3.50it/s]
  6%|▌         | 21758/371472 [1:45:06<26:26:38,  3.67it/s]
  6%|▌         | 21759/371472 [1:45:07<26:33:56,  3.66it/s]
  6%|▌         | 21760/371472 [1:45:07<27:06:15,  3.58it/s]
                                                           
{'loss': 4.5355, 'learning_rate': 9.477364304337521e-07, 'epoch': 0.94}

  6%|▌         | 21760/371472 [1:45:07<27:06:15,  3.58it/s]
  6%|▌         | 21761/371472 [1:45:07<26:32:53,  3.66it/s]
  6%|▌         | 21762/371472 [1:45:07<26:24:34,  3.68it/s]
  6%|▌         | 21763/371472 [1:45:08<26:30:17,  3.67it/s]
  6%|▌         | 21764/371472 [1:45:08<26:55:42,  3.61it/s]
  6%|▌         | 21765/371472 [1:45:08<27:09:02,  3.58it/s]
  6%|▌         | 21766/371472 [1:45:09<28:07:12,  3.45it/s]
  6%|▌         | 21767/371472 [1:45:09<29:29:00,  3.29it/s]
  6%|▌         | 21768/371472 [1:45:09<28:21:54,  3.42it/s]
  6%|▌         | 21769/371472 [1:45:09<29:05:59,  3.34it/s]
  6%|▌         | 21770/371472 [1:45:10<33:39:47,  2.89it/s]
  6%|▌         | 21771/371472 [1:45:10<31:07:26,  3.12it/s]
  6%|▌         | 21772/371472 [1:45:11<30:26:47,  3.19it/s]
  6%|▌         | 21773/371472 [1:45:11<29:58:51,  3.24it/s]
  6%|▌         | 21774/371472 [1:45:11<28:34:49,  3.40it/s]
  6%|▌         | 21775/371472 [1:45:11<27:43:15,  3.50it/s]
  6%|▌         | 21776/371472 [1:45:12<28:17:23,  3.43it/s]
  6%|▌         | 21777/371472 [1:45:12<29:04:30,  3.34it/s]
  6%|▌         | 21778/371472 [1:45:12<28:19:22,  3.43it/s]
  6%|▌         | 21779/371472 [1:45:13<28:18:17,  3.43it/s]
  6%|▌         | 21780/371472 [1:45:13<28:55:32,  3.36it/s]
                                                           
{'loss': 4.6314, 'learning_rate': 9.47687948458273e-07, 'epoch': 0.94}

  6%|▌         | 21780/371472 [1:45:13<28:55:32,  3.36it/s]
  6%|▌         | 21781/371472 [1:45:13<28:37:29,  3.39it/s]
  6%|▌         | 21782/371472 [1:45:13<30:22:22,  3.20it/s]
  6%|▌         | 21783/371472 [1:45:14<30:30:23,  3.18it/s]
  6%|▌         | 21784/371472 [1:45:14<31:02:21,  3.13it/s]
  6%|▌         | 21785/371472 [1:45:14<30:48:30,  3.15it/s]
  6%|▌         | 21786/371472 [1:45:15<29:58:39,  3.24it/s]
  6%|▌         | 21787/371472 [1:45:15<28:42:10,  3.38it/s]
  6%|▌         | 21788/371472 [1:45:15<29:46:36,  3.26it/s]
  6%|▌         | 21789/371472 [1:45:16<28:11:16,  3.45it/s]
  6%|▌         | 21790/371472 [1:45:16<28:24:23,  3.42it/s]
  6%|▌         | 21791/371472 [1:45:16<28:04:33,  3.46it/s]
  6%|▌         | 21792/371472 [1:45:16<27:04:16,  3.59it/s]
  6%|▌         | 21793/371472 [1:45:17<28:26:31,  3.42it/s]
  6%|▌         | 21794/371472 [1:45:17<28:14:13,  3.44it/s]
  6%|▌         | 21795/371472 [1:45:17<26:55:35,  3.61it/s]
  6%|▌         | 21796/371472 [1:45:18<28:56:01,  3.36it/s]
  6%|▌         | 21797/371472 [1:45:18<28:03:39,  3.46it/s]
  6%|▌         | 21798/371472 [1:45:18<28:07:40,  3.45it/s]
  6%|▌         | 21799/371472 [1:45:18<28:08:17,  3.45it/s]
  6%|▌         | 21800/371472 [1:45:19<28:29:09,  3.41it/s]
                                                           
{'loss': 4.6773, 'learning_rate': 9.476394664827942e-07, 'epoch': 0.94}

  6%|▌         | 21800/371472 [1:45:19<28:29:09,  3.41it/s]
  6%|▌         | 21801/371472 [1:45:19<27:40:08,  3.51it/s]
  6%|▌         | 21802/371472 [1:45:19<28:19:39,  3.43it/s]
  6%|▌         | 21803/371472 [1:45:20<28:46:38,  3.38it/s]
  6%|▌         | 21804/371472 [1:45:20<28:42:09,  3.38it/s]
  6%|▌         | 21805/371472 [1:45:20<27:37:14,  3.52it/s]
  6%|▌         | 21806/371472 [1:45:21<29:33:19,  3.29it/s]
  6%|▌         | 21807/371472 [1:45:21<28:33:03,  3.40it/s]
  6%|▌         | 21808/371472 [1:45:21<28:32:35,  3.40it/s]
  6%|▌         | 21809/371472 [1:45:21<28:18:37,  3.43it/s]
  6%|▌         | 21810/371472 [1:45:22<27:49:36,  3.49it/s]
  6%|▌         | 21811/371472 [1:45:22<27:46:38,  3.50it/s]
  6%|▌         | 21812/371472 [1:45:22<28:05:11,  3.46it/s]
  6%|▌         | 21813/371472 [1:45:23<27:50:40,  3.49it/s]
  6%|▌         | 21814/371472 [1:45:23<26:39:13,  3.64it/s]
  6%|▌         | 21815/371472 [1:45:23<27:48:45,  3.49it/s]
  6%|▌         | 21816/371472 [1:45:23<27:24:32,  3.54it/s]
  6%|▌         | 21817/371472 [1:45:24<27:01:52,  3.59it/s]
  6%|▌         | 21818/371472 [1:45:24<28:18:01,  3.43it/s]
  6%|▌         | 21819/371472 [1:45:24<28:09:58,  3.45it/s]
  6%|▌         | 21820/371472 [1:45:25<27:53:16,  3.48it/s]
                                                           
{'loss': 4.7378, 'learning_rate': 9.475909845073153e-07, 'epoch': 0.94}

  6%|▌         | 21820/371472 [1:45:25<27:53:16,  3.48it/s]
  6%|▌         | 21821/371472 [1:45:25<27:57:36,  3.47it/s]
  6%|▌         | 21822/371472 [1:45:25<28:32:35,  3.40it/s]
  6%|▌         | 21823/371472 [1:45:25<27:51:57,  3.49it/s]
  6%|▌         | 21824/371472 [1:45:26<31:24:43,  3.09it/s]
  6%|▌         | 21825/371472 [1:45:26<29:20:39,  3.31it/s]
  6%|▌         | 21826/371472 [1:45:26<29:09:17,  3.33it/s]
  6%|▌         | 21827/371472 [1:45:27<28:31:29,  3.40it/s]
  6%|▌         | 21828/371472 [1:45:27<28:29:05,  3.41it/s]
  6%|▌         | 21829/371472 [1:45:27<28:04:14,  3.46it/s]
  6%|▌         | 21830/371472 [1:45:28<29:59:31,  3.24it/s]
  6%|▌         | 21831/371472 [1:45:28<30:26:44,  3.19it/s]
  6%|▌         | 21832/371472 [1:45:28<30:14:44,  3.21it/s]
  6%|▌         | 21833/371472 [1:45:28<29:13:25,  3.32it/s]
  6%|▌         | 21834/371472 [1:45:29<31:04:26,  3.13it/s]
  6%|▌         | 21835/371472 [1:45:29<29:14:58,  3.32it/s]
  6%|▌         | 21836/371472 [1:45:29<29:06:24,  3.34it/s]
  6%|▌         | 21837/371472 [1:45:30<27:46:48,  3.50it/s]
  6%|▌         | 21838/371472 [1:45:30<27:46:12,  3.50it/s]
  6%|▌         | 21839/371472 [1:45:30<28:16:04,  3.44it/s]
  6%|▌         | 21840/371472 [1:45:30<27:35:02,  3.52it/s]
                                                           
{'loss': 4.3205, 'learning_rate': 9.475425025318365e-07, 'epoch': 0.94}

  6%|▌         | 21840/371472 [1:45:30<27:35:02,  3.52it/s]
  6%|▌         | 21841/371472 [1:45:31<27:22:54,  3.55it/s]
  6%|▌         | 21842/371472 [1:45:31<28:00:10,  3.47it/s]
  6%|▌         | 21843/371472 [1:45:31<27:58:07,  3.47it/s]
  6%|▌         | 21844/371472 [1:45:32<29:08:38,  3.33it/s]
  6%|▌         | 21845/371472 [1:45:32<29:09:23,  3.33it/s]
  6%|▌         | 21846/371472 [1:45:32<27:57:01,  3.47it/s]
  6%|▌         | 21847/371472 [1:45:33<27:52:21,  3.48it/s]
  6%|▌         | 21848/371472 [1:45:33<27:56:42,  3.48it/s]
  6%|▌         | 21849/371472 [1:45:33<27:49:00,  3.49it/s]
  6%|▌         | 21850/371472 [1:45:33<29:02:05,  3.34it/s]
  6%|▌         | 21851/371472 [1:45:34<27:46:32,  3.50it/s]
  6%|▌         | 21852/371472 [1:45:34<27:20:07,  3.55it/s]
  6%|▌         | 21853/371472 [1:45:34<27:10:58,  3.57it/s]
  6%|▌         | 21854/371472 [1:45:35<26:59:57,  3.60it/s]
  6%|▌         | 21855/371472 [1:45:35<27:20:04,  3.55it/s]
  6%|▌         | 21856/371472 [1:45:35<27:54:48,  3.48it/s]
  6%|▌         | 21857/371472 [1:45:35<28:57:24,  3.35it/s]
  6%|▌         | 21858/371472 [1:45:36<28:17:55,  3.43it/s]
  6%|▌         | 21859/371472 [1:45:36<27:24:54,  3.54it/s]
  6%|▌         | 21860/371472 [1:45:36<27:29:01,  3.53it/s]
                                                           
{'loss': 4.6247, 'learning_rate': 9.474940205563575e-07, 'epoch': 0.94}

  6%|▌         | 21860/371472 [1:45:36<27:29:01,  3.53it/s]
  6%|▌         | 21861/371472 [1:45:37<28:08:27,  3.45it/s]
  6%|▌         | 21862/371472 [1:45:37<29:18:37,  3.31it/s]
  6%|▌         | 21863/371472 [1:45:37<29:00:49,  3.35it/s]
  6%|▌         | 21864/371472 [1:45:37<27:42:14,  3.51it/s]
  6%|▌         | 21865/371472 [1:45:38<34:01:09,  2.85it/s]
  6%|▌         | 21866/371472 [1:45:38<31:18:55,  3.10it/s]
  6%|▌         | 21867/371472 [1:45:38<29:41:18,  3.27it/s]
  6%|▌         | 21868/371472 [1:45:39<29:11:54,  3.33it/s]
  6%|▌         | 21869/371472 [1:45:39<29:19:16,  3.31it/s]
  6%|▌         | 21870/371472 [1:45:39<28:44:52,  3.38it/s]
  6%|▌         | 21871/371472 [1:45:40<28:04:40,  3.46it/s]
  6%|▌         | 21872/371472 [1:45:40<27:27:20,  3.54it/s]
  6%|▌         | 21873/371472 [1:45:40<27:05:00,  3.59it/s]
  6%|▌         | 21874/371472 [1:45:40<26:52:14,  3.61it/s]
  6%|▌         | 21875/371472 [1:45:41<26:50:59,  3.62it/s]
  6%|▌         | 21876/371472 [1:45:41<27:58:16,  3.47it/s]
  6%|▌         | 21877/371472 [1:45:41<27:39:10,  3.51it/s]
  6%|▌         | 21878/371472 [1:45:42<27:09:36,  3.58it/s]
  6%|▌         | 21879/371472 [1:45:42<27:10:06,  3.57it/s]
  6%|▌         | 21880/371472 [1:45:42<26:15:01,  3.70it/s]
                                                           
{'loss': 4.4743, 'learning_rate': 9.474455385808787e-07, 'epoch': 0.94}

  6%|▌         | 21880/371472 [1:45:42<26:15:01,  3.70it/s]
  6%|▌         | 21881/371472 [1:45:42<26:15:46,  3.70it/s]
  6%|▌         | 21882/371472 [1:45:43<27:17:42,  3.56it/s]
  6%|▌         | 21883/371472 [1:45:43<26:51:50,  3.61it/s]
  6%|▌         | 21884/371472 [1:45:43<26:46:24,  3.63it/s]
  6%|▌         | 21885/371472 [1:45:43<27:22:35,  3.55it/s]
  6%|▌         | 21886/371472 [1:45:44<27:37:06,  3.52it/s]
  6%|▌         | 21887/371472 [1:45:44<27:27:20,  3.54it/s]
  6%|▌         | 21888/371472 [1:45:44<26:18:51,  3.69it/s]
  6%|▌         | 21889/371472 [1:45:45<26:31:29,  3.66it/s]
  6%|▌         | 21890/371472 [1:45:45<26:13:07,  3.70it/s]
  6%|▌         | 21891/371472 [1:45:45<26:18:37,  3.69it/s]
  6%|▌         | 21892/371472 [1:45:45<27:36:43,  3.52it/s]
  6%|▌         | 21893/371472 [1:45:46<27:35:47,  3.52it/s]
  6%|▌         | 21894/371472 [1:45:46<27:14:36,  3.56it/s]
  6%|▌         | 21895/371472 [1:45:46<26:51:05,  3.62it/s]
  6%|▌         | 21896/371472 [1:45:46<25:59:44,  3.74it/s]
  6%|▌         | 21897/371472 [1:45:47<26:53:47,  3.61it/s]
  6%|▌         | 21898/371472 [1:45:47<27:24:21,  3.54it/s]
  6%|▌         | 21899/371472 [1:45:47<28:55:44,  3.36it/s]
  6%|▌         | 21900/371472 [1:45:48<27:26:13,  3.54it/s]
                                                           
{'loss': 4.5955, 'learning_rate': 9.473970566053997e-07, 'epoch': 0.94}

  6%|▌         | 21900/371472 [1:45:48<27:26:13,  3.54it/s]
  6%|▌         | 21901/371472 [1:45:48<26:24:00,  3.68it/s]
  6%|▌         | 21902/371472 [1:45:48<27:23:12,  3.55it/s]
  6%|▌         | 21903/371472 [1:45:49<27:53:41,  3.48it/s]
  6%|▌         | 21904/371472 [1:45:49<29:07:37,  3.33it/s]
  6%|▌         | 21905/371472 [1:45:49<28:02:12,  3.46it/s]
  6%|▌         | 21906/371472 [1:45:49<26:49:43,  3.62it/s]
  6%|▌         | 21907/371472 [1:45:50<27:05:22,  3.58it/s]
  6%|▌         | 21908/371472 [1:45:50<26:15:55,  3.70it/s]
  6%|▌         | 21909/371472 [1:45:50<25:41:23,  3.78it/s]
  6%|▌         | 21910/371472 [1:45:50<26:59:50,  3.60it/s]
  6%|▌         | 21911/371472 [1:45:51<26:48:05,  3.62it/s]
  6%|▌         | 21912/371472 [1:45:51<28:02:20,  3.46it/s]
  6%|▌         | 21913/371472 [1:45:51<28:04:35,  3.46it/s]
  6%|▌         | 21914/371472 [1:45:52<30:51:50,  3.15it/s]
  6%|▌         | 21915/371472 [1:45:52<30:10:55,  3.22it/s]
  6%|▌         | 21916/371472 [1:45:52<30:50:43,  3.15it/s]
  6%|▌         | 21917/371472 [1:45:53<29:09:26,  3.33it/s]
  6%|▌         | 21918/371472 [1:45:53<28:33:23,  3.40it/s]
  6%|▌         | 21919/371472 [1:45:53<27:53:22,  3.48it/s]
  6%|▌         | 21920/371472 [1:45:53<27:44:11,  3.50it/s]
                                                           
{'loss': 4.4757, 'learning_rate': 9.473485746299209e-07, 'epoch': 0.94}

  6%|▌         | 21920/371472 [1:45:53<27:44:11,  3.50it/s]
  6%|▌         | 21921/371472 [1:45:54<27:19:58,  3.55it/s]
  6%|▌         | 21922/371472 [1:45:54<26:52:05,  3.61it/s]
  6%|▌         | 21923/371472 [1:45:54<26:43:41,  3.63it/s]
  6%|▌         | 21924/371472 [1:45:55<26:33:16,  3.66it/s]
  6%|▌         | 21925/371472 [1:45:55<25:43:05,  3.78it/s]
  6%|▌         | 21926/371472 [1:45:55<26:02:32,  3.73it/s]
  6%|▌         | 21927/371472 [1:45:55<27:34:26,  3.52it/s]
  6%|▌         | 21928/371472 [1:45:56<28:16:27,  3.43it/s]
  6%|▌         | 21929/371472 [1:45:56<28:00:33,  3.47it/s]
  6%|▌         | 21930/371472 [1:45:56<28:00:25,  3.47it/s]
  6%|▌         | 21931/371472 [1:45:57<28:11:28,  3.44it/s]
  6%|▌         | 21932/371472 [1:45:57<27:25:49,  3.54it/s]
  6%|▌         | 21933/371472 [1:45:57<28:30:34,  3.41it/s]
  6%|▌         | 21934/371472 [1:45:57<29:15:57,  3.32it/s]
  6%|▌         | 21935/371472 [1:45:58<28:26:02,  3.41it/s]
  6%|▌         | 21936/371472 [1:45:58<28:23:56,  3.42it/s]
  6%|▌         | 21937/371472 [1:45:58<27:57:25,  3.47it/s]
  6%|▌         | 21938/371472 [1:45:59<27:34:36,  3.52it/s]
  6%|▌         | 21939/371472 [1:45:59<27:51:01,  3.49it/s]
  6%|▌         | 21940/371472 [1:45:59<27:32:23,  3.53it/s]
                                                           
{'loss': 4.6824, 'learning_rate': 9.473000926544419e-07, 'epoch': 0.94}

  6%|▌         | 21940/371472 [1:45:59<27:32:23,  3.53it/s]
  6%|▌         | 21941/371472 [1:45:59<26:28:59,  3.67it/s]
  6%|▌         | 21942/371472 [1:46:00<26:15:01,  3.70it/s]
  6%|▌         | 21943/371472 [1:46:00<28:05:12,  3.46it/s]
  6%|▌         | 21944/371472 [1:46:00<27:57:39,  3.47it/s]
  6%|▌         | 21945/371472 [1:46:01<28:26:13,  3.41it/s]
  6%|▌         | 21946/371472 [1:46:01<28:45:42,  3.38it/s]
  6%|▌         | 21947/371472 [1:46:01<29:09:05,  3.33it/s]
  6%|▌         | 21948/371472 [1:46:01<28:33:35,  3.40it/s]
  6%|▌         | 21949/371472 [1:46:02<29:29:17,  3.29it/s]
  6%|▌         | 21950/371472 [1:46:02<28:13:55,  3.44it/s]
  6%|▌         | 21951/371472 [1:46:02<27:03:07,  3.59it/s]
  6%|▌         | 21952/371472 [1:46:03<26:40:41,  3.64it/s]
  6%|▌         | 21953/371472 [1:46:03<27:16:10,  3.56it/s]
  6%|▌         | 21954/371472 [1:46:03<27:58:36,  3.47it/s]
  6%|▌         | 21955/371472 [1:46:03<28:18:23,  3.43it/s]
  6%|▌         | 21956/371472 [1:46:04<27:58:17,  3.47it/s]
  6%|▌         | 21957/371472 [1:46:04<27:49:51,  3.49it/s]
  6%|▌         | 21958/371472 [1:46:04<27:42:03,  3.50it/s]
  6%|▌         | 21959/371472 [1:46:05<26:56:46,  3.60it/s]
  6%|▌         | 21960/371472 [1:46:05<26:35:43,  3.65it/s]
                                                           
{'loss': 4.4245, 'learning_rate': 9.472516106789631e-07, 'epoch': 0.95}

  6%|▌         | 21960/371472 [1:46:05<26:35:43,  3.65it/s]
  6%|▌         | 21961/371472 [1:46:05<26:05:47,  3.72it/s]
  6%|▌         | 21962/371472 [1:46:05<26:29:44,  3.66it/s]
  6%|▌         | 21963/371472 [1:46:06<25:45:44,  3.77it/s]
  6%|▌         | 21964/371472 [1:46:06<26:29:03,  3.67it/s]
  6%|▌         | 21965/371472 [1:46:06<27:09:34,  3.57it/s]
  6%|▌         | 21966/371472 [1:46:06<27:41:29,  3.51it/s]
  6%|▌         | 21967/371472 [1:46:07<27:43:18,  3.50it/s]
  6%|▌         | 21968/371472 [1:46:07<28:07:20,  3.45it/s]
  6%|▌         | 21969/371472 [1:46:07<27:52:36,  3.48it/s]
  6%|▌         | 21970/371472 [1:46:08<26:51:07,  3.62it/s]
  6%|▌         | 21971/371472 [1:46:08<26:48:56,  3.62it/s]
  6%|▌         | 21972/371472 [1:46:08<27:57:20,  3.47it/s]
  6%|▌         | 21973/371472 [1:46:08<27:59:25,  3.47it/s]
  6%|▌         | 21974/371472 [1:46:09<28:09:19,  3.45it/s]
  6%|▌         | 21975/371472 [1:46:09<27:38:44,  3.51it/s]
  6%|▌         | 21976/371472 [1:46:09<27:11:25,  3.57it/s]
  6%|▌         | 21977/371472 [1:46:10<27:15:54,  3.56it/s]
  6%|▌         | 21978/371472 [1:46:10<27:03:26,  3.59it/s]
  6%|▌         | 21979/371472 [1:46:10<26:05:25,  3.72it/s]
  6%|▌         | 21980/371472 [1:46:10<26:14:19,  3.70it/s]
                                                           
{'loss': 4.7057, 'learning_rate': 9.472031287034842e-07, 'epoch': 0.95}

  6%|▌         | 21980/371472 [1:46:10<26:14:19,  3.70it/s]
  6%|▌         | 21981/371472 [1:46:11<26:44:06,  3.63it/s]
  6%|▌         | 21982/371472 [1:46:11<28:16:26,  3.43it/s]
  6%|▌         | 21983/371472 [1:46:11<27:54:15,  3.48it/s]
  6%|▌         | 21984/371472 [1:46:12<27:02:58,  3.59it/s]
  6%|▌         | 21985/371472 [1:46:12<28:49:32,  3.37it/s]
  6%|▌         | 21986/371472 [1:46:12<28:19:35,  3.43it/s]
  6%|▌         | 21987/371472 [1:46:12<28:22:26,  3.42it/s]
  6%|▌         | 21988/371472 [1:46:13<28:56:10,  3.35it/s]
  6%|▌         | 21989/371472 [1:46:13<27:55:54,  3.48it/s]
  6%|▌         | 21990/371472 [1:46:13<28:21:29,  3.42it/s]
  6%|▌         | 21991/371472 [1:46:14<30:06:05,  3.23it/s]
  6%|▌         | 21992/371472 [1:46:14<31:15:49,  3.11it/s]
  6%|▌         | 21993/371472 [1:46:14<31:49:19,  3.05it/s]
  6%|▌         | 21994/371472 [1:46:15<31:42:19,  3.06it/s]
  6%|▌         | 21995/371472 [1:46:15<31:35:19,  3.07it/s]
  6%|▌         | 21996/371472 [1:46:15<31:06:39,  3.12it/s]
  6%|▌         | 21997/371472 [1:46:16<30:19:33,  3.20it/s]
  6%|▌         | 21998/371472 [1:46:16<28:53:03,  3.36it/s]
  6%|▌         | 21999/371472 [1:46:16<27:38:14,  3.51it/s]
  6%|▌         | 22000/371472 [1:46:17<30:06:10,  3.22it/s]
                                                           
{'loss': 4.2502, 'learning_rate': 9.471546467280054e-07, 'epoch': 0.95}

  6%|▌         | 22000/371472 [1:46:17<30:06:10,  3.22it/s]
  6%|▌         | 22001/371472 [1:46:17<29:28:05,  3.29it/s]
  6%|▌         | 22002/371472 [1:46:17<30:52:41,  3.14it/s]
  6%|▌         | 22003/371472 [1:46:17<30:03:46,  3.23it/s]
  6%|▌         | 22004/371472 [1:46:18<30:45:12,  3.16it/s]
  6%|▌         | 22005/371472 [1:46:18<32:32:03,  2.98it/s]
  6%|▌         | 22006/371472 [1:46:18<32:02:48,  3.03it/s]
  6%|▌         | 22007/371472 [1:46:19<30:51:52,  3.15it/s]
  6%|▌         | 22008/371472 [1:46:19<29:23:51,  3.30it/s]
  6%|▌         | 22009/371472 [1:46:19<28:04:46,  3.46it/s]
  6%|▌         | 22010/371472 [1:46:20<28:36:48,  3.39it/s]
  6%|▌         | 22011/371472 [1:46:20<29:31:56,  3.29it/s]
  6%|▌         | 22012/371472 [1:46:20<28:14:17,  3.44it/s]
  6%|▌         | 22013/371472 [1:46:20<28:21:59,  3.42it/s]
  6%|▌         | 22014/371472 [1:46:21<28:11:11,  3.44it/s]
  6%|▌         | 22015/371472 [1:46:21<28:04:47,  3.46it/s]
  6%|▌         | 22016/371472 [1:46:21<29:14:24,  3.32it/s]
  6%|▌         | 22017/371472 [1:46:22<29:02:28,  3.34it/s]
  6%|▌         | 22018/371472 [1:46:22<28:08:50,  3.45it/s]
  6%|▌         | 22019/371472 [1:46:22<28:59:03,  3.35it/s]
  6%|▌         | 22020/371472 [1:46:23<28:20:55,  3.42it/s]
                                                           
{'loss': 4.4566, 'learning_rate': 9.471061647525264e-07, 'epoch': 0.95}

  6%|▌         | 22020/371472 [1:46:23<28:20:55,  3.42it/s]
  6%|▌         | 22021/371472 [1:46:23<27:22:45,  3.55it/s]
  6%|▌         | 22022/371472 [1:46:23<26:58:44,  3.60it/s]
  6%|▌         | 22023/371472 [1:46:23<27:43:07,  3.50it/s]
  6%|▌         | 22024/371472 [1:46:24<27:49:43,  3.49it/s]
  6%|▌         | 22025/371472 [1:46:24<27:02:15,  3.59it/s]
  6%|▌         | 22026/371472 [1:46:24<28:42:49,  3.38it/s]
  6%|▌         | 22027/371472 [1:46:25<31:04:30,  3.12it/s]
  6%|▌         | 22028/371472 [1:46:25<30:23:36,  3.19it/s]
  6%|▌         | 22029/371472 [1:46:25<31:43:43,  3.06it/s]
  6%|▌         | 22030/371472 [1:46:26<30:58:27,  3.13it/s]
  6%|▌         | 22031/371472 [1:46:26<29:44:45,  3.26it/s]
  6%|▌         | 22032/371472 [1:46:26<29:20:00,  3.31it/s]
  6%|▌         | 22033/371472 [1:46:26<28:30:47,  3.40it/s]
  6%|▌         | 22034/371472 [1:46:27<29:35:26,  3.28it/s]
  6%|▌         | 22035/371472 [1:46:27<29:35:17,  3.28it/s]
  6%|▌         | 22036/371472 [1:46:27<29:35:05,  3.28it/s]
  6%|▌         | 22037/371472 [1:46:28<29:01:36,  3.34it/s]
  6%|▌         | 22038/371472 [1:46:28<29:33:02,  3.28it/s]
  6%|▌         | 22039/371472 [1:46:28<29:18:22,  3.31it/s]
  6%|▌         | 22040/371472 [1:46:29<30:48:46,  3.15it/s]
                                                           
{'loss': 4.3403, 'learning_rate': 9.470576827770474e-07, 'epoch': 0.95}

  6%|▌         | 22040/371472 [1:46:29<30:48:46,  3.15it/s]
  6%|▌         | 22041/371472 [1:46:29<29:10:36,  3.33it/s]
  6%|▌         | 22042/371472 [1:46:29<28:48:37,  3.37it/s]
  6%|▌         | 22043/371472 [1:46:29<28:18:18,  3.43it/s]
  6%|▌         | 22044/371472 [1:46:30<28:34:26,  3.40it/s]
  6%|▌         | 22045/371472 [1:46:30<27:26:43,  3.54it/s]
  6%|▌         | 22046/371472 [1:46:30<27:25:20,  3.54it/s]
  6%|▌         | 22047/371472 [1:46:31<27:05:54,  3.58it/s]
  6%|▌         | 22048/371472 [1:46:31<26:48:22,  3.62it/s]
  6%|▌         | 22049/371472 [1:46:31<26:36:50,  3.65it/s]
  6%|▌         | 22050/371472 [1:46:31<26:23:37,  3.68it/s]
  6%|▌         | 22051/371472 [1:46:32<26:02:14,  3.73it/s]
  6%|▌         | 22052/371472 [1:46:32<27:08:31,  3.58it/s]
  6%|▌         | 22053/371472 [1:46:32<26:10:42,  3.71it/s]
  6%|▌         | 22054/371472 [1:46:32<25:54:36,  3.75it/s]
  6%|▌         | 22055/371472 [1:46:33<27:48:47,  3.49it/s]
  6%|▌         | 22056/371472 [1:46:33<29:02:47,  3.34it/s]
  6%|▌         | 22057/371472 [1:46:33<28:20:00,  3.43it/s]
  6%|▌         | 22058/371472 [1:46:34<27:51:29,  3.48it/s]
  6%|▌         | 22059/371472 [1:46:34<27:13:14,  3.57it/s]
  6%|▌         | 22060/371472 [1:46:34<26:49:36,  3.62it/s]
                                                           
{'loss': 4.7907, 'learning_rate': 9.470092008015686e-07, 'epoch': 0.95}

  6%|▌         | 22060/371472 [1:46:34<26:49:36,  3.62it/s]
  6%|▌         | 22061/371472 [1:46:34<27:06:56,  3.58it/s]
  6%|▌         | 22062/371472 [1:46:35<27:05:28,  3.58it/s]
  6%|▌         | 22063/371472 [1:46:35<26:06:22,  3.72it/s]
  6%|▌         | 22064/371472 [1:46:35<26:12:32,  3.70it/s]
  6%|▌         | 22065/371472 [1:46:36<26:50:26,  3.62it/s]
  6%|▌         | 22066/371472 [1:46:36<26:43:18,  3.63it/s]
  6%|▌         | 22067/371472 [1:46:36<27:09:46,  3.57it/s]
  6%|▌         | 22068/371472 [1:46:36<27:42:02,  3.50it/s]
  6%|▌         | 22069/371472 [1:46:37<26:59:46,  3.60it/s]
  6%|▌         | 22070/371472 [1:46:37<27:03:19,  3.59it/s]
  6%|▌         | 22071/371472 [1:46:37<27:09:58,  3.57it/s]
  6%|▌         | 22072/371472 [1:46:38<28:51:48,  3.36it/s]
  6%|▌         | 22073/371472 [1:46:38<28:14:24,  3.44it/s]
  6%|▌         | 22074/371472 [1:46:38<29:21:14,  3.31it/s]
  6%|▌         | 22075/371472 [1:46:39<29:41:37,  3.27it/s]
  6%|▌         | 22076/371472 [1:46:39<29:00:15,  3.35it/s]
  6%|▌         | 22077/371472 [1:46:39<27:22:09,  3.55it/s]
  6%|▌         | 22078/371472 [1:46:39<26:59:57,  3.59it/s]
  6%|▌         | 22079/371472 [1:46:40<26:29:25,  3.66it/s]
  6%|▌         | 22080/371472 [1:46:40<28:52:46,  3.36it/s]
                                                           
{'loss': 4.5686, 'learning_rate': 9.469607188260898e-07, 'epoch': 0.95}

  6%|▌         | 22080/371472 [1:46:40<28:52:46,  3.36it/s]
  6%|▌         | 22081/371472 [1:46:40<28:16:01,  3.43it/s]
  6%|▌         | 22082/371472 [1:46:41<29:41:08,  3.27it/s]
  6%|▌         | 22083/371472 [1:46:41<29:13:54,  3.32it/s]
  6%|▌         | 22084/371472 [1:46:41<28:46:50,  3.37it/s]
  6%|▌         | 22085/371472 [1:46:41<27:38:45,  3.51it/s]
  6%|▌         | 22086/371472 [1:46:42<28:54:09,  3.36it/s]
  6%|▌         | 22087/371472 [1:46:42<28:57:52,  3.35it/s]
  6%|▌         | 22088/371472 [1:46:42<30:50:03,  3.15it/s]
  6%|▌         | 22089/371472 [1:46:43<31:05:21,  3.12it/s]
  6%|▌         | 22090/371472 [1:46:43<31:12:34,  3.11it/s]
  6%|▌         | 22091/371472 [1:46:43<30:39:27,  3.17it/s]
  6%|▌         | 22092/371472 [1:46:44<29:34:48,  3.28it/s]
  6%|▌         | 22093/371472 [1:46:44<29:58:16,  3.24it/s]
  6%|▌         | 22094/371472 [1:46:44<28:34:35,  3.40it/s]
  6%|▌         | 22095/371472 [1:46:44<29:04:36,  3.34it/s]
  6%|▌         | 22096/371472 [1:46:45<28:20:14,  3.42it/s]
  6%|▌         | 22097/371472 [1:46:45<33:08:30,  2.93it/s]
  6%|▌         | 22098/371472 [1:46:46<32:02:10,  3.03it/s]
  6%|▌         | 22099/371472 [1:46:46<29:57:30,  3.24it/s]
  6%|▌         | 22100/371472 [1:46:46<28:12:41,  3.44it/s]
                                                           
{'loss': 4.4133, 'learning_rate': 9.469122368506108e-07, 'epoch': 0.95}

  6%|▌         | 22100/371472 [1:46:46<28:12:41,  3.44it/s]
  6%|▌         | 22101/371472 [1:46:46<29:35:04,  3.28it/s]
  6%|▌         | 22102/371472 [1:46:47<30:49:52,  3.15it/s]
  6%|▌         | 22103/371472 [1:46:47<29:16:43,  3.31it/s]
  6%|▌         | 22104/371472 [1:46:47<31:00:56,  3.13it/s]
  6%|▌         | 22105/371472 [1:46:48<29:51:22,  3.25it/s]
  6%|▌         | 22106/371472 [1:46:48<29:21:17,  3.31it/s]
  6%|▌         | 22107/371472 [1:46:48<29:53:04,  3.25it/s]
  6%|▌         | 22108/371472 [1:46:49<28:38:14,  3.39it/s]
  6%|▌         | 22109/371472 [1:46:49<27:59:20,  3.47it/s]
  6%|▌         | 22110/371472 [1:46:49<29:11:37,  3.32it/s]
  6%|▌         | 22111/371472 [1:46:49<29:20:41,  3.31it/s]
  6%|▌         | 22112/371472 [1:46:50<28:26:36,  3.41it/s]
  6%|▌         | 22113/371472 [1:46:50<27:27:26,  3.53it/s]
  6%|▌         | 22114/371472 [1:46:50<27:40:21,  3.51it/s]
  6%|▌         | 22115/371472 [1:46:51<27:53:58,  3.48it/s]
  6%|▌         | 22116/371472 [1:46:51<28:19:13,  3.43it/s]
  6%|▌         | 22117/371472 [1:46:51<27:36:31,  3.51it/s]
  6%|▌         | 22118/371472 [1:46:51<26:50:59,  3.61it/s]
  6%|▌         | 22119/371472 [1:46:52<26:17:33,  3.69it/s]
  6%|▌         | 22120/371472 [1:46:52<26:57:22,  3.60it/s]
                                                           
{'loss': 4.5255, 'learning_rate': 9.46863754875132e-07, 'epoch': 0.95}

  6%|▌         | 22120/371472 [1:46:52<26:57:22,  3.60it/s]
  6%|▌         | 22121/371472 [1:46:52<26:09:18,  3.71it/s]
  6%|▌         | 22122/371472 [1:46:52<27:17:04,  3.56it/s]
  6%|▌         | 22123/371472 [1:46:53<27:51:57,  3.48it/s]
  6%|▌         | 22124/371472 [1:46:53<27:15:31,  3.56it/s]
  6%|▌         | 22125/371472 [1:46:53<29:04:56,  3.34it/s]
  6%|▌         | 22126/371472 [1:46:54<27:36:08,  3.52it/s]
  6%|▌         | 22127/371472 [1:46:54<27:18:16,  3.55it/s]
  6%|▌         | 22128/371472 [1:46:54<26:48:31,  3.62it/s]
  6%|▌         | 22129/371472 [1:46:54<27:11:51,  3.57it/s]
  6%|▌         | 22130/371472 [1:46:55<26:23:04,  3.68it/s]
  6%|▌         | 22131/371472 [1:46:55<27:50:39,  3.49it/s]
  6%|▌         | 22132/371472 [1:46:55<28:16:12,  3.43it/s]
  6%|▌         | 22133/371472 [1:46:56<28:11:17,  3.44it/s]
  6%|▌         | 22134/371472 [1:46:56<27:48:11,  3.49it/s]
  6%|▌         | 22135/371472 [1:46:56<28:03:59,  3.46it/s]
  6%|▌         | 22136/371472 [1:46:56<27:33:27,  3.52it/s]
  6%|▌         | 22137/371472 [1:46:57<30:25:23,  3.19it/s]
  6%|▌         | 22138/371472 [1:46:57<29:23:27,  3.30it/s]
  6%|▌         | 22139/371472 [1:46:57<27:46:34,  3.49it/s]
  6%|▌         | 22140/371472 [1:46:58<29:12:24,  3.32it/s]
                                                           
{'loss': 4.5422, 'learning_rate': 9.468152728996532e-07, 'epoch': 0.95}

  6%|▌         | 22140/371472 [1:46:58<29:12:24,  3.32it/s]
  6%|▌         | 22141/371472 [1:46:58<29:50:30,  3.25it/s]
  6%|▌         | 22142/371472 [1:46:58<28:37:09,  3.39it/s]
  6%|▌         | 22143/371472 [1:46:59<27:45:29,  3.50it/s]
  6%|▌         | 22144/371472 [1:46:59<27:15:07,  3.56it/s]
  6%|▌         | 22145/371472 [1:46:59<27:13:34,  3.56it/s]
  6%|▌         | 22146/371472 [1:46:59<26:33:38,  3.65it/s]
  6%|▌         | 22147/371472 [1:47:00<26:53:25,  3.61it/s]
  6%|▌         | 22148/371472 [1:47:00<27:54:54,  3.48it/s]
  6%|▌         | 22149/371472 [1:47:00<27:01:00,  3.59it/s]
  6%|▌         | 22150/371472 [1:47:01<27:10:36,  3.57it/s]
  6%|▌         | 22151/371472 [1:47:01<27:14:39,  3.56it/s]
  6%|▌         | 22152/371472 [1:47:01<27:38:03,  3.51it/s]
  6%|▌         | 22153/371472 [1:47:01<27:48:45,  3.49it/s]
  6%|▌         | 22154/371472 [1:47:02<28:05:11,  3.45it/s]
  6%|▌         | 22155/371472 [1:47:02<28:41:30,  3.38it/s]
  6%|▌         | 22156/371472 [1:47:02<28:14:30,  3.44it/s]
  6%|▌         | 22157/371472 [1:47:03<27:35:57,  3.52it/s]
  6%|▌         | 22158/371472 [1:47:03<26:37:10,  3.65it/s]
  6%|▌         | 22159/371472 [1:47:03<25:53:53,  3.75it/s]
  6%|▌         | 22160/371472 [1:47:03<26:38:34,  3.64it/s]
                                                           
{'loss': 4.4569, 'learning_rate': 9.467667909241741e-07, 'epoch': 0.95}

  6%|▌         | 22160/371472 [1:47:03<26:38:34,  3.64it/s]
  6%|▌         | 22161/371472 [1:47:04<27:09:00,  3.57it/s]
  6%|▌         | 22162/371472 [1:47:04<27:40:42,  3.51it/s]
  6%|▌         | 22163/371472 [1:47:04<29:02:24,  3.34it/s]
  6%|▌         | 22164/371472 [1:47:05<29:52:50,  3.25it/s]
  6%|▌         | 22165/371472 [1:47:05<29:43:53,  3.26it/s]
  6%|▌         | 22166/371472 [1:47:05<28:58:54,  3.35it/s]
  6%|▌         | 22167/371472 [1:47:05<29:17:59,  3.31it/s]
  6%|▌         | 22168/371472 [1:47:06<28:12:18,  3.44it/s]
  6%|▌         | 22169/371472 [1:47:06<27:27:48,  3.53it/s]
  6%|▌         | 22170/371472 [1:47:06<26:48:35,  3.62it/s]
  6%|▌         | 22171/371472 [1:47:07<27:05:26,  3.58it/s]
  6%|▌         | 22172/371472 [1:47:07<27:03:09,  3.59it/s]
  6%|▌         | 22173/371472 [1:47:07<26:20:01,  3.68it/s]
  6%|▌         | 22174/371472 [1:47:07<26:36:28,  3.65it/s]
  6%|▌         | 22175/371472 [1:47:08<26:20:33,  3.68it/s]
  6%|▌         | 22176/371472 [1:47:08<26:03:38,  3.72it/s]
  6%|▌         | 22177/371472 [1:47:08<26:15:33,  3.69it/s]
  6%|▌         | 22178/371472 [1:47:08<26:22:20,  3.68it/s]
  6%|▌         | 22179/371472 [1:47:09<27:06:13,  3.58it/s]
  6%|▌         | 22180/371472 [1:47:09<31:04:28,  3.12it/s]
                                                           
{'loss': 4.7992, 'learning_rate': 9.467183089486952e-07, 'epoch': 0.96}

  6%|▌         | 22180/371472 [1:47:09<31:04:28,  3.12it/s]
  6%|▌         | 22181/371472 [1:47:09<30:26:21,  3.19it/s]
  6%|▌         | 22182/371472 [1:47:10<29:44:19,  3.26it/s]
  6%|▌         | 22183/371472 [1:47:10<29:23:59,  3.30it/s]
  6%|▌         | 22184/371472 [1:47:10<28:28:18,  3.41it/s]
  6%|▌         | 22185/371472 [1:47:11<28:12:07,  3.44it/s]
  6%|▌         | 22186/371472 [1:47:11<27:26:04,  3.54it/s]
  6%|▌         | 22187/371472 [1:47:11<28:31:05,  3.40it/s]
  6%|▌         | 22188/371472 [1:47:11<27:01:47,  3.59it/s]
  6%|▌         | 22189/371472 [1:47:12<26:35:28,  3.65it/s]
  6%|▌         | 22190/371472 [1:47:12<27:37:22,  3.51it/s]
  6%|▌         | 22191/371472 [1:47:12<27:06:02,  3.58it/s]
  6%|▌         | 22192/371472 [1:47:13<29:14:45,  3.32it/s]
  6%|▌         | 22193/371472 [1:47:13<28:17:32,  3.43it/s]
  6%|▌         | 22194/371472 [1:47:13<31:31:36,  3.08it/s]
  6%|▌         | 22195/371472 [1:47:14<29:51:03,  3.25it/s]
  6%|▌         | 22196/371472 [1:47:14<28:32:49,  3.40it/s]
  6%|▌         | 22197/371472 [1:47:14<32:36:33,  2.98it/s]
  6%|▌         | 22198/371472 [1:47:15<31:44:08,  3.06it/s]
  6%|▌         | 22199/371472 [1:47:15<30:05:03,  3.22it/s]
  6%|▌         | 22200/371472 [1:47:15<29:08:15,  3.33it/s]
                                                           
{'loss': 4.4247, 'learning_rate': 9.466698269732164e-07, 'epoch': 0.96}

  6%|▌         | 22200/371472 [1:47:15<29:08:15,  3.33it/s]
  6%|▌         | 22201/371472 [1:47:15<29:44:05,  3.26it/s]
  6%|▌         | 22202/371472 [1:47:16<29:07:05,  3.33it/s]
  6%|▌         | 22203/371472 [1:47:16<28:31:39,  3.40it/s]
  6%|▌         | 22204/371472 [1:47:16<28:26:45,  3.41it/s]
  6%|▌         | 22205/371472 [1:47:17<27:10:46,  3.57it/s]
  6%|▌         | 22206/371472 [1:47:17<26:42:36,  3.63it/s]
  6%|▌         | 22207/371472 [1:47:17<25:50:17,  3.75it/s]
  6%|▌         | 22208/371472 [1:47:17<26:07:23,  3.71it/s]
  6%|▌         | 22209/371472 [1:47:18<25:54:12,  3.75it/s]
  6%|▌         | 22210/371472 [1:47:18<26:02:33,  3.73it/s]
  6%|▌         | 22211/371472 [1:47:18<27:42:08,  3.50it/s]
  6%|▌         | 22212/371472 [1:47:18<26:29:45,  3.66it/s]
  6%|▌         | 22213/371472 [1:47:19<26:17:44,  3.69it/s]
  6%|▌         | 22214/371472 [1:47:19<27:56:47,  3.47it/s]
  6%|▌         | 22215/371472 [1:47:19<30:33:15,  3.18it/s]
  6%|▌         | 22216/371472 [1:47:20<28:39:59,  3.38it/s]
  6%|▌         | 22217/371472 [1:47:20<28:35:18,  3.39it/s]
  6%|▌         | 22218/371472 [1:47:20<27:39:13,  3.51it/s]
  6%|▌         | 22219/371472 [1:47:20<27:34:02,  3.52it/s]
  6%|▌         | 22220/371472 [1:47:21<26:42:21,  3.63it/s]
                                                           
{'loss': 4.6975, 'learning_rate': 9.466213449977375e-07, 'epoch': 0.96}

  6%|▌         | 22220/371472 [1:47:21<26:42:21,  3.63it/s]
  6%|▌         | 22221/371472 [1:47:21<26:34:17,  3.65it/s]
  6%|▌         | 22222/371472 [1:47:21<26:08:08,  3.71it/s]
  6%|▌         | 22223/371472 [1:47:22<26:08:51,  3.71it/s]
  6%|▌         | 22224/371472 [1:47:22<27:48:40,  3.49it/s]
  6%|▌         | 22225/371472 [1:47:22<27:55:01,  3.48it/s]
  6%|▌         | 22226/371472 [1:47:22<27:43:19,  3.50it/s]
  6%|▌         | 22227/371472 [1:47:23<27:21:02,  3.55it/s]
  6%|▌         | 22228/371472 [1:47:23<26:49:45,  3.62it/s]
  6%|▌         | 22229/371472 [1:47:23<26:18:17,  3.69it/s]
  6%|▌         | 22230/371472 [1:47:23<26:09:53,  3.71it/s]
  6%|▌         | 22231/371472 [1:47:24<25:40:50,  3.78it/s]
  6%|▌         | 22232/371472 [1:47:24<26:07:10,  3.71it/s]
  6%|▌         | 22233/371472 [1:47:24<26:15:12,  3.70it/s]
  6%|▌         | 22234/371472 [1:47:25<26:26:31,  3.67it/s]
  6%|▌         | 22235/371472 [1:47:25<25:49:34,  3.76it/s]
  6%|▌         | 22236/371472 [1:47:25<25:25:18,  3.82it/s]
  6%|▌         | 22237/371472 [1:47:25<28:09:40,  3.44it/s]
  6%|▌         | 22238/371472 [1:47:26<27:58:37,  3.47it/s]
  6%|▌         | 22239/371472 [1:47:26<27:08:00,  3.58it/s]
  6%|▌         | 22240/371472 [1:47:26<27:10:05,  3.57it/s]
                                                           
{'loss': 4.6951, 'learning_rate': 9.465728630222586e-07, 'epoch': 0.96}

  6%|▌         | 22240/371472 [1:47:26<27:10:05,  3.57it/s]
  6%|▌         | 22241/371472 [1:47:27<28:38:18,  3.39it/s]
  6%|▌         | 22242/371472 [1:47:27<30:03:31,  3.23it/s]
  6%|▌         | 22243/371472 [1:47:27<28:42:53,  3.38it/s]
  6%|▌         | 22244/371472 [1:47:28<29:49:06,  3.25it/s]
  6%|▌         | 22245/371472 [1:47:28<29:15:33,  3.32it/s]
  6%|▌         | 22246/371472 [1:47:28<32:39:22,  2.97it/s]
  6%|▌         | 22247/371472 [1:47:28<30:39:40,  3.16it/s]
  6%|▌         | 22248/371472 [1:47:29<32:41:35,  2.97it/s]
  6%|▌         | 22249/371472 [1:47:29<31:02:30,  3.13it/s]
  6%|▌         | 22250/371472 [1:47:29<28:47:42,  3.37it/s]
  6%|▌         | 22251/371472 [1:47:30<29:54:29,  3.24it/s]
  6%|▌         | 22252/371472 [1:47:30<29:13:39,  3.32it/s]
  6%|▌         | 22253/371472 [1:47:30<28:22:31,  3.42it/s]
  6%|▌         | 22254/371472 [1:47:31<30:15:24,  3.21it/s]
  6%|▌         | 22255/371472 [1:47:31<29:40:54,  3.27it/s]
  6%|▌         | 22256/371472 [1:47:31<29:15:26,  3.32it/s]
  6%|▌         | 22257/371472 [1:47:31<28:00:04,  3.46it/s]
  6%|▌         | 22258/371472 [1:47:32<27:52:14,  3.48it/s]
  6%|▌         | 22259/371472 [1:47:32<27:32:55,  3.52it/s]
  6%|▌         | 22260/371472 [1:47:32<28:57:33,  3.35it/s]
                                                           
{'loss': 4.6245, 'learning_rate': 9.465243810467797e-07, 'epoch': 0.96}

  6%|▌         | 22260/371472 [1:47:32<28:57:33,  3.35it/s]
  6%|▌         | 22261/371472 [1:47:33<28:05:54,  3.45it/s]
  6%|▌         | 22262/371472 [1:47:33<27:16:27,  3.56it/s]
  6%|▌         | 22263/371472 [1:47:33<28:29:56,  3.40it/s]
  6%|▌         | 22264/371472 [1:47:34<27:48:44,  3.49it/s]
  6%|▌         | 22265/371472 [1:47:34<27:10:35,  3.57it/s]
  6%|▌         | 22266/371472 [1:47:34<26:37:02,  3.64it/s]
  6%|▌         | 22267/371472 [1:47:34<26:52:16,  3.61it/s]
  6%|▌         | 22268/371472 [1:47:35<26:45:38,  3.62it/s]
  6%|▌         | 22269/371472 [1:47:35<26:36:00,  3.65it/s]
  6%|▌         | 22270/371472 [1:47:35<26:50:40,  3.61it/s]
  6%|▌         | 22271/371472 [1:47:35<26:18:31,  3.69it/s]
  6%|▌         | 22272/371472 [1:47:36<26:28:43,  3.66it/s]
  6%|▌         | 22273/371472 [1:47:36<27:45:29,  3.49it/s]
  6%|▌         | 22274/371472 [1:47:36<29:20:52,  3.31it/s]
  6%|▌         | 22275/371472 [1:47:37<28:44:34,  3.37it/s]
  6%|▌         | 22276/371472 [1:47:37<27:50:15,  3.48it/s]
  6%|▌         | 22277/371472 [1:47:37<27:01:13,  3.59it/s]
  6%|▌         | 22278/371472 [1:47:37<26:00:46,  3.73it/s]
  6%|▌         | 22279/371472 [1:47:38<26:11:29,  3.70it/s]
  6%|▌         | 22280/371472 [1:47:38<27:33:17,  3.52it/s]
                                                           
{'loss': 4.4001, 'learning_rate': 9.464758990713008e-07, 'epoch': 0.96}

  6%|▌         | 22280/371472 [1:47:38<27:33:17,  3.52it/s]
  6%|▌         | 22281/371472 [1:47:38<26:55:41,  3.60it/s]
  6%|▌         | 22282/371472 [1:47:39<28:41:44,  3.38it/s]
  6%|▌         | 22283/371472 [1:47:39<30:04:38,  3.22it/s]
  6%|▌         | 22284/371472 [1:47:39<29:18:31,  3.31it/s]
  6%|▌         | 22285/371472 [1:47:40<29:25:40,  3.30it/s]
  6%|▌         | 22286/371472 [1:47:40<29:24:47,  3.30it/s]
  6%|▌         | 22287/371472 [1:47:40<28:19:35,  3.42it/s]
  6%|▌         | 22288/371472 [1:47:40<27:38:17,  3.51it/s]
  6%|▌         | 22289/371472 [1:47:41<27:10:32,  3.57it/s]
  6%|▌         | 22290/371472 [1:47:41<26:41:29,  3.63it/s]
  6%|▌         | 22291/371472 [1:47:41<26:27:38,  3.67it/s]
  6%|▌         | 22292/371472 [1:47:41<26:47:21,  3.62it/s]
  6%|▌         | 22293/371472 [1:47:42<28:01:45,  3.46it/s]
  6%|▌         | 22294/371472 [1:47:42<26:45:01,  3.63it/s]
  6%|▌         | 22295/371472 [1:47:42<27:42:14,  3.50it/s]
  6%|▌         | 22296/371472 [1:47:43<26:58:58,  3.59it/s]
  6%|▌         | 22297/371472 [1:47:43<28:42:59,  3.38it/s]
  6%|▌         | 22298/371472 [1:47:43<28:34:28,  3.39it/s]
  6%|▌         | 22299/371472 [1:47:43<28:04:28,  3.45it/s]
  6%|▌         | 22300/371472 [1:47:44<27:21:24,  3.55it/s]
                                                           
{'loss': 4.4475, 'learning_rate': 9.464274170958219e-07, 'epoch': 0.96}

  6%|▌         | 22300/371472 [1:47:44<27:21:24,  3.55it/s]
  6%|▌         | 22301/371472 [1:47:44<29:26:42,  3.29it/s]
  6%|▌         | 22302/371472 [1:47:44<28:39:07,  3.39it/s]
  6%|▌         | 22303/371472 [1:47:45<28:39:35,  3.38it/s]
  6%|▌         | 22304/371472 [1:47:45<27:00:51,  3.59it/s]
  6%|▌         | 22305/371472 [1:47:45<26:38:29,  3.64it/s]
  6%|▌         | 22306/371472 [1:47:45<25:55:53,  3.74it/s]
  6%|▌         | 22307/371472 [1:47:46<26:11:53,  3.70it/s]
  6%|▌         | 22308/371472 [1:47:46<26:24:48,  3.67it/s]
  6%|▌         | 22309/371472 [1:47:46<26:12:45,  3.70it/s]
  6%|▌         | 22310/371472 [1:47:47<26:35:05,  3.65it/s]
  6%|▌         | 22311/371472 [1:47:47<28:20:14,  3.42it/s]
  6%|▌         | 22312/371472 [1:47:47<27:07:25,  3.58it/s]
  6%|▌         | 22313/371472 [1:47:47<26:49:02,  3.62it/s]
  6%|▌         | 22314/371472 [1:47:48<27:22:45,  3.54it/s]
  6%|▌         | 22315/371472 [1:47:48<31:51:53,  3.04it/s]
  6%|▌         | 22316/371472 [1:47:48<29:58:27,  3.24it/s]
  6%|▌         | 22317/371472 [1:47:49<29:00:13,  3.34it/s]
  6%|▌         | 22318/371472 [1:47:49<27:47:11,  3.49it/s]
  6%|▌         | 22319/371472 [1:47:49<29:18:33,  3.31it/s]
  6%|▌         | 22320/371472 [1:47:49<27:41:32,  3.50it/s]
                                                           
{'loss': 4.576, 'learning_rate': 9.463789351203429e-07, 'epoch': 0.96}

  6%|▌         | 22320/371472 [1:47:49<27:41:32,  3.50it/s]
  6%|▌         | 22321/371472 [1:47:50<27:40:11,  3.51it/s]
  6%|▌         | 22322/371472 [1:47:50<27:49:19,  3.49it/s]
  6%|▌         | 22323/371472 [1:47:50<26:48:45,  3.62it/s]
  6%|▌         | 22324/371472 [1:47:51<27:18:41,  3.55it/s]
  6%|▌         | 22325/371472 [1:47:51<28:47:06,  3.37it/s]
  6%|▌         | 22326/371472 [1:47:51<29:59:13,  3.23it/s]
  6%|▌         | 22327/371472 [1:47:52<28:56:14,  3.35it/s]
  6%|▌         | 22328/371472 [1:47:52<30:23:38,  3.19it/s]
  6%|▌         | 22329/371472 [1:47:52<30:37:39,  3.17it/s]
  6%|▌         | 22330/371472 [1:47:52<29:32:13,  3.28it/s]
  6%|▌         | 22331/371472 [1:47:53<28:38:24,  3.39it/s]
  6%|▌         | 22332/371472 [1:47:53<27:31:50,  3.52it/s]
  6%|▌         | 22333/371472 [1:47:53<27:51:55,  3.48it/s]
  6%|▌         | 22334/371472 [1:47:54<27:46:17,  3.49it/s]
  6%|▌         | 22335/371472 [1:47:54<29:12:39,  3.32it/s]
  6%|▌         | 22336/371472 [1:47:54<28:01:10,  3.46it/s]
  6%|▌         | 22337/371472 [1:47:54<27:05:24,  3.58it/s]
  6%|▌         | 22338/371472 [1:47:55<28:54:04,  3.36it/s]
  6%|▌         | 22339/371472 [1:47:55<28:49:04,  3.37it/s]
  6%|▌         | 22340/371472 [1:47:55<28:00:52,  3.46it/s]
                                                           
{'loss': 4.5425, 'learning_rate': 9.463304531448641e-07, 'epoch': 0.96}

  6%|▌         | 22340/371472 [1:47:55<28:00:52,  3.46it/s]
  6%|▌         | 22341/371472 [1:47:56<27:35:33,  3.51it/s]
  6%|▌         | 22342/371472 [1:47:56<26:52:17,  3.61it/s]
  6%|▌         | 22343/371472 [1:47:56<26:58:28,  3.60it/s]
  6%|▌         | 22344/371472 [1:47:56<26:52:45,  3.61it/s]
  6%|▌         | 22345/371472 [1:47:57<28:25:26,  3.41it/s]
  6%|▌         | 22346/371472 [1:47:57<28:27:24,  3.41it/s]
  6%|▌         | 22347/371472 [1:47:57<29:41:53,  3.27it/s]
  6%|▌         | 22348/371472 [1:47:58<28:28:06,  3.41it/s]
  6%|▌         | 22349/371472 [1:47:58<28:21:40,  3.42it/s]
  6%|▌         | 22350/371472 [1:47:58<29:08:39,  3.33it/s]
  6%|▌         | 22351/371472 [1:47:59<28:39:13,  3.38it/s]
  6%|▌         | 22352/371472 [1:47:59<27:51:01,  3.48it/s]
  6%|▌         | 22353/371472 [1:47:59<26:56:24,  3.60it/s]
  6%|▌         | 22354/371472 [1:47:59<26:49:39,  3.61it/s]
  6%|▌         | 22355/371472 [1:48:00<28:44:19,  3.37it/s]
  6%|▌         | 22356/371472 [1:48:00<28:52:05,  3.36it/s]
  6%|▌         | 22357/371472 [1:48:00<27:51:13,  3.48it/s]
  6%|▌         | 22358/371472 [1:48:01<27:43:35,  3.50it/s]
  6%|▌         | 22359/371472 [1:48:01<27:03:52,  3.58it/s]
  6%|▌         | 22360/371472 [1:48:01<26:09:22,  3.71it/s]
                                                           
{'loss': 4.6569, 'learning_rate': 9.462819711693852e-07, 'epoch': 0.96}

  6%|▌         | 22360/371472 [1:48:01<26:09:22,  3.71it/s]
  6%|▌         | 22361/371472 [1:48:01<26:11:31,  3.70it/s]
  6%|▌         | 22362/371472 [1:48:02<25:28:31,  3.81it/s]
  6%|▌         | 22363/371472 [1:48:02<26:38:51,  3.64it/s]
  6%|▌         | 22364/371472 [1:48:02<27:11:21,  3.57it/s]
  6%|▌         | 22365/371472 [1:48:02<27:37:28,  3.51it/s]
  6%|▌         | 22366/371472 [1:48:03<26:43:29,  3.63it/s]
  6%|▌         | 22367/371472 [1:48:03<28:31:41,  3.40it/s]
  6%|▌         | 22368/371472 [1:48:03<28:01:57,  3.46it/s]
  6%|▌         | 22369/371472 [1:48:04<27:18:11,  3.55it/s]
  6%|▌         | 22370/371472 [1:48:04<27:22:09,  3.54it/s]
  6%|▌         | 22371/371472 [1:48:04<26:59:46,  3.59it/s]
  6%|▌         | 22372/371472 [1:48:04<26:19:46,  3.68it/s]
  6%|▌         | 22373/371472 [1:48:05<27:26:54,  3.53it/s]
  6%|▌         | 22374/371472 [1:48:05<27:28:44,  3.53it/s]
  6%|▌         | 22375/371472 [1:48:05<27:07:10,  3.58it/s]
  6%|▌         | 22376/371472 [1:48:06<26:38:17,  3.64it/s]
  6%|▌         | 22377/371472 [1:48:06<25:52:41,  3.75it/s]
  6%|▌         | 22378/371472 [1:48:06<27:09:14,  3.57it/s]
  6%|▌         | 22379/371472 [1:48:06<26:28:50,  3.66it/s]
  6%|▌         | 22380/371472 [1:48:07<26:41:18,  3.63it/s]
                                                           
{'loss': 4.7177, 'learning_rate': 9.462334891939064e-07, 'epoch': 0.96}

  6%|▌         | 22380/371472 [1:48:07<26:41:18,  3.63it/s]
  6%|▌         | 22381/371472 [1:48:07<26:09:47,  3.71it/s]
  6%|▌         | 22382/371472 [1:48:07<26:49:25,  3.62it/s]
  6%|▌         | 22383/371472 [1:48:07<26:37:53,  3.64it/s]
  6%|▌         | 22384/371472 [1:48:08<26:13:21,  3.70it/s]
  6%|▌         | 22385/371472 [1:48:08<26:22:06,  3.68it/s]
  6%|▌         | 22386/371472 [1:48:08<27:03:33,  3.58it/s]
  6%|▌         | 22387/371472 [1:48:09<26:21:22,  3.68it/s]
  6%|▌         | 22388/371472 [1:48:09<27:55:27,  3.47it/s]
  6%|▌         | 22389/371472 [1:48:09<30:24:28,  3.19it/s]
  6%|▌         | 22390/371472 [1:48:10<30:16:40,  3.20it/s]
  6%|▌         | 22391/371472 [1:48:10<29:37:23,  3.27it/s]
  6%|▌         | 22392/371472 [1:48:10<28:17:43,  3.43it/s]
  6%|▌         | 22393/371472 [1:48:10<27:35:34,  3.51it/s]
  6%|▌         | 22394/371472 [1:48:11<27:43:24,  3.50it/s]
  6%|▌         | 22395/371472 [1:48:11<29:12:24,  3.32it/s]
  6%|▌         | 22396/371472 [1:48:11<28:20:38,  3.42it/s]
  6%|▌         | 22397/371472 [1:48:12<29:08:47,  3.33it/s]
  6%|▌         | 22398/371472 [1:48:12<29:09:42,  3.33it/s]
  6%|▌         | 22399/371472 [1:48:12<28:09:03,  3.44it/s]
  6%|▌         | 22400/371472 [1:48:12<28:04:46,  3.45it/s]
                                                           
{'loss': 4.5029, 'learning_rate': 9.461850072184274e-07, 'epoch': 0.96}

  6%|▌         | 22400/371472 [1:48:12<28:04:46,  3.45it/s]
  6%|▌         | 22401/371472 [1:48:13<27:27:35,  3.53it/s]
  6%|▌         | 22402/371472 [1:48:13<27:04:10,  3.58it/s]
  6%|▌         | 22403/371472 [1:48:13<27:20:29,  3.55it/s]
  6%|▌         | 22404/371472 [1:48:14<28:34:05,  3.39it/s]
  6%|▌         | 22405/371472 [1:48:14<27:27:57,  3.53it/s]
  6%|▌         | 22406/371472 [1:48:14<26:53:23,  3.61it/s]
  6%|▌         | 22407/371472 [1:48:14<26:14:06,  3.70it/s]
  6%|▌         | 22408/371472 [1:48:15<27:29:09,  3.53it/s]
  6%|▌         | 22409/371472 [1:48:15<27:30:14,  3.53it/s]
  6%|▌         | 22410/371472 [1:48:15<27:00:36,  3.59it/s]
  6%|▌         | 22411/371472 [1:48:16<26:24:30,  3.67it/s]
  6%|▌         | 22412/371472 [1:48:16<26:21:41,  3.68it/s]
  6%|▌         | 22413/371472 [1:48:16<27:22:37,  3.54it/s]
  6%|▌         | 22414/371472 [1:48:16<27:23:52,  3.54it/s]
  6%|▌         | 22415/371472 [1:48:17<26:47:32,  3.62it/s]
  6%|▌         | 22416/371472 [1:48:17<29:33:18,  3.28it/s]
  6%|▌         | 22417/371472 [1:48:17<28:45:23,  3.37it/s]
  6%|▌         | 22418/371472 [1:48:18<28:15:40,  3.43it/s]
  6%|▌         | 22419/371472 [1:48:18<27:29:07,  3.53it/s]
  6%|▌         | 22420/371472 [1:48:18<27:50:43,  3.48it/s]
                                                           
{'loss': 4.5453, 'learning_rate': 9.461365252429485e-07, 'epoch': 0.97}

  6%|▌         | 22420/371472 [1:48:18<27:50:43,  3.48it/s]
  6%|▌         | 22421/371472 [1:48:18<27:33:40,  3.52it/s]
  6%|▌         | 22422/371472 [1:48:19<29:03:21,  3.34it/s]
  6%|▌         | 22423/371472 [1:48:19<28:39:21,  3.38it/s]
  6%|▌         | 22424/371472 [1:48:19<28:08:35,  3.45it/s]
  6%|▌         | 22425/371472 [1:48:20<27:39:37,  3.51it/s]
  6%|▌         | 22426/371472 [1:48:20<27:30:38,  3.52it/s]
  6%|▌         | 22427/371472 [1:48:20<27:59:12,  3.46it/s]
  6%|▌         | 22428/371472 [1:48:20<27:43:53,  3.50it/s]
  6%|▌         | 22429/371472 [1:48:21<27:14:46,  3.56it/s]
  6%|▌         | 22430/371472 [1:48:21<26:17:21,  3.69it/s]
  6%|▌         | 22431/371472 [1:48:21<29:43:46,  3.26it/s]
  6%|▌         | 22432/371472 [1:48:22<28:57:59,  3.35it/s]
  6%|▌         | 22433/371472 [1:48:22<29:20:33,  3.30it/s]
  6%|▌         | 22434/371472 [1:48:22<27:51:22,  3.48it/s]
  6%|▌         | 22435/371472 [1:48:22<27:50:31,  3.48it/s]
  6%|▌         | 22436/371472 [1:48:23<28:00:19,  3.46it/s]
  6%|▌         | 22437/371472 [1:48:23<27:27:59,  3.53it/s]
  6%|▌         | 22438/371472 [1:48:23<28:12:14,  3.44it/s]
  6%|▌         | 22439/371472 [1:48:24<27:21:47,  3.54it/s]
  6%|▌         | 22440/371472 [1:48:24<27:59:18,  3.46it/s]
                                                           
{'loss': 4.3993, 'learning_rate': 9.460880432674696e-07, 'epoch': 0.97}

  6%|▌         | 22440/371472 [1:48:24<27:59:18,  3.46it/s]
  6%|▌         | 22441/371472 [1:48:24<27:35:17,  3.51it/s]
  6%|▌         | 22442/371472 [1:48:24<27:11:00,  3.57it/s]
  6%|▌         | 22443/371472 [1:48:25<27:49:25,  3.48it/s]
  6%|▌         | 22444/371472 [1:48:25<28:13:57,  3.43it/s]
  6%|▌         | 22445/371472 [1:48:25<28:14:16,  3.43it/s]
  6%|▌         | 22446/371472 [1:48:26<28:27:16,  3.41it/s]
  6%|▌         | 22447/371472 [1:48:26<28:22:44,  3.42it/s]
  6%|▌         | 22448/371472 [1:48:26<27:48:56,  3.49it/s]
  6%|▌         | 22449/371472 [1:48:27<29:43:51,  3.26it/s]
  6%|▌         | 22450/371472 [1:48:27<28:09:14,  3.44it/s]
  6%|▌         | 22451/371472 [1:48:27<27:07:53,  3.57it/s]
  6%|▌         | 22452/371472 [1:48:27<28:31:37,  3.40it/s]
  6%|▌         | 22453/371472 [1:48:28<28:56:05,  3.35it/s]
  6%|▌         | 22454/371472 [1:48:28<29:53:41,  3.24it/s]
  6%|▌         | 22455/371472 [1:48:28<28:55:18,  3.35it/s]
  6%|▌         | 22456/371472 [1:48:29<28:19:23,  3.42it/s]
  6%|▌         | 22457/371472 [1:48:29<26:53:54,  3.60it/s]
  6%|▌         | 22458/371472 [1:48:29<27:55:46,  3.47it/s]
  6%|▌         | 22459/371472 [1:48:29<27:05:26,  3.58it/s]
  6%|▌         | 22460/371472 [1:48:30<27:30:57,  3.52it/s]
                                                           
{'loss': 4.5315, 'learning_rate': 9.460395612919907e-07, 'epoch': 0.97}

  6%|▌         | 22460/371472 [1:48:30<27:30:57,  3.52it/s]
  6%|▌         | 22461/371472 [1:48:30<28:28:34,  3.40it/s]
  6%|▌         | 22462/371472 [1:48:30<27:28:51,  3.53it/s]
  6%|▌         | 22463/371472 [1:48:31<28:03:56,  3.45it/s]
  6%|▌         | 22464/371472 [1:48:31<27:27:47,  3.53it/s]
  6%|▌         | 22465/371472 [1:48:31<26:52:17,  3.61it/s]
  6%|▌         | 22466/371472 [1:48:31<27:47:40,  3.49it/s]
  6%|▌         | 22467/371472 [1:48:32<27:10:05,  3.57it/s]
  6%|▌         | 22468/371472 [1:48:32<26:17:09,  3.69it/s]
  6%|▌         | 22469/371472 [1:48:32<25:34:27,  3.79it/s]
  6%|▌         | 22470/371472 [1:48:33<30:55:09,  3.14it/s]
  6%|▌         | 22471/371472 [1:48:33<30:16:14,  3.20it/s]
  6%|▌         | 22472/371472 [1:48:33<33:16:38,  2.91it/s]
  6%|▌         | 22473/371472 [1:48:34<30:42:38,  3.16it/s]
  6%|▌         | 22474/371472 [1:48:34<32:14:01,  3.01it/s]
  6%|▌         | 22475/371472 [1:48:34<30:27:05,  3.18it/s]
  6%|▌         | 22476/371472 [1:48:35<29:48:36,  3.25it/s]
  6%|▌         | 22477/371472 [1:48:35<29:27:33,  3.29it/s]
  6%|▌         | 22478/371472 [1:48:35<30:17:10,  3.20it/s]
  6%|▌         | 22479/371472 [1:48:35<29:36:12,  3.27it/s]
  6%|▌         | 22480/371472 [1:48:36<28:23:38,  3.41it/s]
                                                           
{'loss': 4.3262, 'learning_rate': 9.459910793165118e-07, 'epoch': 0.97}

  6%|▌         | 22480/371472 [1:48:36<28:23:38,  3.41it/s]
  6%|▌         | 22481/371472 [1:48:36<27:55:54,  3.47it/s]
  6%|▌         | 22482/371472 [1:48:36<27:13:18,  3.56it/s]
  6%|▌         | 22483/371472 [1:48:37<27:36:41,  3.51it/s]
  6%|▌         | 22484/371472 [1:48:37<27:11:54,  3.56it/s]
  6%|▌         | 22485/371472 [1:48:37<25:55:45,  3.74it/s]
  6%|▌         | 22486/371472 [1:48:37<26:18:50,  3.68it/s]
  6%|▌         | 22487/371472 [1:48:38<25:43:55,  3.77it/s]
  6%|▌         | 22488/371472 [1:48:38<25:38:34,  3.78it/s]
  6%|▌         | 22489/371472 [1:48:38<25:30:51,  3.80it/s]
  6%|▌         | 22490/371472 [1:48:38<27:06:02,  3.58it/s]
  6%|▌         | 22491/371472 [1:48:39<26:02:07,  3.72it/s]
  6%|▌         | 22492/371472 [1:48:39<26:42:11,  3.63it/s]
  6%|▌         | 22493/371472 [1:48:39<26:42:51,  3.63it/s]
  6%|▌         | 22494/371472 [1:48:40<26:44:07,  3.63it/s]
  6%|▌         | 22495/371472 [1:48:40<25:52:39,  3.75it/s]
  6%|▌         | 22496/371472 [1:48:40<28:35:47,  3.39it/s]
  6%|▌         | 22497/371472 [1:48:40<30:02:54,  3.23it/s]
  6%|▌         | 22498/371472 [1:48:41<28:48:33,  3.36it/s]
  6%|▌         | 22499/371472 [1:48:41<30:18:52,  3.20it/s]
  6%|▌         | 22500/371472 [1:48:41<29:14:45,  3.31it/s]
                                                           
{'loss': 4.2996, 'learning_rate': 9.45942597341033e-07, 'epoch': 0.97}

  6%|▌         | 22500/371472 [1:48:41<29:14:45,  3.31it/s]
  6%|▌         | 22501/371472 [1:48:42<29:03:48,  3.34it/s]
  6%|▌         | 22502/371472 [1:48:42<27:56:31,  3.47it/s]
  6%|▌         | 22503/371472 [1:48:42<27:28:05,  3.53it/s]
  6%|▌         | 22504/371472 [1:48:43<29:17:08,  3.31it/s]
  6%|▌         | 22505/371472 [1:48:43<28:00:53,  3.46it/s]
  6%|▌         | 22506/371472 [1:48:43<27:32:46,  3.52it/s]
  6%|▌         | 22507/371472 [1:48:43<27:47:11,  3.49it/s]
  6%|▌         | 22508/371472 [1:48:44<27:26:52,  3.53it/s]
  6%|▌         | 22509/371472 [1:48:44<29:43:05,  3.26it/s]
  6%|▌         | 22510/371472 [1:48:44<28:39:33,  3.38it/s]
  6%|▌         | 22511/371472 [1:48:45<28:29:19,  3.40it/s]
  6%|▌         | 22512/371472 [1:48:45<29:41:30,  3.26it/s]
  6%|▌         | 22513/371472 [1:48:45<28:17:04,  3.43it/s]
  6%|▌         | 22514/371472 [1:48:45<28:41:11,  3.38it/s]
  6%|▌         | 22515/371472 [1:48:46<28:19:04,  3.42it/s]
  6%|▌         | 22516/371472 [1:48:46<28:13:18,  3.43it/s]
  6%|▌         | 22517/371472 [1:48:46<27:16:17,  3.55it/s]
  6%|▌         | 22518/371472 [1:48:47<26:51:57,  3.61it/s]
  6%|▌         | 22519/371472 [1:48:47<26:26:27,  3.67it/s]
  6%|▌         | 22520/371472 [1:48:47<26:39:45,  3.64it/s]
                                                           
{'loss': 4.5598, 'learning_rate': 9.458941153655541e-07, 'epoch': 0.97}

  6%|▌         | 22520/371472 [1:48:47<26:39:45,  3.64it/s]
  6%|▌         | 22521/371472 [1:48:47<26:10:17,  3.70it/s]
  6%|▌         | 22522/371472 [1:48:48<26:27:08,  3.66it/s]
  6%|▌         | 22523/371472 [1:48:48<27:16:22,  3.55it/s]
  6%|▌         | 22524/371472 [1:48:48<29:09:06,  3.32it/s]
  6%|▌         | 22525/371472 [1:48:49<28:12:33,  3.44it/s]
  6%|▌         | 22526/371472 [1:48:49<29:49:22,  3.25it/s]
  6%|▌         | 22527/371472 [1:48:49<30:52:16,  3.14it/s]
  6%|▌         | 22528/371472 [1:48:49<29:17:52,  3.31it/s]
  6%|▌         | 22529/371472 [1:48:50<28:52:10,  3.36it/s]
  6%|▌         | 22530/371472 [1:48:50<30:13:33,  3.21it/s]
  6%|▌         | 22531/371472 [1:48:51<33:04:30,  2.93it/s]
  6%|▌         | 22532/371472 [1:48:51<32:29:02,  2.98it/s]
  6%|▌         | 22533/371472 [1:48:51<30:18:01,  3.20it/s]
  6%|▌         | 22534/371472 [1:48:51<29:59:08,  3.23it/s]
  6%|▌         | 22535/371472 [1:48:52<31:08:32,  3.11it/s]
  6%|▌         | 22536/371472 [1:48:52<29:37:44,  3.27it/s]
  6%|▌         | 22537/371472 [1:48:52<29:07:42,  3.33it/s]
  6%|▌         | 22538/371472 [1:48:53<29:12:51,  3.32it/s]
  6%|▌         | 22539/371472 [1:48:53<29:40:52,  3.27it/s]
  6%|▌         | 22540/371472 [1:48:53<28:58:19,  3.35it/s]
                                                           
{'loss': 4.5351, 'learning_rate': 9.458456333900751e-07, 'epoch': 0.97}

  6%|▌         | 22540/371472 [1:48:53<28:58:19,  3.35it/s]
  6%|▌         | 22541/371472 [1:48:54<28:25:34,  3.41it/s]
  6%|▌         | 22542/371472 [1:48:54<27:51:26,  3.48it/s]
  6%|▌         | 22543/371472 [1:48:54<27:43:51,  3.50it/s]
  6%|▌         | 22544/371472 [1:48:54<29:09:03,  3.32it/s]
  6%|▌         | 22545/371472 [1:48:55<28:22:12,  3.42it/s]
  6%|▌         | 22546/371472 [1:48:55<27:47:01,  3.49it/s]
  6%|▌         | 22547/371472 [1:48:55<26:58:36,  3.59it/s]
  6%|▌         | 22548/371472 [1:48:55<26:21:58,  3.68it/s]
  6%|▌         | 22549/371472 [1:48:56<27:19:17,  3.55it/s]
  6%|▌         | 22550/371472 [1:48:56<26:21:55,  3.68it/s]
  6%|▌         | 22551/371472 [1:48:56<25:47:20,  3.76it/s]
  6%|▌         | 22552/371472 [1:48:57<26:00:22,  3.73it/s]
  6%|▌         | 22553/371472 [1:48:57<25:50:13,  3.75it/s]
  6%|▌         | 22554/371472 [1:48:57<25:51:27,  3.75it/s]
  6%|▌         | 22555/371472 [1:48:57<25:40:09,  3.78it/s]
  6%|▌         | 22556/371472 [1:48:58<25:22:23,  3.82it/s]
  6%|▌         | 22557/371472 [1:48:58<26:00:53,  3.73it/s]
  6%|▌         | 22558/371472 [1:48:58<28:08:45,  3.44it/s]
  6%|▌         | 22559/371472 [1:48:58<27:24:02,  3.54it/s]
  6%|▌         | 22560/371472 [1:48:59<30:27:39,  3.18it/s]
                                                           
{'loss': 4.605, 'learning_rate': 9.457971514145962e-07, 'epoch': 0.97}

  6%|▌         | 22560/371472 [1:48:59<30:27:39,  3.18it/s]
  6%|▌         | 22561/371472 [1:48:59<30:01:27,  3.23it/s]
  6%|▌         | 22562/371472 [1:49:00<31:10:42,  3.11it/s]
  6%|▌         | 22563/371472 [1:49:00<33:13:37,  2.92it/s]
  6%|▌         | 22564/371472 [1:49:00<31:20:19,  3.09it/s]
  6%|▌         | 22565/371472 [1:49:00<28:53:40,  3.35it/s]
  6%|▌         | 22566/371472 [1:49:01<27:33:55,  3.52it/s]
  6%|▌         | 22567/371472 [1:49:01<27:31:44,  3.52it/s]
  6%|▌         | 22568/371472 [1:49:01<27:56:25,  3.47it/s]
  6%|▌         | 22569/371472 [1:49:02<27:27:24,  3.53it/s]
  6%|▌         | 22570/371472 [1:49:02<27:26:44,  3.53it/s]
  6%|▌         | 22571/371472 [1:49:02<27:18:32,  3.55it/s]
  6%|▌         | 22572/371472 [1:49:02<27:33:13,  3.52it/s]
  6%|▌         | 22573/371472 [1:49:03<26:59:04,  3.59it/s]
  6%|▌         | 22574/371472 [1:49:03<27:59:30,  3.46it/s]
  6%|▌         | 22575/371472 [1:49:03<27:06:06,  3.58it/s]
  6%|▌         | 22576/371472 [1:49:04<28:27:55,  3.40it/s]
  6%|▌         | 22577/371472 [1:49:04<28:03:51,  3.45it/s]
  6%|▌         | 22578/371472 [1:49:04<28:09:51,  3.44it/s]
  6%|▌         | 22579/371472 [1:49:04<28:10:40,  3.44it/s]
  6%|▌         | 22580/371472 [1:49:05<27:50:11,  3.48it/s]
                                                           
{'loss': 4.4104, 'learning_rate': 9.457486694391174e-07, 'epoch': 0.97}

  6%|▌         | 22580/371472 [1:49:05<27:50:11,  3.48it/s]
  6%|▌         | 22581/371472 [1:49:05<27:52:23,  3.48it/s]
  6%|▌         | 22582/371472 [1:49:05<26:35:49,  3.64it/s]
  6%|▌         | 22583/371472 [1:49:05<26:23:00,  3.67it/s]
  6%|▌         | 22584/371472 [1:49:06<27:39:22,  3.50it/s]
  6%|▌         | 22585/371472 [1:49:06<27:10:56,  3.57it/s]
  6%|▌         | 22586/371472 [1:49:06<27:21:21,  3.54it/s]
  6%|▌         | 22587/371472 [1:49:07<28:16:50,  3.43it/s]
  6%|▌         | 22588/371472 [1:49:07<28:15:35,  3.43it/s]
  6%|▌         | 22589/371472 [1:49:07<27:43:48,  3.49it/s]
  6%|▌         | 22590/371472 [1:49:08<27:33:16,  3.52it/s]
  6%|▌         | 22591/371472 [1:49:08<27:18:49,  3.55it/s]
  6%|▌         | 22592/371472 [1:49:08<27:00:09,  3.59it/s]
  6%|▌         | 22593/371472 [1:49:08<27:28:01,  3.53it/s]
  6%|▌         | 22594/371472 [1:49:09<26:55:06,  3.60it/s]
  6%|▌         | 22595/371472 [1:49:09<26:26:14,  3.67it/s]
  6%|▌         | 22596/371472 [1:49:09<26:23:36,  3.67it/s]
  6%|▌         | 22597/371472 [1:49:09<27:43:15,  3.50it/s]
  6%|▌         | 22598/371472 [1:49:10<27:31:52,  3.52it/s]
  6%|▌         | 22599/371472 [1:49:10<27:37:26,  3.51it/s]
  6%|▌         | 22600/371472 [1:49:10<27:55:51,  3.47it/s]
                                                           
{'loss': 4.5709, 'learning_rate': 9.457001874636385e-07, 'epoch': 0.97}

  6%|▌         | 22600/371472 [1:49:10<27:55:51,  3.47it/s]
  6%|▌         | 22601/371472 [1:49:11<27:39:04,  3.50it/s]
  6%|▌         | 22602/371472 [1:49:11<26:30:06,  3.66it/s]
  6%|▌         | 22603/371472 [1:49:11<26:50:50,  3.61it/s]
  6%|▌         | 22604/371472 [1:49:11<26:48:03,  3.62it/s]
  6%|▌         | 22605/371472 [1:49:12<26:38:20,  3.64it/s]
  6%|▌         | 22606/371472 [1:49:12<27:58:10,  3.46it/s]
  6%|▌         | 22607/371472 [1:49:12<28:32:19,  3.40it/s]
  6%|▌         | 22608/371472 [1:49:13<28:23:37,  3.41it/s]
  6%|▌         | 22609/371472 [1:49:13<28:11:51,  3.44it/s]
  6%|▌         | 22610/371472 [1:49:13<27:20:56,  3.54it/s]
  6%|▌         | 22611/371472 [1:49:13<27:17:59,  3.55it/s]
  6%|▌         | 22612/371472 [1:49:14<27:47:36,  3.49it/s]
  6%|▌         | 22613/371472 [1:49:14<28:17:30,  3.43it/s]
  6%|▌         | 22614/371472 [1:49:14<27:16:56,  3.55it/s]
  6%|▌         | 22615/371472 [1:49:15<26:55:37,  3.60it/s]
  6%|▌         | 22616/371472 [1:49:15<26:28:38,  3.66it/s]
  6%|▌         | 22617/371472 [1:49:15<26:59:42,  3.59it/s]
  6%|▌         | 22618/371472 [1:49:15<26:27:16,  3.66it/s]
  6%|▌         | 22619/371472 [1:49:16<26:09:06,  3.71it/s]
  6%|▌         | 22620/371472 [1:49:16<26:15:27,  3.69it/s]
                                                           
{'loss': 4.475, 'learning_rate': 9.456517054881596e-07, 'epoch': 0.97}

  6%|▌         | 22620/371472 [1:49:16<26:15:27,  3.69it/s]
  6%|▌         | 22621/371472 [1:49:16<26:04:13,  3.72it/s]
  6%|▌         | 22622/371472 [1:49:17<28:33:53,  3.39it/s]
  6%|▌         | 22623/371472 [1:49:17<28:22:17,  3.42it/s]
  6%|▌         | 22624/371472 [1:49:17<27:29:52,  3.52it/s]
  6%|▌         | 22625/371472 [1:49:17<26:44:15,  3.62it/s]
  6%|▌         | 22626/371472 [1:49:18<27:11:11,  3.56it/s]
  6%|▌         | 22627/371472 [1:49:18<26:57:12,  3.60it/s]
  6%|▌         | 22628/371472 [1:49:18<26:26:48,  3.66it/s]
  6%|▌         | 22629/371472 [1:49:18<26:26:04,  3.67it/s]
  6%|▌         | 22630/371472 [1:49:19<27:00:37,  3.59it/s]
  6%|▌         | 22631/371472 [1:49:19<26:46:22,  3.62it/s]
  6%|▌         | 22632/371472 [1:49:19<27:05:41,  3.58it/s]
  6%|▌         | 22633/371472 [1:49:20<26:27:53,  3.66it/s]
  6%|▌         | 22634/371472 [1:49:20<26:59:20,  3.59it/s]
  6%|▌         | 22635/371472 [1:49:20<26:24:23,  3.67it/s]
  6%|▌         | 22636/371472 [1:49:20<26:49:22,  3.61it/s]
  6%|▌         | 22637/371472 [1:49:21<26:28:26,  3.66it/s]
  6%|▌         | 22638/371472 [1:49:21<25:47:48,  3.76it/s]
  6%|▌         | 22639/371472 [1:49:21<27:21:31,  3.54it/s]
  6%|▌         | 22640/371472 [1:49:21<27:07:24,  3.57it/s]
                                                           
{'loss': 4.6957, 'learning_rate': 9.456032235126807e-07, 'epoch': 0.98}

  6%|▌         | 22640/371472 [1:49:21<27:07:24,  3.57it/s]
  6%|▌         | 22641/371472 [1:49:22<30:09:55,  3.21it/s]
  6%|▌         | 22642/371472 [1:49:22<32:09:00,  3.01it/s]
  6%|▌         | 22643/371472 [1:49:23<30:58:00,  3.13it/s]
  6%|▌         | 22644/371472 [1:49:23<29:19:49,  3.30it/s]
  6%|▌         | 22645/371472 [1:49:23<28:55:17,  3.35it/s]
  6%|▌         | 22646/371472 [1:49:23<29:37:49,  3.27it/s]
  6%|▌         | 22647/371472 [1:49:24<28:40:40,  3.38it/s]
  6%|▌         | 22648/371472 [1:49:24<27:55:17,  3.47it/s]
  6%|▌         | 22649/371472 [1:49:24<27:32:56,  3.52it/s]
  6%|▌         | 22650/371472 [1:49:25<27:24:29,  3.54it/s]
  6%|▌         | 22651/371472 [1:49:25<27:07:47,  3.57it/s]
  6%|▌         | 22652/371472 [1:49:25<27:57:15,  3.47it/s]
  6%|▌         | 22653/371472 [1:49:25<28:29:01,  3.40it/s]
  6%|▌         | 22654/371472 [1:49:26<27:06:00,  3.58it/s]
  6%|▌         | 22655/371472 [1:49:26<27:04:44,  3.58it/s]
  6%|▌         | 22656/371472 [1:49:26<26:26:39,  3.66it/s]
  6%|▌         | 22657/371472 [1:49:27<28:57:44,  3.35it/s]
  6%|▌         | 22658/371472 [1:49:27<27:16:23,  3.55it/s]
  6%|▌         | 22659/371472 [1:49:27<26:49:03,  3.61it/s]
  6%|▌         | 22660/371472 [1:49:27<26:53:37,  3.60it/s]
                                                           
{'loss': 4.5696, 'learning_rate': 9.455547415372018e-07, 'epoch': 0.98}

  6%|▌         | 22660/371472 [1:49:27<26:53:37,  3.60it/s]
  6%|▌         | 22661/371472 [1:49:28<26:27:54,  3.66it/s]
  6%|▌         | 22662/371472 [1:49:28<27:35:17,  3.51it/s]
  6%|▌         | 22663/371472 [1:49:28<26:46:27,  3.62it/s]
  6%|▌         | 22664/371472 [1:49:28<27:15:10,  3.56it/s]
  6%|▌         | 22665/371472 [1:49:29<27:37:18,  3.51it/s]
  6%|▌         | 22666/371472 [1:49:29<26:51:43,  3.61it/s]
  6%|▌         | 22667/371472 [1:49:29<27:03:02,  3.58it/s]
  6%|▌         | 22668/371472 [1:49:30<26:44:21,  3.62it/s]
  6%|▌         | 22669/371472 [1:49:30<28:56:29,  3.35it/s]
  6%|▌         | 22670/371472 [1:49:30<27:46:22,  3.49it/s]
  6%|▌         | 22671/371472 [1:49:31<29:56:46,  3.24it/s]
  6%|▌         | 22672/371472 [1:49:31<29:42:03,  3.26it/s]
  6%|▌         | 22673/371472 [1:49:31<29:30:03,  3.28it/s]
  6%|▌         | 22674/371472 [1:49:31<28:28:43,  3.40it/s]
  6%|▌         | 22675/371472 [1:49:32<30:29:35,  3.18it/s]
  6%|▌         | 22676/371472 [1:49:32<28:50:24,  3.36it/s]
  6%|▌         | 22677/371472 [1:49:32<27:53:56,  3.47it/s]
  6%|▌         | 22678/371472 [1:49:33<28:19:24,  3.42it/s]
  6%|▌         | 22679/371472 [1:49:33<28:21:55,  3.42it/s]
  6%|▌         | 22680/371472 [1:49:33<29:20:28,  3.30it/s]
                                                           
{'loss': 4.4252, 'learning_rate': 9.455062595617229e-07, 'epoch': 0.98}

  6%|▌         | 22680/371472 [1:49:33<29:20:28,  3.30it/s]
  6%|▌         | 22681/371472 [1:49:33<28:23:36,  3.41it/s]
  6%|▌         | 22682/371472 [1:49:34<28:54:22,  3.35it/s]
  6%|▌         | 22683/371472 [1:49:34<28:06:46,  3.45it/s]
  6%|▌         | 22684/371472 [1:49:34<28:05:07,  3.45it/s]
  6%|▌         | 22685/371472 [1:49:35<27:23:21,  3.54it/s]
  6%|▌         | 22686/371472 [1:49:35<27:33:48,  3.51it/s]
  6%|▌         | 22687/371472 [1:49:35<29:11:09,  3.32it/s]
  6%|▌         | 22688/371472 [1:49:36<28:38:04,  3.38it/s]
  6%|▌         | 22689/371472 [1:49:36<27:16:45,  3.55it/s]
  6%|▌         | 22690/371472 [1:49:36<27:46:35,  3.49it/s]
  6%|▌         | 22691/371472 [1:49:36<27:12:21,  3.56it/s]
  6%|▌         | 22692/371472 [1:49:37<29:48:00,  3.25it/s]
  6%|▌         | 22693/371472 [1:49:37<28:36:23,  3.39it/s]
  6%|▌         | 22694/371472 [1:49:37<28:30:26,  3.40it/s]
  6%|▌         | 22695/371472 [1:49:38<27:17:43,  3.55it/s]
  6%|▌         | 22696/371472 [1:49:38<27:55:35,  3.47it/s]
  6%|▌         | 22697/371472 [1:49:38<28:21:24,  3.42it/s]
  6%|▌         | 22698/371472 [1:49:38<28:15:36,  3.43it/s]
  6%|▌         | 22699/371472 [1:49:39<30:53:56,  3.14it/s]
  6%|▌         | 22700/371472 [1:49:39<29:40:12,  3.27it/s]
                                                           
{'loss': 4.5615, 'learning_rate': 9.45457777586244e-07, 'epoch': 0.98}

  6%|▌         | 22700/371472 [1:49:39<29:40:12,  3.27it/s]
  6%|▌         | 22701/371472 [1:49:39<30:08:52,  3.21it/s]
  6%|▌         | 22702/371472 [1:49:40<28:52:52,  3.35it/s]
  6%|▌         | 22703/371472 [1:49:40<27:52:38,  3.48it/s]
  6%|▌         | 22704/371472 [1:49:40<27:07:13,  3.57it/s]
  6%|▌         | 22705/371472 [1:49:40<27:03:36,  3.58it/s]
  6%|▌         | 22706/371472 [1:49:41<27:00:56,  3.59it/s]
  6%|▌         | 22707/371472 [1:49:41<26:33:57,  3.65it/s]
  6%|▌         | 22708/371472 [1:49:41<27:06:43,  3.57it/s]
  6%|▌         | 22709/371472 [1:49:42<26:45:06,  3.62it/s]
  6%|▌         | 22710/371472 [1:49:42<26:43:09,  3.63it/s]
  6%|▌         | 22711/371472 [1:49:42<28:29:14,  3.40it/s]
  6%|▌         | 22712/371472 [1:49:42<27:35:33,  3.51it/s]
  6%|▌         | 22713/371472 [1:49:43<27:06:10,  3.57it/s]
  6%|▌         | 22714/371472 [1:49:43<27:59:37,  3.46it/s]
  6%|▌         | 22715/371472 [1:49:43<28:28:49,  3.40it/s]
  6%|▌         | 22716/371472 [1:49:44<27:22:43,  3.54it/s]
  6%|▌         | 22717/371472 [1:49:44<28:17:59,  3.42it/s]
  6%|▌         | 22718/371472 [1:49:44<27:55:29,  3.47it/s]
  6%|▌         | 22719/371472 [1:49:44<27:01:18,  3.59it/s]
  6%|▌         | 22720/371472 [1:49:45<26:55:38,  3.60it/s]
                                                           
{'loss': 4.6245, 'learning_rate': 9.454092956107651e-07, 'epoch': 0.98}

  6%|▌         | 22720/371472 [1:49:45<26:55:38,  3.60it/s]
  6%|▌         | 22721/371472 [1:49:45<28:04:13,  3.45it/s]
  6%|▌         | 22722/371472 [1:49:45<27:10:02,  3.57it/s]
  6%|▌         | 22723/371472 [1:49:46<29:41:15,  3.26it/s]
  6%|▌         | 22724/371472 [1:49:46<29:08:51,  3.32it/s]
  6%|▌         | 22725/371472 [1:49:46<28:22:20,  3.41it/s]
  6%|▌         | 22726/371472 [1:49:47<28:35:38,  3.39it/s]
  6%|▌         | 22727/371472 [1:49:47<28:17:11,  3.42it/s]
  6%|▌         | 22728/371472 [1:49:47<28:18:35,  3.42it/s]
  6%|▌         | 22729/371472 [1:49:47<28:52:45,  3.35it/s]
  6%|▌         | 22730/371472 [1:49:48<27:39:36,  3.50it/s]
  6%|▌         | 22731/371472 [1:49:48<26:56:08,  3.60it/s]
  6%|▌         | 22732/371472 [1:49:48<27:52:14,  3.48it/s]
  6%|▌         | 22733/371472 [1:49:49<27:13:30,  3.56it/s]
  6%|▌         | 22734/371472 [1:49:49<27:58:44,  3.46it/s]
  6%|▌         | 22735/371472 [1:49:49<27:13:32,  3.56it/s]
  6%|▌         | 22736/371472 [1:49:49<27:56:11,  3.47it/s]
  6%|▌         | 22737/371472 [1:49:50<30:01:47,  3.23it/s]
  6%|▌         | 22738/371472 [1:49:50<28:40:21,  3.38it/s]
  6%|▌         | 22739/371472 [1:49:50<30:15:11,  3.20it/s]
  6%|▌         | 22740/371472 [1:49:51<28:22:54,  3.41it/s]
                                                           
{'loss': 4.754, 'learning_rate': 9.453608136352863e-07, 'epoch': 0.98}

  6%|▌         | 22740/371472 [1:49:51<28:22:54,  3.41it/s]
  6%|▌         | 22741/371472 [1:49:51<29:22:49,  3.30it/s]
  6%|▌         | 22742/371472 [1:49:51<27:59:02,  3.46it/s]
  6%|▌         | 22743/371472 [1:49:52<28:50:02,  3.36it/s]
  6%|▌         | 22744/371472 [1:49:52<29:08:42,  3.32it/s]
  6%|▌         | 22745/371472 [1:49:52<28:10:17,  3.44it/s]
  6%|▌         | 22746/371472 [1:49:52<28:17:19,  3.42it/s]
  6%|▌         | 22747/371472 [1:49:53<30:38:21,  3.16it/s]
  6%|▌         | 22748/371472 [1:49:53<29:28:31,  3.29it/s]
  6%|▌         | 22749/371472 [1:49:53<30:05:11,  3.22it/s]
  6%|▌         | 22750/371472 [1:49:54<29:34:32,  3.28it/s]
  6%|▌         | 22751/371472 [1:49:54<30:50:34,  3.14it/s]
  6%|▌         | 22752/371472 [1:49:54<30:31:41,  3.17it/s]
  6%|▌         | 22753/371472 [1:49:55<29:43:43,  3.26it/s]
  6%|▌         | 22754/371472 [1:49:55<27:56:33,  3.47it/s]
  6%|▌         | 22755/371472 [1:49:55<27:10:56,  3.56it/s]
  6%|▌         | 22756/371472 [1:49:55<26:48:56,  3.61it/s]
  6%|▌         | 22757/371472 [1:49:56<26:50:54,  3.61it/s]
  6%|▌         | 22758/371472 [1:49:56<26:58:07,  3.59it/s]
  6%|▌         | 22759/371472 [1:49:56<26:48:10,  3.61it/s]
  6%|▌         | 22760/371472 [1:49:56<26:38:35,  3.64it/s]
                                                           
{'loss': 4.5483, 'learning_rate': 9.453123316598073e-07, 'epoch': 0.98}

  6%|▌         | 22760/371472 [1:49:56<26:38:35,  3.64it/s]
  6%|▌         | 22761/371472 [1:49:57<26:39:55,  3.63it/s]
  6%|▌         | 22762/371472 [1:49:57<27:20:13,  3.54it/s]
  6%|▌         | 22763/371472 [1:49:57<27:33:01,  3.52it/s]
  6%|▌         | 22764/371472 [1:49:58<27:43:46,  3.49it/s]
  6%|▌         | 22765/371472 [1:49:58<28:18:52,  3.42it/s]
  6%|▌         | 22766/371472 [1:49:58<27:55:31,  3.47it/s]
  6%|▌         | 22767/371472 [1:49:58<27:39:50,  3.50it/s]
  6%|▌         | 22768/371472 [1:49:59<29:22:23,  3.30it/s]
  6%|▌         | 22769/371472 [1:49:59<28:25:05,  3.41it/s]
  6%|▌         | 22770/371472 [1:49:59<29:00:46,  3.34it/s]
  6%|▌         | 22771/371472 [1:50:00<28:23:12,  3.41it/s]
  6%|▌         | 22772/371472 [1:50:00<27:34:47,  3.51it/s]
  6%|▌         | 22773/371472 [1:50:00<27:58:13,  3.46it/s]
  6%|▌         | 22774/371472 [1:50:01<27:23:50,  3.54it/s]
  6%|▌         | 22775/371472 [1:50:01<26:42:59,  3.63it/s]
  6%|▌         | 22776/371472 [1:50:01<30:12:45,  3.21it/s]
  6%|▌         | 22777/371472 [1:50:02<30:55:50,  3.13it/s]
  6%|▌         | 22778/371472 [1:50:02<29:57:48,  3.23it/s]
  6%|▌         | 22779/371472 [1:50:02<28:40:06,  3.38it/s]
  6%|▌         | 22780/371472 [1:50:02<28:23:16,  3.41it/s]
                                                           
{'loss': 4.817, 'learning_rate': 9.452638496843284e-07, 'epoch': 0.98}

  6%|▌         | 22780/371472 [1:50:02<28:23:16,  3.41it/s]
  6%|▌         | 22781/371472 [1:50:03<28:12:19,  3.43it/s]
  6%|▌         | 22782/371472 [1:50:03<27:41:30,  3.50it/s]
  6%|▌         | 22783/371472 [1:50:03<27:27:22,  3.53it/s]
  6%|▌         | 22784/371472 [1:50:04<28:28:02,  3.40it/s]
  6%|▌         | 22785/371472 [1:50:04<27:50:07,  3.48it/s]
  6%|▌         | 22786/371472 [1:50:04<29:06:04,  3.33it/s]
  6%|▌         | 22787/371472 [1:50:04<28:18:30,  3.42it/s]
  6%|▌         | 22788/371472 [1:50:05<29:34:58,  3.27it/s]
  6%|▌         | 22789/371472 [1:50:05<29:25:21,  3.29it/s]
  6%|▌         | 22790/371472 [1:50:06<39:09:49,  2.47it/s]
  6%|▌         | 22791/371472 [1:50:06<34:55:42,  2.77it/s]
  6%|▌         | 22792/371472 [1:50:06<33:11:50,  2.92it/s]
  6%|▌         | 22793/371472 [1:50:07<31:17:17,  3.10it/s]
  6%|▌         | 22794/371472 [1:50:07<29:03:07,  3.33it/s]
  6%|▌         | 22795/371472 [1:50:07<27:35:18,  3.51it/s]
  6%|▌         | 22796/371472 [1:50:07<26:47:25,  3.62it/s]
  6%|▌         | 22797/371472 [1:50:08<26:22:15,  3.67it/s]
  6%|▌         | 22798/371472 [1:50:08<26:26:08,  3.66it/s]
  6%|▌         | 22799/371472 [1:50:08<26:44:40,  3.62it/s]
  6%|▌         | 22800/371472 [1:50:08<28:05:53,  3.45it/s]
                                                           
{'loss': 4.5536, 'learning_rate': 9.452153677088495e-07, 'epoch': 0.98}

  6%|▌         | 22800/371472 [1:50:08<28:05:53,  3.45it/s]
  6%|▌         | 22801/371472 [1:50:09<28:23:29,  3.41it/s]
  6%|▌         | 22802/371472 [1:50:09<27:36:23,  3.51it/s]
  6%|▌         | 22803/371472 [1:50:09<28:02:57,  3.45it/s]
  6%|▌         | 22804/371472 [1:50:10<27:11:45,  3.56it/s]
  6%|▌         | 22805/371472 [1:50:10<27:07:46,  3.57it/s]
  6%|▌         | 22806/371472 [1:50:10<27:53:50,  3.47it/s]
  6%|▌         | 22807/371472 [1:50:10<27:19:10,  3.55it/s]
  6%|▌         | 22808/371472 [1:50:11<27:14:45,  3.55it/s]
  6%|▌         | 22809/371472 [1:50:11<29:16:24,  3.31it/s]
  6%|▌         | 22810/371472 [1:50:11<30:27:02,  3.18it/s]
  6%|▌         | 22811/371472 [1:50:12<30:27:51,  3.18it/s]
  6%|▌         | 22812/371472 [1:50:12<28:34:12,  3.39it/s]
  6%|▌         | 22813/371472 [1:50:12<28:45:59,  3.37it/s]
  6%|▌         | 22814/371472 [1:50:12<28:03:32,  3.45it/s]
  6%|▌         | 22815/371472 [1:50:13<27:06:34,  3.57it/s]
  6%|▌         | 22816/371472 [1:50:13<28:06:36,  3.45it/s]
  6%|▌         | 22817/371472 [1:50:13<27:58:14,  3.46it/s]
  6%|▌         | 22818/371472 [1:50:14<28:26:50,  3.40it/s]
  6%|▌         | 22819/371472 [1:50:14<27:37:46,  3.51it/s]
  6%|▌         | 22820/371472 [1:50:14<29:21:43,  3.30it/s]
                                                           
{'loss': 4.6521, 'learning_rate': 9.451668857333707e-07, 'epoch': 0.98}

  6%|▌         | 22820/371472 [1:50:14<29:21:43,  3.30it/s]
  6%|▌         | 22821/371472 [1:50:15<28:26:20,  3.41it/s]
  6%|▌         | 22822/371472 [1:50:15<27:31:42,  3.52it/s]
  6%|▌         | 22823/371472 [1:50:15<27:54:11,  3.47it/s]
  6%|▌         | 22824/371472 [1:50:15<27:17:07,  3.55it/s]
  6%|▌         | 22825/371472 [1:50:16<27:39:37,  3.50it/s]
  6%|▌         | 22826/371472 [1:50:16<26:36:56,  3.64it/s]
  6%|▌         | 22827/371472 [1:50:16<27:17:23,  3.55it/s]
  6%|▌         | 22828/371472 [1:50:17<28:11:50,  3.43it/s]
  6%|▌         | 22829/371472 [1:50:17<28:26:30,  3.41it/s]
  6%|▌         | 22830/371472 [1:50:17<27:21:16,  3.54it/s]
  6%|▌         | 22831/371472 [1:50:17<27:10:44,  3.56it/s]
  6%|▌         | 22832/371472 [1:50:18<28:15:41,  3.43it/s]
  6%|▌         | 22833/371472 [1:50:18<28:57:56,  3.34it/s]
  6%|▌         | 22834/371472 [1:50:18<28:06:00,  3.45it/s]
  6%|▌         | 22835/371472 [1:50:19<28:36:32,  3.39it/s]
  6%|▌         | 22836/371472 [1:50:19<28:12:26,  3.43it/s]
  6%|▌         | 22837/371472 [1:50:19<27:18:20,  3.55it/s]
  6%|▌         | 22838/371472 [1:50:19<28:21:31,  3.41it/s]
  6%|▌         | 22839/371472 [1:50:20<27:26:50,  3.53it/s]
  6%|▌         | 22840/371472 [1:50:20<27:25:54,  3.53it/s]
                                                           
{'loss': 4.6244, 'learning_rate': 9.451184037578917e-07, 'epoch': 0.98}

  6%|▌         | 22840/371472 [1:50:20<27:25:54,  3.53it/s]
  6%|▌         | 22841/371472 [1:50:20<29:18:29,  3.30it/s]
  6%|▌         | 22842/371472 [1:50:21<30:07:42,  3.21it/s]
  6%|▌         | 22843/371472 [1:50:21<29:15:27,  3.31it/s]
  6%|▌         | 22844/371472 [1:50:21<29:01:22,  3.34it/s]
  6%|▌         | 22845/371472 [1:50:21<28:03:53,  3.45it/s]
  6%|▌         | 22846/371472 [1:50:22<26:57:54,  3.59it/s]
  6%|▌         | 22847/371472 [1:50:22<26:50:06,  3.61it/s]
  6%|▌         | 22848/371472 [1:50:22<27:12:40,  3.56it/s]
  6%|▌         | 22849/371472 [1:50:23<26:46:58,  3.62it/s]
  6%|▌         | 22850/371472 [1:50:23<26:22:30,  3.67it/s]
  6%|▌         | 22851/371472 [1:50:23<26:20:44,  3.68it/s]
  6%|▌         | 22852/371472 [1:50:23<26:58:25,  3.59it/s]
  6%|▌         | 22853/371472 [1:50:24<29:18:31,  3.30it/s]
  6%|▌         | 22854/371472 [1:50:24<28:35:33,  3.39it/s]
  6%|▌         | 22855/371472 [1:50:24<28:55:33,  3.35it/s]
  6%|▌         | 22856/371472 [1:50:25<27:56:06,  3.47it/s]
  6%|▌         | 22857/371472 [1:50:25<27:23:22,  3.54it/s]
  6%|▌         | 22858/371472 [1:50:25<26:58:00,  3.59it/s]
  6%|▌         | 22859/371472 [1:50:25<26:53:23,  3.60it/s]
  6%|▌         | 22860/371472 [1:50:26<26:50:31,  3.61it/s]
                                                           
{'loss': 4.7698, 'learning_rate': 9.450699217824128e-07, 'epoch': 0.98}

  6%|▌         | 22860/371472 [1:50:26<26:50:31,  3.61it/s]
  6%|▌         | 22861/371472 [1:50:26<26:40:30,  3.63it/s]
  6%|▌         | 22862/371472 [1:50:26<26:29:58,  3.65it/s]
  6%|▌         | 22863/371472 [1:50:27<27:02:49,  3.58it/s]
  6%|▌         | 22864/371472 [1:50:27<28:20:26,  3.42it/s]
  6%|▌         | 22865/371472 [1:50:27<27:25:20,  3.53it/s]
  6%|▌         | 22866/371472 [1:50:27<27:01:48,  3.58it/s]
  6%|▌         | 22867/371472 [1:50:28<26:42:00,  3.63it/s]
  6%|▌         | 22868/371472 [1:50:28<26:49:08,  3.61it/s]
  6%|▌         | 22869/371472 [1:50:28<26:43:40,  3.62it/s]
  6%|▌         | 22870/371472 [1:50:28<26:48:05,  3.61it/s]
  6%|▌         | 22871/371472 [1:50:29<26:49:09,  3.61it/s]
  6%|▌         | 22872/371472 [1:50:29<26:30:53,  3.65it/s]
  6%|▌         | 22873/371472 [1:50:29<27:44:27,  3.49it/s]
  6%|▌         | 22874/371472 [1:50:30<28:56:10,  3.35it/s]
  6%|▌         | 22875/371472 [1:50:30<28:07:32,  3.44it/s]
  6%|▌         | 22876/371472 [1:50:30<27:46:09,  3.49it/s]
  6%|▌         | 22877/371472 [1:50:31<28:24:16,  3.41it/s]
  6%|▌         | 22878/371472 [1:50:31<28:04:32,  3.45it/s]
  6%|▌         | 22879/371472 [1:50:31<28:52:55,  3.35it/s]
  6%|▌         | 22880/371472 [1:50:31<30:41:56,  3.15it/s]
                                                           
{'loss': 4.5851, 'learning_rate': 9.45021439806934e-07, 'epoch': 0.99}

  6%|▌         | 22880/371472 [1:50:31<30:41:56,  3.15it/s]
  6%|▌         | 22881/371472 [1:50:32<29:45:44,  3.25it/s]
  6%|▌         | 22882/371472 [1:50:32<28:58:18,  3.34it/s]
  6%|▌         | 22883/371472 [1:50:32<27:40:26,  3.50it/s]
  6%|▌         | 22884/371472 [1:50:33<27:10:00,  3.56it/s]
  6%|▌         | 22885/371472 [1:50:33<26:50:08,  3.61it/s]
  6%|▌         | 22886/371472 [1:50:33<27:11:40,  3.56it/s]
  6%|▌         | 22887/371472 [1:50:33<28:08:01,  3.44it/s]
  6%|▌         | 22888/371472 [1:50:34<27:20:04,  3.54it/s]
  6%|▌         | 22889/371472 [1:50:34<27:27:53,  3.53it/s]
  6%|▌         | 22890/371472 [1:50:34<26:52:54,  3.60it/s]
  6%|▌         | 22891/371472 [1:50:35<27:29:40,  3.52it/s]
  6%|▌         | 22892/371472 [1:50:35<29:29:17,  3.28it/s]
  6%|▌         | 22893/371472 [1:50:35<28:30:14,  3.40it/s]
  6%|▌         | 22894/371472 [1:50:35<28:31:52,  3.39it/s]
  6%|▌         | 22895/371472 [1:50:36<28:26:51,  3.40it/s]
  6%|▌         | 22896/371472 [1:50:36<28:17:10,  3.42it/s]
  6%|▌         | 22897/371472 [1:50:36<28:16:30,  3.42it/s]
  6%|▌         | 22898/371472 [1:50:37<27:57:26,  3.46it/s]
  6%|▌         | 22899/371472 [1:50:37<27:22:32,  3.54it/s]
  6%|▌         | 22900/371472 [1:50:37<26:45:51,  3.62it/s]
                                                           
{'loss': 4.3717, 'learning_rate': 9.449729578314551e-07, 'epoch': 0.99}

  6%|▌         | 22900/371472 [1:50:37<26:45:51,  3.62it/s]
  6%|▌         | 22901/371472 [1:50:37<26:20:07,  3.68it/s]
  6%|▌         | 22902/371472 [1:50:38<26:53:18,  3.60it/s]
  6%|▌         | 22903/371472 [1:50:38<26:11:41,  3.70it/s]
  6%|▌         | 22904/371472 [1:50:38<26:15:12,  3.69it/s]
  6%|▌         | 22905/371472 [1:50:39<26:34:07,  3.64it/s]
  6%|▌         | 22906/371472 [1:50:39<26:37:24,  3.64it/s]
  6%|▌         | 22907/371472 [1:50:39<26:43:52,  3.62it/s]
  6%|▌         | 22908/371472 [1:50:39<29:41:27,  3.26it/s]
  6%|▌         | 22909/371472 [1:50:40<28:14:55,  3.43it/s]
  6%|▌         | 22910/371472 [1:50:40<31:01:32,  3.12it/s]
  6%|▌         | 22911/371472 [1:50:40<29:06:53,  3.33it/s]
  6%|▌         | 22912/371472 [1:50:41<29:20:53,  3.30it/s]
  6%|▌         | 22913/371472 [1:50:41<28:31:44,  3.39it/s]
  6%|▌         | 22914/371472 [1:50:41<28:08:04,  3.44it/s]
  6%|▌         | 22915/371472 [1:50:41<27:47:15,  3.48it/s]
  6%|▌         | 22916/371472 [1:50:42<27:15:37,  3.55it/s]
  6%|▌         | 22917/371472 [1:50:42<27:09:33,  3.56it/s]
  6%|▌         | 22918/371472 [1:50:42<26:48:51,  3.61it/s]
  6%|▌         | 22919/371472 [1:50:43<29:05:31,  3.33it/s]
  6%|▌         | 22920/371472 [1:50:43<28:42:54,  3.37it/s]
                                                           
{'loss': 4.7009, 'learning_rate': 9.449244758559761e-07, 'epoch': 0.99}

  6%|▌         | 22920/371472 [1:50:43<28:42:54,  3.37it/s]
  6%|▌         | 22921/371472 [1:50:43<27:52:21,  3.47it/s]
  6%|▌         | 22922/371472 [1:50:44<27:42:25,  3.49it/s]
  6%|▌         | 22923/371472 [1:50:44<28:32:50,  3.39it/s]
  6%|▌         | 22924/371472 [1:50:44<27:24:56,  3.53it/s]
  6%|▌         | 22925/371472 [1:50:44<27:10:08,  3.56it/s]
  6%|▌         | 22926/371472 [1:50:45<26:38:57,  3.63it/s]
  6%|▌         | 22927/371472 [1:50:45<26:24:45,  3.67it/s]
  6%|▌         | 22928/371472 [1:50:45<26:07:52,  3.71it/s]
  6%|▌         | 22929/371472 [1:50:45<28:30:46,  3.40it/s]
  6%|▌         | 22930/371472 [1:50:46<27:26:10,  3.53it/s]
  6%|▌         | 22931/371472 [1:50:46<26:26:11,  3.66it/s]
  6%|▌         | 22932/371472 [1:50:46<25:47:49,  3.75it/s]
  6%|▌         | 22933/371472 [1:50:47<27:14:01,  3.56it/s]
  6%|▌         | 22934/371472 [1:50:47<26:48:39,  3.61it/s]
  6%|▌         | 22935/371472 [1:50:47<26:33:08,  3.65it/s]
  6%|▌         | 22936/371472 [1:50:47<26:24:18,  3.67it/s]
  6%|▌         | 22937/371472 [1:50:48<27:20:46,  3.54it/s]
  6%|▌         | 22938/371472 [1:50:48<27:10:51,  3.56it/s]
  6%|▌         | 22939/371472 [1:50:48<27:44:26,  3.49it/s]
  6%|▌         | 22940/371472 [1:50:49<28:46:39,  3.36it/s]
                                                           
{'loss': 4.5667, 'learning_rate': 9.448759938804972e-07, 'epoch': 0.99}

  6%|▌         | 22940/371472 [1:50:49<28:46:39,  3.36it/s]
  6%|▌         | 22941/371472 [1:50:49<28:23:02,  3.41it/s]
  6%|▌         | 22942/371472 [1:50:49<28:02:43,  3.45it/s]
  6%|▌         | 22943/371472 [1:50:49<27:51:10,  3.48it/s]
  6%|▌         | 22944/371472 [1:50:50<28:01:55,  3.45it/s]
  6%|▌         | 22945/371472 [1:50:50<28:18:17,  3.42it/s]
  6%|▌         | 22946/371472 [1:50:50<29:07:27,  3.32it/s]
  6%|▌         | 22947/371472 [1:50:51<29:26:13,  3.29it/s]
  6%|▌         | 22948/371472 [1:50:51<28:54:40,  3.35it/s]
  6%|▌         | 22949/371472 [1:50:51<27:41:35,  3.50it/s]
  6%|▌         | 22950/371472 [1:50:51<26:53:06,  3.60it/s]
  6%|▌         | 22951/371472 [1:50:52<26:26:15,  3.66it/s]
  6%|▌         | 22952/371472 [1:50:52<27:39:22,  3.50it/s]
  6%|▌         | 22953/371472 [1:50:52<27:11:41,  3.56it/s]
  6%|▌         | 22954/371472 [1:50:53<26:12:06,  3.69it/s]
  6%|▌         | 22955/371472 [1:50:53<27:46:45,  3.48it/s]
  6%|▌         | 22956/371472 [1:50:53<27:36:59,  3.51it/s]
  6%|▌         | 22957/371472 [1:50:53<27:39:18,  3.50it/s]
  6%|▌         | 22958/371472 [1:50:54<30:38:06,  3.16it/s]
  6%|▌         | 22959/371472 [1:50:54<30:31:33,  3.17it/s]
  6%|▌         | 22960/371472 [1:50:54<29:50:14,  3.24it/s]
                                                           
{'loss': 4.7279, 'learning_rate': 9.448275119050184e-07, 'epoch': 0.99}

  6%|▌         | 22960/371472 [1:50:54<29:50:14,  3.24it/s]
  6%|▌         | 22961/371472 [1:50:55<28:46:13,  3.36it/s]
  6%|▌         | 22962/371472 [1:50:55<28:02:41,  3.45it/s]
  6%|▌         | 22963/371472 [1:50:55<27:57:54,  3.46it/s]
  6%|▌         | 22964/371472 [1:50:56<27:00:54,  3.58it/s]
  6%|▌         | 22965/371472 [1:50:56<27:15:39,  3.55it/s]
  6%|▌         | 22966/371472 [1:50:56<26:33:50,  3.64it/s]
  6%|▌         | 22967/371472 [1:50:56<26:40:43,  3.63it/s]
  6%|▌         | 22968/371472 [1:50:57<27:03:37,  3.58it/s]
  6%|▌         | 22969/371472 [1:50:57<29:35:36,  3.27it/s]
  6%|▌         | 22970/371472 [1:50:57<29:22:56,  3.29it/s]
  6%|▌         | 22971/371472 [1:50:58<30:30:05,  3.17it/s]
  6%|▌         | 22972/371472 [1:50:58<29:24:24,  3.29it/s]
  6%|▌         | 22973/371472 [1:50:58<30:08:22,  3.21it/s]
  6%|▌         | 22974/371472 [1:50:58<28:35:04,  3.39it/s]
  6%|▌         | 22975/371472 [1:50:59<28:13:33,  3.43it/s]
  6%|▌         | 22976/371472 [1:50:59<27:06:37,  3.57it/s]
  6%|▌         | 22977/371472 [1:50:59<26:51:57,  3.60it/s]
  6%|▌         | 22978/371472 [1:51:00<26:35:37,  3.64it/s]
  6%|▌         | 22979/371472 [1:51:00<25:46:37,  3.76it/s]
  6%|▌         | 22980/371472 [1:51:00<27:52:37,  3.47it/s]
                                                           
{'loss': 4.6005, 'learning_rate': 9.447790299295395e-07, 'epoch': 0.99}

  6%|▌         | 22980/371472 [1:51:00<27:52:37,  3.47it/s]
  6%|▌         | 22981/371472 [1:51:00<28:54:47,  3.35it/s]
  6%|▌         | 22982/371472 [1:51:01<28:11:36,  3.43it/s]
  6%|▌         | 22983/371472 [1:51:01<27:57:50,  3.46it/s]
  6%|▌         | 22984/371472 [1:51:01<28:15:12,  3.43it/s]
  6%|▌         | 22985/371472 [1:51:02<28:38:59,  3.38it/s]
  6%|▌         | 22986/371472 [1:51:02<30:04:59,  3.22it/s]
  6%|▌         | 22987/371472 [1:51:02<29:55:03,  3.24it/s]
  6%|▌         | 22988/371472 [1:51:03<28:51:53,  3.35it/s]
  6%|▌         | 22989/371472 [1:51:03<29:20:26,  3.30it/s]
  6%|▌         | 22990/371472 [1:51:03<28:34:39,  3.39it/s]
  6%|▌         | 22991/371472 [1:51:03<28:14:29,  3.43it/s]
  6%|▌         | 22992/371472 [1:51:04<29:28:41,  3.28it/s]
  6%|▌         | 22993/371472 [1:51:04<28:46:18,  3.36it/s]
  6%|▌         | 22994/371472 [1:51:04<28:31:04,  3.39it/s]
  6%|▌         | 22995/371472 [1:51:05<27:27:23,  3.53it/s]
  6%|▌         | 22996/371472 [1:51:05<27:02:30,  3.58it/s]
  6%|▌         | 22997/371472 [1:51:05<27:02:22,  3.58it/s]
  6%|▌         | 22998/371472 [1:51:05<27:07:50,  3.57it/s]
  6%|▌         | 22999/371472 [1:51:06<26:24:06,  3.67it/s]
  6%|▌         | 23000/371472 [1:51:06<27:09:49,  3.56it/s]
                                                           
{'loss': 4.875, 'learning_rate': 9.447305479540606e-07, 'epoch': 0.99}

  6%|▌         | 23000/371472 [1:51:06<27:09:49,  3.56it/s]
  6%|▌         | 23001/371472 [1:51:06<26:53:06,  3.60it/s]
  6%|▌         | 23002/371472 [1:51:07<26:51:42,  3.60it/s]
  6%|▌         | 23003/371472 [1:51:07<26:28:38,  3.66it/s]
  6%|▌         | 23004/371472 [1:51:07<27:30:47,  3.52it/s]
  6%|▌         | 23005/371472 [1:51:07<28:01:38,  3.45it/s]
  6%|▌         | 23006/371472 [1:51:08<28:16:44,  3.42it/s]
  6%|▌         | 23007/371472 [1:51:08<27:15:17,  3.55it/s]
  6%|▌         | 23008/371472 [1:51:08<27:35:04,  3.51it/s]
  6%|▌         | 23009/371472 [1:51:09<26:40:45,  3.63it/s]
  6%|▌         | 23010/371472 [1:51:09<26:33:42,  3.64it/s]
  6%|▌         | 23011/371472 [1:51:09<27:59:47,  3.46it/s]
  6%|▌         | 23012/371472 [1:51:09<27:41:59,  3.49it/s]
  6%|▌         | 23013/371472 [1:51:10<28:22:11,  3.41it/s]
  6%|▌         | 23014/371472 [1:51:10<27:41:13,  3.50it/s]
  6%|▌         | 23015/371472 [1:51:10<27:41:47,  3.49it/s]
  6%|▌         | 23016/371472 [1:51:11<32:27:39,  2.98it/s]
  6%|▌         | 23017/371472 [1:51:11<30:39:33,  3.16it/s]
  6%|▌         | 23018/371472 [1:51:11<29:01:17,  3.34it/s]
  6%|▌         | 23019/371472 [1:51:12<28:37:15,  3.38it/s]
  6%|▌         | 23020/371472 [1:51:12<28:20:10,  3.42it/s]
                                                           
{'loss': 4.6195, 'learning_rate': 9.446820659785817e-07, 'epoch': 0.99}

  6%|▌         | 23020/371472 [1:51:12<28:20:10,  3.42it/s]
  6%|▌         | 23021/371472 [1:51:12<27:25:33,  3.53it/s]
  6%|▌         | 23022/371472 [1:51:12<27:18:25,  3.54it/s]
  6%|▌         | 23023/371472 [1:51:13<27:55:20,  3.47it/s]
  6%|▌         | 23024/371472 [1:51:13<27:40:45,  3.50it/s]
  6%|▌         | 23025/371472 [1:51:13<29:32:58,  3.28it/s]
  6%|▌         | 23026/371472 [1:51:14<30:52:16,  3.14it/s]
  6%|▌         | 23027/371472 [1:51:14<31:10:58,  3.10it/s]
  6%|▌         | 23028/371472 [1:51:14<29:42:42,  3.26it/s]
  6%|▌         | 23029/371472 [1:51:15<29:36:40,  3.27it/s]
  6%|▌         | 23030/371472 [1:51:15<30:30:40,  3.17it/s]
  6%|▌         | 23031/371472 [1:51:15<29:24:30,  3.29it/s]
  6%|▌         | 23032/371472 [1:51:15<28:29:00,  3.40it/s]
  6%|▌         | 23033/371472 [1:51:16<27:19:04,  3.54it/s]
  6%|▌         | 23034/371472 [1:51:16<26:45:13,  3.62it/s]
  6%|▌         | 23035/371472 [1:51:16<26:36:00,  3.64it/s]
  6%|▌         | 23036/371472 [1:51:16<26:18:42,  3.68it/s]
  6%|▌         | 23037/371472 [1:51:17<28:48:18,  3.36it/s]
  6%|▌         | 23038/371472 [1:51:17<27:53:21,  3.47it/s]
  6%|▌         | 23039/371472 [1:51:17<27:21:14,  3.54it/s]
  6%|▌         | 23040/371472 [1:51:18<30:06:25,  3.21it/s]
                                                           
{'loss': 4.3456, 'learning_rate': 9.446335840031028e-07, 'epoch': 0.99}

  6%|▌         | 23040/371472 [1:51:18<30:06:25,  3.21it/s]
  6%|▌         | 23041/371472 [1:51:18<28:48:43,  3.36it/s]
  6%|▌         | 23042/371472 [1:51:18<28:03:56,  3.45it/s]
  6%|▌         | 23043/371472 [1:51:19<27:22:47,  3.53it/s]
  6%|▌         | 23044/371472 [1:51:19<27:16:27,  3.55it/s]
  6%|▌         | 23045/371472 [1:51:19<28:37:16,  3.38it/s]
  6%|▌         | 23046/371472 [1:51:19<28:00:48,  3.45it/s]
  6%|▌         | 23047/371472 [1:51:20<29:40:12,  3.26it/s]
  6%|▌         | 23048/371472 [1:51:20<28:40:56,  3.37it/s]
  6%|▌         | 23049/371472 [1:51:20<28:18:04,  3.42it/s]
  6%|▌         | 23050/371472 [1:51:21<27:33:37,  3.51it/s]
  6%|▌         | 23051/371472 [1:51:21<27:49:22,  3.48it/s]
  6%|▌         | 23052/371472 [1:51:21<27:32:02,  3.52it/s]
  6%|▌         | 23053/371472 [1:51:21<27:13:27,  3.56it/s]
  6%|▌         | 23054/371472 [1:51:22<27:34:24,  3.51it/s]
  6%|▌         | 23055/371472 [1:51:22<28:34:08,  3.39it/s]
  6%|▌         | 23056/371472 [1:51:22<27:54:06,  3.47it/s]
  6%|▌         | 23057/371472 [1:51:23<27:09:00,  3.56it/s]
  6%|▌         | 23058/371472 [1:51:23<27:22:53,  3.53it/s]
  6%|▌         | 23059/371472 [1:51:23<28:10:07,  3.44it/s]
  6%|▌         | 23060/371472 [1:51:23<27:19:51,  3.54it/s]
                                                           
{'loss': 4.5356, 'learning_rate': 9.445851020276238e-07, 'epoch': 0.99}

  6%|▌         | 23060/371472 [1:51:23<27:19:51,  3.54it/s]
  6%|▌         | 23061/371472 [1:51:24<28:41:44,  3.37it/s]
  6%|▌         | 23062/371472 [1:51:24<27:58:34,  3.46it/s]
  6%|▌         | 23063/371472 [1:51:24<29:03:44,  3.33it/s]
  6%|▌         | 23064/371472 [1:51:25<29:50:19,  3.24it/s]
  6%|▌         | 23065/371472 [1:51:25<30:30:48,  3.17it/s]
  6%|▌         | 23066/371472 [1:51:25<28:55:34,  3.35it/s]
  6%|▌         | 23067/371472 [1:51:26<30:43:10,  3.15it/s]
  6%|▌         | 23068/371472 [1:51:26<30:57:34,  3.13it/s]
  6%|▌         | 23069/371472 [1:51:26<29:08:40,  3.32it/s]
  6%|▌         | 23070/371472 [1:51:27<27:45:48,  3.49it/s]
  6%|▌         | 23071/371472 [1:51:27<28:51:06,  3.35it/s]
  6%|▌         | 23072/371472 [1:51:27<28:04:24,  3.45it/s]
  6%|▌         | 23073/371472 [1:51:27<27:18:00,  3.54it/s]
  6%|▌         | 23074/371472 [1:51:28<26:39:35,  3.63it/s]
  6%|▌         | 23075/371472 [1:51:28<26:51:40,  3.60it/s]
  6%|▌         | 23076/371472 [1:51:28<27:40:14,  3.50it/s]
  6%|▌         | 23077/371472 [1:51:28<27:01:48,  3.58it/s]
  6%|▌         | 23078/371472 [1:51:29<25:59:22,  3.72it/s]
  6%|▌         | 23079/371472 [1:51:29<27:12:03,  3.56it/s]
  6%|▌         | 23080/371472 [1:51:29<27:39:00,  3.50it/s]
                                                           
{'loss': 4.5905, 'learning_rate': 9.44536620052145e-07, 'epoch': 0.99}

  6%|▌         | 23080/371472 [1:51:29<27:39:00,  3.50it/s]
  6%|▌         | 23081/371472 [1:51:30<26:59:01,  3.59it/s]
  6%|▌         | 23082/371472 [1:51:30<27:07:57,  3.57it/s]
  6%|▌         | 23083/371472 [1:51:30<27:10:15,  3.56it/s]
  6%|▌         | 23084/371472 [1:51:30<27:40:15,  3.50it/s]
  6%|▌         | 23085/371472 [1:51:31<28:17:57,  3.42it/s]
  6%|▌         | 23086/371472 [1:51:31<27:12:57,  3.56it/s]
  6%|▌         | 23087/371472 [1:51:31<28:01:58,  3.45it/s]
  6%|▌         | 23088/371472 [1:51:32<27:41:29,  3.49it/s]
  6%|▌         | 23089/371472 [1:51:32<26:31:05,  3.65it/s]
  6%|▌         | 23090/371472 [1:51:32<26:01:37,  3.72it/s]
  6%|▌         | 23091/371472 [1:51:32<25:41:42,  3.77it/s]
  6%|▌         | 23092/371472 [1:51:33<26:40:05,  3.63it/s]
  6%|▌         | 23093/371472 [1:51:33<26:30:10,  3.65it/s]
  6%|▌         | 23094/371472 [1:51:33<27:22:37,  3.53it/s]
  6%|▌         | 23095/371472 [1:51:34<27:14:01,  3.55it/s]
  6%|▌         | 23096/371472 [1:51:34<26:36:01,  3.64it/s]
  6%|▌         | 23097/371472 [1:51:34<28:20:39,  3.41it/s]
  6%|▌         | 23098/371472 [1:51:34<30:27:58,  3.18it/s]
  6%|▌         | 23099/371472 [1:51:35<29:45:58,  3.25it/s]
  6%|▌         | 23100/371472 [1:51:35<28:18:15,  3.42it/s]
                                                           
{'loss': 4.6106, 'learning_rate': 9.444881380766661e-07, 'epoch': 0.99}

  6%|▌         | 23100/371472 [1:51:35<28:18:15,  3.42it/s]
  6%|▌         | 23101/371472 [1:51:35<28:06:16,  3.44it/s]
  6%|▌         | 23102/371472 [1:51:36<27:15:35,  3.55it/s]
  6%|▌         | 23103/371472 [1:51:36<27:40:59,  3.50it/s]
  6%|▌         | 23104/371472 [1:51:36<27:21:21,  3.54it/s]
  6%|▌         | 23105/371472 [1:51:36<26:41:29,  3.63it/s]
  6%|▌         | 23106/371472 [1:51:37<28:48:35,  3.36it/s]
  6%|▌         | 23107/371472 [1:51:37<28:02:17,  3.45it/s]
  6%|▌         | 23108/371472 [1:51:37<27:52:04,  3.47it/s]
  6%|▌         | 23109/371472 [1:51:38<26:38:17,  3.63it/s]
  6%|▌         | 23110/371472 [1:51:38<30:51:14,  3.14it/s]
  6%|▌         | 23111/371472 [1:51:38<30:00:19,  3.22it/s]
  6%|▌         | 23112/371472 [1:51:39<28:49:00,  3.36it/s]
  6%|▌         | 23113/371472 [1:51:39<28:06:31,  3.44it/s]
  6%|▌         | 23114/371472 [1:51:39<28:24:22,  3.41it/s]
  6%|▌         | 23115/371472 [1:51:39<29:24:19,  3.29it/s]
  6%|▌         | 23116/371472 [1:51:40<28:31:56,  3.39it/s]
  6%|▌         | 23117/371472 [1:51:40<28:23:57,  3.41it/s]
  6%|▌         | 23118/371472 [1:51:40<28:30:58,  3.39it/s]
  6%|▌         | 23119/371472 [1:51:41<30:44:06,  3.15it/s]
  6%|▌         | 23120/371472 [1:51:41<30:01:25,  3.22it/s]
                                                           
{'loss': 4.443, 'learning_rate': 9.444396561011873e-07, 'epoch': 1.0}

  6%|▌         | 23120/371472 [1:51:41<30:01:25,  3.22it/s]
  6%|▌         | 23121/371472 [1:51:41<28:42:55,  3.37it/s]
  6%|▌         | 23122/371472 [1:51:41<28:08:49,  3.44it/s]
  6%|▌         | 23123/371472 [1:51:42<34:34:31,  2.80it/s]
  6%|▌         | 23124/371472 [1:51:42<32:23:37,  2.99it/s]
  6%|▌         | 23125/371472 [1:51:43<30:49:09,  3.14it/s]
  6%|▌         | 23126/371472 [1:51:43<32:25:14,  2.98it/s]
  6%|▌         | 23127/371472 [1:51:43<30:17:58,  3.19it/s]
  6%|▌         | 23128/371472 [1:51:44<31:51:11,  3.04it/s]
  6%|▌         | 23129/371472 [1:51:44<30:54:11,  3.13it/s]
  6%|▌         | 23130/371472 [1:51:44<31:46:24,  3.05it/s]
  6%|▌         | 23131/371472 [1:51:44<29:46:39,  3.25it/s]
  6%|▌         | 23132/371472 [1:51:45<27:50:28,  3.48it/s]
  6%|▌         | 23133/371472 [1:51:45<26:46:52,  3.61it/s]
  6%|▌         | 23134/371472 [1:51:45<26:12:37,  3.69it/s]
  6%|▌         | 23135/371472 [1:51:46<26:48:34,  3.61it/s]
  6%|▌         | 23136/371472 [1:51:46<27:02:17,  3.58it/s]
  6%|▌         | 23137/371472 [1:51:46<26:59:08,  3.59it/s]
  6%|▌         | 23138/371472 [1:51:46<29:02:19,  3.33it/s]
  6%|▌         | 23139/371472 [1:51:47<27:43:15,  3.49it/s]
  6%|▌         | 23140/371472 [1:51:47<26:46:29,  3.61it/s]
                                                           
{'loss': 4.7554, 'learning_rate': 9.443911741257083e-07, 'epoch': 1.0}

  6%|▌         | 23140/371472 [1:51:47<26:46:29,  3.61it/s]
  6%|▌         | 23141/371472 [1:51:47<26:17:10,  3.68it/s]
  6%|▌         | 23142/371472 [1:51:47<26:45:45,  3.62it/s]
  6%|▌         | 23143/371472 [1:51:48<28:43:59,  3.37it/s]
  6%|▌         | 23144/371472 [1:51:48<27:53:06,  3.47it/s]
  6%|▌         | 23145/371472 [1:51:48<27:44:58,  3.49it/s]
  6%|▌         | 23146/371472 [1:51:49<27:08:50,  3.56it/s]
  6%|▌         | 23147/371472 [1:51:49<27:51:46,  3.47it/s]
  6%|▌         | 23148/371472 [1:51:49<26:52:48,  3.60it/s]
  6%|▌         | 23149/371472 [1:51:49<27:02:48,  3.58it/s]
  6%|▌         | 23150/371472 [1:51:50<27:12:04,  3.56it/s]
  6%|▌         | 23151/371472 [1:51:50<26:49:14,  3.61it/s]
  6%|▌         | 23152/371472 [1:51:50<26:28:15,  3.66it/s]
  6%|▌         | 23153/371472 [1:51:51<29:05:17,  3.33it/s]
  6%|▌         | 23154/371472 [1:51:51<29:34:36,  3.27it/s]
  6%|▌         | 23155/371472 [1:51:51<28:29:53,  3.40it/s]
  6%|▌         | 23156/371472 [1:51:52<29:55:20,  3.23it/s]
  6%|▌         | 23157/371472 [1:51:52<28:50:24,  3.35it/s]
  6%|▌         | 23158/371472 [1:51:52<29:12:22,  3.31it/s]
  6%|▌         | 23159/371472 [1:51:52<28:18:31,  3.42it/s]
  6%|▌         | 23160/371472 [1:51:53<28:12:13,  3.43it/s]
                                                           
{'loss': 4.4825, 'learning_rate': 9.443426921502295e-07, 'epoch': 1.0}

  6%|▌         | 23160/371472 [1:51:53<28:12:13,  3.43it/s]
  6%|▌         | 23161/371472 [1:51:53<28:19:33,  3.42it/s]
  6%|▌         | 23162/371472 [1:51:53<28:26:49,  3.40it/s]
  6%|▌         | 23163/371472 [1:51:54<28:43:32,  3.37it/s]
  6%|▌         | 23164/371472 [1:51:54<28:05:22,  3.44it/s]
  6%|▌         | 23165/371472 [1:51:54<28:16:18,  3.42it/s]
  6%|▌         | 23166/371472 [1:51:54<27:45:22,  3.49it/s]
  6%|▌         | 23167/371472 [1:51:55<27:21:04,  3.54it/s]
  6%|▌         | 23168/371472 [1:51:55<27:14:20,  3.55it/s]
  6%|▌         | 23169/371472 [1:51:55<27:44:49,  3.49it/s]
  6%|▌         | 23170/371472 [1:51:56<27:30:51,  3.52it/s]
  6%|▌         | 23171/371472 [1:51:56<27:36:20,  3.50it/s]
  6%|▌         | 23172/371472 [1:51:56<28:43:51,  3.37it/s]
  6%|▌         | 23173/371472 [1:51:56<27:41:21,  3.49it/s]
  6%|▌         | 23174/371472 [1:51:57<28:03:50,  3.45it/s]
  6%|▌         | 23175/371472 [1:51:57<27:22:39,  3.53it/s]
  6%|▌         | 23176/371472 [1:51:57<26:49:49,  3.61it/s]
  6%|▌         | 23177/371472 [1:51:58<27:31:56,  3.51it/s]
  6%|▌         | 23178/371472 [1:51:58<26:50:35,  3.60it/s]
  6%|▌         | 23179/371472 [1:51:58<27:14:30,  3.55it/s]
  6%|▌         | 23180/371472 [1:51:58<26:45:09,  3.62it/s]
                                                           
{'loss': 4.8178, 'learning_rate': 9.442942101747505e-07, 'epoch': 1.0}

  6%|▌         | 23180/371472 [1:51:58<26:45:09,  3.62it/s]
  6%|▌         | 23181/371472 [1:51:59<26:23:47,  3.67it/s]
  6%|▌         | 23182/371472 [1:51:59<26:36:13,  3.64it/s]
  6%|▌         | 23183/371472 [1:51:59<26:01:04,  3.72it/s]
  6%|▌         | 23184/371472 [1:52:00<26:01:15,  3.72it/s]
  6%|▌         | 23185/371472 [1:52:00<25:32:38,  3.79it/s]
  6%|▌         | 23186/371472 [1:52:00<26:02:50,  3.71it/s]
  6%|▌         | 23187/371472 [1:52:00<27:36:26,  3.50it/s]
  6%|▌         | 23188/371472 [1:52:01<28:30:23,  3.39it/s]
  6%|▌         | 23189/371472 [1:52:01<27:40:42,  3.50it/s]
  6%|▌         | 23190/371472 [1:52:01<28:32:40,  3.39it/s]
  6%|▌         | 23191/371472 [1:52:02<28:20:10,  3.41it/s]
  6%|▌         | 23192/371472 [1:52:02<30:11:13,  3.20it/s]
  6%|▌         | 23193/371472 [1:52:02<29:42:18,  3.26it/s]
  6%|▌         | 23194/371472 [1:52:02<28:25:04,  3.40it/s]
  6%|▌         | 23195/371472 [1:52:03<27:46:39,  3.48it/s]
  6%|▌         | 23196/371472 [1:52:03<27:59:20,  3.46it/s]
  6%|▌         | 23197/371472 [1:52:03<28:23:12,  3.41it/s]
  6%|▌         | 23198/371472 [1:52:04<27:04:43,  3.57it/s]
  6%|▌         | 23199/371472 [1:52:04<27:18:04,  3.54it/s]
  6%|▌         | 23200/371472 [1:52:04<27:05:04,  3.57it/s]
                                                           
{'loss': 4.51, 'learning_rate': 9.442457281992717e-07, 'epoch': 1.0}

  6%|▌         | 23200/371472 [1:52:04<27:05:04,  3.57it/s]
  6%|▌         | 23201/371472 [1:52:04<28:05:23,  3.44it/s]
  6%|▌         | 23202/371472 [1:52:05<29:06:11,  3.32it/s]
  6%|▌         | 23203/371472 [1:52:05<28:19:58,  3.41it/s]
  6%|▌         | 23204/371472 [1:52:05<28:13:23,  3.43it/s]
  6%|▌         | 23205/371472 [1:52:06<27:26:36,  3.53it/s]
  6%|▌         | 23206/371472 [1:52:06<27:23:10,  3.53it/s]
  6%|▌         | 23207/371472 [1:52:06<26:20:26,  3.67it/s]
  6%|▌         | 23208/371472 [1:52:06<27:59:08,  3.46it/s]
  6%|▌         | 23209/371472 [1:52:07<30:54:46,  3.13it/s]
  6%|▌         | 23210/371472 [1:52:07<29:52:23,  3.24it/s]
  6%|▌         | 23211/371472 [1:52:07<30:00:41,  3.22it/s]
  6%|▌         | 23212/371472 [1:52:08<29:04:26,  3.33it/s]
  6%|▌         | 23213/371472 [1:52:08<29:42:46,  3.26it/s]
  6%|▌         | 23214/371472 [1:52:08<29:17:31,  3.30it/s]
  6%|▌         | 23215/371472 [1:52:09<28:50:26,  3.35it/s]
  6%|▌         | 23216/371472 [1:52:09<28:01:02,  3.45it/s]
  6%|▋         | 23217/371472 [1:52:09<28:23:44,  3.41it/s]Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co./docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
Non-default generation parameters: {'max_length': 200, 'early_stopping': True, 'num_beams': 5, 'forced_eos_token_id': 2}
/opt/conda/lib/python3.10/multiprocessing/popen_fork.py:66: RuntimeWarning: os.fork() was called. os.fork() is incompatible with multithreaded code, and JAX is multithreaded, so this will likely lead to a deadlock.
  self.pid = os.fork()

  6%|▋         | 23218/371472 [1:52:20<340:25:10,  3.52s/it]
  6%|▋         | 23219/371472 [1:52:21<246:28:56,  2.55s/it]
  6%|▋         | 23220/371472 [1:52:21<180:47:45,  1.87s/it]
                                                            
{'loss': 4.6528, 'learning_rate': 9.441972462237927e-07, 'epoch': 1.0}

  6%|▋         | 23220/371472 [1:52:21<180:47:45,  1.87s/it]
  6%|▋         | 23221/371472 [1:52:21<135:28:39,  1.40s/it]
  6%|▋         | 23222/371472 [1:52:21<102:47:02,  1.06s/it]
  6%|▋         | 23223/371472 [1:52:22<80:09:39,  1.21it/s] 
  6%|▋         | 23224/371472 [1:52:22<63:51:09,  1.51it/s]
  6%|▋         | 23225/371472 [1:52:22<53:25:14,  1.81it/s]
  6%|▋         | 23226/371472 [1:52:23<45:33:50,  2.12it/s]
  6%|▋         | 23227/371472 [1:52:23<40:12:12,  2.41it/s]
  6%|▋         | 23228/371472 [1:52:23<35:58:39,  2.69it/s]
  6%|▋         | 23229/371472 [1:52:23<34:02:56,  2.84it/s]
  6%|▋         | 23230/371472 [1:52:24<33:12:33,  2.91it/s]
  6%|▋         | 23231/371472 [1:52:24<31:01:41,  3.12it/s]
  6%|▋         | 23232/371472 [1:52:24<31:57:20,  3.03it/s]
  6%|▋         | 23233/371472 [1:52:25<30:28:05,  3.17it/s]
  6%|▋         | 23234/371472 [1:52:25<29:55:03,  3.23it/s]
  6%|▋         | 23235/371472 [1:52:25<29:38:50,  3.26it/s]
  6%|▋         | 23236/371472 [1:52:25<28:40:42,  3.37it/s]
  6%|▋         | 23237/371472 [1:52:26<28:52:29,  3.35it/s]
  6%|▋         | 23238/371472 [1:52:26<29:48:39,  3.24it/s]
  6%|▋         | 23239/371472 [1:52:26<30:02:39,  3.22it/s]
  6%|▋         | 23240/371472 [1:52:27<29:43:53,  3.25it/s]
                                                           
{'loss': 4.6363, 'learning_rate': 9.441487642483139e-07, 'epoch': 1.0}

  6%|▋         | 23240/371472 [1:52:27<29:43:53,  3.25it/s]
  6%|▋         | 23241/371472 [1:52:27<28:51:58,  3.35it/s]
  6%|▋         | 23242/371472 [1:52:27<28:35:59,  3.38it/s]
  6%|▋         | 23243/371472 [1:52:28<27:59:44,  3.46it/s]
  6%|▋         | 23244/371472 [1:52:28<28:33:41,  3.39it/s]
  6%|▋         | 23245/371472 [1:52:28<29:26:29,  3.29it/s]
  6%|▋         | 23246/371472 [1:52:28<28:40:04,  3.37it/s]
  6%|▋         | 23247/371472 [1:52:29<28:40:41,  3.37it/s]
  6%|▋         | 23248/371472 [1:52:29<27:58:27,  3.46it/s]
  6%|▋         | 23249/371472 [1:52:29<27:39:21,  3.50it/s]
  6%|▋         | 23250/371472 [1:52:30<27:19:36,  3.54it/s]
  6%|▋         | 23251/371472 [1:52:30<30:20:36,  3.19it/s]
  6%|▋         | 23252/371472 [1:52:30<29:13:52,  3.31it/s]
  6%|▋         | 23253/371472 [1:52:31<29:04:36,  3.33it/s]
  6%|▋         | 23254/371472 [1:52:31<30:57:31,  3.12it/s]
  6%|▋         | 23255/371472 [1:52:31<29:16:26,  3.30it/s]
  6%|▋         | 23256/371472 [1:52:31<28:12:31,  3.43it/s]
  6%|▋         | 23257/371472 [1:52:32<27:29:53,  3.52it/s]
  6%|▋         | 23258/371472 [1:52:32<27:32:36,  3.51it/s]
  6%|▋         | 23259/371472 [1:52:32<26:47:06,  3.61it/s]
  6%|▋         | 23260/371472 [1:52:33<27:32:19,  3.51it/s]
                                                           
{'loss': 4.398, 'learning_rate': 9.44100282272835e-07, 'epoch': 1.0}

  6%|▋         | 23260/371472 [1:52:33<27:32:19,  3.51it/s]
  6%|▋         | 23261/371472 [1:52:33<28:31:56,  3.39it/s]
  6%|▋         | 23262/371472 [1:52:33<28:35:54,  3.38it/s]
  6%|▋         | 23263/371472 [1:52:34<29:12:39,  3.31it/s]
  6%|▋         | 23264/371472 [1:52:34<29:22:39,  3.29it/s]
  6%|▋         | 23265/371472 [1:52:34<29:45:24,  3.25it/s]
  6%|▋         | 23266/371472 [1:52:35<31:40:52,  3.05it/s]
  6%|▋         | 23267/371472 [1:52:35<29:44:51,  3.25it/s]
  6%|▋         | 23268/371472 [1:52:35<30:32:03,  3.17it/s]
  6%|▋         | 23269/371472 [1:52:35<30:55:34,  3.13it/s]
  6%|▋         | 23270/371472 [1:52:36<30:44:06,  3.15it/s]
  6%|▋         | 23271/371472 [1:52:36<29:10:44,  3.31it/s]
  6%|▋         | 23272/371472 [1:52:36<28:34:44,  3.38it/s]
  6%|▋         | 23273/371472 [1:52:37<28:48:18,  3.36it/s]
  6%|▋         | 23274/371472 [1:52:37<28:05:04,  3.44it/s]
  6%|▋         | 23275/371472 [1:52:37<29:03:05,  3.33it/s]
  6%|▋         | 23276/371472 [1:52:38<29:08:34,  3.32it/s]
  6%|▋         | 23277/371472 [1:52:38<28:05:26,  3.44it/s]
  6%|▋         | 23278/371472 [1:52:38<28:04:30,  3.45it/s]
  6%|▋         | 23279/371472 [1:52:38<27:54:53,  3.46it/s]
  6%|▋         | 23280/371472 [1:52:39<28:23:55,  3.41it/s]
                                                           
{'loss': 4.5253, 'learning_rate': 9.440518002973562e-07, 'epoch': 1.0}

  6%|▋         | 23280/371472 [1:52:39<28:23:55,  3.41it/s]
  6%|▋         | 23281/371472 [1:52:39<28:10:17,  3.43it/s]
  6%|▋         | 23282/371472 [1:52:39<27:35:46,  3.50it/s]
  6%|▋         | 23283/371472 [1:52:40<28:26:28,  3.40it/s]
  6%|▋         | 23284/371472 [1:52:40<28:31:49,  3.39it/s]
  6%|▋         | 23285/371472 [1:52:40<28:11:13,  3.43it/s]
  6%|▋         | 23286/371472 [1:52:40<30:09:44,  3.21it/s]
  6%|▋         | 23287/371472 [1:52:41<30:48:19,  3.14it/s]
  6%|▋         | 23288/371472 [1:52:41<29:35:20,  3.27it/s]
  6%|▋         | 23289/371472 [1:52:41<30:31:02,  3.17it/s]
  6%|▋         | 23290/371472 [1:52:42<29:44:46,  3.25it/s]
  6%|▋         | 23291/371472 [1:52:42<28:51:13,  3.35it/s]
  6%|▋         | 23292/371472 [1:52:42<28:03:00,  3.45it/s]
  6%|▋         | 23293/371472 [1:52:43<29:31:09,  3.28it/s]
  6%|▋         | 23294/371472 [1:52:43<28:11:47,  3.43it/s]
  6%|▋         | 23295/371472 [1:52:43<28:06:05,  3.44it/s]
  6%|▋         | 23296/371472 [1:52:43<29:25:07,  3.29it/s]
  6%|▋         | 23297/371472 [1:52:44<28:05:11,  3.44it/s]
  6%|▋         | 23298/371472 [1:52:44<28:21:41,  3.41it/s]
  6%|▋         | 23299/371472 [1:52:44<28:20:13,  3.41it/s]
  6%|▋         | 23300/371472 [1:52:45<29:20:33,  3.30it/s]
                                                           
{'loss': 4.3179, 'learning_rate': 9.44003318321877e-07, 'epoch': 1.0}

  6%|▋         | 23300/371472 [1:52:45<29:20:33,  3.30it/s]
  6%|▋         | 23301/371472 [1:52:45<28:46:03,  3.36it/s]
  6%|▋         | 23302/371472 [1:52:45<31:12:41,  3.10it/s]
  6%|▋         | 23303/371472 [1:52:46<29:26:07,  3.29it/s]
  6%|▋         | 23304/371472 [1:52:46<29:48:11,  3.25it/s]
  6%|▋         | 23305/371472 [1:52:46<30:22:05,  3.18it/s]
  6%|▋         | 23306/371472 [1:52:47<30:06:53,  3.21it/s]
  6%|▋         | 23307/371472 [1:52:47<31:02:07,  3.12it/s]
  6%|▋         | 23308/371472 [1:52:47<30:25:17,  3.18it/s]
  6%|▋         | 23309/371472 [1:52:48<32:07:38,  3.01it/s]
  6%|▋         | 23310/371472 [1:52:48<31:12:49,  3.10it/s]
  6%|▋         | 23311/371472 [1:52:48<30:51:33,  3.13it/s]
  6%|▋         | 23312/371472 [1:52:48<29:36:50,  3.27it/s]
  6%|▋         | 23313/371472 [1:52:49<30:54:09,  3.13it/s]
  6%|▋         | 23314/371472 [1:52:49<29:50:59,  3.24it/s]
  6%|▋         | 23315/371472 [1:52:49<28:55:01,  3.34it/s]
  6%|▋         | 23316/371472 [1:52:50<28:39:09,  3.38it/s]
  6%|▋         | 23317/371472 [1:52:50<29:47:18,  3.25it/s]
  6%|▋         | 23318/371472 [1:52:50<28:32:28,  3.39it/s]
  6%|▋         | 23319/371472 [1:52:51<30:03:43,  3.22it/s]
  6%|▋         | 23320/371472 [1:52:51<29:55:15,  3.23it/s]
                                                           
{'loss': 4.6132, 'learning_rate': 9.439548363463983e-07, 'epoch': 1.0}

  6%|▋         | 23320/371472 [1:52:51<29:55:15,  3.23it/s]
  6%|▋         | 23321/371472 [1:52:51<29:26:14,  3.29it/s]
  6%|▋         | 23322/371472 [1:52:51<28:18:00,  3.42it/s]
  6%|▋         | 23323/371472 [1:52:52<28:38:46,  3.38it/s]
  6%|▋         | 23324/371472 [1:52:52<27:52:12,  3.47it/s]
  6%|▋         | 23325/371472 [1:52:52<29:16:30,  3.30it/s]
  6%|▋         | 23326/371472 [1:52:53<30:29:42,  3.17it/s]
  6%|▋         | 23327/371472 [1:52:53<32:47:08,  2.95it/s]
  6%|▋         | 23328/371472 [1:52:53<33:32:35,  2.88it/s]
  6%|▋         | 23329/371472 [1:52:54<38:17:47,  2.53it/s]
  6%|▋         | 23330/371472 [1:52:54<34:30:47,  2.80it/s]
  6%|▋         | 23331/371472 [1:52:54<31:26:10,  3.08it/s]
  6%|▋         | 23332/371472 [1:52:55<30:50:03,  3.14it/s]
  6%|▋         | 23333/371472 [1:52:55<30:16:06,  3.19it/s]
  6%|▋         | 23334/371472 [1:52:55<28:37:48,  3.38it/s]
  6%|▋         | 23335/371472 [1:52:56<29:27:53,  3.28it/s]
  6%|▋         | 23336/371472 [1:52:56<30:50:26,  3.14it/s]
  6%|▋         | 23337/371472 [1:52:56<28:51:19,  3.35it/s]
  6%|▋         | 23338/371472 [1:52:57<28:21:27,  3.41it/s]
  6%|▋         | 23339/371472 [1:52:57<28:01:32,  3.45it/s]
  6%|▋         | 23340/371472 [1:52:57<27:56:14,  3.46it/s]
                                                           
{'loss': 4.3085, 'learning_rate': 9.439063543709194e-07, 'epoch': 1.01}

  6%|▋         | 23340/371472 [1:52:57<27:56:14,  3.46it/s]
  6%|▋         | 23341/371472 [1:52:57<27:58:12,  3.46it/s]
  6%|▋         | 23342/371472 [1:52:58<30:34:18,  3.16it/s]
  6%|▋         | 23343/371472 [1:52:58<28:43:47,  3.37it/s]
  6%|▋         | 23344/371472 [1:52:58<28:07:55,  3.44it/s]
  6%|▋         | 23345/371472 [1:52:59<28:12:10,  3.43it/s]
  6%|▋         | 23346/371472 [1:52:59<28:56:05,  3.34it/s]
  6%|▋         | 23347/371472 [1:52:59<28:42:39,  3.37it/s]
  6%|▋         | 23348/371472 [1:53:00<28:27:01,  3.40it/s]
  6%|▋         | 23349/371472 [1:53:00<28:10:54,  3.43it/s]
  6%|▋         | 23350/371472 [1:53:00<27:24:31,  3.53it/s]
  6%|▋         | 23351/371472 [1:53:00<27:41:50,  3.49it/s]
  6%|▋         | 23352/371472 [1:53:01<27:59:54,  3.45it/s]
  6%|▋         | 23353/371472 [1:53:01<27:24:53,  3.53it/s]
  6%|▋         | 23354/371472 [1:53:01<28:18:26,  3.42it/s]
  6%|▋         | 23355/371472 [1:53:02<29:56:33,  3.23it/s]
  6%|▋         | 23356/371472 [1:53:02<29:59:18,  3.22it/s]
  6%|▋         | 23357/371472 [1:53:02<29:30:09,  3.28it/s]
  6%|▋         | 23358/371472 [1:53:03<30:07:45,  3.21it/s]
  6%|▋         | 23359/371472 [1:53:03<30:54:11,  3.13it/s]
  6%|▋         | 23360/371472 [1:53:03<30:38:23,  3.16it/s]
                                                           
{'loss': 4.6764, 'learning_rate': 9.438578723954406e-07, 'epoch': 1.01}

  6%|▋         | 23360/371472 [1:53:03<30:38:23,  3.16it/s]
  6%|▋         | 23361/371472 [1:53:03<29:43:02,  3.25it/s]
  6%|▋         | 23362/371472 [1:53:04<29:40:37,  3.26it/s]
  6%|▋         | 23363/371472 [1:53:04<28:29:46,  3.39it/s]
  6%|▋         | 23364/371472 [1:53:04<27:54:49,  3.46it/s]
  6%|▋         | 23365/371472 [1:53:05<27:11:07,  3.56it/s]
  6%|▋         | 23366/371472 [1:53:05<27:41:48,  3.49it/s]
  6%|▋         | 23367/371472 [1:53:05<28:07:45,  3.44it/s]
  6%|▋         | 23368/371472 [1:53:05<28:57:21,  3.34it/s]
  6%|▋         | 23369/371472 [1:53:06<28:36:22,  3.38it/s]
  6%|▋         | 23370/371472 [1:53:06<27:39:47,  3.50it/s]
  6%|▋         | 23371/371472 [1:53:06<27:55:53,  3.46it/s]
  6%|▋         | 23372/371472 [1:53:07<28:42:11,  3.37it/s]
  6%|▋         | 23373/371472 [1:53:07<28:24:24,  3.40it/s]
  6%|▋         | 23374/371472 [1:53:07<29:16:18,  3.30it/s]
  6%|▋         | 23375/371472 [1:53:08<28:23:00,  3.41it/s]
  6%|▋         | 23376/371472 [1:53:08<29:19:17,  3.30it/s]
  6%|▋         | 23377/371472 [1:53:08<31:10:17,  3.10it/s]
  6%|▋         | 23378/371472 [1:53:08<29:33:25,  3.27it/s]
  6%|▋         | 23379/371472 [1:53:09<28:14:07,  3.42it/s]
  6%|▋         | 23380/371472 [1:53:09<29:15:42,  3.30it/s]
                                                           
{'loss': 4.6113, 'learning_rate': 9.438093904199616e-07, 'epoch': 1.01}

  6%|▋         | 23380/371472 [1:53:09<29:15:42,  3.30it/s]
  6%|▋         | 23381/371472 [1:53:09<32:41:49,  2.96it/s]
  6%|▋         | 23382/371472 [1:53:10<30:34:24,  3.16it/s]
  6%|▋         | 23383/371472 [1:53:10<31:09:47,  3.10it/s]
  6%|▋         | 23384/371472 [1:53:10<30:38:05,  3.16it/s]
  6%|▋         | 23385/371472 [1:53:11<29:02:15,  3.33it/s]
  6%|▋         | 23386/371472 [1:53:11<27:54:40,  3.46it/s]
  6%|▋         | 23387/371472 [1:53:11<28:09:12,  3.43it/s]
  6%|▋         | 23388/371472 [1:53:11<27:53:41,  3.47it/s]
  6%|▋         | 23389/371472 [1:53:12<29:16:41,  3.30it/s]
  6%|▋         | 23390/371472 [1:53:12<28:15:19,  3.42it/s]
  6%|▋         | 23391/371472 [1:53:12<27:01:57,  3.58it/s]
  6%|▋         | 23392/371472 [1:53:13<27:00:23,  3.58it/s]
  6%|▋         | 23393/371472 [1:53:13<27:02:57,  3.57it/s]
  6%|▋         | 23394/371472 [1:53:13<28:07:39,  3.44it/s]
  6%|▋         | 23395/371472 [1:53:14<27:53:53,  3.47it/s]
  6%|▋         | 23396/371472 [1:53:14<28:05:22,  3.44it/s]
  6%|▋         | 23397/371472 [1:53:14<27:19:21,  3.54it/s]
  6%|▋         | 23398/371472 [1:53:14<27:08:47,  3.56it/s]
  6%|▋         | 23399/371472 [1:53:15<26:24:13,  3.66it/s]
  6%|▋         | 23400/371472 [1:53:15<26:29:18,  3.65it/s]
                                                           
{'loss': 4.7279, 'learning_rate': 9.437609084444828e-07, 'epoch': 1.01}

  6%|▋         | 23400/371472 [1:53:15<26:29:18,  3.65it/s]
  6%|▋         | 23401/371472 [1:53:15<27:17:58,  3.54it/s]
  6%|▋         | 23402/371472 [1:53:15<27:31:37,  3.51it/s]
  6%|▋         | 23403/371472 [1:53:16<27:20:08,  3.54it/s]
  6%|▋         | 23404/371472 [1:53:16<27:49:40,  3.47it/s]
  6%|▋         | 23405/371472 [1:53:16<28:18:07,  3.42it/s]
  6%|▋         | 23406/371472 [1:53:17<27:16:46,  3.54it/s]
  6%|▋         | 23407/371472 [1:53:17<26:25:04,  3.66it/s]
  6%|▋         | 23408/371472 [1:53:17<27:54:43,  3.46it/s]
  6%|▋         | 23409/371472 [1:53:17<27:59:09,  3.45it/s]
  6%|▋         | 23410/371472 [1:53:18<28:28:27,  3.40it/s]
  6%|▋         | 23411/371472 [1:53:18<28:42:40,  3.37it/s]
  6%|▋         | 23412/371472 [1:53:18<27:54:18,  3.46it/s]
  6%|▋         | 23413/371472 [1:53:19<27:06:40,  3.57it/s]
  6%|▋         | 23414/371472 [1:53:19<27:30:07,  3.52it/s]
  6%|▋         | 23415/371472 [1:53:19<28:10:37,  3.43it/s]
  6%|▋         | 23416/371472 [1:53:19<26:55:47,  3.59it/s]
  6%|▋         | 23417/371472 [1:53:20<27:01:57,  3.58it/s]
  6%|▋         | 23418/371472 [1:53:20<29:13:42,  3.31it/s]
  6%|▋         | 23419/371472 [1:53:20<30:27:03,  3.17it/s]
  6%|▋         | 23420/371472 [1:53:21<29:19:02,  3.30it/s]
                                                           
{'loss': 4.4206, 'learning_rate': 9.437124264690038e-07, 'epoch': 1.01}

  6%|▋         | 23420/371472 [1:53:21<29:19:02,  3.30it/s]
  6%|▋         | 23421/371472 [1:53:21<30:00:23,  3.22it/s]
  6%|▋         | 23422/371472 [1:53:21<30:05:17,  3.21it/s]
  6%|▋         | 23423/371472 [1:53:22<29:46:30,  3.25it/s]
  6%|▋         | 23424/371472 [1:53:22<29:36:49,  3.26it/s]
  6%|▋         | 23425/371472 [1:53:22<29:32:13,  3.27it/s]
  6%|▋         | 23426/371472 [1:53:23<28:19:29,  3.41it/s]
  6%|▋         | 23427/371472 [1:53:23<28:00:07,  3.45it/s]
  6%|▋         | 23428/371472 [1:53:23<28:01:42,  3.45it/s]
  6%|▋         | 23429/371472 [1:53:23<28:22:30,  3.41it/s]
  6%|▋         | 23430/371472 [1:53:24<27:35:17,  3.50it/s]
  6%|▋         | 23431/371472 [1:53:24<27:12:37,  3.55it/s]
  6%|▋         | 23432/371472 [1:53:24<27:25:57,  3.52it/s]
  6%|▋         | 23433/371472 [1:53:25<27:36:37,  3.50it/s]
  6%|▋         | 23434/371472 [1:53:25<26:39:18,  3.63it/s]
  6%|▋         | 23435/371472 [1:53:25<26:31:42,  3.64it/s]
  6%|▋         | 23436/371472 [1:53:25<28:16:11,  3.42it/s]
  6%|▋         | 23437/371472 [1:53:26<27:08:44,  3.56it/s]
  6%|▋         | 23438/371472 [1:53:26<27:14:18,  3.55it/s]
  6%|▋         | 23439/371472 [1:53:26<26:49:21,  3.60it/s]
  6%|▋         | 23440/371472 [1:53:26<26:16:50,  3.68it/s]
                                                           
{'loss': 4.5451, 'learning_rate': 9.436639444935248e-07, 'epoch': 1.01}

  6%|▋         | 23440/371472 [1:53:26<26:16:50,  3.68it/s]
  6%|▋         | 23441/371472 [1:53:27<26:08:53,  3.70it/s]
  6%|▋         | 23442/371472 [1:53:27<26:16:43,  3.68it/s]