log/modified_beam_search/log-decode-epoch-14-avg-8-modified_beam_search-beam-size-4-2022-11-21-09-01-02

2022-11-21 09:01:02,312 INFO [decode.py:574] Decoding started
2022-11-21 09:01:02,313 INFO [decode.py:580] Device: cuda:0
2022-11-21 09:01:02,320 INFO [decode.py:590] {'best_train_loss': inf, 'best_valid_loss': inf, 'best_train_epoch': -1, 'best_valid_epoch': -1, 'batch_idx_train': 0, 'log_interval': 100, 'reset_interval': 200, 'valid_interval': 3000, 'feature_dim': 80, 'subsampling_factor': 4, 'warm_step': 2000, 'env_info': {'k2-version': '1.21', 'k2-build-type': 'Debug', 'k2-with-cuda': True, 'k2-git-sha1': 'f271e82ef30f75fecbae44b163e1244e53def116', 'k2-git-date': 'Fri Oct 28 05:02:16 2022', 'lhotse-version': '1.9.0.dev+git.97bf4b0.dirty', 'torch-version': '1.10.0+cu111', 'torch-cuda-available': True, 'torch-cuda-version': '11.1', 'python-version': '3.8', 'icefall-git-branch': 'ami_recipe', 'icefall-git-sha1': 'd1b5a16-dirty', 'icefall-git-date': 'Sun Nov 20 22:32:57 2022', 'icefall-path': '/exp/draj/mini_scale_2022/icefall', 'k2-path': '/exp/draj/mini_scale_2022/k2/k2/python/k2/__init__.py', 'lhotse-path': '/exp/draj/mini_scale_2022/lhotse/lhotse/__init__.py', 'hostname': 'r2n06', 'IP address': '10.1.2.6'}, 'epoch': 14, 'iter': 0, 'avg': 8, 'use_averaged_model': True, 'exp_dir': PosixPath('pruned_transducer_stateless7/exp/v2'), 'lang_dir': PosixPath('data/lang_bpe_500'), 'decoding_method': 'modified_beam_search', 'beam_size': 4, 'beam': 4, 'ngram_lm_scale': 0.01, 'max_contexts': 4, 'max_states': 8, 'context_size': 2, 'max_sym_per_frame': 1, 'num_paths': 200, 'nbest_scale': 0.5, 'num_encoder_layers': '2,4,3,2,4', 'feedforward_dims': '1024,1024,2048,2048,1024', 'nhead': '8,8,8,8,8', 'encoder_dims': '384,384,384,384,384', 'attention_dims': '192,192,192,192,192', 'encoder_unmasked_dims': '256,256,256,256,256', 'zipformer_downsampling_factors': '1,2,4,8,2', 'cnn_module_kernels': '31,31,31,31,31', 'decoder_dim': 512, 'joiner_dim': 512, 'manifest_dir': PosixPath('data/manifests'), 'enable_musan': True, 'concatenate_cuts': False, 'duration_factor': 1.0, 'gap': 1.0, 'max_duration': 500, 'max_cuts': None, 'num_buckets': 50, 'on_the_fly_feats': False, 'shuffle': True, 'num_workers': 8, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'ihm_only': False, 'res_dir': PosixPath('pruned_transducer_stateless7/exp/v2/modified_beam_search'), 'suffix': 'epoch-14-avg-8-modified_beam_search-beam-size-4', 'blank_id': 0, 'unk_id': 2, 'vocab_size': 500}
2022-11-21 09:01:02,321 INFO [decode.py:592] About to create model
2022-11-21 09:01:02,816 INFO [zipformer.py:179] At encoder stack 4, which has downsampling_factor=2, we will combine the outputs of layers 1 and 3, with downsampling_factors=2 and 8.
2022-11-21 09:01:02,827 INFO [decode.py:659] Calculating the averaged model over epoch range from 6 (excluded) to 14
2022-11-21 09:01:10,139 INFO [decode.py:694] Number of model parameters: 70369391
2022-11-21 09:01:10,139 INFO [asr_datamodule.py:392] About to get AMI IHM dev cuts
2022-11-21 09:01:10,142 INFO [asr_datamodule.py:413] About to get AMI IHM test cuts
2022-11-21 09:01:10,143 INFO [asr_datamodule.py:398] About to get AMI SDM dev cuts
2022-11-21 09:01:10,144 INFO [asr_datamodule.py:419] About to get AMI SDM test cuts
2022-11-21 09:01:10,145 INFO [asr_datamodule.py:407] About to get AMI GSS-enhanced dev cuts
2022-11-21 09:01:10,146 INFO [asr_datamodule.py:428] About to get AMI GSS-enhanced test cuts
2022-11-21 09:01:12,241 INFO [decode.py:726] Decoding dev_ihm
2022-11-21 09:01:17,970 INFO [decode.py:469] batch 0/?, cuts processed until now is 72
2022-11-21 09:01:24,445 INFO [decode.py:469] batch 2/?, cuts processed until now is 537
2022-11-21 09:01:32,449 INFO [decode.py:469] batch 4/?, cuts processed until now is 689
2022-11-21 09:01:39,961 INFO [decode.py:469] batch 6/?, cuts processed until now is 823
2022-11-21 09:01:48,348 INFO [decode.py:469] batch 8/?, cuts processed until now is 985
2022-11-21 09:01:55,879 INFO [decode.py:469] batch 10/?, cuts processed until now is 1088
2022-11-21 09:02:04,026 INFO [decode.py:469] batch 12/?, cuts processed until now is 1263
2022-11-21 09:02:11,696 INFO [decode.py:469] batch 14/?, cuts processed until now is 1521
2022-11-21 09:02:18,730 INFO [decode.py:469] batch 16/?, cuts processed until now is 1903
2022-11-21 09:02:26,186 INFO [decode.py:469] batch 18/?, cuts processed until now is 2032
2022-11-21 09:02:26,279 INFO [zipformer.py:1414] attn_weights_entropy = tensor([4.7244, 4.5302, 5.0729, 4.5917, 4.4891, 4.7754, 5.2246, 5.0226],
       device='cuda:0'), covar=tensor([0.0264, 0.1119, 0.0193, 0.0885, 0.0289, 0.0124, 0.0456, 0.0206],
       device='cuda:0'), in_proj_covar=tensor([0.0075, 0.0097, 0.0083, 0.0108, 0.0078, 0.0067, 0.0133, 0.0090],
       device='cuda:0'), out_proj_covar=tensor([0.0002, 0.0002, 0.0002, 0.0002, 0.0002, 0.0001, 0.0003, 0.0002],
       device='cuda:0')
2022-11-21 09:02:33,682 INFO [decode.py:469] batch 20/?, cuts processed until now is 2117
2022-11-21 09:02:41,528 INFO [decode.py:469] batch 22/?, cuts processed until now is 2375
2022-11-21 09:02:48,457 INFO [decode.py:469] batch 24/?, cuts processed until now is 2824
2022-11-21 09:02:56,346 INFO [decode.py:469] batch 26/?, cuts processed until now is 2969
2022-11-21 09:03:03,813 INFO [decode.py:469] batch 28/?, cuts processed until now is 3245
2022-11-21 09:03:11,965 INFO [decode.py:469] batch 30/?, cuts processed until now is 3401
2022-11-21 09:03:19,724 INFO [decode.py:469] batch 32/?, cuts processed until now is 3519
2022-11-21 09:03:27,731 INFO [decode.py:469] batch 34/?, cuts processed until now is 3694
2022-11-21 09:03:32,425 INFO [zipformer.py:1414] attn_weights_entropy = tensor([2.4334, 1.3831, 2.0322, 1.8725, 1.5110, 2.0865, 1.8069, 1.8511],
       device='cuda:0'), covar=tensor([0.0042, 0.0129, 0.0076, 0.0054, 0.0217, 0.0127, 0.0041, 0.0050],
       device='cuda:0'), in_proj_covar=tensor([0.0018, 0.0018, 0.0018, 0.0025, 0.0021, 0.0019, 0.0024, 0.0024],
       device='cuda:0'), out_proj_covar=tensor([1.6600e-05, 1.6809e-05, 1.6082e-05, 2.4018e-05, 1.9485e-05, 1.8494e-05,
        2.3316e-05, 2.3270e-05], device='cuda:0')
2022-11-21 09:03:36,214 INFO [decode.py:469] batch 36/?, cuts processed until now is 3818
2022-11-21 09:03:44,069 INFO [decode.py:469] batch 38/?, cuts processed until now is 3970
2022-11-21 09:03:48,740 INFO [decode.py:469] batch 40/?, cuts processed until now is 4750
2022-11-21 09:03:56,160 INFO [decode.py:469] batch 42/?, cuts processed until now is 5038
2022-11-21 09:04:03,980 INFO [decode.py:469] batch 44/?, cuts processed until now is 5144
2022-11-21 09:04:11,912 INFO [decode.py:469] batch 46/?, cuts processed until now is 5253
2022-11-21 09:04:17,681 INFO [decode.py:469] batch 48/?, cuts processed until now is 5672
2022-11-21 09:04:25,764 INFO [decode.py:469] batch 50/?, cuts processed until now is 5878
2022-11-21 09:04:32,820 INFO [decode.py:469] batch 52/?, cuts processed until now is 6260
2022-11-21 09:04:38,364 INFO [decode.py:469] batch 54/?, cuts processed until now is 6808
2022-11-21 09:04:45,747 INFO [decode.py:469] batch 56/?, cuts processed until now is 7117
2022-11-21 09:04:52,581 INFO [decode.py:469] batch 58/?, cuts processed until now is 7565
2022-11-21 09:04:58,410 INFO [decode.py:469] batch 60/?, cuts processed until now is 8078
2022-11-21 09:05:04,058 INFO [decode.py:469] batch 62/?, cuts processed until now is 8626
2022-11-21 09:05:09,700 INFO [decode.py:469] batch 64/?, cuts processed until now is 9174
2022-11-21 09:05:16,929 INFO [decode.py:469] batch 66/?, cuts processed until now is 9455
2022-11-21 09:05:22,079 INFO [decode.py:469] batch 68/?, cuts processed until now is 9968
2022-11-21 09:05:27,626 INFO [decode.py:469] batch 70/?, cuts processed until now is 10481
2022-11-21 09:05:31,929 INFO [decode.py:469] batch 72/?, cuts processed until now is 11264
2022-11-21 09:05:35,087 INFO [decode.py:469] batch 74/?, cuts processed until now is 11669
2022-11-21 09:05:37,666 INFO [decode.py:469] batch 76/?, cuts processed until now is 11761
2022-11-21 09:05:41,062 INFO [decode.py:469] batch 78/?, cuts processed until now is 11843
2022-11-21 09:05:45,179 INFO [decode.py:469] batch 80/?, cuts processed until now is 11956
2022-11-21 09:05:48,124 INFO [decode.py:469] batch 82/?, cuts processed until now is 12467
2022-11-21 09:05:55,133 INFO [decode.py:469] batch 84/?, cuts processed until now is 12586
2022-11-21 09:05:57,323 INFO [decode.py:485] The transcripts are stored in pruned_transducer_stateless7/exp/v2/modified_beam_search/recogs-dev_ihm-beam_size_4-epoch-14-avg-8-modified_beam_search-beam-size-4.txt
2022-11-21 09:05:57,502 INFO [utils.py:530] [dev_ihm-beam_size_4] %WER 18.92% [17962 / 94940, 3111 ins, 2975 del, 11876 sub ]
2022-11-21 09:05:58,205 INFO [utils.py:530] [dev_ihm-beam_size_4] %WER 11.68% [43218 / 369873, 11996 ins, 13603 del, 17619 sub ]
2022-11-21 09:05:59,215 INFO [decode.py:511] Wrote detailed error stats to pruned_transducer_stateless7/exp/v2/modified_beam_search/wers-dev_ihm-beam_size_4-epoch-14-avg-8-modified_beam_search-beam-size-4.txt
2022-11-21 09:05:59,217 INFO [decode.py:531] 
For dev_ihm, WER/CER of different settings are:
beam_size_4	18.92	11.68	best for dev_ihm

2022-11-21 09:05:59,220 INFO [decode.py:726] Decoding test_ihm
2022-11-21 09:06:04,715 INFO [decode.py:469] batch 0/?, cuts processed until now is 69
2022-11-21 09:06:10,954 INFO [decode.py:469] batch 2/?, cuts processed until now is 555
2022-11-21 09:06:19,024 INFO [decode.py:469] batch 4/?, cuts processed until now is 703
2022-11-21 09:06:27,235 INFO [decode.py:469] batch 6/?, cuts processed until now is 830
2022-11-21 09:06:34,994 INFO [decode.py:469] batch 8/?, cuts processed until now is 987
2022-11-21 09:06:42,886 INFO [decode.py:469] batch 10/?, cuts processed until now is 1095
2022-11-21 09:06:51,032 INFO [decode.py:469] batch 12/?, cuts processed until now is 1267
2022-11-21 09:06:58,867 INFO [decode.py:469] batch 14/?, cuts processed until now is 1532
2022-11-21 09:07:05,705 INFO [decode.py:469] batch 16/?, cuts processed until now is 1931
2022-11-21 09:07:13,684 INFO [decode.py:469] batch 18/?, cuts processed until now is 2055
2022-11-21 09:07:21,704 INFO [decode.py:469] batch 20/?, cuts processed until now is 2124
2022-11-21 09:07:22,115 INFO [zipformer.py:1414] attn_weights_entropy = tensor([2.5191, 3.3342, 3.4575, 2.9623, 1.8843, 3.3087, 2.0741, 3.0035],
       device='cuda:0'), covar=tensor([0.0386, 0.0169, 0.0156, 0.0372, 0.0595, 0.0185, 0.0601, 0.0165],
       device='cuda:0'), in_proj_covar=tensor([0.0176, 0.0146, 0.0155, 0.0177, 0.0173, 0.0154, 0.0169, 0.0152],
       device='cuda:0'), out_proj_covar=tensor([0.0003, 0.0002, 0.0002, 0.0003, 0.0003, 0.0002, 0.0003, 0.0002],
       device='cuda:0')
2022-11-21 09:07:29,506 INFO [decode.py:469] batch 22/?, cuts processed until now is 2388
2022-11-21 09:07:36,620 INFO [decode.py:469] batch 24/?, cuts processed until now is 2856
2022-11-21 09:07:44,829 INFO [decode.py:469] batch 26/?, cuts processed until now is 2996
2022-11-21 09:07:52,836 INFO [decode.py:469] batch 28/?, cuts processed until now is 3278
2022-11-21 09:08:00,575 INFO [decode.py:469] batch 30/?, cuts processed until now is 3430
2022-11-21 09:08:08,412 INFO [decode.py:469] batch 32/?, cuts processed until now is 3535
2022-11-21 09:08:16,364 INFO [decode.py:469] batch 34/?, cuts processed until now is 3706
2022-11-21 09:08:24,588 INFO [decode.py:469] batch 36/?, cuts processed until now is 3822
2022-11-21 09:08:32,343 INFO [decode.py:469] batch 38/?, cuts processed until now is 3969
2022-11-21 09:08:38,690 INFO [decode.py:469] batch 40/?, cuts processed until now is 4411
2022-11-21 09:08:44,383 INFO [decode.py:469] batch 42/?, cuts processed until now is 5058
2022-11-21 09:08:50,396 INFO [decode.py:469] batch 44/?, cuts processed until now is 5544
2022-11-21 09:08:58,871 INFO [decode.py:469] batch 46/?, cuts processed until now is 5685
2022-11-21 09:09:06,438 INFO [decode.py:469] batch 48/?, cuts processed until now is 5890
2022-11-21 09:09:13,207 INFO [decode.py:469] batch 50/?, cuts processed until now is 6372
2022-11-21 09:09:20,513 INFO [decode.py:469] batch 52/?, cuts processed until now is 6706
2022-11-21 09:09:27,641 INFO [decode.py:469] batch 54/?, cuts processed until now is 7105
2022-11-21 09:09:35,134 INFO [decode.py:469] batch 56/?, cuts processed until now is 7290
2022-11-21 09:09:39,422 INFO [decode.py:469] batch 58/?, cuts processed until now is 8116
2022-11-21 09:09:46,957 INFO [decode.py:469] batch 60/?, cuts processed until now is 8258
2022-11-21 09:09:52,819 INFO [decode.py:469] batch 62/?, cuts processed until now is 8794
2022-11-21 09:09:58,964 INFO [decode.py:469] batch 64/?, cuts processed until now is 9330
2022-11-21 09:10:06,455 INFO [decode.py:469] batch 66/?, cuts processed until now is 9476
2022-11-21 09:10:12,202 INFO [decode.py:469] batch 68/?, cuts processed until now is 9921
2022-11-21 09:10:19,151 INFO [decode.py:469] batch 70/?, cuts processed until now is 10251
2022-11-21 09:10:23,394 INFO [decode.py:469] batch 72/?, cuts processed until now is 10679
2022-11-21 09:10:29,661 INFO [decode.py:469] batch 74/?, cuts processed until now is 10794
2022-11-21 09:10:33,944 INFO [decode.py:469] batch 76/?, cuts processed until now is 11039
2022-11-21 09:10:36,458 INFO [decode.py:469] batch 78/?, cuts processed until now is 11155
2022-11-21 09:10:39,525 INFO [decode.py:469] batch 80/?, cuts processed until now is 11600
2022-11-21 09:10:44,056 INFO [decode.py:469] batch 82/?, cuts processed until now is 12041
2022-11-21 09:10:46,825 INFO [decode.py:469] batch 84/?, cuts processed until now is 12110
2022-11-21 09:10:46,994 INFO [decode.py:485] The transcripts are stored in pruned_transducer_stateless7/exp/v2/modified_beam_search/recogs-test_ihm-beam_size_4-epoch-14-avg-8-modified_beam_search-beam-size-4.txt
2022-11-21 09:10:47,133 INFO [utils.py:530] [test_ihm-beam_size_4] %WER 17.40% [15604 / 89659, 2198 ins, 3032 del, 10374 sub ]
2022-11-21 09:10:47,785 INFO [utils.py:530] [test_ihm-beam_size_4] %WER 10.59% [37495 / 354205, 9519 ins, 13048 del, 14928 sub ]
2022-11-21 09:10:48,645 INFO [decode.py:511] Wrote detailed error stats to pruned_transducer_stateless7/exp/v2/modified_beam_search/wers-test_ihm-beam_size_4-epoch-14-avg-8-modified_beam_search-beam-size-4.txt
2022-11-21 09:10:48,646 INFO [decode.py:531] 
For test_ihm, WER/CER of different settings are:
beam_size_4	17.4	10.59	best for test_ihm

2022-11-21 09:10:48,650 INFO [decode.py:726] Decoding dev_sdm
2022-11-21 09:10:53,586 INFO [decode.py:469] batch 0/?, cuts processed until now is 71
2022-11-21 09:11:00,078 INFO [decode.py:469] batch 2/?, cuts processed until now is 535
2022-11-21 09:11:08,441 INFO [decode.py:469] batch 4/?, cuts processed until now is 686
2022-11-21 09:11:16,604 INFO [decode.py:469] batch 6/?, cuts processed until now is 819
2022-11-21 09:11:24,670 INFO [decode.py:469] batch 8/?, cuts processed until now is 980
2022-11-21 09:11:32,576 INFO [decode.py:469] batch 10/?, cuts processed until now is 1083
2022-11-21 09:11:40,590 INFO [decode.py:469] batch 12/?, cuts processed until now is 1257
2022-11-21 09:11:48,188 INFO [decode.py:469] batch 14/?, cuts processed until now is 1513
2022-11-21 09:11:55,339 INFO [decode.py:469] batch 16/?, cuts processed until now is 1892
2022-11-21 09:12:03,417 INFO [decode.py:469] batch 18/?, cuts processed until now is 2020
2022-11-21 09:12:10,931 INFO [decode.py:469] batch 20/?, cuts processed until now is 2106
2022-11-21 09:12:15,052 INFO [zipformer.py:1414] attn_weights_entropy = tensor([1.6967, 1.4837, 1.5797, 0.9655, 1.6488, 1.6996, 1.0788, 1.4325],
       device='cuda:0'), covar=tensor([0.0955, 0.0501, 0.0807, 0.1407, 0.1460, 0.1023, 0.1419, 0.0759],
       device='cuda:0'), in_proj_covar=tensor([0.0011, 0.0017, 0.0012, 0.0015, 0.0012, 0.0011, 0.0016, 0.0011],
       device='cuda:0'), out_proj_covar=tensor([5.8009e-05, 8.0520e-05, 5.9059e-05, 7.3872e-05, 6.4258e-05, 5.7202e-05,
        7.6631e-05, 5.7227e-05], device='cuda:0')
2022-11-21 09:12:18,842 INFO [decode.py:469] batch 22/?, cuts processed until now is 2362
2022-11-21 09:12:22,409 INFO [zipformer.py:1414] attn_weights_entropy = tensor([2.2773, 3.6592, 2.6922, 1.8210, 3.3981, 1.4356, 3.0403, 2.0862],
       device='cuda:0'), covar=tensor([0.1255, 0.0138, 0.0884, 0.1800, 0.0199, 0.1800, 0.0346, 0.1266],
       device='cuda:0'), in_proj_covar=tensor([0.0112, 0.0093, 0.0102, 0.0107, 0.0090, 0.0114, 0.0086, 0.0106],
       device='cuda:0'), out_proj_covar=tensor([0.0005, 0.0003, 0.0004, 0.0004, 0.0003, 0.0004, 0.0003, 0.0004],
       device='cuda:0')
2022-11-21 09:12:25,870 INFO [decode.py:469] batch 24/?, cuts processed until now is 2807
2022-11-21 09:12:34,063 INFO [decode.py:469] batch 26/?, cuts processed until now is 2952
2022-11-21 09:12:41,930 INFO [decode.py:469] batch 28/?, cuts processed until now is 3226
2022-11-21 09:12:50,165 INFO [decode.py:469] batch 30/?, cuts processed until now is 3381
2022-11-21 09:12:57,903 INFO [decode.py:469] batch 32/?, cuts processed until now is 3499
2022-11-21 09:13:06,015 INFO [decode.py:469] batch 34/?, cuts processed until now is 3673
2022-11-21 09:13:14,228 INFO [decode.py:469] batch 36/?, cuts processed until now is 3797
2022-11-21 09:13:22,343 INFO [decode.py:469] batch 38/?, cuts processed until now is 3948
2022-11-21 09:13:26,513 INFO [decode.py:469] batch 40/?, cuts processed until now is 4722
2022-11-21 09:13:33,694 INFO [decode.py:469] batch 42/?, cuts processed until now is 5007
2022-11-21 09:13:38,075 INFO [zipformer.py:1414] attn_weights_entropy = tensor([2.1764, 2.4642, 2.3265, 1.6185, 1.7980, 2.0457, 1.7485, 2.0824],
       device='cuda:0'), covar=tensor([0.0046, 0.0036, 0.0027, 0.0048, 0.0045, 0.0025, 0.0028, 0.0073],
       device='cuda:0'), in_proj_covar=tensor([0.0044, 0.0039, 0.0040, 0.0042, 0.0040, 0.0035, 0.0039, 0.0033],
       device='cuda:0'), out_proj_covar=tensor([3.9198e-05, 3.5622e-05, 3.5491e-05, 3.7523e-05, 3.5422e-05, 3.0569e-05,
        3.5922e-05, 2.9496e-05], device='cuda:0')
2022-11-21 09:13:41,560 INFO [decode.py:469] batch 44/?, cuts processed until now is 5112
2022-11-21 09:13:49,048 INFO [decode.py:469] batch 46/?, cuts processed until now is 5219
2022-11-21 09:13:54,526 INFO [decode.py:469] batch 48/?, cuts processed until now is 5636
2022-11-21 09:14:02,394 INFO [decode.py:469] batch 50/?, cuts processed until now is 5842
2022-11-21 09:14:09,772 INFO [decode.py:469] batch 52/?, cuts processed until now is 6222
2022-11-21 09:14:15,197 INFO [decode.py:469] batch 54/?, cuts processed until now is 6766
2022-11-21 09:14:22,289 INFO [decode.py:469] batch 56/?, cuts processed until now is 7072
2022-11-21 09:14:28,639 INFO [decode.py:469] batch 58/?, cuts processed until now is 7518
2022-11-21 09:14:34,828 INFO [decode.py:469] batch 60/?, cuts processed until now is 8027
2022-11-21 09:14:40,248 INFO [decode.py:469] batch 62/?, cuts processed until now is 8571
2022-11-21 09:14:45,626 INFO [decode.py:469] batch 64/?, cuts processed until now is 9115
2022-11-21 09:14:53,473 INFO [decode.py:469] batch 66/?, cuts processed until now is 9395
2022-11-21 09:14:59,246 INFO [decode.py:469] batch 68/?, cuts processed until now is 9904
2022-11-21 09:15:04,871 INFO [decode.py:469] batch 70/?, cuts processed until now is 10413
2022-11-21 09:15:09,260 INFO [decode.py:469] batch 72/?, cuts processed until now is 11190
2022-11-21 09:15:12,674 INFO [decode.py:469] batch 74/?, cuts processed until now is 11589
2022-11-21 09:15:15,723 INFO [decode.py:469] batch 76/?, cuts processed until now is 11699
2022-11-21 09:15:19,815 INFO [decode.py:469] batch 78/?, cuts processed until now is 11799
2022-11-21 09:15:23,501 INFO [decode.py:469] batch 80/?, cuts processed until now is 11889
2022-11-21 09:15:26,876 INFO [decode.py:469] batch 82/?, cuts processed until now is 12461
2022-11-21 09:15:31,178 INFO [decode.py:469] batch 84/?, cuts processed until now is 12568
2022-11-21 09:15:36,190 INFO [decode.py:469] batch 86/?, cuts processed until now is 12601
2022-11-21 09:15:36,384 INFO [decode.py:485] The transcripts are stored in pruned_transducer_stateless7/exp/v2/modified_beam_search/recogs-dev_sdm-beam_size_4-epoch-14-avg-8-modified_beam_search-beam-size-4.txt
2022-11-21 09:15:36,562 INFO [utils.py:530] [dev_sdm-beam_size_4] %WER 31.25% [29668 / 94940, 5433 ins, 5576 del, 18659 sub ]
2022-11-21 09:15:37,345 INFO [utils.py:530] [dev_sdm-beam_size_4] %WER 22.33% [82593 / 369873, 23606 ins, 24717 del, 34270 sub ]
2022-11-21 09:15:38,345 INFO [decode.py:511] Wrote detailed error stats to pruned_transducer_stateless7/exp/v2/modified_beam_search/wers-dev_sdm-beam_size_4-epoch-14-avg-8-modified_beam_search-beam-size-4.txt
2022-11-21 09:15:38,346 INFO [decode.py:531] 
For dev_sdm, WER/CER of different settings are:
beam_size_4	31.25	22.33	best for dev_sdm

2022-11-21 09:15:38,352 INFO [decode.py:726] Decoding test_sdm
2022-11-21 09:15:43,887 INFO [decode.py:469] batch 0/?, cuts processed until now is 69
2022-11-21 09:15:49,996 INFO [decode.py:469] batch 2/?, cuts processed until now is 555
2022-11-21 09:15:57,848 INFO [decode.py:469] batch 4/?, cuts processed until now is 703
2022-11-21 09:16:06,019 INFO [decode.py:469] batch 6/?, cuts processed until now is 831
2022-11-21 09:16:13,801 INFO [decode.py:469] batch 8/?, cuts processed until now is 988
2022-11-21 09:16:21,992 INFO [decode.py:469] batch 10/?, cuts processed until now is 1096
2022-11-21 09:16:29,492 INFO [decode.py:469] batch 12/?, cuts processed until now is 1268
2022-11-21 09:16:37,060 INFO [decode.py:469] batch 14/?, cuts processed until now is 1533
2022-11-21 09:16:40,900 INFO [zipformer.py:1414] attn_weights_entropy = tensor([1.9254, 2.2960, 1.9014, 1.4409, 2.2690, 2.7155, 2.6079, 2.6767],
       device='cuda:0'), covar=tensor([0.1587, 0.1619, 0.1986, 0.2581, 0.0769, 0.1048, 0.0449, 0.1019],
       device='cuda:0'), in_proj_covar=tensor([0.0155, 0.0166, 0.0141, 0.0170, 0.0150, 0.0167, 0.0133, 0.0161],
       device='cuda:0'), out_proj_covar=tensor([0.0003, 0.0003, 0.0003, 0.0003, 0.0003, 0.0003, 0.0003, 0.0003],
       device='cuda:0')
2022-11-21 09:16:43,758 INFO [decode.py:469] batch 16/?, cuts processed until now is 1932
2022-11-21 09:16:51,292 INFO [decode.py:469] batch 18/?, cuts processed until now is 2057
2022-11-21 09:16:59,380 INFO [decode.py:469] batch 20/?, cuts processed until now is 2126
2022-11-21 09:17:06,967 INFO [decode.py:469] batch 22/?, cuts processed until now is 2390
2022-11-21 09:17:13,791 INFO [decode.py:469] batch 24/?, cuts processed until now is 2858
2022-11-21 09:17:21,957 INFO [decode.py:469] batch 26/?, cuts processed until now is 2998
2022-11-21 09:17:29,364 INFO [decode.py:469] batch 28/?, cuts processed until now is 3280
2022-11-21 09:17:37,465 INFO [decode.py:469] batch 30/?, cuts processed until now is 3432
2022-11-21 09:17:44,999 INFO [decode.py:469] batch 32/?, cuts processed until now is 3537
2022-11-21 09:17:52,940 INFO [decode.py:469] batch 34/?, cuts processed until now is 3709
2022-11-21 09:18:01,289 INFO [decode.py:469] batch 36/?, cuts processed until now is 3825
2022-11-21 09:18:08,987 INFO [decode.py:469] batch 38/?, cuts processed until now is 3972
2022-11-21 09:18:13,769 INFO [decode.py:469] batch 40/?, cuts processed until now is 4410
2022-11-21 09:18:19,209 INFO [decode.py:469] batch 42/?, cuts processed until now is 5060
2022-11-21 09:18:24,864 INFO [decode.py:469] batch 44/?, cuts processed until now is 5546
2022-11-21 09:18:32,695 INFO [decode.py:469] batch 46/?, cuts processed until now is 5687
2022-11-21 09:18:40,341 INFO [decode.py:469] batch 48/?, cuts processed until now is 5893
2022-11-21 09:18:46,511 INFO [decode.py:469] batch 50/?, cuts processed until now is 6379
2022-11-21 09:18:53,626 INFO [decode.py:469] batch 52/?, cuts processed until now is 6713
2022-11-21 09:19:00,565 INFO [decode.py:469] batch 54/?, cuts processed until now is 7112
2022-11-21 09:19:08,390 INFO [decode.py:469] batch 56/?, cuts processed until now is 7298
2022-11-21 09:19:12,597 INFO [decode.py:469] batch 58/?, cuts processed until now is 8130
2022-11-21 09:19:20,029 INFO [decode.py:469] batch 60/?, cuts processed until now is 8273
2022-11-21 09:19:26,189 INFO [decode.py:469] batch 62/?, cuts processed until now is 8813
2022-11-21 09:19:31,871 INFO [decode.py:469] batch 64/?, cuts processed until now is 9353
2022-11-21 09:19:39,561 INFO [decode.py:469] batch 66/?, cuts processed until now is 9500
2022-11-21 09:19:45,221 INFO [decode.py:469] batch 68/?, cuts processed until now is 9944
2022-11-21 09:19:52,554 INFO [decode.py:469] batch 70/?, cuts processed until now is 10274
2022-11-21 09:19:57,593 INFO [decode.py:469] batch 72/?, cuts processed until now is 10711
2022-11-21 09:20:03,275 INFO [decode.py:469] batch 74/?, cuts processed until now is 10820
2022-11-21 09:20:07,770 INFO [decode.py:469] batch 76/?, cuts processed until now is 11076
2022-11-21 09:20:10,704 INFO [decode.py:469] batch 78/?, cuts processed until now is 11209
2022-11-21 09:20:13,725 INFO [decode.py:469] batch 80/?, cuts processed until now is 11651
2022-11-21 09:20:18,160 INFO [decode.py:469] batch 82/?, cuts processed until now is 12070
2022-11-21 09:20:21,139 INFO [decode.py:485] The transcripts are stored in pruned_transducer_stateless7/exp/v2/modified_beam_search/recogs-test_sdm-beam_size_4-epoch-14-avg-8-modified_beam_search-beam-size-4.txt
2022-11-21 09:20:21,313 INFO [utils.py:530] [test_sdm-beam_size_4] %WER 32.21% [28883 / 89659, 4708 ins, 6487 del, 17688 sub ]
2022-11-21 09:20:22,053 INFO [utils.py:530] [test_sdm-beam_size_4] %WER 23.28% [82450 / 354205, 22184 ins, 27548 del, 32718 sub ]
2022-11-21 09:20:22,998 INFO [decode.py:511] Wrote detailed error stats to pruned_transducer_stateless7/exp/v2/modified_beam_search/wers-test_sdm-beam_size_4-epoch-14-avg-8-modified_beam_search-beam-size-4.txt
2022-11-21 09:20:22,999 INFO [decode.py:531] 
For test_sdm, WER/CER of different settings are:
beam_size_4	32.21	23.28	best for test_sdm

2022-11-21 09:20:23,005 INFO [decode.py:726] Decoding dev_gss
2022-11-21 09:20:28,375 INFO [decode.py:469] batch 0/?, cuts processed until now is 71
2022-11-21 09:20:34,835 INFO [decode.py:469] batch 2/?, cuts processed until now is 535
2022-11-21 09:20:43,338 INFO [decode.py:469] batch 4/?, cuts processed until now is 686
2022-11-21 09:20:51,446 INFO [decode.py:469] batch 6/?, cuts processed until now is 819
2022-11-21 09:20:59,651 INFO [decode.py:469] batch 8/?, cuts processed until now is 980
2022-11-21 09:21:07,549 INFO [decode.py:469] batch 10/?, cuts processed until now is 1083
2022-11-21 09:21:15,578 INFO [decode.py:469] batch 12/?, cuts processed until now is 1257
2022-11-21 09:21:23,224 INFO [decode.py:469] batch 14/?, cuts processed until now is 1513
2022-11-21 09:21:30,517 INFO [decode.py:469] batch 16/?, cuts processed until now is 1892
2022-11-21 09:21:38,093 INFO [decode.py:469] batch 18/?, cuts processed until now is 2020
2022-11-21 09:21:42,272 INFO [zipformer.py:1414] attn_weights_entropy = tensor([4.9197, 5.4255, 4.9842, 5.4606, 5.4453, 4.6336, 5.1070, 4.8309],
       device='cuda:0'), covar=tensor([0.0148, 0.0254, 0.0958, 0.0222, 0.0267, 0.0338, 0.0230, 0.0314],
       device='cuda:0'), in_proj_covar=tensor([0.0111, 0.0156, 0.0254, 0.0151, 0.0197, 0.0151, 0.0167, 0.0154],
       device='cuda:0'), out_proj_covar=tensor([0.0002, 0.0002, 0.0003, 0.0002, 0.0003, 0.0002, 0.0002, 0.0002],
       device='cuda:0')
2022-11-21 09:21:45,797 INFO [decode.py:469] batch 20/?, cuts processed until now is 2106
2022-11-21 09:21:53,231 INFO [decode.py:469] batch 22/?, cuts processed until now is 2362
2022-11-21 09:22:00,005 INFO [decode.py:469] batch 24/?, cuts processed until now is 2807
2022-11-21 09:22:08,283 INFO [decode.py:469] batch 26/?, cuts processed until now is 2952
2022-11-21 09:22:16,156 INFO [decode.py:469] batch 28/?, cuts processed until now is 3226
2022-11-21 09:22:24,633 INFO [decode.py:469] batch 30/?, cuts processed until now is 3381
2022-11-21 09:22:32,196 INFO [decode.py:469] batch 32/?, cuts processed until now is 3499
2022-11-21 09:22:40,344 INFO [decode.py:469] batch 34/?, cuts processed until now is 3673
2022-11-21 09:22:48,656 INFO [decode.py:469] batch 36/?, cuts processed until now is 3797
2022-11-21 09:22:56,597 INFO [decode.py:469] batch 38/?, cuts processed until now is 3948
2022-11-21 09:23:01,410 INFO [decode.py:469] batch 40/?, cuts processed until now is 4722
2022-11-21 09:23:09,274 INFO [decode.py:469] batch 42/?, cuts processed until now is 5007
2022-11-21 09:23:16,748 INFO [decode.py:469] batch 44/?, cuts processed until now is 5112
2022-11-21 09:23:24,760 INFO [decode.py:469] batch 46/?, cuts processed until now is 5219
2022-11-21 09:23:30,497 INFO [decode.py:469] batch 48/?, cuts processed until now is 5636
2022-11-21 09:23:38,821 INFO [decode.py:469] batch 50/?, cuts processed until now is 5842
2022-11-21 09:23:45,999 INFO [decode.py:469] batch 52/?, cuts processed until now is 6222
2022-11-21 09:23:51,397 INFO [decode.py:469] batch 54/?, cuts processed until now is 6766
2022-11-21 09:23:58,221 INFO [decode.py:469] batch 56/?, cuts processed until now is 7072
2022-11-21 09:24:05,361 INFO [decode.py:469] batch 58/?, cuts processed until now is 7518
2022-11-21 09:24:11,014 INFO [decode.py:469] batch 60/?, cuts processed until now is 8027
2022-11-21 09:24:17,082 INFO [decode.py:469] batch 62/?, cuts processed until now is 8571
2022-11-21 09:24:22,948 INFO [decode.py:469] batch 64/?, cuts processed until now is 9115
2022-11-21 09:24:30,673 INFO [decode.py:469] batch 66/?, cuts processed until now is 9395
2022-11-21 09:24:36,297 INFO [decode.py:469] batch 68/?, cuts processed until now is 9904
2022-11-21 09:24:41,485 INFO [decode.py:469] batch 70/?, cuts processed until now is 10413
2022-11-21 09:24:45,616 INFO [decode.py:469] batch 72/?, cuts processed until now is 11190
2022-11-21 09:24:49,039 INFO [decode.py:469] batch 74/?, cuts processed until now is 11589
2022-11-21 09:24:51,963 INFO [decode.py:469] batch 76/?, cuts processed until now is 11699
2022-11-21 09:24:56,131 INFO [decode.py:469] batch 78/?, cuts processed until now is 11799
2022-11-21 09:24:59,351 INFO [decode.py:469] batch 80/?, cuts processed until now is 11889
2022-11-21 09:25:02,511 INFO [decode.py:469] batch 82/?, cuts processed until now is 12461
2022-11-21 09:25:06,796 INFO [decode.py:469] batch 84/?, cuts processed until now is 12568
2022-11-21 09:25:11,871 INFO [decode.py:469] batch 86/?, cuts processed until now is 12601
2022-11-21 09:25:12,039 INFO [decode.py:485] The transcripts are stored in pruned_transducer_stateless7/exp/v2/modified_beam_search/recogs-dev_gss-beam_size_4-epoch-14-avg-8-modified_beam_search-beam-size-4.txt
2022-11-21 09:25:12,191 INFO [utils.py:530] [dev_gss-beam_size_4] %WER 21.67% [20576 / 94940, 3148 ins, 3682 del, 13746 sub ]
2022-11-21 09:25:12,965 INFO [utils.py:530] [dev_gss-beam_size_4] %WER 13.93% [51515 / 369873, 13082 ins, 16531 del, 21902 sub ]
2022-11-21 09:25:13,879 INFO [decode.py:511] Wrote detailed error stats to pruned_transducer_stateless7/exp/v2/modified_beam_search/wers-dev_gss-beam_size_4-epoch-14-avg-8-modified_beam_search-beam-size-4.txt
2022-11-21 09:25:13,880 INFO [decode.py:531] 
For dev_gss, WER/CER of different settings are:
beam_size_4	21.67	13.93	best for dev_gss

2022-11-21 09:25:13,885 INFO [decode.py:726] Decoding test_gss
2022-11-21 09:25:19,019 INFO [decode.py:469] batch 0/?, cuts processed until now is 69
2022-11-21 09:25:25,088 INFO [decode.py:469] batch 2/?, cuts processed until now is 555
2022-11-21 09:25:33,195 INFO [decode.py:469] batch 4/?, cuts processed until now is 703
2022-11-21 09:25:41,397 INFO [decode.py:469] batch 6/?, cuts processed until now is 831
2022-11-21 09:25:49,687 INFO [decode.py:469] batch 8/?, cuts processed until now is 988
2022-11-21 09:25:57,741 INFO [decode.py:469] batch 10/?, cuts processed until now is 1096
2022-11-21 09:26:05,907 INFO [decode.py:469] batch 12/?, cuts processed until now is 1268
2022-11-21 09:26:13,572 INFO [decode.py:469] batch 14/?, cuts processed until now is 1533
2022-11-21 09:26:13,998 INFO [zipformer.py:1414] attn_weights_entropy = tensor([2.5126, 3.3009, 3.4744, 3.0003, 1.9551, 3.3108, 2.1116, 3.0031],
       device='cuda:0'), covar=tensor([0.0391, 0.0189, 0.0137, 0.0343, 0.0551, 0.0189, 0.0597, 0.0172],
       device='cuda:0'), in_proj_covar=tensor([0.0176, 0.0146, 0.0155, 0.0177, 0.0173, 0.0154, 0.0169, 0.0152],
       device='cuda:0'), out_proj_covar=tensor([0.0003, 0.0002, 0.0002, 0.0003, 0.0003, 0.0002, 0.0003, 0.0002],
       device='cuda:0')
2022-11-21 09:26:20,798 INFO [decode.py:469] batch 16/?, cuts processed until now is 1932
2022-11-21 09:26:28,664 INFO [decode.py:469] batch 18/?, cuts processed until now is 2057
2022-11-21 09:26:36,340 INFO [decode.py:469] batch 20/?, cuts processed until now is 2126
2022-11-21 09:26:44,428 INFO [decode.py:469] batch 22/?, cuts processed until now is 2390
2022-11-21 09:26:50,815 INFO [decode.py:469] batch 24/?, cuts processed until now is 2858
2022-11-21 09:26:59,079 INFO [decode.py:469] batch 26/?, cuts processed until now is 2998
2022-11-21 09:27:06,725 INFO [decode.py:469] batch 28/?, cuts processed until now is 3280
2022-11-21 09:27:14,411 INFO [decode.py:469] batch 30/?, cuts processed until now is 3432
2022-11-21 09:27:22,118 INFO [decode.py:469] batch 32/?, cuts processed until now is 3537
2022-11-21 09:27:30,082 INFO [decode.py:469] batch 34/?, cuts processed until now is 3709
2022-11-21 09:27:37,886 INFO [decode.py:469] batch 36/?, cuts processed until now is 3825
2022-11-21 09:27:45,813 INFO [decode.py:469] batch 38/?, cuts processed until now is 3972
2022-11-21 09:27:50,913 INFO [decode.py:469] batch 40/?, cuts processed until now is 4410
2022-11-21 09:27:57,067 INFO [decode.py:469] batch 42/?, cuts processed until now is 5060
2022-11-21 09:28:03,118 INFO [decode.py:469] batch 44/?, cuts processed until now is 5546
2022-11-21 09:28:11,017 INFO [decode.py:469] batch 46/?, cuts processed until now is 5687
2022-11-21 09:28:18,631 INFO [decode.py:469] batch 48/?, cuts processed until now is 5893
2022-11-21 09:28:24,962 INFO [decode.py:469] batch 50/?, cuts processed until now is 6379
2022-11-21 09:28:31,865 INFO [decode.py:469] batch 52/?, cuts processed until now is 6713
2022-11-21 09:28:38,619 INFO [decode.py:469] batch 54/?, cuts processed until now is 7112
2022-11-21 09:28:46,053 INFO [decode.py:469] batch 56/?, cuts processed until now is 7298
2022-11-21 09:28:50,136 INFO [decode.py:469] batch 58/?, cuts processed until now is 8130
2022-11-21 09:28:57,824 INFO [decode.py:469] batch 60/?, cuts processed until now is 8273
2022-11-21 09:29:03,428 INFO [decode.py:469] batch 62/?, cuts processed until now is 8813
2022-11-21 09:29:09,120 INFO [decode.py:469] batch 64/?, cuts processed until now is 9353
2022-11-21 09:29:16,759 INFO [decode.py:469] batch 66/?, cuts processed until now is 9500
2022-11-21 09:29:22,139 INFO [decode.py:469] batch 68/?, cuts processed until now is 9944
2022-11-21 09:29:28,960 INFO [decode.py:469] batch 70/?, cuts processed until now is 10274
2022-11-21 09:29:33,815 INFO [decode.py:469] batch 72/?, cuts processed until now is 10711
2022-11-21 09:29:39,442 INFO [decode.py:469] batch 74/?, cuts processed until now is 10820
2022-11-21 09:29:44,059 INFO [decode.py:469] batch 76/?, cuts processed until now is 11076
2022-11-21 09:29:46,738 INFO [decode.py:469] batch 78/?, cuts processed until now is 11209
2022-11-21 09:29:49,386 INFO [decode.py:469] batch 80/?, cuts processed until now is 11651
2022-11-21 09:29:54,016 INFO [decode.py:469] batch 82/?, cuts processed until now is 12070
2022-11-21 09:29:56,941 INFO [decode.py:485] The transcripts are stored in pruned_transducer_stateless7/exp/v2/modified_beam_search/recogs-test_gss-beam_size_4-epoch-14-avg-8-modified_beam_search-beam-size-4.txt
2022-11-21 09:29:57,109 INFO [utils.py:530] [test_gss-beam_size_4] %WER 22.43% [20109 / 89659, 2537 ins, 4269 del, 13303 sub ]
2022-11-21 09:29:57,791 INFO [utils.py:530] [test_gss-beam_size_4] %WER 14.70% [52077 / 354205, 11842 ins, 18389 del, 21846 sub ]
2022-11-21 09:29:58,690 INFO [decode.py:511] Wrote detailed error stats to pruned_transducer_stateless7/exp/v2/modified_beam_search/wers-test_gss-beam_size_4-epoch-14-avg-8-modified_beam_search-beam-size-4.txt
2022-11-21 09:29:58,691 INFO [decode.py:531] 
For test_gss, WER/CER of different settings are:
beam_size_4	22.43	14.7	best for test_gss

2022-11-21 09:29:58,695 INFO [decode.py:743] Done!