INFO:nncf:Ignored adding weight sparsifier in scope: SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/SwinPatchMerging[downsample]/NNCFLinear[reduction]/linear_0 INFO:nncf:Ignored adding weight sparsifier in scope: SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/SwinPatchMerging[downsample]/NNCFLinear[reduction]/linear_0 INFO:nncf:Ignored adding weight sparsifier in scope: SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/SwinPatchMerging[downsample]/NNCFLinear[reduction]/linear_0 INFO:nncf:Ignored adding weight sparsifier in scope: SwinForImageClassification/NNCFLinear[classifier]/linear_0 INFO:nncf:Not adding activation input quantizer for operation: 4 SwinForImageClassification/SwinModel[swin]/SwinEmbeddings[embeddings]/NNCFLayerNorm[norm]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 6 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 26 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 29 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 41 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 42 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 47 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[0]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 48 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 69 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 71 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 75 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 88 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 89 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 94 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/ModuleList[blocks]/SwinLayer[1]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 102 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[0]/SwinPatchMerging[downsample]/NNCFLayerNorm[norm]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 104 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 124 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 127 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 139 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 140 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 145 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[0]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 146 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 167 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 169 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 173 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 186 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 187 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 192 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/ModuleList[blocks]/SwinLayer[1]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 200 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[1]/SwinPatchMerging[downsample]/NNCFLayerNorm[norm]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 202 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 222 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 225 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 237 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 238 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 243 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[0]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 244 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 265 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 267 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 271 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 284 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 285 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 290 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[1]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 291 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 311 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 314 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 326 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 327 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 332 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[2]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 333 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 354 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 356 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 360 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 373 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 374 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 379 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[3]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 380 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 400 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 403 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 415 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 416 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 421 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[4]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 422 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 443 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 445 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 449 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 462 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 463 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 468 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[5]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 469 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 489 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 492 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 504 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 505 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 510 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[6]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 511 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 532 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 534 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 538 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 551 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 552 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 557 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[7]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 558 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 578 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 581 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 593 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 594 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 599 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[8]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 600 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 621 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 623 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 627 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 640 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 641 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 646 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[9]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 647 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 667 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 670 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 682 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 683 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 688 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[10]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 689 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 710 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 712 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 716 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 729 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 730 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 735 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[11]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 736 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 756 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 759 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 771 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 772 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 777 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[12]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 778 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 799 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 801 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 805 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 818 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 819 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 824 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[13]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 825 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 845 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 848 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 860 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 861 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 866 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[14]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 867 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 888 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 890 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 894 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 907 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 908 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 913 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[15]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 914 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 934 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 937 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 949 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 950 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 955 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[16]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 956 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 977 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 979 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/SwinAttention[attention]/SwinSelfAttention[self]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 983 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 996 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 997 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1002 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/ModuleList[blocks]/SwinLayer[17]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 1010 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[2]/SwinPatchMerging[downsample]/NNCFLayerNorm[norm]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1012 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1032 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 1035 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 1047 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 1048 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1053 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[0]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 1054 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_before]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1074 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 1077 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/SwinAttention[attention]/SwinSelfAttention[self]/matmul_1 INFO:nncf:Not adding activation input quantizer for operation: 1089 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/__add___0 INFO:nncf:Not adding activation input quantizer for operation: 1090 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/NNCFLayerNorm[layernorm_after]/layer_norm_0 INFO:nncf:Not adding activation input quantizer for operation: 1095 SwinForImageClassification/SwinModel[swin]/SwinEncoder[encoder]/ModuleList[layers]/SwinStage[3]/ModuleList[blocks]/SwinLayer[1]/__add___1 INFO:nncf:Not adding activation input quantizer for operation: 1096 SwinForImageClassification/SwinModel[swin]/NNCFLayerNorm[layernorm]/layer_norm_0 INFO:nncf:Collecting tensor statistics |████████ | 1 / 2 INFO:nncf:Collecting tensor statistics |████████████████| 2 / 2 INFO:nncf:Compiling and loading torch extension: quantized_functions_cuda... INFO:nncf:Finished loading torch extension: quantized_functions_cuda INFO:nncf:BatchNorm statistics adaptation |█ | 1 / 13 INFO:nncf:BatchNorm statistics adaptation |██ | 2 / 13 INFO:nncf:BatchNorm statistics adaptation |███ | 3 / 13 INFO:nncf:BatchNorm statistics adaptation |████ | 4 / 13 INFO:nncf:BatchNorm statistics adaptation |██████ | 5 / 13 INFO:nncf:BatchNorm statistics adaptation |███████ | 6 / 13 INFO:nncf:BatchNorm statistics adaptation |████████ | 7 / 13 INFO:nncf:BatchNorm statistics adaptation |█████████ | 8 / 13 INFO:nncf:BatchNorm statistics adaptation |███████████ | 9 / 13 INFO:nncf:BatchNorm statistics adaptation |████████████ | 10 / 13 INFO:nncf:BatchNorm statistics adaptation |█████████████ | 11 / 13 INFO:nncf:BatchNorm statistics adaptation |██████████████ | 12 / 13 INFO:nncf:BatchNorm statistics adaptation |████████████████| 13 / 13 WARNING:nncf:Number of potential building blocks is too much. The processing time can be high. Shallow the accepted range for the length of building blocks via max_block_size and min_block_size to accelerate the search process. INFO:nncf:Movement sparsity scheduler updates importance threshold and regularizationfactor per optimizer step, but steps_per_epoch was not set in config. Will measure the actual steps per epoch as signaled by a .epoch_step() call. INFO:nncf:Statistics of the sparsified model: Epoch 0 |+-----------------------------------------+-------+ Epoch 0 || Statistic's name | Value | Epoch 0 |+=========================================+=======+ Epoch 0 || Sparsity level of the whole model | 0 | Epoch 0 |+-----------------------------------------+-------+ Epoch 0 || Sparsity level of all sparsified layers | 0 | Epoch 0 |+-----------------------------------------+-------+ Epoch 0 | Epoch 0 |Statistics by sparsified layers: Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 0 |+======================+================+================+=====================+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[0]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[1]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[2]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[3]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[4]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[5]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[6]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[7]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[8]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[9]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[10]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[11]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[12]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[13]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[14]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[15]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[16]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[query]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[key]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfAttention[self]/NN | | | | Epoch 0 || CFLinear[value]/line | | | | Epoch 0 || ar_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinAttenti | | | | Epoch 0 || on[attention]/SwinSe | | | | Epoch 0 || lfOutput[output]/NNC | | | | Epoch 0 || FLinear[dense]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinInterme | | | | Epoch 0 || diate[intermediate]/ | | | | Epoch 0 || NNCFLinear[dense]/li | | | | Epoch 0 || near_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[2]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[17]/SwinOutput[ | | | | Epoch 0 || output]/NNCFLinear[d | | | | Epoch 0 || ense]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[0]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[query]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[key]/linear_ | | | | Epoch 0 || 0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fAttention[self]/NNC | | | | Epoch 0 || FLinear[value]/linea | | | | Epoch 0 || r_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinAttentio | | | | Epoch 0 || n[attention]/SwinSel | | | | Epoch 0 || fOutput[output]/NNCF | | | | Epoch 0 || Linear[dense]/linear | | | | Epoch 0 || _0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinIntermed | | | | Epoch 0 || iate[intermediate]/N | | | | Epoch 0 || NCFLinear[dense]/lin | | | | Epoch 0 || ear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0 | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 0 || cation/SwinModel[swi | | | | Epoch 0 || n]/SwinEncoder[encod | | | | Epoch 0 || er]/ModuleList[layer | | | | Epoch 0 || s]/SwinStage[3]/Modu | | | | Epoch 0 || leList[blocks]/SwinL | | | | Epoch 0 || ayer[1]/SwinOutput[o | | | | Epoch 0 || utput]/NNCFLinear[de | | | | Epoch 0 || nse]/linear_0/bias | | | | Epoch 0 |+----------------------+----------------+----------------+---------------------+ Epoch 0 | Epoch 0 |Statistics of the movement-sparsity algorithm: Epoch 0 |+----------------------------------+-------+ Epoch 0 || Statistic's name | Value | Epoch 0 |+==================================+=======+ Epoch 0 || Mask Importance Threshold | -inf | Epoch 0 |+----------------------------------+-------+ Epoch 0 || Importance Regularization Factor | 0 | Epoch 0 |+----------------------------------+-------+ Epoch 0 | Epoch 0 |Statistics of the quantization algorithm: Epoch 0 |+--------------------------------+-------+ Epoch 0 || Statistic's name | Value | Epoch 0 |+================================+=======+ Epoch 0 || Ratio of enabled quantizations | 100 | Epoch 0 |+--------------------------------+-------+ Epoch 0 | Epoch 0 |Statistics of the quantization share: Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Statistic's name | Value | Epoch 0 |+==================================+======================+ Epoch 0 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 0 |+----------------------------------+----------------------+ Epoch 0 | Epoch 0 |Statistics of the bitwidth distribution: Epoch 0 |+--------------+---------------------+--------------------+--------------------+ Epoch 0 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 0 || | WQs | Placed AQs | Qs | Epoch 0 |+==============+=====================+====================+====================+ Epoch 0 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 0 || | 149) | 149) | 298) | Epoch 0 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 1 |+-----------------------------------------+-------+ Epoch 1 || Statistic's name | Value | Epoch 1 |+=========================================+=======+ Epoch 1 || Sparsity level of the whole model | 0 | Epoch 1 |+-----------------------------------------+-------+ Epoch 1 || Sparsity level of all sparsified layers | 0 | Epoch 1 |+-----------------------------------------+-------+ Epoch 1 | Epoch 1 |Statistics by sparsified layers: Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 1 |+======================+================+================+=====================+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[0]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[1]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[2]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[3]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[4]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[5]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[6]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[7]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[8]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[9]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[10]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[11]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[12]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[13]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[14]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[15]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[16]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[query]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[key]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfAttention[self]/NN | | | | Epoch 1 || CFLinear[value]/line | | | | Epoch 1 || ar_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinAttenti | | | | Epoch 1 || on[attention]/SwinSe | | | | Epoch 1 || lfOutput[output]/NNC | | | | Epoch 1 || FLinear[dense]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinInterme | | | | Epoch 1 || diate[intermediate]/ | | | | Epoch 1 || NNCFLinear[dense]/li | | | | Epoch 1 || near_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[2]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[17]/SwinOutput[ | | | | Epoch 1 || output]/NNCFLinear[d | | | | Epoch 1 || ense]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[0]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[query]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[key]/linear_ | | | | Epoch 1 || 0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fAttention[self]/NNC | | | | Epoch 1 || FLinear[value]/linea | | | | Epoch 1 || r_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinAttentio | | | | Epoch 1 || n[attention]/SwinSel | | | | Epoch 1 || fOutput[output]/NNCF | | | | Epoch 1 || Linear[dense]/linear | | | | Epoch 1 || _0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinIntermed | | | | Epoch 1 || iate[intermediate]/N | | | | Epoch 1 || NCFLinear[dense]/lin | | | | Epoch 1 || ear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0 | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 1 || cation/SwinModel[swi | | | | Epoch 1 || n]/SwinEncoder[encod | | | | Epoch 1 || er]/ModuleList[layer | | | | Epoch 1 || s]/SwinStage[3]/Modu | | | | Epoch 1 || leList[blocks]/SwinL | | | | Epoch 1 || ayer[1]/SwinOutput[o | | | | Epoch 1 || utput]/NNCFLinear[de | | | | Epoch 1 || nse]/linear_0/bias | | | | Epoch 1 |+----------------------+----------------+----------------+---------------------+ Epoch 1 | Epoch 1 |Statistics of the movement-sparsity algorithm: Epoch 1 |+----------------------------------+-------+ Epoch 1 || Statistic's name | Value | Epoch 1 |+==================================+=======+ Epoch 1 || Mask Importance Threshold | -inf | Epoch 1 |+----------------------------------+-------+ Epoch 1 || Importance Regularization Factor | 0 | Epoch 1 |+----------------------------------+-------+ Epoch 1 | Epoch 1 |Statistics of the quantization algorithm: Epoch 1 |+--------------------------------+-------+ Epoch 1 || Statistic's name | Value | Epoch 1 |+================================+=======+ Epoch 1 || Ratio of enabled quantizations | 100 | Epoch 1 |+--------------------------------+-------+ Epoch 1 | Epoch 1 |Statistics of the quantization share: Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Statistic's name | Value | Epoch 1 |+==================================+======================+ Epoch 1 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 1 |+----------------------------------+----------------------+ Epoch 1 | Epoch 1 |Statistics of the bitwidth distribution: Epoch 1 |+--------------+---------------------+--------------------+--------------------+ Epoch 1 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 1 || | WQs | Placed AQs | Qs | Epoch 1 |+==============+=====================+====================+====================+ Epoch 1 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 1 || | 149) | 149) | 298) | Epoch 1 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 2 |+-----------------------------------------+-------+ Epoch 2 || Statistic's name | Value | Epoch 2 |+=========================================+=======+ Epoch 2 || Sparsity level of the whole model | 0 | Epoch 2 |+-----------------------------------------+-------+ Epoch 2 || Sparsity level of all sparsified layers | 0 | Epoch 2 |+-----------------------------------------+-------+ Epoch 2 | Epoch 2 |Statistics by sparsified layers: Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 2 |+======================+================+================+=====================+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 128] | 0 | 0.020 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 128] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128, 512] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[0]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 256] | 0 | 0.078 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 256] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256, 1024] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[1]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[2]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[3]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[4]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[5]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[6]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[7]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[8]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[9]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[10]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[11]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[12]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[13]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[14]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[15]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[16]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[query]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[key]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfAttention[self]/NN | | | | Epoch 2 || CFLinear[value]/line | | | | Epoch 2 || ar_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 512] | 0 | 0.313 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinAttenti | | | | Epoch 2 || on[attention]/SwinSe | | | | Epoch 2 || lfOutput[output]/NNC | | | | Epoch 2 || FLinear[dense]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048, 512] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [2048] | 0 | 0.002 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinInterme | | | | Epoch 2 || diate[intermediate]/ | | | | Epoch 2 || NNCFLinear[dense]/li | | | | Epoch 2 || near_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512, 2048] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[2]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[17]/SwinOutput[ | | | | Epoch 2 || output]/NNCFLinear[d | | | | Epoch 2 || ense]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[0]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[query]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[key]/linear_ | | | | Epoch 2 || 0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fAttention[self]/NNC | | | | Epoch 2 || FLinear[value]/linea | | | | Epoch 2 || r_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinAttentio | | | | Epoch 2 || n[attention]/SwinSel | | | | Epoch 2 || fOutput[output]/NNCF | | | | Epoch 2 || Linear[dense]/linear | | | | Epoch 2 || _0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [4096, 1024] | 0 | 5.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [4096] | 0 | 0.005 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinIntermed | | | | Epoch 2 || iate[intermediate]/N | | | | Epoch 2 || NCFLinear[dense]/lin | | | | Epoch 2 || ear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024, 4096] | 0 | 5.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0 | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 2 || cation/SwinModel[swi | | | | Epoch 2 || n]/SwinEncoder[encod | | | | Epoch 2 || er]/ModuleList[layer | | | | Epoch 2 || s]/SwinStage[3]/Modu | | | | Epoch 2 || leList[blocks]/SwinL | | | | Epoch 2 || ayer[1]/SwinOutput[o | | | | Epoch 2 || utput]/NNCFLinear[de | | | | Epoch 2 || nse]/linear_0/bias | | | | Epoch 2 |+----------------------+----------------+----------------+---------------------+ Epoch 2 | Epoch 2 |Statistics of the movement-sparsity algorithm: Epoch 2 |+----------------------------------+-------+ Epoch 2 || Statistic's name | Value | Epoch 2 |+==================================+=======+ Epoch 2 || Mask Importance Threshold | -inf | Epoch 2 |+----------------------------------+-------+ Epoch 2 || Importance Regularization Factor | 0 | Epoch 2 |+----------------------------------+-------+ Epoch 2 | Epoch 2 |Statistics of the quantization algorithm: Epoch 2 |+--------------------------------+-------+ Epoch 2 || Statistic's name | Value | Epoch 2 |+================================+=======+ Epoch 2 || Ratio of enabled quantizations | 100 | Epoch 2 |+--------------------------------+-------+ Epoch 2 | Epoch 2 |Statistics of the quantization share: Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Statistic's name | Value | Epoch 2 |+==================================+======================+ Epoch 2 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 2 |+----------------------------------+----------------------+ Epoch 2 | Epoch 2 |Statistics of the bitwidth distribution: Epoch 2 |+--------------+---------------------+--------------------+--------------------+ Epoch 2 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 2 || | WQs | Placed AQs | Qs | Epoch 2 |+==============+=====================+====================+====================+ Epoch 2 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 2 || | 149) | 149) | 298) | Epoch 2 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Movement sparsity automatically calculates `init_importance_threshold` as -0.00649014487862587 so that warmup starts from ~0.1% linear layer sparsity. INFO:nncf:Statistics of the sparsified model: Epoch 3 |+-----------------------------------------+-------+ Epoch 3 || Statistic's name | Value | Epoch 3 |+=========================================+=======+ Epoch 3 || Sparsity level of the whole model | 0.696 | Epoch 3 |+-----------------------------------------+-------+ Epoch 3 || Sparsity level of all sparsified layers | 0.721 | Epoch 3 |+-----------------------------------------+-------+ Epoch 3 | Epoch 3 |Statistics by sparsified layers: Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 3 |+======================+================+================+=====================+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 128] | 0.406 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.240 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 512] | 0.408 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.906 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 0.875 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 128] | 0.859 | 0.020 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 0.875 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 128] | 0.279 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.146 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128, 512] | 0.289 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[0]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 0.938 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.617 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.535 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 256] | 0.161 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.062 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 1024] | 0.293 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 0.562 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.727 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 0.812 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 256] | 0.664 | 0.078 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 256] | 0.294 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.062 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256, 1024] | 0.396 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[1]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.970 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.953 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.660 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.542 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.531 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.595 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.104 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.788 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.643 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.590 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.481 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.096 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.707 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.900 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.886 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.534 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.461 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.551 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.100 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.728 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[2]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.935 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.719 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.922 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.696 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.674 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.656 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.670 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.120 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.821 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[3]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.856 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.825 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.613 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.546 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.656 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.696 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.105 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.834 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[4]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.933 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.719 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.909 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.762 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.724 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.696 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.097 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.840 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[5]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.862 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.594 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.833 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.611 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.567 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.692 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.089 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.831 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[6]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.927 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.911 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.652 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.622 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.600 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.095 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.776 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[7]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.813 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.406 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.765 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.580 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.844 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.523 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.578 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.096 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.759 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[8]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.906 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.854 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.683 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.641 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.541 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.100 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.737 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[9]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.789 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.724 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.519 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.496 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.844 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.581 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.080 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.750 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[10]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.848 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.281 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.774 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.631 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.644 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.612 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.089 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.763 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[11]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.761 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.250 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.668 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.511 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.719 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.517 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.681 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.104 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.768 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[12]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.862 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.188 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.800 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.680 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.670 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.723 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.111 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.788 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[13]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.804 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.724 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.595 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.578 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.808 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.125 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.833 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[14]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.885 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.094 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.807 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.720 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.844 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.686 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.806 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.140 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.825 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[15]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.857 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.281 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.762 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.608 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.559 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.656 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.807 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.171 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.824 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[16]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.927 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.219 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[query]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.841 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[key]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.698 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfAttention[self]/NN | | | | Epoch 3 || CFLinear[value]/line | | | | Epoch 3 || ar_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 512] | 0.642 | 0.313 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinAttenti | | | | Epoch 3 || on[attention]/SwinSe | | | | Epoch 3 || lfOutput[output]/NNC | | | | Epoch 3 || FLinear[dense]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048, 512] | 0.733 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [2048] | 0.171 | 0.002 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinInterme | | | | Epoch 3 || diate[intermediate]/ | | | | Epoch 3 || NNCFLinear[dense]/li | | | | Epoch 3 || near_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512, 2048] | 0.756 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[2]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[17]/SwinOutput[ | | | | Epoch 3 || output]/NNCFLinear[d | | | | Epoch 3 || ense]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.803 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.234 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.652 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.380 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.719 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.294 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.562 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [4096, 1024] | 0.945 | 5.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [4096] | 0.109 | 0.005 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 4096] | 0.951 | 5.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[0]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.947 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.328 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[query]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.869 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[key]/linear_ | | | | Epoch 3 || 0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.362 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.953 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fAttention[self]/NNC | | | | Epoch 3 || FLinear[value]/linea | | | | Epoch 3 || r_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 1024] | 0.334 | 1.250 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 0.625 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinAttentio | | | | Epoch 3 || n[attention]/SwinSel | | | | Epoch 3 || fOutput[output]/NNCF | | | | Epoch 3 || Linear[dense]/linear | | | | Epoch 3 || _0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [4096, 1024] | 0.642 | 5.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [4096] | 0.263 | 0.005 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinIntermed | | | | Epoch 3 || iate[intermediate]/N | | | | Epoch 3 || NCFLinear[dense]/lin | | | | Epoch 3 || ear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024, 4096] | 0.674 | 5.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0 | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 3 || cation/SwinModel[swi | | | | Epoch 3 || n]/SwinEncoder[encod | | | | Epoch 3 || er]/ModuleList[layer | | | | Epoch 3 || s]/SwinStage[3]/Modu | | | | Epoch 3 || leList[blocks]/SwinL | | | | Epoch 3 || ayer[1]/SwinOutput[o | | | | Epoch 3 || utput]/NNCFLinear[de | | | | Epoch 3 || nse]/linear_0/bias | | | | Epoch 3 |+----------------------+----------------+----------------+---------------------+ Epoch 3 | Epoch 3 |Statistics of the movement-sparsity algorithm: Epoch 3 |+----------------------------------+--------+ Epoch 3 || Statistic's name | Value | Epoch 3 |+==================================+========+ Epoch 3 || Mask Importance Threshold | -0.002 | Epoch 3 |+----------------------------------+--------+ Epoch 3 || Importance Regularization Factor | 0.703 | Epoch 3 |+----------------------------------+--------+ Epoch 3 | Epoch 3 |Statistics of the quantization algorithm: Epoch 3 |+--------------------------------+-------+ Epoch 3 || Statistic's name | Value | Epoch 3 |+================================+=======+ Epoch 3 || Ratio of enabled quantizations | 100 | Epoch 3 |+--------------------------------+-------+ Epoch 3 | Epoch 3 |Statistics of the quantization share: Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Statistic's name | Value | Epoch 3 |+==================================+======================+ Epoch 3 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 3 |+----------------------------------+----------------------+ Epoch 3 | Epoch 3 |Statistics of the bitwidth distribution: Epoch 3 |+--------------+---------------------+--------------------+--------------------+ Epoch 3 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 3 || | WQs | Placed AQs | Qs | Epoch 3 |+==============+=====================+====================+====================+ Epoch 3 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 3 || | 149) | 149) | 298) | Epoch 3 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 4 |+-----------------------------------------+-------+ Epoch 4 || Statistic's name | Value | Epoch 4 |+=========================================+=======+ Epoch 4 || Sparsity level of the whole model | 0.876 | Epoch 4 |+-----------------------------------------+-------+ Epoch 4 || Sparsity level of all sparsified layers | 0.907 | Epoch 4 |+-----------------------------------------+-------+ Epoch 4 | Epoch 4 |Statistics by sparsified layers: Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 4 |+======================+================+================+=====================+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 128] | 0.654 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.453 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 512] | 0.623 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 128] | 0.582 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.365 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128, 512] | 0.555 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[0]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 0.938 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.824 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.766 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 0.938 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 256] | 0.571 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.296 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 1024] | 0.629 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.949 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 256] | 0.941 | 0.078 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 0.938 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 256] | 0.729 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.248 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256, 1024] | 0.723 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[1]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.969 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.828 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.844 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.936 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.954 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.852 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.824 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.844 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.874 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.370 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.894 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.964 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.844 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.956 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.757 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.751 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.891 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.386 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.905 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[2]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.963 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.957 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.881 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.880 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.934 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.376 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.943 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[3]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.929 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.918 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.848 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.848 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.953 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.377 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.959 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[4]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.971 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.965 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.955 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.946 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.957 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.371 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.960 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[5]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.973 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.962 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.859 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.832 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.958 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.355 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.960 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[6]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.979 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.975 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.928 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.921 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.932 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.376 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.938 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[7]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.952 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.719 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.921 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.862 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.851 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.928 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.362 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.934 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[8]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.964 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.963 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.919 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.376 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.920 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[9]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.895 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.838 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.800 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.788 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.918 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.363 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.918 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[10]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.967 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.951 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.941 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.919 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.374 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.928 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[11]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.912 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.531 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.843 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.792 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.764 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.926 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.371 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.928 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[12]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.971 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.656 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.947 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.950 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.949 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.928 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.374 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.925 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[13]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.945 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.531 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.882 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.876 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.867 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.936 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.419 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.931 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[14]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.594 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.976 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.928 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.448 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.924 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[15]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.594 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.972 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.966 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.960 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.914 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.490 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.915 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[16]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 0.719 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[query]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.971 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[key]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.959 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfAttention[self]/NN | | | | Epoch 4 || CFLinear[value]/line | | | | Epoch 4 || ar_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 512] | 0.964 | 0.313 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinAttenti | | | | Epoch 4 || on[attention]/SwinSe | | | | Epoch 4 || lfOutput[output]/NNC | | | | Epoch 4 || FLinear[dense]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048, 512] | 0.906 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [2048] | 0.480 | 0.002 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinInterme | | | | Epoch 4 || diate[intermediate]/ | | | | Epoch 4 || NNCFLinear[dense]/li | | | | Epoch 4 || near_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512, 2048] | 0.907 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[2]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[17]/SwinOutput[ | | | | Epoch 4 || output]/NNCFLinear[d | | | | Epoch 4 || ense]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.939 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.438 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.826 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.664 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.592 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [4096, 1024] | 0.974 | 5.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [4096] | 0.409 | 0.005 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 4096] | 0.971 | 5.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[0]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.980 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.469 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[query]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.941 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[key]/linear_ | | | | Epoch 4 || 0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.671 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fAttention[self]/NNC | | | | Epoch 4 || FLinear[value]/linea | | | | Epoch 4 || r_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 1024] | 0.641 | 1.250 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinAttentio | | | | Epoch 4 || n[attention]/SwinSel | | | | Epoch 4 || fOutput[output]/NNCF | | | | Epoch 4 || Linear[dense]/linear | | | | Epoch 4 || _0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [4096, 1024] | 0.892 | 5.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [4096] | 0.515 | 0.005 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinIntermed | | | | Epoch 4 || iate[intermediate]/N | | | | Epoch 4 || NCFLinear[dense]/lin | | | | Epoch 4 || ear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024, 4096] | 0.887 | 5.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0 | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 4 || cation/SwinModel[swi | | | | Epoch 4 || n]/SwinEncoder[encod | | | | Epoch 4 || er]/ModuleList[layer | | | | Epoch 4 || s]/SwinStage[3]/Modu | | | | Epoch 4 || leList[blocks]/SwinL | | | | Epoch 4 || ayer[1]/SwinOutput[o | | | | Epoch 4 || utput]/NNCFLinear[de | | | | Epoch 4 || nse]/linear_0/bias | | | | Epoch 4 |+----------------------+----------------+----------------+---------------------+ Epoch 4 | Epoch 4 |Statistics of the movement-sparsity algorithm: Epoch 4 |+----------------------------------+--------+ Epoch 4 || Statistic's name | Value | Epoch 4 |+==================================+========+ Epoch 4 || Mask Importance Threshold | -0.000 | Epoch 4 |+----------------------------------+--------+ Epoch 4 || Importance Regularization Factor | 0.963 | Epoch 4 |+----------------------------------+--------+ Epoch 4 | Epoch 4 |Statistics of the quantization algorithm: Epoch 4 |+--------------------------------+-------+ Epoch 4 || Statistic's name | Value | Epoch 4 |+================================+=======+ Epoch 4 || Ratio of enabled quantizations | 100 | Epoch 4 |+--------------------------------+-------+ Epoch 4 | Epoch 4 |Statistics of the quantization share: Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Statistic's name | Value | Epoch 4 |+==================================+======================+ Epoch 4 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 4 |+----------------------------------+----------------------+ Epoch 4 | Epoch 4 |Statistics of the bitwidth distribution: Epoch 4 |+--------------+---------------------+--------------------+--------------------+ Epoch 4 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 4 || | WQs | Placed AQs | Qs | Epoch 4 |+==============+=====================+====================+====================+ Epoch 4 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 4 || | 149) | 149) | 298) | Epoch 4 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 5 |+-----------------------------------------+-------+ Epoch 5 || Statistic's name | Value | Epoch 5 |+=========================================+=======+ Epoch 5 || Sparsity level of the whole model | 0.899 | Epoch 5 |+-----------------------------------------+-------+ Epoch 5 || Sparsity level of all sparsified layers | 0.931 | Epoch 5 |+-----------------------------------------+-------+ Epoch 5 | Epoch 5 |Statistics by sparsified layers: Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 5 |+======================+================+================+=====================+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 0.875 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 128] | 0.703 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.494 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 512] | 0.684 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 128] | 0.984 | 0.020 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 128] | 0.637 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.412 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128, 512] | 0.596 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [128] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[0]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 0.938 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.918 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.891 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 0.938 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 256] | 0.668 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.320 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 1024] | 0.688 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.980 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.973 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 256] | 0.965 | 0.078 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 0.938 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 256] | 0.797 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.300 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256, 1024] | 0.770 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [256] | 1 | 0.000 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[1]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.906 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.975 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.886 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.866 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.963 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.446 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.963 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.884 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.860 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.844 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.915 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.425 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.917 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.978 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.973 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.799 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.777 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.926 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.436 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.925 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[2]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.969 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.963 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.890 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.901 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.958 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.438 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.959 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[3]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.940 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.844 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.928 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.854 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.851 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.972 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.439 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.971 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[4]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.974 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.971 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.966 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.951 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.975 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.428 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.974 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[5]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.977 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.880 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.858 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.975 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.412 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.972 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[6]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.960 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.963 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.958 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.438 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.957 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[7]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.967 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.844 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.940 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.869 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.863 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.955 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.419 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.954 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[8]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.979 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.949 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.442 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.945 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[9]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.905 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.781 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.854 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.803 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.790 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.948 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.423 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.946 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[10]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.979 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.975 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.971 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.951 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.428 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.946 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[11]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.940 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.885 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.833 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.831 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.958 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.431 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.956 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[12]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.969 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.962 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.948 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.439 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.942 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[13]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.971 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.921 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.903 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.938 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.896 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.957 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.519 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.953 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[14]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.875 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.946 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.583 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.943 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[15]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.933 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.640 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.933 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[16]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.844 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[query]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[key]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfAttention[self]/NN | | | | Epoch 5 || CFLinear[value]/line | | | | Epoch 5 || ar_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 512] | 0.980 | 0.313 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinAttenti | | | | Epoch 5 || on[attention]/SwinSe | | | | Epoch 5 || lfOutput[output]/NNC | | | | Epoch 5 || FLinear[dense]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048, 512] | 0.933 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [2048] | 0.598 | 0.002 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinInterme | | | | Epoch 5 || diate[intermediate]/ | | | | Epoch 5 || NNCFLinear[dense]/li | | | | Epoch 5 || near_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512, 2048] | 0.933 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [512] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[2]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[17]/SwinOutput[ | | | | Epoch 5 || output]/NNCFLinear[d | | | | Epoch 5 || ense]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.961 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.500 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.852 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.702 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.636 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [4096, 1024] | 0.980 | 5.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [4096] | 0.552 | 0.005 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 4096] | 0.976 | 5.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[0]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.980 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.609 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[query]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.950 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[key]/linear_ | | | | Epoch 5 || 0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.720 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.984 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fAttention[self]/NNC | | | | Epoch 5 || FLinear[value]/linea | | | | Epoch 5 || r_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 1024] | 0.700 | 1.250 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 0.969 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinAttentio | | | | Epoch 5 || n[attention]/SwinSel | | | | Epoch 5 || fOutput[output]/NNCF | | | | Epoch 5 || Linear[dense]/linear | | | | Epoch 5 || _0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [4096, 1024] | 0.937 | 5.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [4096] | 0.559 | 0.005 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinIntermed | | | | Epoch 5 || iate[intermediate]/N | | | | Epoch 5 || NCFLinear[dense]/lin | | | | Epoch 5 || ear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024, 4096] | 0.935 | 5.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0 | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 || SwinForImageClassifi | [1024] | 1 | 0.001 | Epoch 5 || cation/SwinModel[swi | | | | Epoch 5 || n]/SwinEncoder[encod | | | | Epoch 5 || er]/ModuleList[layer | | | | Epoch 5 || s]/SwinStage[3]/Modu | | | | Epoch 5 || leList[blocks]/SwinL | | | | Epoch 5 || ayer[1]/SwinOutput[o | | | | Epoch 5 || utput]/NNCFLinear[de | | | | Epoch 5 || nse]/linear_0/bias | | | | Epoch 5 |+----------------------+----------------+----------------+---------------------+ Epoch 5 | Epoch 5 |Statistics of the movement-sparsity algorithm: Epoch 5 |+----------------------------------+--------+ Epoch 5 || Statistic's name | Value | Epoch 5 |+==================================+========+ Epoch 5 || Mask Importance Threshold | -0.000 | Epoch 5 |+----------------------------------+--------+ Epoch 5 || Importance Regularization Factor | 1.000 | Epoch 5 |+----------------------------------+--------+ Epoch 5 | Epoch 5 |Statistics of the quantization algorithm: Epoch 5 |+--------------------------------+-------+ Epoch 5 || Statistic's name | Value | Epoch 5 |+================================+=======+ Epoch 5 || Ratio of enabled quantizations | 100 | Epoch 5 |+--------------------------------+-------+ Epoch 5 | Epoch 5 |Statistics of the quantization share: Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Statistic's name | Value | Epoch 5 |+==================================+======================+ Epoch 5 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 5 |+----------------------------------+----------------------+ Epoch 5 | Epoch 5 |Statistics of the bitwidth distribution: Epoch 5 |+--------------+---------------------+--------------------+--------------------+ Epoch 5 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 5 || | WQs | Placed AQs | Qs | Epoch 5 |+==============+=====================+====================+====================+ Epoch 5 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 5 || | 149) | 149) | 298) | Epoch 5 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 6 |+-----------------------------------------+-------+ Epoch 6 || Statistic's name | Value | Epoch 6 |+=========================================+=======+ Epoch 6 || Sparsity level of the whole model | 0.416 | Epoch 6 |+-----------------------------------------+-------+ Epoch 6 || Sparsity level of all sparsified layers | 0.431 | Epoch 6 |+-----------------------------------------+-------+ Epoch 6 | Epoch 6 |Statistics by sparsified layers: Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 6 |+======================+================+================+=====================+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 128] | 0.402 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.402 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 512] | 0.402 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 128] | 0.211 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.211 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128, 512] | 0.211 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[0]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 256] | 0.236 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0.236 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 1024] | 0.236 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 256] | 0.212 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0.212 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256, 1024] | 0.212 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[1]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.422 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.422 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.422 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[2]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.411 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.411 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.411 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[3]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.419 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.419 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.419 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[4]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.409 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.409 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.409 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[5]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.393 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.393 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.393 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[6]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.410 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.410 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.410 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[7]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[8]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.403 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.403 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.403 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[9]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.383 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.383 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.383 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[10]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[11]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.398 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.398 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.398 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[12]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[13]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.479 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.479 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.479 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[14]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.537 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.537 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.537 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[15]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.586 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.586 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.586 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[16]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[query]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[key]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfAttention[self]/NN | | | | Epoch 6 || CFLinear[value]/line | | | | Epoch 6 || ar_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinAttenti | | | | Epoch 6 || on[attention]/SwinSe | | | | Epoch 6 || lfOutput[output]/NNC | | | | Epoch 6 || FLinear[dense]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048, 512] | 0.545 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [2048] | 0.545 | 0.002 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinInterme | | | | Epoch 6 || diate[intermediate]/ | | | | Epoch 6 || NNCFLinear[dense]/li | | | | Epoch 6 || near_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512, 2048] | 0.545 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[2]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[17]/SwinOutput[ | | | | Epoch 6 || output]/NNCFLinear[d | | | | Epoch 6 || ense]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [4096, 1024] | 0.533 | 5.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [4096] | 0.533 | 0.005 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 4096] | 0.533 | 5.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[0]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[query]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[key]/linear_ | | | | Epoch 6 || 0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fAttention[self]/NNC | | | | Epoch 6 || FLinear[value]/linea | | | | Epoch 6 || r_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinAttentio | | | | Epoch 6 || n[attention]/SwinSel | | | | Epoch 6 || fOutput[output]/NNCF | | | | Epoch 6 || Linear[dense]/linear | | | | Epoch 6 || _0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [4096, 1024] | 0.497 | 5.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [4096] | 0.497 | 0.005 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinIntermed | | | | Epoch 6 || iate[intermediate]/N | | | | Epoch 6 || NCFLinear[dense]/lin | | | | Epoch 6 || ear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024, 4096] | 0.497 | 5.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0 | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 6 || cation/SwinModel[swi | | | | Epoch 6 || n]/SwinEncoder[encod | | | | Epoch 6 || er]/ModuleList[layer | | | | Epoch 6 || s]/SwinStage[3]/Modu | | | | Epoch 6 || leList[blocks]/SwinL | | | | Epoch 6 || ayer[1]/SwinOutput[o | | | | Epoch 6 || utput]/NNCFLinear[de | | | | Epoch 6 || nse]/linear_0/bias | | | | Epoch 6 |+----------------------+----------------+----------------+---------------------+ Epoch 6 | Epoch 6 |Statistics of the movement-sparsity algorithm: Epoch 6 |+----------------------------------+-------+ Epoch 6 || Statistic's name | Value | Epoch 6 |+==================================+=======+ Epoch 6 || Mask Importance Threshold | 0 | Epoch 6 |+----------------------------------+-------+ Epoch 6 || Importance Regularization Factor | 1 | Epoch 6 |+----------------------------------+-------+ Epoch 6 | Epoch 6 |Statistics of the quantization algorithm: Epoch 6 |+--------------------------------+-------+ Epoch 6 || Statistic's name | Value | Epoch 6 |+================================+=======+ Epoch 6 || Ratio of enabled quantizations | 100 | Epoch 6 |+--------------------------------+-------+ Epoch 6 | Epoch 6 |Statistics of the quantization share: Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Statistic's name | Value | Epoch 6 |+==================================+======================+ Epoch 6 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 6 |+----------------------------------+----------------------+ Epoch 6 | Epoch 6 |Statistics of the bitwidth distribution: Epoch 6 |+--------------+---------------------+--------------------+--------------------+ Epoch 6 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 6 || | WQs | Placed AQs | Qs | Epoch 6 |+==============+=====================+====================+====================+ Epoch 6 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 6 || | 149) | 149) | 298) | Epoch 6 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 7 |+-----------------------------------------+-------+ Epoch 7 || Statistic's name | Value | Epoch 7 |+=========================================+=======+ Epoch 7 || Sparsity level of the whole model | 0.416 | Epoch 7 |+-----------------------------------------+-------+ Epoch 7 || Sparsity level of all sparsified layers | 0.431 | Epoch 7 |+-----------------------------------------+-------+ Epoch 7 | Epoch 7 |Statistics by sparsified layers: Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 7 |+======================+================+================+=====================+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 128] | 0.402 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.402 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 512] | 0.402 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 128] | 0.211 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.211 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128, 512] | 0.211 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[0]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 256] | 0.236 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0.236 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 1024] | 0.236 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 256] | 0.212 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0.212 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256, 1024] | 0.212 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[1]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.422 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.422 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.422 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[2]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.411 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.411 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.411 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[3]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.419 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.419 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.419 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[4]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.409 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.409 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.409 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[5]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.393 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.393 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.393 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[6]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.410 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.410 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.410 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[7]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[8]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.403 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.403 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.403 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[9]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.383 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.383 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.383 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[10]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[11]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.398 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.398 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.398 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[12]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[13]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.479 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.479 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.479 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[14]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.537 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.537 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.537 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[15]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.586 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.586 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.586 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[16]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[query]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[key]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfAttention[self]/NN | | | | Epoch 7 || CFLinear[value]/line | | | | Epoch 7 || ar_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinAttenti | | | | Epoch 7 || on[attention]/SwinSe | | | | Epoch 7 || lfOutput[output]/NNC | | | | Epoch 7 || FLinear[dense]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048, 512] | 0.545 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [2048] | 0.545 | 0.002 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinInterme | | | | Epoch 7 || diate[intermediate]/ | | | | Epoch 7 || NNCFLinear[dense]/li | | | | Epoch 7 || near_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512, 2048] | 0.545 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[2]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[17]/SwinOutput[ | | | | Epoch 7 || output]/NNCFLinear[d | | | | Epoch 7 || ense]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [4096, 1024] | 0.533 | 5.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [4096] | 0.533 | 0.005 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 4096] | 0.533 | 5.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[0]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[query]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[key]/linear_ | | | | Epoch 7 || 0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fAttention[self]/NNC | | | | Epoch 7 || FLinear[value]/linea | | | | Epoch 7 || r_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinAttentio | | | | Epoch 7 || n[attention]/SwinSel | | | | Epoch 7 || fOutput[output]/NNCF | | | | Epoch 7 || Linear[dense]/linear | | | | Epoch 7 || _0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [4096, 1024] | 0.497 | 5.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [4096] | 0.497 | 0.005 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinIntermed | | | | Epoch 7 || iate[intermediate]/N | | | | Epoch 7 || NCFLinear[dense]/lin | | | | Epoch 7 || ear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024, 4096] | 0.497 | 5.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0 | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 7 || cation/SwinModel[swi | | | | Epoch 7 || n]/SwinEncoder[encod | | | | Epoch 7 || er]/ModuleList[layer | | | | Epoch 7 || s]/SwinStage[3]/Modu | | | | Epoch 7 || leList[blocks]/SwinL | | | | Epoch 7 || ayer[1]/SwinOutput[o | | | | Epoch 7 || utput]/NNCFLinear[de | | | | Epoch 7 || nse]/linear_0/bias | | | | Epoch 7 |+----------------------+----------------+----------------+---------------------+ Epoch 7 | Epoch 7 |Statistics of the movement-sparsity algorithm: Epoch 7 |+----------------------------------+-------+ Epoch 7 || Statistic's name | Value | Epoch 7 |+==================================+=======+ Epoch 7 || Mask Importance Threshold | 0 | Epoch 7 |+----------------------------------+-------+ Epoch 7 || Importance Regularization Factor | 1 | Epoch 7 |+----------------------------------+-------+ Epoch 7 | Epoch 7 |Statistics of the quantization algorithm: Epoch 7 |+--------------------------------+-------+ Epoch 7 || Statistic's name | Value | Epoch 7 |+================================+=======+ Epoch 7 || Ratio of enabled quantizations | 100 | Epoch 7 |+--------------------------------+-------+ Epoch 7 | Epoch 7 |Statistics of the quantization share: Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Statistic's name | Value | Epoch 7 |+==================================+======================+ Epoch 7 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 7 |+----------------------------------+----------------------+ Epoch 7 | Epoch 7 |Statistics of the bitwidth distribution: Epoch 7 |+--------------+---------------------+--------------------+--------------------+ Epoch 7 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 7 || | WQs | Placed AQs | Qs | Epoch 7 |+==============+=====================+====================+====================+ Epoch 7 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 7 || | 149) | 149) | 298) | Epoch 7 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 8 |+-----------------------------------------+-------+ Epoch 8 || Statistic's name | Value | Epoch 8 |+=========================================+=======+ Epoch 8 || Sparsity level of the whole model | 0.416 | Epoch 8 |+-----------------------------------------+-------+ Epoch 8 || Sparsity level of all sparsified layers | 0.431 | Epoch 8 |+-----------------------------------------+-------+ Epoch 8 | Epoch 8 |Statistics by sparsified layers: Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 8 |+======================+================+================+=====================+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 128] | 0.402 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.402 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 512] | 0.402 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 128] | 0.211 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.211 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128, 512] | 0.211 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[0]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 256] | 0.236 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0.236 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 1024] | 0.236 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 256] | 0.212 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0.212 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256, 1024] | 0.212 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[1]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.422 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.422 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.422 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[2]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.411 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.411 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.411 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[3]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.419 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.419 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.419 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[4]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.409 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.409 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.409 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[5]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.393 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.393 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.393 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[6]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.410 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.410 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.410 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[7]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[8]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.403 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.403 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.403 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[9]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.383 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.383 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.383 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[10]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[11]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.398 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.398 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.398 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[12]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[13]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.479 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.479 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.479 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[14]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.537 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.537 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.537 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[15]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.586 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.586 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.586 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[16]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[query]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[key]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfAttention[self]/NN | | | | Epoch 8 || CFLinear[value]/line | | | | Epoch 8 || ar_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinAttenti | | | | Epoch 8 || on[attention]/SwinSe | | | | Epoch 8 || lfOutput[output]/NNC | | | | Epoch 8 || FLinear[dense]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048, 512] | 0.545 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [2048] | 0.545 | 0.002 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinInterme | | | | Epoch 8 || diate[intermediate]/ | | | | Epoch 8 || NNCFLinear[dense]/li | | | | Epoch 8 || near_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512, 2048] | 0.545 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[2]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[17]/SwinOutput[ | | | | Epoch 8 || output]/NNCFLinear[d | | | | Epoch 8 || ense]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [4096, 1024] | 0.533 | 5.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [4096] | 0.533 | 0.005 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 4096] | 0.533 | 5.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[0]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[query]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[key]/linear_ | | | | Epoch 8 || 0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fAttention[self]/NNC | | | | Epoch 8 || FLinear[value]/linea | | | | Epoch 8 || r_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinAttentio | | | | Epoch 8 || n[attention]/SwinSel | | | | Epoch 8 || fOutput[output]/NNCF | | | | Epoch 8 || Linear[dense]/linear | | | | Epoch 8 || _0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [4096, 1024] | 0.497 | 5.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [4096] | 0.497 | 0.005 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinIntermed | | | | Epoch 8 || iate[intermediate]/N | | | | Epoch 8 || NCFLinear[dense]/lin | | | | Epoch 8 || ear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024, 4096] | 0.497 | 5.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0 | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 8 || cation/SwinModel[swi | | | | Epoch 8 || n]/SwinEncoder[encod | | | | Epoch 8 || er]/ModuleList[layer | | | | Epoch 8 || s]/SwinStage[3]/Modu | | | | Epoch 8 || leList[blocks]/SwinL | | | | Epoch 8 || ayer[1]/SwinOutput[o | | | | Epoch 8 || utput]/NNCFLinear[de | | | | Epoch 8 || nse]/linear_0/bias | | | | Epoch 8 |+----------------------+----------------+----------------+---------------------+ Epoch 8 | Epoch 8 |Statistics of the movement-sparsity algorithm: Epoch 8 |+----------------------------------+-------+ Epoch 8 || Statistic's name | Value | Epoch 8 |+==================================+=======+ Epoch 8 || Mask Importance Threshold | 0 | Epoch 8 |+----------------------------------+-------+ Epoch 8 || Importance Regularization Factor | 1 | Epoch 8 |+----------------------------------+-------+ Epoch 8 | Epoch 8 |Statistics of the quantization algorithm: Epoch 8 |+--------------------------------+-------+ Epoch 8 || Statistic's name | Value | Epoch 8 |+================================+=======+ Epoch 8 || Ratio of enabled quantizations | 100 | Epoch 8 |+--------------------------------+-------+ Epoch 8 | Epoch 8 |Statistics of the quantization share: Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Statistic's name | Value | Epoch 8 |+==================================+======================+ Epoch 8 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 8 |+----------------------------------+----------------------+ Epoch 8 | Epoch 8 |Statistics of the bitwidth distribution: Epoch 8 |+--------------+---------------------+--------------------+--------------------+ Epoch 8 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 8 || | WQs | Placed AQs | Qs | Epoch 8 |+==============+=====================+====================+====================+ Epoch 8 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 8 || | 149) | 149) | 298) | Epoch 8 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 9 |+-----------------------------------------+-------+ Epoch 9 || Statistic's name | Value | Epoch 9 |+=========================================+=======+ Epoch 9 || Sparsity level of the whole model | 0.416 | Epoch 9 |+-----------------------------------------+-------+ Epoch 9 || Sparsity level of all sparsified layers | 0.431 | Epoch 9 |+-----------------------------------------+-------+ Epoch 9 | Epoch 9 |Statistics by sparsified layers: Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 9 |+======================+================+================+=====================+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 128] | 0.402 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.402 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 512] | 0.402 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 128] | 0.211 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.211 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128, 512] | 0.211 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[0]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 256] | 0.236 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0.236 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 1024] | 0.236 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 256] | 0.212 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0.212 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256, 1024] | 0.212 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[1]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.422 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.422 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.422 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[2]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.411 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.411 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.411 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[3]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.419 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.419 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.419 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[4]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.409 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.409 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.409 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[5]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.393 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.393 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.393 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[6]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.410 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.410 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.410 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[7]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[8]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.403 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.403 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.403 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[9]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.383 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.383 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.383 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[10]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[11]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.398 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.398 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.398 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[12]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[13]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.479 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.479 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.479 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[14]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.537 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.537 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.537 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[15]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.586 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.586 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.586 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[16]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[query]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[key]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfAttention[self]/NN | | | | Epoch 9 || CFLinear[value]/line | | | | Epoch 9 || ar_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinAttenti | | | | Epoch 9 || on[attention]/SwinSe | | | | Epoch 9 || lfOutput[output]/NNC | | | | Epoch 9 || FLinear[dense]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048, 512] | 0.545 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [2048] | 0.545 | 0.002 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinInterme | | | | Epoch 9 || diate[intermediate]/ | | | | Epoch 9 || NNCFLinear[dense]/li | | | | Epoch 9 || near_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512, 2048] | 0.545 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[2]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[17]/SwinOutput[ | | | | Epoch 9 || output]/NNCFLinear[d | | | | Epoch 9 || ense]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [4096, 1024] | 0.533 | 5.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [4096] | 0.533 | 0.005 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 4096] | 0.533 | 5.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[0]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[query]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[key]/linear_ | | | | Epoch 9 || 0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fAttention[self]/NNC | | | | Epoch 9 || FLinear[value]/linea | | | | Epoch 9 || r_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinAttentio | | | | Epoch 9 || n[attention]/SwinSel | | | | Epoch 9 || fOutput[output]/NNCF | | | | Epoch 9 || Linear[dense]/linear | | | | Epoch 9 || _0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [4096, 1024] | 0.497 | 5.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [4096] | 0.497 | 0.005 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinIntermed | | | | Epoch 9 || iate[intermediate]/N | | | | Epoch 9 || NCFLinear[dense]/lin | | | | Epoch 9 || ear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024, 4096] | 0.497 | 5.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0 | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 9 || cation/SwinModel[swi | | | | Epoch 9 || n]/SwinEncoder[encod | | | | Epoch 9 || er]/ModuleList[layer | | | | Epoch 9 || s]/SwinStage[3]/Modu | | | | Epoch 9 || leList[blocks]/SwinL | | | | Epoch 9 || ayer[1]/SwinOutput[o | | | | Epoch 9 || utput]/NNCFLinear[de | | | | Epoch 9 || nse]/linear_0/bias | | | | Epoch 9 |+----------------------+----------------+----------------+---------------------+ Epoch 9 | Epoch 9 |Statistics of the movement-sparsity algorithm: Epoch 9 |+----------------------------------+-------+ Epoch 9 || Statistic's name | Value | Epoch 9 |+==================================+=======+ Epoch 9 || Mask Importance Threshold | 0 | Epoch 9 |+----------------------------------+-------+ Epoch 9 || Importance Regularization Factor | 1 | Epoch 9 |+----------------------------------+-------+ Epoch 9 | Epoch 9 |Statistics of the quantization algorithm: Epoch 9 |+--------------------------------+-------+ Epoch 9 || Statistic's name | Value | Epoch 9 |+================================+=======+ Epoch 9 || Ratio of enabled quantizations | 100 | Epoch 9 |+--------------------------------+-------+ Epoch 9 | Epoch 9 |Statistics of the quantization share: Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Statistic's name | Value | Epoch 9 |+==================================+======================+ Epoch 9 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 9 |+----------------------------------+----------------------+ Epoch 9 | Epoch 9 |Statistics of the bitwidth distribution: Epoch 9 |+--------------+---------------------+--------------------+--------------------+ Epoch 9 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 9 || | WQs | Placed AQs | Qs | Epoch 9 |+==============+=====================+====================+====================+ Epoch 9 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 9 || | 149) | 149) | 298) | Epoch 9 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 10 |+-----------------------------------------+-------+ Epoch 10 || Statistic's name | Value | Epoch 10 |+=========================================+=======+ Epoch 10 || Sparsity level of the whole model | 0.416 | Epoch 10 |+-----------------------------------------+-------+ Epoch 10 || Sparsity level of all sparsified layers | 0.431 | Epoch 10 |+-----------------------------------------+-------+ Epoch 10 | Epoch 10 |Statistics by sparsified layers: Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 10 |+======================+================+================+=====================+ Epoch 10 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 128] | 0.402 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.402 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 512] | 0.402 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 128] | 0.211 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.211 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128, 512] | 0.211 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[0]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 256] | 0.236 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0.236 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 1024] | 0.236 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 256] | 0.212 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0.212 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256, 1024] | 0.212 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[1]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.422 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.422 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.422 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[2]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.411 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.411 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.411 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[3]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.419 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.419 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.419 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[4]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.409 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.409 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.409 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[5]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.393 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.393 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.393 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[6]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.410 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.410 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.410 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[7]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[8]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.403 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.403 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.403 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[9]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.383 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.383 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.383 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[10]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[11]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.398 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.398 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.398 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[12]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[13]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.479 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.479 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.479 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[14]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.537 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.537 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.537 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[15]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.586 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.586 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.586 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[16]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[query]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[key]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfAttention[self]/NN | | | | Epoch 10 || CFLinear[value]/line | | | | Epoch 10 || ar_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinAttenti | | | | Epoch 10 || on[attention]/SwinSe | | | | Epoch 10 || lfOutput[output]/NNC | | | | Epoch 10 || FLinear[dense]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048, 512] | 0.545 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [2048] | 0.545 | 0.002 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinInterme | | | | Epoch 10 || diate[intermediate]/ | | | | Epoch 10 || NNCFLinear[dense]/li | | | | Epoch 10 || near_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512, 2048] | 0.545 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[2]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[17]/SwinOutput[ | | | | Epoch 10 || output]/NNCFLinear[d | | | | Epoch 10 || ense]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [4096, 1024] | 0.533 | 5.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [4096] | 0.533 | 0.005 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 4096] | 0.533 | 5.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[0]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[query]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[key]/linear_ | | | | Epoch 10 || 0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fAttention[self]/NNC | | | | Epoch 10 || FLinear[value]/linea | | | | Epoch 10 || r_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinAttentio | | | | Epoch 10 || n[attention]/SwinSel | | | | Epoch 10 || fOutput[output]/NNCF | | | | Epoch 10 || Linear[dense]/linear | | | | Epoch 10 || _0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [4096, 1024] | 0.497 | 5.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [4096] | 0.497 | 0.005 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinIntermed | | | | Epoch 10 || iate[intermediate]/N | | | | Epoch 10 || NCFLinear[dense]/lin | | | | Epoch 10 || ear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024, 4096] | 0.497 | 5.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0 | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 10 || cation/SwinModel[swi | | | | Epoch 10 || n]/SwinEncoder[encod | | | | Epoch 10 || er]/ModuleList[layer | | | | Epoch 10 || s]/SwinStage[3]/Modu | | | | Epoch 10 || leList[blocks]/SwinL | | | | Epoch 10 || ayer[1]/SwinOutput[o | | | | Epoch 10 || utput]/NNCFLinear[de | | | | Epoch 10 || nse]/linear_0/bias | | | | Epoch 10 |+----------------------+----------------+----------------+---------------------+ Epoch 10 | Epoch 10 |Statistics of the movement-sparsity algorithm: Epoch 10 |+----------------------------------+-------+ Epoch 10 || Statistic's name | Value | Epoch 10 |+==================================+=======+ Epoch 10 || Mask Importance Threshold | 0 | Epoch 10 |+----------------------------------+-------+ Epoch 10 || Importance Regularization Factor | 1 | Epoch 10 |+----------------------------------+-------+ Epoch 10 | Epoch 10 |Statistics of the quantization algorithm: Epoch 10 |+--------------------------------+-------+ Epoch 10 || Statistic's name | Value | Epoch 10 |+================================+=======+ Epoch 10 || Ratio of enabled quantizations | 100 | Epoch 10 |+--------------------------------+-------+ Epoch 10 | Epoch 10 |Statistics of the quantization share: Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Statistic's name | Value | Epoch 10 |+==================================+======================+ Epoch 10 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 10 |+----------------------------------+----------------------+ Epoch 10 | Epoch 10 |Statistics of the bitwidth distribution: Epoch 10 |+--------------+---------------------+--------------------+--------------------+ Epoch 10 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 10 || | WQs | Placed AQs | Qs | Epoch 10 |+==============+=====================+====================+====================+ Epoch 10 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 10 || | 149) | 149) | 298) | Epoch 10 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 11 |+-----------------------------------------+-------+ Epoch 11 || Statistic's name | Value | Epoch 11 |+=========================================+=======+ Epoch 11 || Sparsity level of the whole model | 0.416 | Epoch 11 |+-----------------------------------------+-------+ Epoch 11 || Sparsity level of all sparsified layers | 0.431 | Epoch 11 |+-----------------------------------------+-------+ Epoch 11 | Epoch 11 |Statistics by sparsified layers: Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 11 |+======================+================+================+=====================+ Epoch 11 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 128] | 0.402 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.402 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 512] | 0.402 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 128] | 0.211 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.211 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128, 512] | 0.211 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[0]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 256] | 0.236 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0.236 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 1024] | 0.236 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 256] | 0.212 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0.212 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256, 1024] | 0.212 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[1]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.422 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.422 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.422 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[2]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.411 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.411 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.411 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[3]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.419 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.419 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.419 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[4]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.409 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.409 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.409 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[5]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.393 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.393 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.393 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[6]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.410 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.410 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.410 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[7]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[8]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.403 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.403 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.403 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[9]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.383 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.383 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.383 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[10]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[11]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.398 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.398 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.398 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[12]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[13]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.479 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.479 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.479 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[14]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.537 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.537 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.537 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[15]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.586 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.586 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.586 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[16]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[query]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[key]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfAttention[self]/NN | | | | Epoch 11 || CFLinear[value]/line | | | | Epoch 11 || ar_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinAttenti | | | | Epoch 11 || on[attention]/SwinSe | | | | Epoch 11 || lfOutput[output]/NNC | | | | Epoch 11 || FLinear[dense]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048, 512] | 0.545 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [2048] | 0.545 | 0.002 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinInterme | | | | Epoch 11 || diate[intermediate]/ | | | | Epoch 11 || NNCFLinear[dense]/li | | | | Epoch 11 || near_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512, 2048] | 0.545 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[2]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[17]/SwinOutput[ | | | | Epoch 11 || output]/NNCFLinear[d | | | | Epoch 11 || ense]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [4096, 1024] | 0.533 | 5.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [4096] | 0.533 | 0.005 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 4096] | 0.533 | 5.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[0]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[query]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[key]/linear_ | | | | Epoch 11 || 0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fAttention[self]/NNC | | | | Epoch 11 || FLinear[value]/linea | | | | Epoch 11 || r_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinAttentio | | | | Epoch 11 || n[attention]/SwinSel | | | | Epoch 11 || fOutput[output]/NNCF | | | | Epoch 11 || Linear[dense]/linear | | | | Epoch 11 || _0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [4096, 1024] | 0.497 | 5.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [4096] | 0.497 | 0.005 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinIntermed | | | | Epoch 11 || iate[intermediate]/N | | | | Epoch 11 || NCFLinear[dense]/lin | | | | Epoch 11 || ear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024, 4096] | 0.497 | 5.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0 | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 11 || cation/SwinModel[swi | | | | Epoch 11 || n]/SwinEncoder[encod | | | | Epoch 11 || er]/ModuleList[layer | | | | Epoch 11 || s]/SwinStage[3]/Modu | | | | Epoch 11 || leList[blocks]/SwinL | | | | Epoch 11 || ayer[1]/SwinOutput[o | | | | Epoch 11 || utput]/NNCFLinear[de | | | | Epoch 11 || nse]/linear_0/bias | | | | Epoch 11 |+----------------------+----------------+----------------+---------------------+ Epoch 11 | Epoch 11 |Statistics of the movement-sparsity algorithm: Epoch 11 |+----------------------------------+-------+ Epoch 11 || Statistic's name | Value | Epoch 11 |+==================================+=======+ Epoch 11 || Mask Importance Threshold | 0 | Epoch 11 |+----------------------------------+-------+ Epoch 11 || Importance Regularization Factor | 1 | Epoch 11 |+----------------------------------+-------+ Epoch 11 | Epoch 11 |Statistics of the quantization algorithm: Epoch 11 |+--------------------------------+-------+ Epoch 11 || Statistic's name | Value | Epoch 11 |+================================+=======+ Epoch 11 || Ratio of enabled quantizations | 100 | Epoch 11 |+--------------------------------+-------+ Epoch 11 | Epoch 11 |Statistics of the quantization share: Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Statistic's name | Value | Epoch 11 |+==================================+======================+ Epoch 11 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 11 |+----------------------------------+----------------------+ Epoch 11 | Epoch 11 |Statistics of the bitwidth distribution: Epoch 11 |+--------------+---------------------+--------------------+--------------------+ Epoch 11 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 11 || | WQs | Placed AQs | Qs | Epoch 11 |+==============+=====================+====================+====================+ Epoch 11 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 11 || | 149) | 149) | 298) | Epoch 11 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 12 |+-----------------------------------------+-------+ Epoch 12 || Statistic's name | Value | Epoch 12 |+=========================================+=======+ Epoch 12 || Sparsity level of the whole model | 0.416 | Epoch 12 |+-----------------------------------------+-------+ Epoch 12 || Sparsity level of all sparsified layers | 0.431 | Epoch 12 |+-----------------------------------------+-------+ Epoch 12 | Epoch 12 |Statistics by sparsified layers: Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 12 |+======================+================+================+=====================+ Epoch 12 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 128] | 0.402 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.402 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 512] | 0.402 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 128] | 0.211 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.211 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128, 512] | 0.211 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[0]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 256] | 0.236 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0.236 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 1024] | 0.236 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 256] | 0.212 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0.212 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256, 1024] | 0.212 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[1]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.422 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.422 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.422 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[2]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.411 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.411 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.411 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[3]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.419 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.419 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.419 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[4]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.409 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.409 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.409 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[5]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.393 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.393 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.393 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[6]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.410 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.410 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.410 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[7]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[8]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.403 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.403 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.403 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[9]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.383 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.383 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.383 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[10]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[11]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.398 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.398 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.398 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[12]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[13]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.479 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.479 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.479 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[14]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.537 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.537 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.537 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[15]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.586 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.586 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.586 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[16]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[query]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[key]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfAttention[self]/NN | | | | Epoch 12 || CFLinear[value]/line | | | | Epoch 12 || ar_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinAttenti | | | | Epoch 12 || on[attention]/SwinSe | | | | Epoch 12 || lfOutput[output]/NNC | | | | Epoch 12 || FLinear[dense]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048, 512] | 0.545 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [2048] | 0.545 | 0.002 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinInterme | | | | Epoch 12 || diate[intermediate]/ | | | | Epoch 12 || NNCFLinear[dense]/li | | | | Epoch 12 || near_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512, 2048] | 0.545 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[2]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[17]/SwinOutput[ | | | | Epoch 12 || output]/NNCFLinear[d | | | | Epoch 12 || ense]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [4096, 1024] | 0.533 | 5.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [4096] | 0.533 | 0.005 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 4096] | 0.533 | 5.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[0]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[query]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[key]/linear_ | | | | Epoch 12 || 0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fAttention[self]/NNC | | | | Epoch 12 || FLinear[value]/linea | | | | Epoch 12 || r_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinAttentio | | | | Epoch 12 || n[attention]/SwinSel | | | | Epoch 12 || fOutput[output]/NNCF | | | | Epoch 12 || Linear[dense]/linear | | | | Epoch 12 || _0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [4096, 1024] | 0.497 | 5.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [4096] | 0.497 | 0.005 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinIntermed | | | | Epoch 12 || iate[intermediate]/N | | | | Epoch 12 || NCFLinear[dense]/lin | | | | Epoch 12 || ear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024, 4096] | 0.497 | 5.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0 | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 12 || cation/SwinModel[swi | | | | Epoch 12 || n]/SwinEncoder[encod | | | | Epoch 12 || er]/ModuleList[layer | | | | Epoch 12 || s]/SwinStage[3]/Modu | | | | Epoch 12 || leList[blocks]/SwinL | | | | Epoch 12 || ayer[1]/SwinOutput[o | | | | Epoch 12 || utput]/NNCFLinear[de | | | | Epoch 12 || nse]/linear_0/bias | | | | Epoch 12 |+----------------------+----------------+----------------+---------------------+ Epoch 12 | Epoch 12 |Statistics of the movement-sparsity algorithm: Epoch 12 |+----------------------------------+-------+ Epoch 12 || Statistic's name | Value | Epoch 12 |+==================================+=======+ Epoch 12 || Mask Importance Threshold | 0 | Epoch 12 |+----------------------------------+-------+ Epoch 12 || Importance Regularization Factor | 1 | Epoch 12 |+----------------------------------+-------+ Epoch 12 | Epoch 12 |Statistics of the quantization algorithm: Epoch 12 |+--------------------------------+-------+ Epoch 12 || Statistic's name | Value | Epoch 12 |+================================+=======+ Epoch 12 || Ratio of enabled quantizations | 100 | Epoch 12 |+--------------------------------+-------+ Epoch 12 | Epoch 12 |Statistics of the quantization share: Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Statistic's name | Value | Epoch 12 |+==================================+======================+ Epoch 12 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 12 |+----------------------------------+----------------------+ Epoch 12 | Epoch 12 |Statistics of the bitwidth distribution: Epoch 12 |+--------------+---------------------+--------------------+--------------------+ Epoch 12 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 12 || | WQs | Placed AQs | Qs | Epoch 12 |+==============+=====================+====================+====================+ Epoch 12 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 12 || | 149) | 149) | 298) | Epoch 12 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 13 |+-----------------------------------------+-------+ Epoch 13 || Statistic's name | Value | Epoch 13 |+=========================================+=======+ Epoch 13 || Sparsity level of the whole model | 0.416 | Epoch 13 |+-----------------------------------------+-------+ Epoch 13 || Sparsity level of all sparsified layers | 0.431 | Epoch 13 |+-----------------------------------------+-------+ Epoch 13 | Epoch 13 |Statistics by sparsified layers: Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 13 |+======================+================+================+=====================+ Epoch 13 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 128] | 0.402 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.402 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 512] | 0.402 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 128] | 0.211 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.211 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128, 512] | 0.211 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[0]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 256] | 0.236 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0.236 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 1024] | 0.236 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 256] | 0.212 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0.212 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256, 1024] | 0.212 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[1]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.422 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.422 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.422 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[2]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.411 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.411 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.411 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[3]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.419 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.419 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.419 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[4]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.409 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.409 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.409 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[5]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.393 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.393 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.393 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[6]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.410 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.410 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.410 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[7]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[8]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.403 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.403 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.403 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[9]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.383 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.383 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.383 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[10]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[11]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.398 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.398 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.398 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[12]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[13]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.479 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.479 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.479 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[14]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.537 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.537 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.537 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[15]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.586 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.586 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.586 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[16]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[query]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[key]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfAttention[self]/NN | | | | Epoch 13 || CFLinear[value]/line | | | | Epoch 13 || ar_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinAttenti | | | | Epoch 13 || on[attention]/SwinSe | | | | Epoch 13 || lfOutput[output]/NNC | | | | Epoch 13 || FLinear[dense]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048, 512] | 0.545 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [2048] | 0.545 | 0.002 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinInterme | | | | Epoch 13 || diate[intermediate]/ | | | | Epoch 13 || NNCFLinear[dense]/li | | | | Epoch 13 || near_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512, 2048] | 0.545 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[2]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[17]/SwinOutput[ | | | | Epoch 13 || output]/NNCFLinear[d | | | | Epoch 13 || ense]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [4096, 1024] | 0.533 | 5.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [4096] | 0.533 | 0.005 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 4096] | 0.533 | 5.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[0]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[query]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[key]/linear_ | | | | Epoch 13 || 0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fAttention[self]/NNC | | | | Epoch 13 || FLinear[value]/linea | | | | Epoch 13 || r_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinAttentio | | | | Epoch 13 || n[attention]/SwinSel | | | | Epoch 13 || fOutput[output]/NNCF | | | | Epoch 13 || Linear[dense]/linear | | | | Epoch 13 || _0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [4096, 1024] | 0.497 | 5.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [4096] | 0.497 | 0.005 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinIntermed | | | | Epoch 13 || iate[intermediate]/N | | | | Epoch 13 || NCFLinear[dense]/lin | | | | Epoch 13 || ear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024, 4096] | 0.497 | 5.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0 | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 13 || cation/SwinModel[swi | | | | Epoch 13 || n]/SwinEncoder[encod | | | | Epoch 13 || er]/ModuleList[layer | | | | Epoch 13 || s]/SwinStage[3]/Modu | | | | Epoch 13 || leList[blocks]/SwinL | | | | Epoch 13 || ayer[1]/SwinOutput[o | | | | Epoch 13 || utput]/NNCFLinear[de | | | | Epoch 13 || nse]/linear_0/bias | | | | Epoch 13 |+----------------------+----------------+----------------+---------------------+ Epoch 13 | Epoch 13 |Statistics of the movement-sparsity algorithm: Epoch 13 |+----------------------------------+-------+ Epoch 13 || Statistic's name | Value | Epoch 13 |+==================================+=======+ Epoch 13 || Mask Importance Threshold | 0 | Epoch 13 |+----------------------------------+-------+ Epoch 13 || Importance Regularization Factor | 1 | Epoch 13 |+----------------------------------+-------+ Epoch 13 | Epoch 13 |Statistics of the quantization algorithm: Epoch 13 |+--------------------------------+-------+ Epoch 13 || Statistic's name | Value | Epoch 13 |+================================+=======+ Epoch 13 || Ratio of enabled quantizations | 100 | Epoch 13 |+--------------------------------+-------+ Epoch 13 | Epoch 13 |Statistics of the quantization share: Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Statistic's name | Value | Epoch 13 |+==================================+======================+ Epoch 13 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 13 |+----------------------------------+----------------------+ Epoch 13 | Epoch 13 |Statistics of the bitwidth distribution: Epoch 13 |+--------------+---------------------+--------------------+--------------------+ Epoch 13 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 13 || | WQs | Placed AQs | Qs | Epoch 13 |+==============+=====================+====================+====================+ Epoch 13 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 13 || | 149) | 149) | 298) | Epoch 13 |+--------------+---------------------+--------------------+--------------------+ INFO:nncf:Statistics of the sparsified model: Epoch 14 |+-----------------------------------------+-------+ Epoch 14 || Statistic's name | Value | Epoch 14 |+=========================================+=======+ Epoch 14 || Sparsity level of the whole model | 0.416 | Epoch 14 |+-----------------------------------------+-------+ Epoch 14 || Sparsity level of all sparsified layers | 0.431 | Epoch 14 |+-----------------------------------------+-------+ Epoch 14 | Epoch 14 |Statistics by sparsified layers: Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || Layer's name | Weight's shape | Sparsity level | Weight's percentage | Epoch 14 |+======================+================+================+=====================+ Epoch 14 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0.500 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 128] | 0.500 | 0.020 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 128] | 0.402 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.402 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 512] | 0.402 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0.750 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 128] | 0.750 | 0.020 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 128] | 0.211 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.211 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128, 512] | 0.211 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [128] | 0 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[0]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 256] | 0.236 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0.236 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 1024] | 0.236 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0.625 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 256] | 0.625 | 0.078 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 256] | 0.212 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0.212 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256, 1024] | 0.212 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [256] | 0 | 0.000 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[1]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.422 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.422 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.422 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.400 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.400 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.400 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[2]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.411 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.411 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.411 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[3]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.419 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.419 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.419 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[4]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.812 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.812 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.409 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.409 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.409 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[5]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.438 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.438 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.393 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.393 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.393 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[6]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.410 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.410 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.410 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[7]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[8]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.403 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.403 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.403 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[9]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.625 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.625 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.383 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.383 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.383 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[10]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.388 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.388 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.388 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[11]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.312 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.312 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.398 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.398 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.398 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[12]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.688 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.688 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.390 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.390 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.390 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[13]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.500 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.500 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.479 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.479 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.479 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[14]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.562 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.562 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.537 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.537 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.537 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[15]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.375 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.375 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.586 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.586 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.586 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[16]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[query]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[key]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0.750 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfAttention[self]/NN | | | | Epoch 14 || CFLinear[value]/line | | | | Epoch 14 || ar_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 512] | 0.750 | 0.313 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinAttenti | | | | Epoch 14 || on[attention]/SwinSe | | | | Epoch 14 || lfOutput[output]/NNC | | | | Epoch 14 || FLinear[dense]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048, 512] | 0.545 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [2048] | 0.545 | 0.002 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinInterme | | | | Epoch 14 || diate[intermediate]/ | | | | Epoch 14 || NNCFLinear[dense]/li | | | | Epoch 14 || near_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512, 2048] | 0.545 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [512] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[2]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[17]/SwinOutput[ | | | | Epoch 14 || output]/NNCFLinear[d | | | | Epoch 14 || ense]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [4096, 1024] | 0.533 | 5.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [4096] | 0.533 | 0.005 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 4096] | 0.533 | 5.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[0]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[query]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[key]/linear_ | | | | Epoch 14 || 0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fAttention[self]/NNC | | | | Epoch 14 || FLinear[value]/linea | | | | Epoch 14 || r_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 1024] | 0 | 1.250 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinAttentio | | | | Epoch 14 || n[attention]/SwinSel | | | | Epoch 14 || fOutput[output]/NNCF | | | | Epoch 14 || Linear[dense]/linear | | | | Epoch 14 || _0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [4096, 1024] | 0.497 | 5.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [4096] | 0.497 | 0.005 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinIntermed | | | | Epoch 14 || iate[intermediate]/N | | | | Epoch 14 || NCFLinear[dense]/lin | | | | Epoch 14 || ear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024, 4096] | 0.497 | 5.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0 | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 || SwinForImageClassifi | [1024] | 0 | 0.001 | Epoch 14 || cation/SwinModel[swi | | | | Epoch 14 || n]/SwinEncoder[encod | | | | Epoch 14 || er]/ModuleList[layer | | | | Epoch 14 || s]/SwinStage[3]/Modu | | | | Epoch 14 || leList[blocks]/SwinL | | | | Epoch 14 || ayer[1]/SwinOutput[o | | | | Epoch 14 || utput]/NNCFLinear[de | | | | Epoch 14 || nse]/linear_0/bias | | | | Epoch 14 |+----------------------+----------------+----------------+---------------------+ Epoch 14 | Epoch 14 |Statistics of the movement-sparsity algorithm: Epoch 14 |+----------------------------------+-------+ Epoch 14 || Statistic's name | Value | Epoch 14 |+==================================+=======+ Epoch 14 || Mask Importance Threshold | 0 | Epoch 14 |+----------------------------------+-------+ Epoch 14 || Importance Regularization Factor | 1 | Epoch 14 |+----------------------------------+-------+ Epoch 14 | Epoch 14 |Statistics of the quantization algorithm: Epoch 14 |+--------------------------------+-------+ Epoch 14 || Statistic's name | Value | Epoch 14 |+================================+=======+ Epoch 14 || Ratio of enabled quantizations | 100 | Epoch 14 |+--------------------------------+-------+ Epoch 14 | Epoch 14 |Statistics of the quantization share: Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Statistic's name | Value | Epoch 14 |+==================================+======================+ Epoch 14 || Symmetric WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Asymmetric WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Signed WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Unsigned WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Per-tensor WQs / All placed WQs | 0.00 % (0 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Per-channel WQs / All placed WQs | 100.00 % (149 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Placed WQs / Potential WQs | 73.76 % (149 / 202) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Symmetric AQs / All placed AQs | 32.21 % (48 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Asymmetric AQs / All placed AQs | 67.79 % (101 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Signed AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Unsigned AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Per-tensor AQs / All placed AQs | 100.00 % (149 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 || Per-channel AQs / All placed AQs | 0.00 % (0 / 149) | Epoch 14 |+----------------------------------+----------------------+ Epoch 14 | Epoch 14 |Statistics of the bitwidth distribution: Epoch 14 |+--------------+---------------------+--------------------+--------------------+ Epoch 14 || Num bits (N) | N-bits WQs / Placed | N-bits AQs / | N-bits Qs / Placed | Epoch 14 || | WQs | Placed AQs | Qs | Epoch 14 |+==============+=====================+====================+====================+ Epoch 14 || 8 | 100.00 % (149 / | 100.00 % (149 / | 100.00 % (298 / | Epoch 14 || | 149) | 149) | 298) | Epoch 14 |+--------------+---------------------+--------------------+--------------------+