Model description: cat-ita
Date: 2024-08-30
TF version 2.10.0, OpenNMT version 2.29.1, CTranslate2 version 3.22.0
Test data set
  BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 38.3 (μ = 38.3 ± 0.6) 66.0/44.9/33.0/24.7 (BP = 0.972 ratio = 0.972 hyp_len = 171543 ref_len = 176440)
chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 64.2 (μ = 64.2 ± 0.5)
Flores data set
  BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 25.1 (μ = 25.1 ± 0.9) 58.5/32.8/20.0/12.3 (BP = 0.957 ratio = 0.958 hyp_len = 26150 ref_len = 27306)
chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 55.2 (μ = 55.2 ± 0.6)