rahular commited on
Commit
bc481cf
1 Parent(s): 1a25667

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -8
README.md CHANGED
@@ -42,20 +42,20 @@ The model was trained with [NVIDIA NeMo™ Framework](https://github.com/NVIDIA
42
 
43
  ## Performance
44
 
45
- ### Academic Benchmarks (Zero-shot)
 
 
 
 
 
 
 
46
 
47
  - Flores English-to-Indic translation: 46.81 chrF++
48
  - CrossSum: 20.88 chrF++
49
  - XORQA: 26.47 F1
50
  - XQUAD: 41.58 F1
51
 
52
- ### IndicGenBench (One-shot)
53
-
54
- - Flores English-to-Indic translation: 46.81% BLEU
55
- - CrossSum: 20.88% chrF++
56
- - XORQA: 26.47% F1
57
- - XQUAD: 41.58% F1
58
-
59
  ## Usage
60
 
61
  ```python
 
42
 
43
  ## Performance
44
 
45
+ ### Translated Academic Benchmarks (Zero-shot)
46
+
47
+ - MMLU: 38.22
48
+ - ARC-Challenge: 46.71
49
+ - TriviaQA: 86.11
50
+ - BoolQ: 62.59
51
+
52
+ ### IndicGenBench (One-shot)
53
 
54
  - Flores English-to-Indic translation: 46.81 chrF++
55
  - CrossSum: 20.88 chrF++
56
  - XORQA: 26.47 F1
57
  - XQUAD: 41.58 F1
58
 
 
 
 
 
 
 
 
59
  ## Usage
60
 
61
  ```python