Update README.md
Browse files
README.md
CHANGED
@@ -42,20 +42,20 @@ The model was trained with [NVIDIA NeMo™ Framework](https://github.com/NVIDIA
|
|
42 |
|
43 |
## Performance
|
44 |
|
45 |
-
### Academic Benchmarks (Zero-shot)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
46 |
|
47 |
- Flores English-to-Indic translation: 46.81 chrF++
|
48 |
- CrossSum: 20.88 chrF++
|
49 |
- XORQA: 26.47 F1
|
50 |
- XQUAD: 41.58 F1
|
51 |
|
52 |
-
### IndicGenBench (One-shot)
|
53 |
-
|
54 |
-
- Flores English-to-Indic translation: 46.81% BLEU
|
55 |
-
- CrossSum: 20.88% chrF++
|
56 |
-
- XORQA: 26.47% F1
|
57 |
-
- XQUAD: 41.58% F1
|
58 |
-
|
59 |
## Usage
|
60 |
|
61 |
```python
|
|
|
42 |
|
43 |
## Performance
|
44 |
|
45 |
+
### Translated Academic Benchmarks (Zero-shot)
|
46 |
+
|
47 |
+
- MMLU: 38.22
|
48 |
+
- ARC-Challenge: 46.71
|
49 |
+
- TriviaQA: 86.11
|
50 |
+
- BoolQ: 62.59
|
51 |
+
|
52 |
+
### IndicGenBench (One-shot)
|
53 |
|
54 |
- Flores English-to-Indic translation: 46.81 chrF++
|
55 |
- CrossSum: 20.88 chrF++
|
56 |
- XORQA: 26.47 F1
|
57 |
- XQUAD: 41.58 F1
|
58 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
59 |
## Usage
|
60 |
|
61 |
```python
|