Commit
•
62b10d9
1
Parent(s):
2ce46ea
Update README.md
Browse files
README.md
CHANGED
|
@@ -18,6 +18,13 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 18 |
GSM8K: 60.05
|
| 19 |
MMLU: 58.89
|
| 20 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
This model is a fine-tuned version of [catallama/CataLlama-v0.2-Instruct-SFT](https://huggingface.co/catallama/CataLlama-v0.2-Instruct-SFT) on an unknown dataset.
|
| 22 |
|
| 23 |
## Model description
|
|
|
|
| 18 |
GSM8K: 60.05
|
| 19 |
MMLU: 58.89
|
| 20 |
|
| 21 |
+
## Benchmarks
|
| 22 |
+
|
| 23 |
+
| Model | CataLlama-v0.1-Instruct-DPO | CataLlama-v0.2-Instruct-DPO |
|
| 24 |
+
| ------------------ | --------------------------- | ------------------------------- |
|
| 25 |
+
| MMLU 5 shot | 47.34 | **58.89** |
|
| 26 |
+
| GSM8K cot 8 shot | 43.29 | **60.05** |
|
| 27 |
+
|
| 28 |
This model is a fine-tuned version of [catallama/CataLlama-v0.2-Instruct-SFT](https://huggingface.co/catallama/CataLlama-v0.2-Instruct-SFT) on an unknown dataset.
|
| 29 |
|
| 30 |
## Model description
|