We are utilizing the mmlu_recall dataset to continuously train the Llama-2-7b-hf model, aiming to enhance performance on mmlu metrics, while ensuring that other metric performances remain unaffected.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 46.31
ARC (25-shot) 56.14
HellaSwag (10-shot) 79.13
MMLU (5-shot) 60.04
TruthfulQA (0-shot) 40.95
Winogrande (5-shot) 74.43
GSM8K (5-shot) 7.88
DROP (3-shot) 5.59
Downloads last month
1,564
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Dataset used to train itsliupeng/llama2_7b_mmlu