Hugging Face's logo

lgaalves
/
gpt-2-xl_camel-ai-physics

Text Generation
Transformers
PyTorch
Safetensors
English
gpt2
text-generation-inference
Inference Endpoints
Model card Files Community
2
lgaalves commited on
Commit
fd2f25f
•
1 Parent(s): e20cf5a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -5
README.md CHANGED
@@ -18,11 +18,12 @@ pipeline_tag: text-generation
18
 
19
  | Metric |lgaalves/gpt2-xl-camel-ai-physics |gpt2-xl (base) |
20
  |-----------------------|-------|-------|
21
- | Avg. | - | 36.66 |
22
- | ARC (25-shot) | - | 30.29 |
23
- | HellaSwag (10-shot) | - | 51.38 |
24
- | MMLU (5-shot) | - | 26.43 |
25
- | TruthfulQA (0-shot) | - | 38.54 |
 
26
 
27
  We use state-of-the-art [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) to run the benchmark tests above, using the same version as the HuggingFace LLM Leaderboard. Please see below for detailed instructions on reproducing benchmark results.
28
 
 
18
 
19
  | Metric |lgaalves/gpt2-xl-camel-ai-physics |gpt2-xl (base) |
20
  |-----------------------|-------|-------|
21
+ | Avg. | 36.51 | **36.66** |
22
+ | ARC (25-shot) | 29.52 | **30.29** |
23
+ | HellaSwag (10-shot) | 50.62 | **51.38** |
24
+ | MMLU (5-shot) | **26.79** | 26.43 |
25
+ | TruthfulQA (0-shot) | **39.12** | 38.54 |
26
+
27
 
28
  We use state-of-the-art [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) to run the benchmark tests above, using the same version as the HuggingFace LLM Leaderboard. Please see below for detailed instructions on reproducing benchmark results.
29