Hugging Face's logo

camel-ai
/
CAMEL-13B-Combined-Data

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
Model card Files Community
3
itanh0b commited on
Commit
5f9068f
•
1 Parent(s): 44aa60d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -4
README.md CHANGED
@@ -2,10 +2,9 @@ CAMEL-13B-Combined-Data is a chat large language model obtained by finetuning LL
2
 
3
  | Model | size | ARC-C (25 shots, acc_norm) | HellaSwag (10 shots, acc_norm) | MMLU (5 shots, acc_norm) | TruthfulQA (0 shot, mc2) | Average | Delta |
4
  |-------------|:----:|:---------------------------:|:-------------------------------:|:-------------------------:|:-------------------------:|:-------:|-------|
5
- | LLaMA | 13B | 50.8 | 78.9 | 37.7 | 39.9 | 51.8 | - |
6
- | Vicuna | 13B | 47.4 | 75.2 | 39.6 | 49.8 | 53.7 | 1.9 |
7
- | CAMEL<sup>*</sup> | 13B | 55.5 | 79.3 | 50.3 | 47.3 | 58.1 | 6.3 |
8
- | LLaMA | 65B | 57.8 | 84.2 | 48.8 | 42.3 | **58.3** | 6.5 |
9
 
10
  ---
11
  license: cc-by-nc-4.0
 
2
 
3
  | Model | size | ARC-C (25 shots, acc_norm) | HellaSwag (10 shots, acc_norm) | MMLU (5 shots, acc_norm) | TruthfulQA (0 shot, mc2) | Average | Delta |
4
  |-------------|:----:|:---------------------------:|:-------------------------------:|:-------------------------:|:-------------------------:|:-------:|-------|
5
+ | LLaMA | 13B | 56.3 | 80.9 | 46.7 | 39.9 | 56.0 | - |
6
+ | Vicuna | 13B | 52.8 | 80.1 | 50.5 | 51.8 | 58.8 | 2.8 |
7
+ | CAMEL<sup>*</sup> | 13B | 56.1 | 79.9 | 50.5 | 49.0 | 58.9 | 2.9 |
 
8
 
9
  ---
10
  license: cc-by-nc-4.0