Hugging Face's logo

noneUsername
/
Replete-LLM-V2.5-Qwen-14b-W8A8-Dynamic-Per-Token

Safetensors
qwen2
8-bit precision
Model card Files Community
noneUsername commited on
Commit
12fe2a4
•
1 Parent(s): d675ee8

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ vllm (pretrained=/root/autodl-tmp/output,add_bos_token=true,tensor_parallel_size=2,max_model_len=2048), gen_kwargs: (None), limit: 250.0, num_fewshot: 5, batch_size: auto
2
+ |Tasks|Version| Filter |n-shot| Metric | |Value| |Stderr|
3
+ |-----|------:|----------------|-----:|-----------|---|----:|---|-----:|
4
+ |gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.556|± |0.0315|
5
+ | | |strict-match | 5|exact_match|↑ |0.832|± |0.0237|
6
+
7
+
8
+ vllm (pretrained=/root/autodl-tmp/Replete-LLM-V2.5-Qwen-14b,add_bos_token=true,tensor_parallel_size=2,max_model_len=2048), gen_kwargs: (None), limit: 250.0, num_fewshot: 5, batch_size: auto
9
+ |Tasks|Version| Filter |n-shot| Metric | |Value| |Stderr|
10
+ |-----|------:|----------------|-----:|-----------|---|----:|---|-----:|
11
+ |gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.528|± |0.0316|
12
+ | | |strict-match | 5|exact_match|↑ |0.844|± |0.0230|