ThomasBaruzier commited on
Commit
66cb1be
1 Parent(s): c9e9d2f

Upload perplexity.md

Browse files
Files changed (1) hide show
  1. perplexity.md +7 -0
perplexity.md ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+
2
+ Qwen2.5-7B-Instruct
3
+ Quant Size (MB) PPL Size (%) Accuracy (%) PPL error rate
4
+ IQ1_S 1816 29.2065 0.23022
5
+ IQ1_M 1948 17.5876 0.13256
6
+ IQ2_XXS 2168 13.0997 0.10138
7
+ IQ2_XS 2355 10.6611 0.07823