perplexity.md

Qwen2.5-7B-Instruct Quant Size (MB) PPL Size (%) Accuracy (%) PPL error rate IQ1_S 1816 29.2065 0.23022 IQ1_M 1948 17.5876 0.13256 IQ2_XXS 2168 13.0997 0.10138 IQ2_XS 2355 10.6611 0.07823