hfl
/

chinese-mixtral-instruct-gguf

Mixture of Experts

Inference Endpoints

Model card Files Files and versions

hfl-rc commited on Jan 29

Commit

c6b5514

•

1 Parent(s): 21b80ab

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -21,7 +21,7 @@ Metric: PPL, lower is better
 | Quant | PPL  |
 | ----- | ---- |
 | IQ2_XXS | - |
-| IQ2_XS | - |
 | Q2_K  | 4.5758 +/- 0.03959    |
 | Q3_K  | 4.5563 +/- 0.04126     |
 | Q4_0  | 3.9757 +/- 0.03455      |

 | Quant | PPL  |
 | ----- | ---- |
 | IQ2_XXS | - |
+| IQ2_XS | 7.4175 +/- 0.08420 |
 | Q2_K  | 4.5758 +/- 0.03959    |
 | Q3_K  | 4.5563 +/- 0.04126     |
 | Q4_0  | 3.9757 +/- 0.03455      |