Lewdiculous
/

InfinityNexus_9B-GGUF-IQ-Imatrix

Model card Files Files and versions Community

Lewdiculous commited on Mar 14, 2024

Commit

5d84315

·

verified ·

1 Parent(s): 8ea5e9e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -37,7 +37,7 @@ Base⇢ GGUF(F16)⇢ Imatrix-Data(F16)⇢ GGUF(Imatrix-Quants)
 **Quants:**
 ```python
     quantization_options = [
-        "Q4_K_M", "Q4_K_S" "IQ4_XS", "Q5_K_M", "Q5_K_S", "Q6_K",
         "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS"
     ]
 ```

 **Quants:**
 ```python
     quantization_options = [
+        "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S", "Q6_K",
         "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS"
     ]
 ```