| license: cc-by-4.0 | |
| Quantizing and uploading... | |
| ```python | |
| quantization_options = [ | |
| "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S", | |
| "Q6_K", "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS" | |
| ] | |
| ``` | |
|  | |