metadata
license: cc-by-nc-4.0
Simple python script to generate various GGUF-Imatrix quantizations from a Hugging Face author/model input, for Windows.
Your imatrix.txt is expected to be located inside the imatrix folder. Included file is considered a good option, this discussion is where it came from.
Requirements:
- Python 3.11
pip install huggingface_hub