AetherArchitectural/GGUF-Quantization-Script

Text Generation • Updated Dec 18, 2024 • 63

Note Simple python script to generate various GGUF-IQ-Imatrix quantizations from a Hugging Face author/model input, for Windows and NVIDIA hardware.