Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
FantasiaFoundry
/
GGUF-Quantization-Script
like
60
Text Generation
GGUF
quantized
text-generation-inference
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
36
Deploy
267592f
GGUF-Quantization-Script
4 contributors
History:
29 commits
FantasiaFoundry
Fix lines.
267592f
verified
6 months ago
imatrix
Upload 2 files
7 months ago
.gitattributes
1.52 kB
initial commit
7 months ago
README.md
2.56 kB
Fix lines.
6 months ago
gguf-imat.py
8.33 kB
Add checks for F16.gguf and imatrix.dat, as well make HF model removal optional by default. (#11)
6 months ago