GPTQ available
#7
by
MaziyarPanahi
- opened
Hi,
Thanks for sharing your amazing model with the community. Specially in such small size!
I have quantized it to GPTQ format in case anyone has low GPU resources.
https://huggingface.co./MaziyarPanahi/Starling-LM-7B-beta-GPTQ