Quantization Script
#2
by
cdawg
- opened
Hey guys,
first of all thank you very much for uploading the quantized model. Is there any option to release how you quantized the model?
I assume it is with autogptq, but i got problems quantizing the model even with the text-generation-server quantize cli.
That would be very great!
cdawg
changed discussion title from
Quantization Scrip
to Quantization Script
cdawg
changed discussion status to
closed