unable to load model, safetensors argument error
#1
by
ebudmada
- opened
Thank you for the great work! But i am unable to load this model, i get error:
TypeError: AutoAWQForCausalLM.from_quantized() got an unexpected keyword argument 'safetensors'
when using the code in the model card.
If i remove safetensors from argument, now i get
TypeError: AutoAWQForCausalLM.from_quantized() missing 1 required positional argument: 'quant_filename'
I can't find documentation on how to use safetensors. And I don't see any .pt file in the files and version to load quant_filename.
What i am missing?
Thank you