rope_theta in config.json
#3
by
akashicmarga
- opened
The quantized model config has rope_theta param, which was throwing an error as it was not used in model args. Removing this parameter worked for generation. @reach-vb how did you quantised the model?
You are right, it was removed by @marcsun13 in https://huggingface.co./mlx-community/Mistral-7B-Instruct-v0.2-4-bit/discussions/4