Spaces:
Running
Running
Error converting microsoft/Phi-4-mini-instruct: Shapes (48) and (64) cannot be broadcast.
#35
by
Felladrin
- opened
When converting https://huggingface.co./microsoft/Phi-4-mini-instruct, it throws this error.
The model needed some fixes to work. It's now fixed in mlx-lm 0.21.5.
I restarted the space hopefully it will install the latest mlx-lm.
I did a "factory reset" and it works now, here's a converted model: https://huggingface.co./mlx-community/Phi-4-mini-instruct-Q4-mlx
pcuenq
changed discussion status to
closed
Working like a charm! Thank you both!
I've added https://huggingface.co./mlx-community/Phi-4-mini-instruct-6bit and https://huggingface.co./mlx-community/Phi-4-mini-instruct-8bit