ValueError: [broadcast_shapes] Shapes (48) and (64) cannot be broadcast.
#1
by
alexcardo
- opened
🥲 Failed to load the model
Failed to load model
Error when loading model: ValueError: [broadcast_shapes] Shapes (48) and (64) cannot be broadcast.
Hi @alexcardo ! The new model required some changes, did you install the latest version (0.21.5) of mlx-lm?
pip install --upgrade mlx-lm
Hi,
@alexcardo
!
The solution
@pcuenq
shared works if you're using the mlx-lm python package.
But I noticed that the error you pasted is the default error message from LM Studio. As it depends on mlx-lm to run MLX, we'll need to wait for the next release of LM Studio (or use the beta version, to get it earlier).
cc
@yagilb