mac mps/cpu support

#5
by MLLife - opened

not working on mac m3, not even on cpu or mps

i digged into this, supposed to be a issue with the vllm library? any chance of change in dependency away from this in future?

MLLife changed discussion status to closed
MLLife changed discussion status to open

Sign up or log in to comment