Phi-4 mini does not work inside of unsloth.
#1
by
Pinkstack
- opened
The Phi-4 mini release is very promising, but sadly it cannot load inside of the Unsloth framework: "RuntimeError: rope_scaling
's short_factor field must have length 64, got 48".
Will unsloth release a fixed version possibly?
seems like the modelling_phi3.py is not included
The Phi-4 mini release is very promising, but sadly it cannot load inside of the Unsloth framework: "RuntimeError:
rope_scaling
's short_factor field must have length 64, got 48".Will unsloth release a fixed version possibly?
seems like the modelling_phi3.py is not included
unfortunately doesnt work atm in any framework. doesnt work in unsloth, ollama, llama.cpp etc because of new arch
will update u guys when it does