Phi-4 mini does not work inside of unsloth.

#1
by Pinkstack - opened

The Phi-4 mini release is very promising, but sadly it cannot load inside of the Unsloth framework: "RuntimeError: rope_scaling's short_factor field must have length 64, got 48".

Will unsloth release a fixed version possibly?

seems like the modelling_phi3.py is not included

The Phi-4 mini release is very promising, but sadly it cannot load inside of the Unsloth framework: "RuntimeError: rope_scaling's short_factor field must have length 64, got 48".

Will unsloth release a fixed version possibly?

seems like the modelling_phi3.py is not included

unfortunately doesnt work atm in any framework. doesnt work in unsloth, ollama, llama.cpp etc because of new arch

will update u guys when it does

Sign up or log in to comment