Running this model on LM Studio

#1
by shermanhuman - opened

Hey, I tried running this on LM Studio:

2025-01-09 09:40:48 [DEBUG]
llama_model_load: error loading model: error loading model vocabulary: unknown pre-tokenizer type: 'stella_en_1.5B_v5'
llama_load_model_from_file: failed to load model
2025-01-09 09:40:48 [DEBUG] llama_init_from_gpt_params: failed to load model 'C:\Users\s\.cache\lm-studio\models\Losspost\stella_en_1.5b_v5\losspost-stella-en-1.5b-v5.gguf'
2025-01-09 09:40:48 [DEBUG] lmstudio-llama-cpp: failed to load model. Error: llama.cpp error: 'error loading model vocabulary: unknown pre-tokenizer type: 'stella_en_1.5B_v5''

I'm wondering if you have any insight on how we could get this running on LM Studio? I did get it running on Ollama. Does support for the 'stella_en_1.5B_v5' need to be added to llama.cpp?

Thanks for reading, and for the GGUF!

Sign up or log in to comment