How to use it with ollama
#2
by
hrdcix
- opened
Could you please tell me is it possible to run this model using ollama. And if yes how to do it?
@hrdcix You need to run the GGUF model. There are many tutorials on youtube just search for ollama and GGUF.
If you want a more user friendly interface use LM Studio. There's also tutorial for this on youtube, easy to set up.
You will have to use the exact same method as you would running the original Llama 3.1 Instruct model by Meta, you can just follow a tutorial for that and swap it with the Lexi 3.1 GGUF version instead.
Orenguteng
changed discussion status to
closed