Text Generation
Transformers
English

DOUBT

#2
by Koundinyaa - opened

hi @TheBloke
llm=load_model(model_id="TheBloke/orca_mini_v2_7B-GGML", device_type="mps", model_basename="orca-mini-v2_7b.ggmlv3.q4_0.bin")
I'm trying to load this model but what to include in the load_model because it's undefined

What are you using? llama-cpp-python?

This comment has been hidden
Koundinyaa changed discussion status to closed

Sign up or log in to comment