Loading gguf model for inference

#6
by Rasi1610 - opened

I'm new to this Quantized model ,Could anyone provide me the code for how to load this .gguf model and inference.
It would be really helpful

use ollama

Sign up or log in to comment