GGUF?

#2
by neoopus - opened

Please can you release a version that is usable with Ollama or other offline tools (Jan)?

I don't have a powerful machine at hand and I want to test this.

Please can you release a version that is usable with Ollama or other offline tools (Jan)?

You can use any model from HF in Ollama. just use " ollama run hf.co /{username}/{repository} "

https://huggingface.co./docs/hub/ollama

Sign up or log in to comment