Anyone running GGUFs for this?
I ended up just converting them myself (I downloaded binaries from llama.cpp release + git cloned). It actually wasn't that hard!
· Sign up or log in to comment
