How to use a GGUF model for tool calling.
#1
by
supercharge19
- opened
The main instruct model looks very promising and is strong and it can even do function calling, however, I have always met failure when using a gguf model (only tried llama cpp though) and function calling could never be done. Is it possible to do function calling with gguf models (perhaps some other way, other than llama.cpp)?
Thanks