Unable to load using text-generation-webui
#2
by
pchest
- opened
Whenever I attempt to load Falcon3-7b-Instruct with llama.cpp, I get the following error:
My system is running Pop OS 22.04 with an intel processor and an nvidia 3060 rtx GPU. I have no issues like this with other models or even the original tiiuae/Falcon3-7b-Instruct model. I'll be happy to provide more information, if needed.
my guess is that the llama.cpp implementation needs an update