Cant get it to work within TextGenerationWebUI
#1
by
MrToon
- opened
Tried different approaches, and tried both the 4 and 5 model.
Also tried merging them with the famous cat multiple files > file.gguf method.
But all result in errors and warnings about a corrupted model.
Any help would be appreciated, I cant really find good info about the mentioned gguf-split.
People are saying that I shouldn't use this tool anymore.
gguf-split is part of llama.cpp