These models that use rope behave very weird (dumb) with default settings of 32768 in latest Oobabooga text generation webui.
5
#6 opened 12 months ago
by
CR2022
CR2022
I really need help with Templates? How to interpret and use them?
5
#5 opened about 1 year ago
by
Goldenblood56
Goldenblood56
Free and ready to use openchat_3.5-GGUF model as OpenAI API compatible endpoint
1
#4 opened about 1 year ago
by
limcheekin
limcheekin
Llama.cpp's Server crashes when input is long
#3 opened about 1 year ago
by
Mihaiii
Mihaiii
Weird issues with the local model, but not with the online demo
4
#2 opened about 1 year ago
by
sleepyjoecheated
sleepyjoecheated
Prints only reply but when asked something extra it hangs
14
#1 opened about 1 year ago
by
Pumba2
Pumba2