Model responding with all GGGG
#3
by
YorkieOH10
- opened
This model appears to be broken, using the latest version of LM Studio, it just responds in all G's. Sometimes it will respond with a correct answer, and the following replies will be all G's. I'm using the correct preset and Flash Attention is off. Seeing familiar behavior on my Mac and 4090.
Are you on the latest llama.cpp? See https://github.com/ggerganov/llama.cpp/issues/8254 and https://github.com/ggerganov/llama.cpp/pull/8311
@codito I'm on whatever version LM Studio is using.
@codito I'm on whatever version LM Studio is using.
I have same problems with LM Studio like many others.
Koboldcpp have no problems with that model.