Model is writing nonsense endlessly

#5
by prshir - opened

I use DeepSeek-Coder-V2-Lite-Instruct-IQ2_XS.gguf
I asked normal question but the model is writing nonsense endlessly, it is unreadable answer.

image.png

Probably connected with https://huggingface.co./bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF/discussions/3
LM Studio was updated a couple of days ago.

And I'm slightly confused that LM Studio indicates "The model architecture is not supported" but runs the model. Is it really incompatible?

image.png

Lm Studio was updated today again, to version 0.2.31

Sign up or log in to comment