Model responds only with "Replies"
#1
by
YorkieOH10
- opened
@bartowski
this model appears to just output gibberish, cc
@HeraiHench
I confirm, only outputs 'replies'
Hmm if you lower the temperature do you get the same?
I'll take a look myself after, curious if others have the same
I tried with both Ollama and LM Studio to get the same thing. LM Studio has zero difference after setting temperature super low, even 0.15-0.2. And Ollama (with no extra stuff) makes no difference either.
$ ollama run hf.co/bartowski/HeraiHench_DeepSeek-R1-Qwen-Coder-8B-GGUF:Q5_K_L
>>> This is a test prompt.
Replies Replies Replies Replies Replies Replies Replies Replies Replies
Replies Replies Replies Replies Replies Replies Replies Replies Replies
Replies Replies Replies^C
>>> Send a message (/? for help)