Answers coming up just a few words short, literally
#44
by
Groundarts
- opened
It's giving me fine answers, if a bit overly helpful in terms of making sure I know what it is for, and how it works, but several times it's run out of steam what feels like just a few words short of the natural end of its response. Seems like an indication that it's pretty well calibrated, but could use just the tiniest bit more space for longer responses.
yeah I get truncated results too. sometimes the truncation causes it to mess up the token parsing and it gives jumbled output. At least thats what it told me happens, who knows if it's lying.