Suggested Mahou preset.
When I saw that you made a new Mahou but this time for 12B I just had to try it.
For the first try I used the suggested preset:
"temp": 0.3,
"top_p": 0.8,
"min_p": 0.1,
"rep_pen": 1.01,
"dynatemp_exponent": 1
and I got VERY short responses, so short that weren't dynamic for mantaining a conversation. Mind you, I use Layla (a phone app), so I don't have as many parameters to modify. When I changed to these other parameters I reached the sweet spot of 2 - 3 paragraph responses:
"temp": 0.82,
"top_p": 1,
"min_p": 0.1,
"rep_pen": 1.03,
"dynatemp_range": 0.5
I don't have any feedback because the convo was brief, but so far so good.
I have yet to try your Lyra-Gutenberg merges, they look amazing.
Thank you for your models. I'm a fan since Mahou 1.1 L3.
Thanks for your feedback and support!
The short responses are intentional; they're meant to be SMS/text message length. Glad it worked well for ya on different sampler settings!