question about what version your mistral templates are
hey there, I was wondering if your mistral templates are for mistral V7 either normal or tekken. I was going to download the drummers new cydonia 24B V2 model, but it says to use either mistral V7 or mistral V7 tekken template for the prompt template. so since I'm not really a good prompter, I was hoping your templates for mistral would happen to be one of those. thanks for any info you can provide.
Hey, hey. Sadly, I do not use the new Cydonia. I stay with older Mistral Small aka the old Cydonia. It works better for me. So - those presets are not Tekken. They're the basic Mistral version. However, you can just import the sys prompt & use the premade ST Tekken presets for instruct and chat template. They work, they're just a bit less fancy but no problem with them.
do you know if anyone has done preset templates for it yet, or that will work with it? I checked marinara's presets but they appear to be for group chats, and I do 1 on 1 chats. and I'd hopefully like to find something with a bit more, fanciness to them then the premade ST presets.
Honestly, instructs templates are fixed with some custom tricks here & there but they're mostly stable and base on what's provided by the LLM makers. Then - story strings aka context templates - those are a bit different, here we go more or less crazy - but those are not directly limited by a model. You can really use the default tekken templates + my sys-prompt + my regex + my samplers and it will work just fine. However, new Mistral Small likes a low temperature so you may be forced to adjust it. I am sadly not aware if anyone decided to make presets especially for new Mistral - since you know, it was a big disappointment. We expected it to be great and like a new RP SOTA - but it turned out it's very inconsistent, very hard to tame and very hard to lead where you want it to go - so a majority stays with a previous version, we'll see what's gonna happen with a Nemo successor.
which of the file folders is your samplers? is it textgen settings? I've been using your regex for a little while now though so I'm good there. obviously sysprompt is going to be in the folder of the same name. also I don't feel like old mistral small/old cydonia was better than this one, although that could also be because after picking up cydonia 24B V2c from beaverai, I grabbed konnect1221's inception preset for metharne, (I think is the name of the template.) but when I was using cydonia 22B, I was just using the recommended sampler settings I was given. but anyways to each their own.
Ok, so again :-D
Instruct = instruct version of the LLM or the instruct template for that given LLM.
Text Generation Settings = Samplers.
Sys Prompts = system prompt.
Story String = Context Template.
About Mistral - the new one is super-inconsistent. It's generally smarter than the old one but it's also extremely untamed. Has problems with following instructions and the character cards. Drummer managed to tame it down a bit - but when I've tried (and BTW - using the standard ST presets) - then, I found out that it's super hard to control - both at low and high temperatures. Thus - I stayed with previous Cydonia :-D
I had read down through the whole main page of the presets, I don't recall seeing a line where you had mentioned that text generation settings = samplers, but I may have missed it. anyways, thanks for answering my questions.
:-D