license: other
license_name: freeuse
license_link: LICENSE
tags:
- not-for-all-audiences
tldr;
I tried merging and got VERY good results with logic & writing. Try them out!
If you do try it out, please let me know your thoughts! Just tell me which percentages you tried and how they performed. The future of Moistral is in your hands!
Moistral 11B v1, dehumidified
Original unmerged model: https://huggingface.co./TheDrummer/Moistral-11B-v1
What is this?
GGUF merges of Moistral 11B v1 and Fimbulvetr v2.
Why merge?
The finetuned model had some problems with writing, logic, and formatting. Merging itself with the base model (Fimbul) fixed those problems while retaining a lot of its original moist.
I can confidently say that this Moistral is better than the original v1 in all aspects (moist, logic, writing, formatting).
Which one do I pick?
I'm releasing 5 versions of the merge. The % in the filename represents how much "Fimbulvetr v2" I merged into my finetuned model. The higher the percent, the less moist there is.
Assessment:
- 50%: Barely moist. Moistral's style rarely shows up but it may have some impact to the moist moments.
- 25%: Hints of moist. Moistral's style shows up from time to time. It cooks very slowly and the moist moments may not be cooked with the signature moist.
- 10%: Moisty. Moistral's style is emergent. Cooking duration varies here, but there's usually some pacing involved. Moist moments have a good amount of the signature moist.
- 5%: Quite moist. Moistral's style is apparent. Cooks quickly half the time and it definitely has the signature Moistral moist writing. Logic is still very strong at this point.
- 2.5%: Still testing. TBD.
Summary
- 50% and 25% are seemingly more Fimbulvetr than Moistral. It might not be a bad thing if you want Fimbulvetr with some extra flavor.
- 10% and 5% if you want the MOIST. 5% if you want very moist logic and writing, 10% if you just want a lot of moist moments.
Nutshell: All of them are very coherent. Lower percentages = More moist logic & writing.
Note: My assessment was flawed, brief, and subjective.
"I found the perfect merge ratio!"
Great! Let me know which one and why. This WILL affect future development.