--- license: other license_name: freeuse license_link: LICENSE tags: - not-for-all-audiences --- ## Moistral 11B v1, dehumidified Original unmerged model: https://huggingface.co./TheDrummer/Moistral-11B-v1 ### What is this? GGUF merges of Moistral 11B v1 and Fimbulvetr v2. ### Why merge? The finetuned model had some problems with writing, logic, and formatting. Merging itself with the base model (Fimbul) fixed those problems while retaining a lot of its original *moist*. I can confidently say that this Moistral is better than the original v1 in all aspects (moist, logic, writing, formatting). ### Which one do I pick? I'm releasing 5 versions of the merge. The % in the filename represents how much "Fimbulvetr v2" I merged into my finetuned model. The higher the percent, the less **moist** there is. Note: My assessment was flawed, brief, and subjective. - 50%: Barely moist. Moistral's style rarely shows up but it may have some impact to the *moist* moments. - 25%: Hints of moist. Moistral's style shows up from time to time. It cooks very slowly and the *moist* moments may not be cooked with the signature moist. - 10%: Moisty. Moistral's style is emergent. Cooking duration varies here, but there's *usually* some pacing involved. Moist moments have a good amount of the signature moist. - 5%: Quite moist. Moistral's style is apparent. Cooks quickly half the time and it definitely has the signature Moistral moist writing. Logic is still very strong at this point. - 2.5%: Still testing. TBD. Summary - 50% and 25% are seemingly more Fimbulvetr than Moistral. It might not be a bad thing if you want Fimbulvetr with some extra flavor. - 10% and 5% if you want the **MOIST**. 5% if you want very moist logic and writing, 10% if you just want a lot of moist moments. Nutshell: All of them are very coherent. Lower percentages = More moist logic & writing. ### "I found the perfect merge ratio!" Great! Let me know which one and why. This WILL affect future development.