TheDrummer's picture
Update README.md
bbccd0a verified
|
raw
history blame
1.99 kB
---
license: other
license_name: freeuse
license_link: LICENSE
tags:
- not-for-all-audiences
---
## Moistral 11B v1, dehumidified
Original unmerged model: https://huggingface.co./TheDrummer/Moistral-11B-v1
### What is this?
GGUF merges of Moistral 11B v1 and Fimbulvetr v2.
### Why merge?
The finetuned model had some problems with writing, logic, and formatting. Merging itself with the base model (Fimbul) fixed those problems while retaining a lot of its original *moist*.
I can confidently say that this Moistral is better than the original v1 in all aspects (moist, logic, writing, formatting).
### Which one do I pick?
I'm releasing 5 versions of the merge. The % in the filename represents how much "Fimbulvetr v2" I merged into my finetuned model. The higher the percent, the less **moist** there is.
Note: My assessment was flawed, brief, and subjective.
- 50%: Barely moist. Moistral's style rarely shows up but it may have some impact to the *moist* moments.
- 25%: Hints of moist. Moistral's style shows up from time to time. It cooks very slowly and the *moist* moments may not be cooked with the signature moist.
- 10%: Moisty. Moistral's style is emergent. Cooking duration varies here, but there's *usually* some pacing involved. Moist moments have a good amount of the signature moist.
- 5%: Quite moist. Moistral's style is apparent. Cooks quickly half the time and it definitely has the signature Moistral moist writing. Logic is still very strong at this point.
- 2.5%: Still testing. TBD.
Summary
- 50% and 25% are seemingly more Fimbulvetr than Moistral. It might not be a bad thing if you want Fimbulvetr with some extra flavor.
- 10% and 5% if you want the **MOIST**. 5% if you want very moist logic and writing, 10% if you just want a lot of moist moments.
Nutshell: All of them are very coherent. Lower percentages = More moist logic & writing.
### "I found the perfect merge ratio!"
Great! Let me know which one and why. This WILL affect future development.