|
--- |
|
license: other |
|
license_name: freeuse |
|
license_link: LICENSE |
|
tags: |
|
- not-for-all-audiences |
|
--- |
|
|
|
## Moistral 11B v1, dehumidified |
|
|
|
Original unmerged model: https://huggingface.co./TheDrummer/Moistral-11B-v1 |
|
|
|
### What is this? |
|
GGUF merges of Moistral 11B v1 and Fimbulvetr v2. |
|
|
|
### Why merge? |
|
The finetuned model had some problems with writing, logic, and formatting. Merging itself with the base model (Fimbul) fixed those problems while retaining a lot of its original *moist*. |
|
|
|
I can confidently say that this Moistral is better than the original v1 in all aspects (moist, logic, writing, formatting). |
|
|
|
### Which one do I pick? |
|
I'm releasing 5 versions of the merge. The % in the filename represents how much "Fimbulvetr v2" I merged into my finetuned model. The higher the percent, the less **moist** there is. |
|
|
|
Note: My assessment was flawed, brief, and subjective. |
|
- 50%: Barely moist. Moistral's style rarely shows up but it may have some impact to the *moist* moments. |
|
- 25%: Hints of moist. Moistral's style shows up from time to time. It cooks very slowly and the *moist* moments may not be cooked with the signature moist. |
|
- 10%: Moisty. Moistral's style is emergent. Cooking duration varies here, but there's *usually* some pacing involved. Moist moments have a good amount of the signature moist. |
|
- 5%: Quite moist. Moistral's style is apparent. Cooks quickly half the time and it definitely has the signature Moistral moist writing. Logic is still very strong at this point. |
|
- 2.5%: Still testing. TBD. |
|
|
|
Summary |
|
- 50% and 25% are seemingly more Fimbulvetr than Moistral. It might not be a bad thing if you want Fimbulvetr with some extra flavor. |
|
- 10% and 5% if you want the **MOIST**. 5% if you want very moist logic and writing, 10% if you just want a lot of moist moments. |
|
|
|
Nutshell: All of them are very coherent. Lower percentages = More moist logic & writing. |
|
|
|
### "I found the perfect merge ratio!" |
|
|
|
Great! Let me know which one and why. This WILL affect future development. |