TheDrummer
commited on
Commit
•
bbccd0a
1
Parent(s):
d2efe04
Update README.md
Browse files
README.md
CHANGED
@@ -2,4 +2,38 @@
|
|
2 |
license: other
|
3 |
license_name: freeuse
|
4 |
license_link: LICENSE
|
|
|
|
|
5 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2 |
license: other
|
3 |
license_name: freeuse
|
4 |
license_link: LICENSE
|
5 |
+
tags:
|
6 |
+
- not-for-all-audiences
|
7 |
---
|
8 |
+
|
9 |
+
## Moistral 11B v1, dehumidified
|
10 |
+
|
11 |
+
Original unmerged model: https://huggingface.co/TheDrummer/Moistral-11B-v1
|
12 |
+
|
13 |
+
### What is this?
|
14 |
+
GGUF merges of Moistral 11B v1 and Fimbulvetr v2.
|
15 |
+
|
16 |
+
### Why merge?
|
17 |
+
The finetuned model had some problems with writing, logic, and formatting. Merging itself with the base model (Fimbul) fixed those problems while retaining a lot of its original *moist*.
|
18 |
+
|
19 |
+
I can confidently say that this Moistral is better than the original v1 in all aspects (moist, logic, writing, formatting).
|
20 |
+
|
21 |
+
### Which one do I pick?
|
22 |
+
I'm releasing 5 versions of the merge. The % in the filename represents how much "Fimbulvetr v2" I merged into my finetuned model. The higher the percent, the less **moist** there is.
|
23 |
+
|
24 |
+
Note: My assessment was flawed, brief, and subjective.
|
25 |
+
- 50%: Barely moist. Moistral's style rarely shows up but it may have some impact to the *moist* moments.
|
26 |
+
- 25%: Hints of moist. Moistral's style shows up from time to time. It cooks very slowly and the *moist* moments may not be cooked with the signature moist.
|
27 |
+
- 10%: Moisty. Moistral's style is emergent. Cooking duration varies here, but there's *usually* some pacing involved. Moist moments have a good amount of the signature moist.
|
28 |
+
- 5%: Quite moist. Moistral's style is apparent. Cooks quickly half the time and it definitely has the signature Moistral moist writing. Logic is still very strong at this point.
|
29 |
+
- 2.5%: Still testing. TBD.
|
30 |
+
|
31 |
+
Summary
|
32 |
+
- 50% and 25% are seemingly more Fimbulvetr than Moistral. It might not be a bad thing if you want Fimbulvetr with some extra flavor.
|
33 |
+
- 10% and 5% if you want the **MOIST**. 5% if you want very moist logic and writing, 10% if you just want a lot of moist moments.
|
34 |
+
|
35 |
+
Nutshell: All of them are very coherent. Lower percentages = More moist logic & writing.
|
36 |
+
|
37 |
+
### "I found the perfect merge ratio!"
|
38 |
+
|
39 |
+
Great! Let me know which one and why. This WILL affect future development.
|