TheDrummer commited on
Commit
bbccd0a
1 Parent(s): d2efe04

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -0
README.md CHANGED
@@ -2,4 +2,38 @@
2
  license: other
3
  license_name: freeuse
4
  license_link: LICENSE
 
 
5
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: other
3
  license_name: freeuse
4
  license_link: LICENSE
5
+ tags:
6
+ - not-for-all-audiences
7
  ---
8
+
9
+ ## Moistral 11B v1, dehumidified
10
+
11
+ Original unmerged model: https://huggingface.co/TheDrummer/Moistral-11B-v1
12
+
13
+ ### What is this?
14
+ GGUF merges of Moistral 11B v1 and Fimbulvetr v2.
15
+
16
+ ### Why merge?
17
+ The finetuned model had some problems with writing, logic, and formatting. Merging itself with the base model (Fimbul) fixed those problems while retaining a lot of its original *moist*.
18
+
19
+ I can confidently say that this Moistral is better than the original v1 in all aspects (moist, logic, writing, formatting).
20
+
21
+ ### Which one do I pick?
22
+ I'm releasing 5 versions of the merge. The % in the filename represents how much "Fimbulvetr v2" I merged into my finetuned model. The higher the percent, the less **moist** there is.
23
+
24
+ Note: My assessment was flawed, brief, and subjective.
25
+ - 50%: Barely moist. Moistral's style rarely shows up but it may have some impact to the *moist* moments.
26
+ - 25%: Hints of moist. Moistral's style shows up from time to time. It cooks very slowly and the *moist* moments may not be cooked with the signature moist.
27
+ - 10%: Moisty. Moistral's style is emergent. Cooking duration varies here, but there's *usually* some pacing involved. Moist moments have a good amount of the signature moist.
28
+ - 5%: Quite moist. Moistral's style is apparent. Cooks quickly half the time and it definitely has the signature Moistral moist writing. Logic is still very strong at this point.
29
+ - 2.5%: Still testing. TBD.
30
+
31
+ Summary
32
+ - 50% and 25% are seemingly more Fimbulvetr than Moistral. It might not be a bad thing if you want Fimbulvetr with some extra flavor.
33
+ - 10% and 5% if you want the **MOIST**. 5% if you want very moist logic and writing, 10% if you just want a lot of moist moments.
34
+
35
+ Nutshell: All of them are very coherent. Lower percentages = More moist logic & writing.
36
+
37
+ ### "I found the perfect merge ratio!"
38
+
39
+ Great! Let me know which one and why. This WILL affect future development.