Gryphe commited on
Commit
759b2ac
1 Parent(s): 59f441a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +38 -0
README.md CHANGED
@@ -1,3 +1,41 @@
1
  ---
2
  license: other
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: other
3
+ language:
4
+ - en
5
  ---
6
+ ## Model details
7
+
8
+ MythoLogic-Mini-7b can be considered the little brother in my Mytho series of models. ([MythoLogic-13b](https://huggingface.co/Gryphe/MythoLogic-13b), [MythoBoros-13b](https://huggingface.co/Gryphe/MythoBoros-13b))
9
+
10
+ Its Llama-2 core is powered by [Nous Hermes-2](https://huggingface.co/NousResearch/Nous-Hermes-llama-2-7b), which is further augmented by [Stable Beluga](https://huggingface.co/stabilityai/StableBeluga-7B) and a carefully distilled [Kimiko LoRa](https://huggingface.co/nRuaif/Kimiko_7B).
11
+
12
+ Since 7B models tend to be less capable all-rounders, more emphasis was put on improving the roleplaying aspects for this gradient merge, of which various gradients were benchmarked before settling on the configuration shown below.
13
+
14
+ ![](MythoLogic-Mini-7b.png)
15
+
16
+ In technical terms, the Hermes-2 core starts at 90% strength before fading away completely at the 12th layer level, where Stable Beluga (and Kimiko) handle the more intricate linguistic aspects.
17
+
18
+ ## Prompt Format
19
+
20
+ Due to its Hermes-2 core this model works best with Alpaca formatting, so for optimal model performance, use:
21
+ ```
22
+ ### Instruction:
23
+ Your instruction or question here.
24
+ ### Response:
25
+ ```
26
+
27
+ For chat/roleplay conversations, I suggest the following structure instead:
28
+ ```
29
+ You are <AI NAME>, a friendly and supportive AI language model. We discuss all subjects freely and without bias or restrictions.
30
+ I am <YOUR NAME>, the user interacting with you through a chat conversation. Start with greeting me.
31
+
32
+ ### Instruction:
33
+ Write <AI NAME>'s next reply in a chat between <YOUR NAME> and <AI NAME>. Write a single reply only.
34
+
35
+ ### Chat History:
36
+ <AI NAME>: Good day, <YOUR NAME>! How can I assist you today?
37
+ (Etc, etc)
38
+
39
+ ### Response:
40
+ <AI NAME>:
41
+ ```