922CA commited on
Commit
05d4591
1 Parent(s): 0bc522c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -6
README.md CHANGED
@@ -12,16 +12,34 @@ tags:
12
  base_model: unsloth/Phi-3-mini-4k-instruct-bnb-4bit
13
  ---
14
 
15
- Testing...
 
 
 
 
16
 
17
- Use "\nPlayer: INPUT\nMonika:" format.
 
18
 
19
- # Uploaded model
20
 
21
- - **Developed by:** 922CA
22
- - **License:** apache-2.0
23
- - **Finetuned from model :** unsloth/Phi-3-mini-4k-instruct-bnb-4bit
 
 
 
 
 
 
 
 
24
 
25
  This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
26
 
27
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
12
  base_model: unsloth/Phi-3-mini-4k-instruct-bnb-4bit
13
  ---
14
 
15
+ # Moniphi-3-v1:
16
+ * AKA LLilmonix3b-v1
17
+ * Phi-3-mini-4k-instruct fine-tuned for Monika character from DDLC
18
+ * Fine-tuned on a dataset of ~600+ items (dialogue scraped from game, reddit, and Twitter augmented by [l2-7b-monika-v0.3c1](https://huggingface.co/922-CA/llama-2-7b-monika-v0.3c1) to turn each into snippets of multi-turn chat dialogue between Player and Monika; this was then manually edited, with more manually crafted items including info about character added in)
19
+ * [GGUFs](https://huggingface.co/922-CA/Moniphi-3-v1-gguf)
20
 
21
+ ### USAGE
22
+ This is meant to be mainly a chat model with limited RP ability.
23
 
24
+ For best results: replace "Human" and "Assistant" with "Player" and "Monika" like so:
25
 
26
+ \nPlayer: (prompt)\nMonika:
27
+
28
+ ### HYPERPARAMS
29
+ * Trained for ~1 epoch
30
+ * rank: 16
31
+ * lora alpha: 16
32
+ * lora dropout: 0.5
33
+ * lr: 2e-4
34
+ * batch size: 4
35
+ * warmup ratio: 0.1
36
+ * grad steps: 1
37
 
38
  This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
39
 
40
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
41
+
42
+ ### WARNINGS AND DISCLAIMERS
43
+ This model is meant to closely reflect the characteristics of Monika. Despite this, there is always the chance that "Monika" will hallucinate and get information about herself wrong or act out of character (especially for a model of this size).
44
+
45
+ Finally, this model is not guaranteed to output aligned or safe outputs, use at your own risk!