Lewdiculous commited on
Commit
46d9dde
1 Parent(s): 2cb04e3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +77 -7
README.md CHANGED
@@ -1,16 +1,86 @@
1
  ---
2
  license: cc-by-4.0
3
  ---
4
- GGUF-IQ-Imatrix quants for **cgato/L3-TheSpice-8b-v0.1.3** as requested in [#29](https://huggingface.co/Lewdiculous/Model-Requests/discussions/29).
 
 
 
5
 
6
  > [!IMPORTANT]
7
- > **Updated!**
8
- > These quants have been redone with the fixes from [llama.cpp/pull/6920](https://github.com/ggerganov/llama.cpp/pull/6920) in mind. <br>
9
  > Use **KoboldCpp version 1.64** or higher.
10
-
11
  > [!NOTE]
12
- > Use the **ChatML** presets.
13
-
14
- "Possibly more human and better at RP based on llama3."
15
 
16
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/VNpZl0O7dpwWLK8i5RG5d.png)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-4.0
3
  ---
4
+
5
+ # #roleplay
6
+
7
+ GGUF-IQ-Imatrix quants for **cgato/L3-TheSpice-8b-v0.8.3**.
8
 
9
  > [!IMPORTANT]
10
+ > These quants have been done after the fixes from [llama.cpp/pull/6920](https://github.com/ggerganov/llama.cpp/pull/6920). <br>
 
11
  > Use **KoboldCpp version 1.64** or higher.
12
+ >
13
  > [!NOTE]
14
+ > Prompt format is relatively simple, experienment with either Alapaca and ChatML, or the same format and report your experience.
 
 
15
 
16
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/65d4cf2693a0a3744a27536c/VNpZl0O7dpwWLK8i5RG5d.png)
17
+
18
+ # Original model information by the author:
19
+
20
+ Now not overtrained and with the tokenizer fix to base llama3. Trained for 3 epochs.
21
+
22
+ The latest TheSpice, dipped in Mama Liz's LimaRP Oil.
23
+ I've focused on making the model more flexible and provide a more unique experience.
24
+ I'm still working on cleaning up my dataset, but I've shrunken it down a lot to focus on a "less is more" approach.
25
+ This is ultimate a return to form of the way I used to train Thespis, with more of a focus on a small hand edited dataset.
26
+
27
+
28
+ ## Datasets Used
29
+
30
+ * Capybara
31
+ * Claude Multiround 30k
32
+ * Augmental
33
+ * ToxicQA
34
+ * Yahoo Answers
35
+ * Airoboros 3.1
36
+ * LimaRP
37
+
38
+ ## Features ( Examples from 0.1.1 because I'm too lazy to take new screenshots. Its tested tho. )
39
+
40
+ Narration
41
+
42
+ If you request information on objects or characters in the scene, the model will narrate it to you. Most of the time, without moving the story forward.
43
+
44
+ # You can look at anything mostly as long as you end it with "What do I see?"
45
+
46
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64dd7cda3d6b954bf7cdd922/VREY8QHtH6fCL0fCp8AAC.png)
47
+
48
+ # You can also request to know what a character is thinking or planning.
49
+
50
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64dd7cda3d6b954bf7cdd922/U3RTAgbaB2m1ygfZGJ-SM.png)
51
+
52
+ # You can ask for a quick summary on the character as well.
53
+
54
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64dd7cda3d6b954bf7cdd922/uXFd6GhnXS8w_egUEfcAp.png)
55
+
56
+ # Before continuing the conversation as normal.
57
+
58
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64dd7cda3d6b954bf7cdd922/dYTQUdCshUDtp_BJ20tHy.png)
59
+
60
+ ## Prompt Format: Chat ( The default Ooba template and Silly Tavern Template )
61
+
62
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64dd7cda3d6b954bf7cdd922/59vi4VWP2d0bCbsW2eU8h.png)
63
+
64
+ If you're using Ooba in verbose mode as a server, you can check if you're console is logging something that looks like this.
65
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64dd7cda3d6b954bf7cdd922/mB3wZqtwN8B45nR7W1fgR.png)
66
+
67
+ ```
68
+ {System Prompt}
69
+
70
+ Username: {Input}
71
+ BotName: {Response}
72
+ Username: {Input}
73
+ BotName: {Response}
74
+
75
+ ```
76
+ ## Presets
77
+
78
+ All screenshots above were taken with the below SillyTavern Preset.
79
+ ## Recommended Silly Tavern Preset -> (Temp: 1.25, MinP: 0.1, RepPen: 1.05)
80
+ This is a roughly equivalent Kobold Horde Preset.
81
+ ## Recommended Kobold Horde Preset -> MinP
82
+
83
+
84
+ # Disclaimer
85
+
86
+ Please prompt responsibly and take anything outputted by any Language Model with a huge grain of salt. Thanks!