Sao10K commited on
Commit
321492e
1 Parent(s): a42d3d0

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +43 -0
README.md ADDED
@@ -0,0 +1,43 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ language:
4
+ - en
5
+ datasets:
6
+ - Gryphe/Opus-WritingPrompts
7
+ - Sao10K/Claude-3-Opus-Instruct-15K
8
+ - Sao10K/Short-Storygen-v2
9
+ - Sao10K/c2-Logs-Filtered
10
+ ---
11
+
12
+ L3-70B-Euryale-v2.1
13
+
14
+ **She's back!**
15
+
16
+ Stheno's Sister Model, a healthier and chonkier dose this time.
17
+ ```
18
+ - Same Dataset used as Stheno v3.2 -> See notes there.
19
+ - LoRA Fine-Tune -> FFT is simply too expensive.
20
+ - Trained on 8x H100 SXMs.
21
+ ```
22
+
23
+ Testing Notes
24
+ ```
25
+ - Better prompt adherence.
26
+ - Better anatomy / spatial awareness.
27
+ - Adapts much better to unique and custom formatting / reply formats.
28
+ - Very creative, lots of unique swipes.
29
+ - Is not restrictive during roleplays.
30
+ - Feels like a big brained version of Stheno.
31
+ ```
32
+
33
+ *Likely due to it being a 70B model instead of 8B. Similar vibes comparing back in llama 2, where 70B models were simply much more 'aware' in the subtler areas and contexts a smaller model like a 7B or 13B back then simply is not able to handle.*
34
+
35
+ ***
36
+
37
+ As per usual, support me here:
38
+
39
+ Ko-fi: https://ko-fi.com/sao10k
40
+
41
+ ```
42
+ Art by:
43
+ ```