Undi95 commited on
Commit
c2c519d
1 Parent(s): 343a148

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +66 -0
README.md ADDED
@@ -0,0 +1,66 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ tags:
4
+ - not-for-all-audiences
5
+ - nsfw
6
+ ---
7
+
8
+ <!-- description start -->
9
+ ## Description
10
+
11
+ This repo contains quantized files of Toppy-M-7B, a merge I have done with the new task_arithmetic merge method from mergekit.
12
+
13
+ This project was a request from [BlueNipples](https://huggingface.co/BlueNipples) : [link](https://huggingface.co/Undi95/Utopia-13B/discussions/1)
14
+
15
+ <!-- description end -->
16
+ <!-- description start -->
17
+ ## Models and loras used
18
+
19
+ - [openchat/openchat_3.5](https://huggingface.co/openchat/openchat_3.5)
20
+ - [NousResearch/Nous-Capybara-7B-V1.9](https://huggingface.co/NousResearch/Nous-Capybara-7B-V1.9)
21
+ - [HuggingFaceH4/zephyr-7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta)
22
+ - [lemonilia/AshhLimaRP-Mistral-7B](lemonilia/AshhLimaRP-Mistral-7B)
23
+ - [Vulkane/120-Days-of-Sodom-LoRA-Mistral-7b](https://huggingface.co/Vulkane/120-Days-of-Sodom-LoRA-Mistral-7b)
24
+ - [Undi95/Mistral-pippa-sharegpt-7b-qlora](Undi95/Mistral-pippa-sharegpt-7b-qlora)
25
+
26
+ <!-- description end -->
27
+ ## The sauce
28
+ ```
29
+ openchat/openchat_3.5
30
+ lemonilia/AshhLimaRP-Mistral-7B (LoRA) x 0.38
31
+
32
+ NousResearch/Nous-Capybara-7B-V1.9
33
+ Vulkane/120-Days-of-Sodom-LoRA-Mistral-7b x 0.27
34
+
35
+ HuggingFaceH4/zephyr-7b-beta
36
+ Undi95/Mistral-pippa-sharegpt-7b-qlora x 0.38
37
+
38
+ merge_method: task_arithmetic
39
+ base_model: mistralai/Mistral-7B-v0.1
40
+ models:
41
+ - model: mistralai/Mistral-7B-v0.1
42
+ - model: Undi95/zephyr-7b-beta-pippa-sharegpt
43
+ parameters:
44
+ weight: 0.42
45
+ - model: Undi95/Nous-Capybara-7B-V1.9-120-Days
46
+ parameters:
47
+ weight: 0.29
48
+ - model: Undi95/openchat_3.5-LimaRP-13B
49
+ parameters:
50
+ weight: 0.48
51
+ dtype: bfloat16
52
+ ```
53
+ <!-- prompt-template start -->
54
+ ## Prompt template: Alpaca
55
+
56
+ ```
57
+ Below is an instruction that describes a task. Write a response that appropriately completes the request.
58
+
59
+ ### Instruction:
60
+ {prompt}
61
+
62
+ ### Response:
63
+
64
+ ```
65
+
66
+ If you want to support me, you can [here](https://ko-fi.com/undiai).