GGUF
Inference Endpoints
Undi95 commited on
Commit
e8f4a9d
1 Parent(s): d65211b

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +84 -0
README.md ADDED
@@ -0,0 +1,84 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ ---
4
+
5
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/630dfb008df86f1e5becadc3/VKX2Z2yjZX5J8kXzgeCYO.png)
6
+
7
+
8
+ ---
9
+
10
+ # Disclaimer:
11
+ ## This is a ***TEST*** version, don't expect everything to work!!!
12
+
13
+ You may use our custom **prompting format**(scroll down to download them!), or simple alpaca. **(Choose which fits best for you!)**
14
+
15
+ ---
16
+
17
+
18
+ # This model is a collab between [IkariDev](https://huggingface.co/IkariDev) and [Undi](https://huggingface.co/Undi95)!
19
+
20
+ Tired of the same merges everytime? Here it is, the Noromaid-7b-v0.2 model. Suitable for RP, ERP and general stuff.
21
+
22
+ [Recommended generation settings - No settings yet(Please suggest some over in the Community tab!)]
23
+
24
+ <!-- description start -->
25
+ ## Description
26
+
27
+ <!-- [Recommended settings - contributed by localfultonextractor](https://files.catbox.moe/ue0tja.json) -->
28
+
29
+ This repo contains GGUF files of Noromaid-7b-v0.2.
30
+
31
+ [FP16 - by IkariDev and Undi](https://huggingface.co/NeverSleep/Noromaid-7b-v0.2)
32
+
33
+ <!-- [GGUF - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GGUF)-->
34
+
35
+ <!-- [GPTQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GPTQ)-->
36
+
37
+ <!-- [exl2[8bpw-8h] - by AzureBlack](https://huggingface.co/AzureBlack/Echidna-13b-v0.3-8bpw-8h-exl2)-->
38
+
39
+ <!-- [AWQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-AWQ)-->
40
+
41
+ <!-- [fp16 - by IkariDev+Undi95](https://huggingface.co/IkariDev/Athena-v4)-->
42
+
43
+ [GGUF - by IkariDev and Undi](https://huggingface.co/NeverSleep/Noromaid-7b-v0.2-GGUF)
44
+ <!-- [OLD(GGUF - by IkariDev+Undi95)](https://huggingface.co/IkariDev/Athena-v4-GGUF)-->
45
+
46
+ ## Ratings:
47
+
48
+ Note: We have permission of all users to upload their ratings, we DONT screenshot random reviews without asking if we can put them here!
49
+
50
+ No ratings yet!
51
+
52
+ If you want your rating to be here, send us a message over on DC and we'll put up a screenshot of it here. DC name is "ikaridev" and "undi".
53
+
54
+ <!-- description end -->
55
+ <!-- prompt-template start -->
56
+ ## Prompt template: Custom format, or Alpaca
57
+
58
+ ### Custom format:
59
+ UPDATED!! SillyTavern config files: [Context](https://files.catbox.moe/ifmhai.json), [Instruct](https://files.catbox.moe/ttw1l9.json).
60
+
61
+ ### Alpaca:
62
+ ```
63
+ Below is an instruction that describes a task. Write a response that appropriately completes the request.
64
+
65
+ ### Instruction:
66
+ {prompt}
67
+
68
+ ### Response:
69
+
70
+ ```
71
+
72
+ ## Training data used:
73
+ - [no_robots dataset](https://huggingface.co/Undi95/Llama2-13B-no_robots-alpaca-lora) let the model have more human behavior, enhances the output.
74
+ - [Aesir Private RP dataset] New data from a new and never used before dataset, add fresh data, no LimaRP spam, this is 100% new. Thanks to the [MinvervaAI Team](https://huggingface.co/MinervaAI) and, in particular, [Gryphe](https://huggingface.co/Gryphe) for letting us use it!
75
+ - [Another private Aesir dataset]
76
+
77
+ This is a full finetune.
78
+ Trained until 2 epoch(4000 steps), trained on mistral 0.1 7b base.
79
+
80
+ ## Others
81
+
82
+ Undi: If you want to support me, you can [here](https://ko-fi.com/undiai).
83
+
84
+ IkariDev: Visit my [retro/neocities style website](https://ikaridevgit.github.io/) please kek