Update README.md
Browse files
README.md
CHANGED
@@ -8,12 +8,10 @@ license: cc-by-sa-4.0
|
|
8 |
<p>“Luna AI Llama2 Uncensored” is a Llama2 based Chat model <br />fine-tuned on over 40,000 long form chat discussions <br />
|
9 |
This model was fine-tuned by Tap, the creator of Luna AI. <br />
|
10 |
The result is an enhanced Llama2 7b model that rivals ChatGPT in performance <br />across a variety of tasks.</p>
|
11 |
-
|
12 |
-
|
13 |
<h2>Model Training</h2>
|
14 |
<p>The fine-tuning process was performed on an 8x a100 80GB machine.
|
15 |
-
<br />The model was trained
|
16 |
-
<br />This includes data from diverse sources which we included to create our custom dataset,<br /> it includes multiple rounds of chats between Human & AI.
|
17 |
</p>
|
18 |
|
19 |
<a rel="noopener nofollow" href="https://huggingface.co/TheBloke/Luna-AI-Llama2-Uncensored-GPTQ">4bit GPTQ Version provided by @TheBloke - for GPU inference</a><br />
|
@@ -30,10 +28,6 @@ ASSISTANT: Of course! Friends are always here for each other. What do you like t
|
|
30 |
|
31 |
```
|
32 |
|
33 |
-
|
34 |
-
<h2>Future Plans</h2>
|
35 |
-
<p>The model is currently being uploaded in FP16 format, <br />and there are plans to convert the model to GGML and GPTQ 4bit quantizations.</p>
|
36 |
-
|
37 |
<h2>Benchmark Results</h2>
|
38 |
|
39 |
||||||
|
@@ -45,18 +39,6 @@ ASSISTANT: Of course! Friends are always here for each other. What do you like t
|
|
45 |
|truthfulqa_mc|1|mc2|0.4716|0.0155|
|
46 |
|Average|-|-|0.5114|0.0150|
|
47 |
|
48 |
-
<h2>Ethical considerations</h2>
|
49 |
-
<p>The data used to train the model is collected from various sources, mostly from the Web. <br />
|
50 |
-
As such, it contains offensive, harmful and biased content. <br />We thus expect the model to exhibit such biases from the training data.</p>
|
51 |
-
|
52 |
-
<h2>Human life</h2>
|
53 |
-
<p>The model is not intended to inform decisions about matters central to human life, <br />and should not be used in such a way.</p>
|
54 |
-
|
55 |
-
<h2>Risks and harms</h2>
|
56 |
-
<p>Risks and harms of large language models include the generation of harmful, offensive or biased content. <br />
|
57 |
-
These models are often prone to generating incorrect information, sometimes referred to as hallucinations.
|
58 |
-
<br /> We do not expect our model to be an exception in this regard.</p>
|
59 |
-
|
60 |
</div>
|
61 |
|
62 |
|
|
|
8 |
<p>“Luna AI Llama2 Uncensored” is a Llama2 based Chat model <br />fine-tuned on over 40,000 long form chat discussions <br />
|
9 |
This model was fine-tuned by Tap, the creator of Luna AI. <br />
|
10 |
The result is an enhanced Llama2 7b model that rivals ChatGPT in performance <br />across a variety of tasks.</p>
|
11 |
+
|
|
|
12 |
<h2>Model Training</h2>
|
13 |
<p>The fine-tuning process was performed on an 8x a100 80GB machine.
|
14 |
+
<br />The model was trained on synthetic outputs which include multiple rounds of chats between Human & AI.
|
|
|
15 |
</p>
|
16 |
|
17 |
<a rel="noopener nofollow" href="https://huggingface.co/TheBloke/Luna-AI-Llama2-Uncensored-GPTQ">4bit GPTQ Version provided by @TheBloke - for GPU inference</a><br />
|
|
|
28 |
|
29 |
```
|
30 |
|
|
|
|
|
|
|
|
|
31 |
<h2>Benchmark Results</h2>
|
32 |
|
33 |
||||||
|
|
|
39 |
|truthfulqa_mc|1|mc2|0.4716|0.0155|
|
40 |
|Average|-|-|0.5114|0.0150|
|
41 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
42 |
</div>
|
43 |
|
44 |
|