Hastagaras
commited on
Commit
•
953d798
1
Parent(s):
47c1bdb
Update README.md
Browse files
README.md
CHANGED
@@ -13,11 +13,11 @@ pipeline_tag: text-generation
|
|
13 |
|
14 |
### ZABUZA
|
15 |
|
16 |
-
This model is a combination of merge,
|
17 |
|
18 |
-
The base model is [arcee-ai/Llama-3.1-SuperNova-Lite](https://huggingface.co/arcee-ai/Llama-3.1-SuperNova-Lite), which underwent
|
19 |
|
20 |
-
Next, I finetuned the
|
21 |
|
22 |
* **Claude and Gemini Instruction/RP** (15K sloppy examples were removed!)
|
23 |
* **Human-written Stories/RP** (Formatting fixed and most stories have dialogue)
|
|
|
13 |
|
14 |
### ZABUZA
|
15 |
|
16 |
+
This model is a combination of merge, abliteration technique (using baukit) and finetuning.
|
17 |
|
18 |
+
The base model is [arcee-ai/Llama-3.1-SuperNova-Lite](https://huggingface.co/arcee-ai/Llama-3.1-SuperNova-Lite), which underwent abliteration to reduce model refusals.
|
19 |
|
20 |
+
Next, I finetuned the abliterated SuperNova-Lite with 10K diverse examples such as:
|
21 |
|
22 |
* **Claude and Gemini Instruction/RP** (15K sloppy examples were removed!)
|
23 |
* **Human-written Stories/RP** (Formatting fixed and most stories have dialogue)
|