nbeerbower
commited on
Commit
•
eedf5d6
1
Parent(s):
28448ab
Update README.md
Browse files
README.md
CHANGED
@@ -9,19 +9,25 @@ tags:
|
|
9 |
license: llama3.1
|
10 |
---
|
11 |
![image/png](https://huggingface.co/nbeerbower/Llama-3.1-Nemotron-lorablated-70B/resolve/main/nemotron.png?download=true)
|
12 |
-
# Llama-3.1-Nemotron-
|
13 |
|
14 |
-
|
15 |
|
16 |
-
##
|
17 |
-
### Merge Method
|
18 |
|
19 |
-
This model was
|
20 |
|
21 |
-
|
|
|
|
|
|
|
|
|
|
|
22 |
|
23 |
-
|
|
|
24 |
|
|
|
25 |
|
26 |
### Configuration
|
27 |
|
@@ -40,4 +46,10 @@ slices:
|
|
40 |
parameters:
|
41 |
weight: 1.0
|
42 |
|
43 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
9 |
license: llama3.1
|
10 |
---
|
11 |
![image/png](https://huggingface.co/nbeerbower/Llama-3.1-Nemotron-lorablated-70B/resolve/main/nemotron.png?download=true)
|
12 |
+
# Llama-3.1-Nemotron-lorablated-70B
|
13 |
|
14 |
+
An uncensored version of [nvidia/Llama-3.1-Nemotron-70B-Instruct-HF](https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF) created by merging [mlabonne/Llama-3-70B-Instruct-abliterated-LORA](https://huggingface.co/mlabonne/Llama-3-70B-Instruct-abliterated-LORA) using [task arithmetic](https://arxiv.org/abs/2212.04089).
|
15 |
|
16 |
+
## Method
|
|
|
17 |
|
18 |
+
This model was created using [mergekit](https://github.com/cg123/mergekit).
|
19 |
|
20 |
+
From Ubuntu 24 (as root):
|
21 |
+
```
|
22 |
+
apt update
|
23 |
+
apt install pipx
|
24 |
+
git clone https://github.com/arcee-ai/mergekit.git
|
25 |
+
cd mergekit && pipx install -e .
|
26 |
|
27 |
+
mergekit-yaml config.yaml Llama-3.1-Nemotron-lorablated-70B --allow-crimes --lora-merge-cache=./cache
|
28 |
+
```
|
29 |
|
30 |
+
See [@mlabonne](https://huggingface.co/mlabonne)'s [Llama-3.1-70B-Instruct-lorablated](https://huggingface.co/mlabonne/Llama-3.1-70B-Instruct-lorablated) for more details on how the LoRA was extracted.
|
31 |
|
32 |
### Configuration
|
33 |
|
|
|
46 |
parameters:
|
47 |
weight: 1.0
|
48 |
|
49 |
+
```
|
50 |
+
|
51 |
+
### Acknowlegements
|
52 |
+
|
53 |
+
Thanks to [@mlabonne](https://huggingface.co/mlabonne), [@grimjim](https://huggingface.co/grimjim), and [@failspy](https://huggingface.co/failspy) for pioneering this technique for uncensoring models.
|
54 |
+
|
55 |
+
Compute provided by [Hetzner](https://www.hetzner.com/) and funded by [Schneewolf Labs](https://schneewolflabs.com/).
|