nbeerbower commited on
Commit
eedf5d6
1 Parent(s): 28448ab

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -8
README.md CHANGED
@@ -9,19 +9,25 @@ tags:
9
  license: llama3.1
10
  ---
11
  ![image/png](https://huggingface.co/nbeerbower/Llama-3.1-Nemotron-lorablated-70B/resolve/main/nemotron.png?download=true)
12
- # Llama-3.1-Nemotron-Lorablated-70B
13
 
14
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
15
 
16
- ## Merge Details
17
- ### Merge Method
18
 
19
- This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [nvidia/Llama-3.1-Nemotron-70B-Instruct-HF](https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF) + [mlabonne/Llama-3-70B-Instruct-abliterated-LORA](https://huggingface.co/mlabonne/Llama-3-70B-Instruct-abliterated-LORA) as a base.
20
 
21
- ### Models Merged
 
 
 
 
 
22
 
23
- The following models were included in the merge:
 
24
 
 
25
 
26
  ### Configuration
27
 
@@ -40,4 +46,10 @@ slices:
40
  parameters:
41
  weight: 1.0
42
 
43
- ```
 
 
 
 
 
 
 
9
  license: llama3.1
10
  ---
11
  ![image/png](https://huggingface.co/nbeerbower/Llama-3.1-Nemotron-lorablated-70B/resolve/main/nemotron.png?download=true)
12
+ # Llama-3.1-Nemotron-lorablated-70B
13
 
14
+ An uncensored version of [nvidia/Llama-3.1-Nemotron-70B-Instruct-HF](https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF) created by merging [mlabonne/Llama-3-70B-Instruct-abliterated-LORA](https://huggingface.co/mlabonne/Llama-3-70B-Instruct-abliterated-LORA) using [task arithmetic](https://arxiv.org/abs/2212.04089).
15
 
16
+ ## Method
 
17
 
18
+ This model was created using [mergekit](https://github.com/cg123/mergekit).
19
 
20
+ From Ubuntu 24 (as root):
21
+ ```
22
+ apt update
23
+ apt install pipx
24
+ git clone https://github.com/arcee-ai/mergekit.git
25
+ cd mergekit && pipx install -e .
26
 
27
+ mergekit-yaml config.yaml Llama-3.1-Nemotron-lorablated-70B --allow-crimes --lora-merge-cache=./cache
28
+ ```
29
 
30
+ See [@mlabonne](https://huggingface.co/mlabonne)'s [Llama-3.1-70B-Instruct-lorablated](https://huggingface.co/mlabonne/Llama-3.1-70B-Instruct-lorablated) for more details on how the LoRA was extracted.
31
 
32
  ### Configuration
33
 
 
46
  parameters:
47
  weight: 1.0
48
 
49
+ ```
50
+
51
+ ### Acknowlegements
52
+
53
+ Thanks to [@mlabonne](https://huggingface.co/mlabonne), [@grimjim](https://huggingface.co/grimjim), and [@failspy](https://huggingface.co/failspy) for pioneering this technique for uncensoring models.
54
+
55
+ Compute provided by [Hetzner](https://www.hetzner.com/) and funded by [Schneewolf Labs](https://schneewolflabs.com/).