nwhamed commited on
Commit
a057c6f
1 Parent(s): 5d65fc2

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +23 -19
README.md CHANGED
@@ -8,25 +8,29 @@ tags:
8
  - NousResearch/Nous-Hermes-llama-2-7b
9
  ---
10
 
 
11
 
12
- ## 🧩 Configuration
 
 
13
 
14
- ```yaml
15
- slices:
16
- - sources:
17
- - model: NousResearch/Llama-2-7b-chat-hf
18
- layer_range: [0, 32]
19
- - model: NousResearch/Nous-Hermes-llama-2-7b
20
- layer_range: [0, 32]
21
- merge_method: slerp
22
- base_model: NousResearch/Llama-2-7b-hf
23
- parameters:
24
- t:
25
- - filter: self_attn
26
- value: [0, 0.5, 0.3, 0.7, 1]
27
- - filter: mlp
28
- value: [1, 0.5, 0.7, 0.3, 0]
29
- - value: 0.5
30
- dtype: bfloat16
31
 
32
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  - NousResearch/Nous-Hermes-llama-2-7b
9
  ---
10
 
11
+ # lasttrail
12
 
13
+ lasttrail is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
14
+ * [NousResearch/Llama-2-7b-chat-hf](https://huggingface.co/NousResearch/Llama-2-7b-chat-hf)
15
+ * [NousResearch/Nous-Hermes-llama-2-7b](https://huggingface.co/NousResearch/Nous-Hermes-llama-2-7b)
16
 
17
+ ## 🧩 Configuration
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
 
19
+ ```json{
20
+ "models": [
21
+ {
22
+ "model": "NousResearch/Llama-2-7b-chat-hf",
23
+ "parameters": {
24
+ "param1": "value1",
25
+ "param2": "value2"
26
+ }
27
+ },
28
+ {
29
+ "model": "NousResearch/Nous-Hermes-llama-2-7b",
30
+ "parameters": {
31
+ "param1": "value1",
32
+ "param2": "value2"
33
+ }
34
+ }
35
+ ]
36
+ }