BarryFutureman commited on
Commit
9d8b22e
·
verified ·
1 Parent(s): 43d7168

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -38
README.md CHANGED
@@ -3,43 +3,8 @@ base_model: []
3
  tags:
4
  - mergekit
5
  - merge
6
-
7
  ---
8
- # lm-7bd8994e-1938-4141-bfbc-7e3bba914d9a
9
-
10
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
11
-
12
- ## Merge Details
13
- ### Merge Method
14
-
15
- This model was merged using the SLERP merge method.
16
-
17
- ### Models Merged
18
-
19
- The following models were included in the merge:
20
- * /EvoMerge/runs/MistralEvolve/population/lm-93dd3ace-bc52-45fe-bc18-9a1a564c71aa
21
- * /EvoMerge/runs/MistralEvolve/population/WildWest-Variant3-7B
22
-
23
- ### Configuration
24
-
25
- The following YAML configuration was used to produce this model:
26
 
27
- ```yaml
28
- base_model: /EvoMerge/runs/MistralEvolve/population/WildWest-Variant3-7B
29
- dtype: float16
30
- merge_method: slerp
31
- parameters:
32
- t:
33
- - filter: self_attn
34
- value: [0.0, 0.5, 0.3, 0.7, 1.0]
35
- - filter: mlp
36
- value: [1.0, 0.5, 0.7, 0.3, 0.0]
37
- - value: 0.45
38
- slices:
39
- - sources:
40
- - layer_range: [0, 32]
41
- model: /EvoMerge/runs/MistralEvolve/population/WildWest-Variant3-7B
42
- - layer_range: [0, 32]
43
- model: /EvoMerge/runs/MistralEvolve/population/lm-93dd3ace-bc52-45fe-bc18-9a1a564c71aa
44
- tokenizer_source: union
45
- ```
 
3
  tags:
4
  - mergekit
5
  - merge
6
+ license: apache-2.0
7
  ---
8
+ # NeuralLake-Variant1-7B
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
 
10
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).