Update README.md
Browse files
README.md
CHANGED
@@ -101,7 +101,7 @@ model-index:
|
|
101 |
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=icefog72/Ice0.40-20.11-RP
|
102 |
name: Open LLM Leaderboard
|
103 |
---
|
104 |
-
# Ice0.40-20.11-RP
|
105 |
|
106 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
107 |
|
@@ -113,8 +113,8 @@ This model was merged using the SLERP merge method.
|
|
113 |
### Models Merged
|
114 |
|
115 |
The following models were included in the merge:
|
116 |
-
*
|
117 |
-
*
|
118 |
|
119 |
### Configuration
|
120 |
|
@@ -123,13 +123,13 @@ The following YAML configuration was used to produce this model:
|
|
123 |
```yaml
|
124 |
slices:
|
125 |
- sources:
|
126 |
-
- model:
|
127 |
layer_range: [0, 32]
|
128 |
-
- model:
|
129 |
layer_range: [0, 32]
|
130 |
|
131 |
merge_method: slerp
|
132 |
-
base_model:
|
133 |
parameters:
|
134 |
t:
|
135 |
- filter: self_attn
|
|
|
101 |
url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=icefog72/Ice0.40-20.11-RP
|
102 |
name: Open LLM Leaderboard
|
103 |
---
|
104 |
+
# IceDrunkenCherryRP (Ice0.40-20.11-RP)
|
105 |
|
106 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
107 |
|
|
|
113 |
### Models Merged
|
114 |
|
115 |
The following models were included in the merge:
|
116 |
+
* icefog72/Ice0.29-06.11-RP
|
117 |
+
* icefog72/Ice0.37-18.11-RP
|
118 |
|
119 |
### Configuration
|
120 |
|
|
|
123 |
```yaml
|
124 |
slices:
|
125 |
- sources:
|
126 |
+
- model: icefog72/Ice0.37-18.11-RP
|
127 |
layer_range: [0, 32]
|
128 |
+
- model: icefog72/Ice0.29-06.11-RP
|
129 |
layer_range: [0, 32]
|
130 |
|
131 |
merge_method: slerp
|
132 |
+
base_model: icefog72/Ice0.37-18.11-RP
|
133 |
parameters:
|
134 |
t:
|
135 |
- filter: self_attn
|