aipib commited on
Commit
53e1828
1 Parent(s): dab4ca4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -21
README.md CHANGED
@@ -16,27 +16,6 @@ llmjp-slerp3 is a merge of the following models using [LazyMergekit](https://col
16
  * [kcoopermiller/llm-jp-1.3b-v1.0-aya](https://huggingface.co/kcoopermiller/llm-jp-1.3b-v1.0-aya)
17
  * [aipib/llmjp-slerp](https://huggingface.co/aipib/llmjp-slerp)
18
 
19
- ## 🧩 Configuration
20
-
21
- ```yaml
22
- slices:
23
- - sources:
24
- - model: kcoopermiller/llm-jp-1.3b-v1.0-aya
25
- layer_range: [0, 24]
26
- - model: aipib/llmjp-slerp
27
- layer_range: [0, 24]
28
- merge_method: slerp
29
- base_model: aipib/llmjp-slerp
30
- parameters:
31
- t:
32
- - filter: self_attn
33
- value: [0, 0.5, 0.3, 0.7, 1]
34
- - filter: mlp
35
- value: [1, 0.5, 0.7, 0.3, 0]
36
- - value: 0.5
37
- dtype: bfloat16
38
- ```
39
-
40
  ## 💻 Usage
41
 
42
  ```python
 
16
  * [kcoopermiller/llm-jp-1.3b-v1.0-aya](https://huggingface.co/kcoopermiller/llm-jp-1.3b-v1.0-aya)
17
  * [aipib/llmjp-slerp](https://huggingface.co/aipib/llmjp-slerp)
18
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  ## 💻 Usage
20
 
21
  ```python