aipib commited on
Commit
2ed70af
1 Parent(s): 49bc1d5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -21
README.md CHANGED
@@ -16,27 +16,6 @@ llmjp-aya-slerp is a merge of the following models using [LazyMergekit](https://
16
  * [kcoopermiller/llm-jp-1.3b-v1.0-aya](https://huggingface.co/kcoopermiller/llm-jp-1.3b-v1.0-aya)
17
  * [llm-jp/llm-jp-1.3b-v1.0](https://huggingface.co/llm-jp/llm-jp-1.3b-v1.0)
18
 
19
- ## 🧩 Configuration
20
-
21
- ```yaml
22
- slices:
23
- - sources:
24
- - model: kcoopermiller/llm-jp-1.3b-v1.0-aya
25
- layer_range: [0, 22]
26
- - model: llm-jp/llm-jp-1.3b-v1.0
27
- layer_range: [0, 22]
28
- merge_method: slerp
29
- base_model: kcoopermiller/llm-jp-1.3b-v1.0-aya
30
- parameters:
31
- t:
32
- - filter: self_attn
33
- value: [0, 0.5, 0.3, 0.7, 1]
34
- - filter: mlp
35
- value: [1, 0.5, 0.7, 0.3, 0]
36
- - value: 0.5
37
- dtype: bfloat16
38
- ```
39
-
40
  ## 💻 Usage
41
 
42
  ```python
 
16
  * [kcoopermiller/llm-jp-1.3b-v1.0-aya](https://huggingface.co/kcoopermiller/llm-jp-1.3b-v1.0-aya)
17
  * [llm-jp/llm-jp-1.3b-v1.0](https://huggingface.co/llm-jp/llm-jp-1.3b-v1.0)
18
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  ## 💻 Usage
20
 
21
  ```python