saishf commited on
Commit
a090dc0
1 Parent(s): a6635e7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +56 -52
README.md CHANGED
@@ -1,52 +1,56 @@
1
- ---
2
- base_model:
3
- - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
4
- - ResplendentAI/RP_Format_QuoteAsterisk_Llama3
5
- - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
6
- - ResplendentAI/Smarts_Llama3
7
- - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
8
- - ResplendentAI/Aura_Llama3
9
- - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
10
- - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
11
- - ResplendentAI/BlueMoon_Llama3
12
- - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
13
- - ResplendentAI/Luna_Llama3
14
- library_name: transformers
15
- tags:
16
- - mergekit
17
- - merge
18
-
19
- ---
20
- # merge
21
-
22
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
23
-
24
- ## Merge Details
25
- ### Merge Method
26
-
27
- This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS) as a base.
28
-
29
- ### Models Merged
30
-
31
- The following models were included in the merge:
32
- * [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS) + [ResplendentAI/RP_Format_QuoteAsterisk_Llama3](https://huggingface.co/ResplendentAI/RP_Format_QuoteAsterisk_Llama3)
33
- * [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS) + [ResplendentAI/Smarts_Llama3](https://huggingface.co/ResplendentAI/Smarts_Llama3)
34
- * [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS) + [ResplendentAI/Aura_Llama3](https://huggingface.co/ResplendentAI/Aura_Llama3)
35
- * [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS) + [ResplendentAI/BlueMoon_Llama3](https://huggingface.co/ResplendentAI/BlueMoon_Llama3)
36
- * [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS) + [ResplendentAI/Luna_Llama3](https://huggingface.co/ResplendentAI/Luna_Llama3)
37
-
38
- ### Configuration
39
-
40
- The following YAML configuration was used to produce this model:
41
-
42
- ```yaml
43
- models:
44
- - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS+ResplendentAI/Aura_Llama3
45
- - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS+ResplendentAI/Smarts_Llama3
46
- - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS+ResplendentAI/Luna_Llama3
47
- - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS+ResplendentAI/BlueMoon_Llama3
48
- - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS+ResplendentAI/RP_Format_QuoteAsterisk_Llama3
49
- merge_method: model_stock
50
- base_model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
51
- dtype: float16
52
- ```
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ base_model:
4
+ - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
5
+ - ResplendentAI/RP_Format_QuoteAsterisk_Llama3
6
+ - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
7
+ - ResplendentAI/Smarts_Llama3
8
+ - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
9
+ - ResplendentAI/Aura_Llama3
10
+ - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
11
+ - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
12
+ - ResplendentAI/BlueMoon_Llama3
13
+ - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
14
+ - ResplendentAI/Luna_Llama3
15
+ library_name: transformers
16
+ tags:
17
+ - mergekit
18
+ - merge
19
+
20
+ ---
21
+ # merge
22
+
23
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
24
+
25
+ ## Merge Details
26
+ This is yet another experiment to see how unhinged llama3 can be.
27
+
28
+ it's merged similarly to Merge-Mayhem-L3-V2.1](https://huggingface.co/saishf/Merge-Mayhem-L3-V2.1)
29
+ ### Merge Method
30
+
31
+ This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS) as a base.
32
+
33
+ ### Models Merged
34
+
35
+ The following models were included in the merge:
36
+ * [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS) + [ResplendentAI/RP_Format_QuoteAsterisk_Llama3](https://huggingface.co/ResplendentAI/RP_Format_QuoteAsterisk_Llama3)
37
+ * [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS) + [ResplendentAI/Smarts_Llama3](https://huggingface.co/ResplendentAI/Smarts_Llama3)
38
+ * [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS) + [ResplendentAI/Aura_Llama3](https://huggingface.co/ResplendentAI/Aura_Llama3)
39
+ * [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS) + [ResplendentAI/BlueMoon_Llama3](https://huggingface.co/ResplendentAI/BlueMoon_Llama3)
40
+ * [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS) + [ResplendentAI/Luna_Llama3](https://huggingface.co/ResplendentAI/Luna_Llama3)
41
+
42
+ ### Configuration
43
+
44
+ The following YAML configuration was used to produce this model:
45
+
46
+ ```yaml
47
+ models:
48
+ - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS+ResplendentAI/Aura_Llama3
49
+ - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS+ResplendentAI/Smarts_Llama3
50
+ - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS+ResplendentAI/Luna_Llama3
51
+ - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS+ResplendentAI/BlueMoon_Llama3
52
+ - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS+ResplendentAI/RP_Format_QuoteAsterisk_Llama3
53
+ merge_method: model_stock
54
+ base_model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
55
+ dtype: float16
56
+ ```