Fulcrum-AI commited on
Commit
25bd477
·
verified ·
1 Parent(s): 357a6a8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -37
README.md CHANGED
@@ -1,13 +1,5 @@
1
- ---
2
- base_model:
3
- - mistralai/Mistral-7B-Instruct-v0.2
4
- - Open-Orca/Mistral-7B-OpenOrca
5
- library_name: transformers
6
- tags:
7
- - mergekit
8
- - merge
9
 
10
- ---
11
  # Fulcrum-Mistral New
12
 
13
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
@@ -20,31 +12,10 @@ This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522)
20
  ### Models Merged
21
 
22
  The following models were included in the merge:
23
- * [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)
24
- * [Open-Orca/Mistral-7B-OpenOrca](https://huggingface.co/Open-Orca/Mistral-7B-OpenOrca)
25
-
26
- ### Configuration
27
-
28
- The following YAML configuration was used to produce this model:
29
-
30
- ```yaml
31
- base_model:
32
- model:
33
- path: /content/drive/MyDrive/Fulcrum-Mistral
34
- dtype: bfloat16
35
- merge_method: model_stock
36
- slices:
37
- - sources:
38
- - layer_range: [0, 32]
39
- model:
40
- model:
41
- path: Open-Orca/Mistral-7B-OpenOrca
42
- - layer_range: [0, 32]
43
- model:
44
- model:
45
- path: mistralai/Mistral-7B-Instruct-v0.2
46
- - layer_range: [0, 32]
47
- model:
48
- model:
49
- path: /content/drive/MyDrive/Fulcrum-Mistral
50
- ```
 
 
 
 
 
 
 
 
 
1
 
2
+
3
  # Fulcrum-Mistral New
4
 
5
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 
12
  ### Models Merged
13
 
14
  The following models were included in the merge:
15
+ 1) cognitivecomputations/dolphin-2.8-mistral-7b-v02
16
+ 2) NousResearch/Hermes-2-Pro-Mistral-7B
17
+ 3) HuggingFaceH4/zephyr-7b-beta
18
+ 4) teknium/OpenHermes-2.5-Mistral-7B
19
+ 5) mlabonne/Zebrafish-7B
20
+ 6) Open-Orca/Mistral-7B-OpenOrca
21
+ 7) mistralai/Mistral-7B-Instruct-v0.2