MaziyarPanahi
commited on
Commit
•
8d0ccc4
1
Parent(s):
f40c14a
Update README.md (#6)
Browse files- Update README.md (6302ae432cd7b4067e04c07f25ffaf935047beae)
README.md
CHANGED
@@ -13,6 +13,12 @@ tags:
|
|
13 |
|
14 |
## Description
|
15 |
|
|
|
|
|
|
|
|
|
|
|
|
|
16 |
This is a MoE of top 4x 7B models including BioMistral-7B. Here is the comparison between the two:
|
17 |
|
18 |
| Metric | BioMistral-7B | Bioxtral-4x7B-v0.1 |
|
|
|
13 |
|
14 |
## Description
|
15 |
|
16 |
+
3 Models used in this merge of 4x7B:
|
17 |
+
- [cognitivecomputations/WestLake-7B-v2-laser](https://huggingface.co/cognitivecomputations/WestLake-7B-v2-laser)
|
18 |
+
- [mlabonne/Daredevil-7B](https://huggingface.co/mlabonne/Daredevil-7B) (used twice! initially chose another model, but using it twice worked better somehow.)
|
19 |
+
- [BioMistral/BioMistral-7B](https://huggingface.co/BioMistral/BioMistral-7B)
|
20 |
+
|
21 |
+
|
22 |
This is a MoE of top 4x 7B models including BioMistral-7B. Here is the comparison between the two:
|
23 |
|
24 |
| Metric | BioMistral-7B | Bioxtral-4x7B-v0.1 |
|