Hugging Face's logo

Eurdem
/
megatron_2.1_MoE_2x7B

Text Generation
Transformers
Safetensors
mixtral
Mixture of Experts
Merge
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
1
Eurdem commited on
Commit
c9fa748
•
1 Parent(s): dd124c0

Delete mergekit_moe_config.yml

Browse files
Files changed (1) hide show
  1. mergekit_moe_config.yml +0 -60
mergekit_moe_config.yml DELETED
@@ -1,60 +0,0 @@
1
-
2
- base_model: bardsai/jaskier-7b-dpo-v6.1
3
- gate_mode: hidden
4
- dtype: bfloat16
5
- experts:
6
- - source_model: bardsai/jaskier-7b-dpo-v6.1
7
- positive_prompts:
8
- - "Mathematics"
9
- - "Physics"
10
- - "Chemistry"
11
- - "Biology"
12
- - "Medicine"
13
- - "Engineering"
14
- - "Computer Science"
15
-
16
- negative_prompts:
17
- - "Earth Sciences (Geology, Meteorology, Oceanography)"
18
- - "Environmental Science"
19
- - "Astronomy and Space Science"
20
- - "Psychology"
21
- - "Sociology"
22
- - "Anthropology"
23
- - "Political Science"
24
- - "Economics"
25
- - "Education"
26
- - "Law"
27
- - "Theology and Religious Studies"
28
- - "Communication Studies"
29
- - "Business and Management"
30
- - "Agricultural Sciences"
31
- - "Nutrition and Food Science"
32
- - "Sports Science"
33
-
34
- - source_model: CultriX/NeuralTrix-7B-dpo
35
- positive_prompts:
36
- - "Earth Sciences (Geology, Meteorology, Oceanography)"
37
- - "Environmental Science"
38
- - "Astronomy and Space Science"
39
- - "Psychology"
40
- - "Sociology"
41
- - "Anthropology"
42
- - "Political Science"
43
- - "Economics"
44
- - "Education"
45
- - "Law"
46
- - "Theology and Religious Studies"
47
- - "Communication Studies"
48
- - "Business and Management"
49
- - "Agricultural Sciences"
50
- - "Nutrition and Food Science"
51
- - "Sports Science"
52
-
53
- negative_prompts:
54
- - "Mathematics"
55
- - "Physics"
56
- - "Chemistry"
57
- - "Biology"
58
- - "Medicine"
59
- - "Engineering"
60
- - "Computer Science"