Nelathan commited on
Commit
31f23d8
1 Parent(s): 1a9d437

Upload 2 files

Browse files
Files changed (2) hide show
  1. README.md +19 -11
  2. focusmix.jpg +0 -0
README.md CHANGED
@@ -11,22 +11,30 @@ tags:
11
  - merge
12
 
13
  ---
14
- # .
15
 
16
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
17
 
18
- ## Merge Details
19
- ### Merge Method
20
 
21
- This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Qwen/Qwen2-7B](https://huggingface.co/Qwen/Qwen2-7B) as a base.
 
 
 
 
 
22
 
23
- ### Models Merged
24
 
25
- The following models were included in the merge:
26
- * [Replete-AI/Replete-LLM-Qwen2-7b_Beta-Preview](https://huggingface.co/Replete-AI/Replete-LLM-Qwen2-7b_Beta-Preview)
27
- * [MaziyarPanahi/calme-2.8-qwen2-7b](https://huggingface.co/MaziyarPanahi/calme-2.8-qwen2-7b)
28
- * [arcee-ai/Arcee-Spark](https://huggingface.co/arcee-ai/Arcee-Spark)
29
- * [Weyaxi/Einstein-v7-Qwen2-7B](https://huggingface.co/Weyaxi/Einstein-v7-Qwen2-7B)
 
 
 
 
30
 
31
  ### Configuration
32
 
 
11
  - merge
12
 
13
  ---
14
+ <img src="./focusmix.jpg" alt="FocusMix 7B" width="100%" display="block"/>
15
 
16
+ # FocusMix 7B
17
 
18
+ This is a model created by merging several powerful language models:
 
19
 
20
+ * **Base Model:** [Qwen/Qwen2-7B](https://huggingface.co/Qwen/Qwen2-7B)
21
+ * **Merge Stock:**
22
+ * [Replete-AI/Replete-LLM-Qwen2-7b_Beta-Preview](https://huggingface.co/Replete-AI/Replete-LLM-Qwen2-7b_Beta-Preview)
23
+ * [MaziyarPanahi/calme-2.8-qwen2-7b](https://huggingface.co/MaziyarPanahi/calme-2.8-qwen2-7b)
24
+ * [arcee-ai/Arcee-Spark](https://huggingface.co/arcee-ai/Arcee-Spark)
25
+ * [Weyaxi/Einstein-v7-Qwen2-7B](https://huggingface.co/Weyaxi/Einstein-v7-Qwen2-7B)
26
 
27
+ FocusMix inherits the strengths of its component models, resulting in a model with:
28
 
29
+ * **Enhanced Focus:** FocusMix leverages the fine-tuning and instruction-following capabilities of Replete-LLM, Arcee-Spark, and Einstein-v7, leading to improved accuracy and coherence in task-specific responses.
30
+ * **Broader Knowledge Base:** The diverse training datasets of the merged models provide FocusMix with a wider range of knowledge and abilities, making it more versatile and capable of handling a wider variety of prompts and tasks.
31
+ * **Improved Reasoning and Problem-Solving:** The inclusion of Calme-2.8, known for its reasoning and problem-solving abilities, enhances FocusMix's capacity for logical deduction and complex task execution.
32
+
33
+ **Purpose:** aims to provide a powerful and versatile language model that excels in:
34
+
35
+ * **Task-Specific Instructions:** FocusMix can effectively follow specific instructions and complete tasks with higher accuracy.
36
+ * **Complex Reasoning:** The model can handle intricate prompts requiring logical deduction and problem-solving.
37
+ * **Diverse Knowledge Domains:** FocusMix can engage in conversations and provide information across a wide range of topics.
38
 
39
  ### Configuration
40
 
focusmix.jpg ADDED