Update README.md

README.md

@@ -3,46 +3,16 @@ license: apache-2.0
 tags:
 - moe
 - merge
-- mergekit
-- lazymergekit
-- cognitivecomputations/dolphin-2.6-mistral-7b-dpo-laser
-- berkeley-nest/Starling-LM-7B-alpha
 ---
 
 # megatron_v1
 
-megatron_v1 is a Mixure of Experts (MoE) made with the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
-* [cognitivecomputations/dolphin-2.6-mistral-7b-dpo-laser](https://huggingface.co/cognitivecomputations/dolphin-2.6-mistral-7b-dpo-laser)
-* [berkeley-nest/Starling-LM-7B-alpha](https://huggingface.co/berkeley-nest/Starling-LM-7B-alpha)
-
-## 🧩 Configuration
-
-```yaml
-base_model: openchat/openchat-3.5-0106
-gate_mode: hidden
-dtype: bfloat16
-experts:
-  - source_model: cognitivecomputations/dolphin-2.6-mistral-7b-dpo-laser
-    positive_prompts:
-    - "Mathematics"
-    - "Physics"
-    negative_prompts:
-    - "History"
-    - "Philosophy"
-  - source_model: berkeley-nest/Starling-LM-7B-alpha
-    positive_prompts:
-    - "retrieval"
-    - "life science"
-    negative_prompts:
-    - "Education"
-    - "Law"
-```
+megatron_v1 is a Mixure of Experts (MoE) made of mistral models. 
+
 
 ## 💻 Usage
 
 ```python
-!pip install -qU transformers bitsandbytes accelerate
-
 from transformers import AutoTokenizer
 import transformers
 import torch