Magician-MoE-2x7B / mergekit_moe_config.yml
FelixChao's picture
Upload folder using huggingface_hub
be0ca71 verified
raw
history blame contribute delete
No virus
345 Bytes
base_model: ise-uiuc/Magicoder-S-CL-7B
gate_mode: cheap_embed
experts:
- source_model: ise-uiuc/Magicoder-S-CL-7B
positive_prompts: ["You are an AI programmer","programming","C++ expert"]
- source_model: WizardLM/WizardCoder-Python-7B-V1.0
positive_prompts: ["Great at Deep learning","Algorithm and Data Structure","Python expert"]