Skylaude
/

WizardLM-2-4x7B-MoE

Text Generation

Microsoft/WizardLM-2-7B

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Skylaude commited on Apr 16

Commit

54a5eda

•

1 Parent(s): 266dd35

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -10,7 +10,7 @@ tags:
 # WizardLM-2-4x7B-MoE
-The model is currently uploading and should be available in a couple of hours!
 This is an experimental MoE model made with [Mergekit](https://github.com/arcee-ai/mergekit). It was made by combining four [WizardLM-2-7B](https://huggingface.co/microsoft/WizardLM-2-7B) models using the random gate mode. Please be sure to set experts per token to 4 for the best results! Context length should be the same as Mistral-7B-Instruct-v0.1 (8k tokens). For instruction templates, Vicuna-v1.1 is recommended.

 # WizardLM-2-4x7B-MoE
+Some files are still uploading. The model should be available in a couple of hours!
 This is an experimental MoE model made with [Mergekit](https://github.com/arcee-ai/mergekit). It was made by combining four [WizardLM-2-7B](https://huggingface.co/microsoft/WizardLM-2-7B) models using the random gate mode. Please be sure to set experts per token to 4 for the best results! Context length should be the same as Mistral-7B-Instruct-v0.1 (8k tokens). For instruction templates, Vicuna-v1.1 is recommended.