FriendliAI
/

Mixtral-8x7B-Instruct-v0.1-fp8

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

yunmorning commited on Apr 18

Commit

4eb2929

•

1 Parent(s): 13b58bb

Remove HF_TOKEN

Files changed (1) hide show

README.md +0 -1

README.md CHANGED Viewed

@@ -70,7 +70,6 @@ docker run \
   -p 8000:8000 \
   -v ~/.cache/huggingface:/root/.cache/huggingface \
   -e FRIENDLI_CONTAINER_SECRET="YOUR CONTAINER SECRET" \
-  -e HF_TOKEN="YOUR HUGGING FACE TOKEN" \
   registry.friendli.ai/trial \
     --web-server-port 8000 \
     --hf-model-name FriendliAI/Mixtral-8x7B-Instruct-v0.1-fp8

   -p 8000:8000 \
   -v ~/.cache/huggingface:/root/.cache/huggingface \
   -e FRIENDLI_CONTAINER_SECRET="YOUR CONTAINER SECRET" \
   registry.friendli.ai/trial \
     --web-server-port 8000 \
     --hf-model-name FriendliAI/Mixtral-8x7B-Instruct-v0.1-fp8