Hugging Face's logo

ibm-fms
/
llama3-8b-accelerator

Transformers
Safetensors
mlp_speculator
Inference Endpoints
Model card Files Community
3
New discussion

llama3.1 version

1
#3 opened 3 months ago by amgadhasan

ValueError: Unsupported model type mlp_speculator using TGI server

2
#2 opened 6 months ago by rishabh-simpplr

shard 0 never ready when given the speculator option?

7
#1 opened 6 months ago by mhill4980