text-generation-inference

/

Mixtral-8x7B-Instruct-v0.1-medusa

like 16

Follow

Text Generation Inference 116

Can we have steps to generate a medusa model. Currently I am following FasterDecoding github repo. But facing lot of difficulties in training.
jinja2.exceptions.TemplateError: Conversation roles must alternate user/assistant/user/assistant/...