Error in the running script

#10
by samokosik - opened

Hello,
I tried running the model locally, however, the script you provide does not work.
NameError: name 'MistralForCausalLM' is not defined.
This happens after trying to define the model variable.

Can you please post a script that works?
Thank you

Hi,

The fix is to replace MistralForCausalLM to MixtralForCausalLM. It should be Mixtral not Mistral.

Best

Sign up or log in to comment