Does gemma-2-9b-it support seed parameter?

#52
by FrederickYuan - opened

I tried to set seed parameter but seems not work. Does the model support seed or just I used a wrong way to set seed parameter? Thanks.

Google org

Hi @FrederickYuan ,

Seed parameter for this model does not inherently support setting a seed for reproducibility. Instead, controlling randomness during
text generation is typically managed by the generation function where we are using to interface with the model.

To achieve reproducible results, you should set the seed in the environment where you are running the model. Could you please use below lines of code.

 from transformers import set_seed
 set_seed(42)

Thank you.

Thanks, I will try this.

FrederickYuan changed discussion status to closed

Sign up or log in to comment