Qubitium commited on
Commit
e33e96d
·
verified ·
1 Parent(s): 8527200

Fix save compat with HF Transformers 4.39.0

Browse files

Latest transformers (4.49.0), likely earlier versions too, will now validate the generation config file and since top_k and temperature non-default values are set, do_sample must be set to True or eles this configuration is self-conflicting.

Files changed (1) hide show
  1. generation_config.json +1 -1
generation_config.json CHANGED
@@ -1,6 +1,6 @@
1
  {
2
  "max_length": 8192,
3
- "do_sample": false,
4
  "use_cache": true,
5
  "temperature": 0.3,
6
  "top_k": 5,
 
1
  {
2
  "max_length": 8192,
3
+ "do_sample": true,
4
  "use_cache": true,
5
  "temperature": 0.3,
6
  "top_k": 5,