Spaces:

minhdang
/

code

Paused

minhdang commited on Mar 19

Commit

abd7288

•

1 Parent(s): c2bc52a

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -11,7 +11,6 @@ nf4_config = BitsAndBytesConfig(
     load_in_4bit=True,
     bnb_4bit_use_double_quant=True,
     bnb_4bit_quant_type="nf4",
-    bnb_4bit_compute_dtype=torch.bfloat16
 )
 MAX_MAX_NEW_TOKENS = 2048
 DEFAULT_MAX_NEW_TOKENS = 1024

     load_in_4bit=True,
     bnb_4bit_use_double_quant=True,
     bnb_4bit_quant_type="nf4",
 )
 MAX_MAX_NEW_TOKENS = 2048
 DEFAULT_MAX_NEW_TOKENS = 1024