Spaces:

rodrigomasini
/

rephrase

Paused

rodrigomasini commited on Nov 7, 2023

Commit

5d847d4

•

1 Parent(s): 41ac000

Update app_v1.py

Files changed (1) hide show

app_v1.py CHANGED Viewed

@@ -48,7 +48,7 @@ model = AutoGPTQForCausalLM.from_quantized(
     use_safetensors=True,
     strict=use_strict,
     model_basename=model_basename,
-    device=device_map,
     use_triton=use_triton,
     quantize_config=quantize_config
 )

     use_safetensors=True,
     strict=use_strict,
     model_basename=model_basename,
+    device="auto",
     use_triton=use_triton,
     quantize_config=quantize_config
 )