Spaces:

awinml
/

falcon-7b-instruct-api

Runtime error

awinml commited on Jun 27, 2023

Commit

35b8da2

•

1 Parent(s): 08d9a62

Upload app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -9,7 +9,7 @@ model = AutoModelForCausalLM.from_pretrained(
     trust_remote_code=True,
     device_map="auto",
     low_cpu_mem_usage=True,
-    offload_folder="/",
 )
 tokenizer = AutoTokenizer.from_pretrained("tiiuae/falcon-7b-instruct")

     trust_remote_code=True,
     device_map="auto",
     low_cpu_mem_usage=True,
+    #offload_folder="/model_files",
 )
 tokenizer = AutoTokenizer.from_pretrained("tiiuae/falcon-7b-instruct")