Hugging Face's logo

Spaces:
VanguardAI
/
BhashiniSpace_Text_gemma
Runtime error

App Files Community
FlawedLLM commited on
Commit
237c4db
•
1 Parent(s): a800923

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -6,7 +6,7 @@ from peft import AutoPeftModelForCausalLM
6
  from transformers import AutoTokenizer
7
  model = AutoPeftModelForCausalLM.from_pretrained(
8
  "FlawedLLM/BhashiniLLM", # YOUR MODEL YOU USED FOR TRAINING
9
- load_in_4bit = True,
10
  )
11
  tokenizer = AutoTokenizer.from_pretrained("FlawedLLM/BhashiniLLM")
12
 
 
6
  from transformers import AutoTokenizer
7
  model = AutoPeftModelForCausalLM.from_pretrained(
8
  "FlawedLLM/BhashiniLLM", # YOUR MODEL YOU USED FOR TRAINING
9
+ load_in_8bit = True,
10
  )
11
  tokenizer = AutoTokenizer.from_pretrained("FlawedLLM/BhashiniLLM")
12