AIgroup-CVM-utokyohospital
/

Llama-2-70b-chat-4bit-japanese

Text Generation

Model card Files Files and versions Community

stardust-coder commited on Aug 10, 2023

Commit

4f93f4b

•

1 Parent(s): f7cdd63

Update README.md

Files changed (1) hide show

README.md +0 -1

README.md CHANGED Viewed

@@ -46,7 +46,6 @@ bnb_config = BitsAndBytesConfig(
     bnb_4bit_compute_dtype=torch.bfloat16
 )
 config = AutoConfig.from_pretrained(model_id)
-config.pretraining_tp = 1 #LLama-2-70bなら必要
 tokenizer = AutoTokenizer.from_pretrained(model_id)
 model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config=bnb_config,
                                              device_map="auto")

     bnb_4bit_compute_dtype=torch.bfloat16
 )
 config = AutoConfig.from_pretrained(model_id)
 tokenizer = AutoTokenizer.from_pretrained(model_id)
 model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config=bnb_config,
                                              device_map="auto")