katanemo
/

Arch-Function-1.5B.gguf

Text Generation

Inference Endpoints

Model card Files Files and versions Community

nehcgs commited on 14 days ago

Commit

307350a

•

1 Parent(s): 37dd2fe

Update README.md

Files changed (1) hide show

README.md +0 -1

README.md CHANGED Viewed

@@ -276,7 +276,6 @@ inputs = tokenizer.apply_chat_template(
     messages, add_generation_prompt=True, return_tensors="pt"
 ).to(model.device)
-# tokenizer.eos_token_id is the id of <|EOT|> token
 outputs = model.generate(
     inputs,
     max_new_tokens=512,

     messages, add_generation_prompt=True, return_tensors="pt"
 ).to(model.device)
 outputs = model.generate(
     inputs,
     max_new_tokens=512,