alfredplpl
/

plamo-2-8b-magpie-lora

Inference Endpoints

Model card Files Files and versions Community

alfredplpl commited on 4 days ago

Commit

8c681d2

·

verified ·

1 Parent(s): 2608b1c

Update README.md

Files changed (1) hide show

README.md +2 -3

README.md CHANGED Viewed

@@ -44,12 +44,11 @@ tokenized_input = tokenizer.apply_chat_template(chat, add_generation_prompt=True
 with torch.no_grad():
     output = model.generate(
         tokenized_input,
-        max_new_tokens=512,
         do_sample=True,
         top_p=0.95,
         temperature=0.7,
-        repetition_penalty=1.05,
-        pad_token_id=tokenizer.eos_token_id
     )[0]
 print(tokenizer.decode(output))
 ```

 with torch.no_grad():
     output = model.generate(
         tokenized_input,
+        max_new_tokens=256,
         do_sample=True,
         top_p=0.95,
         temperature=0.7,
+        repetition_penalty=1.05
     )[0]
 print(tokenizer.decode(output))
 ```