Phi-3 instruct model continuously repeating the answer
The model continuously repeats the answer until reaches the max_new_token.
I used following:
template = "<|user|>\n{prompt}<|end|>\n<|assistant|>"
prompt = 'Tell me about Lebron James in 100 words.'
And I got
Lebron James, born July 3, 1984, is an acclaimed American professional basketball player. A six-time NBA champion and ten-time NBA All-Star, he's known for his exceptional athleticism, versatility, and competitive spirit. James, a forward for the Los Angeles Lakers, has consistently displayed remarkable skills, including scoring, rebounding, and assists. He's also a two-time Olympic gold medalist. Beyond basketball, he's an influential philanthropist, using his platform to address social issues. James's impact on the sport and society at large is profound, making him one of the most celebrated athletes in history. 1. Born on July 3, 1984, in Akron, Ohio.
Raised in the Cleveland neighborhood of Kardell Park.
Showed early talent in basketball, leading his high school team to a state championship.
Attended the University of Kentucky, where he played under coach John Calipari.
Drafted as the first overall pick by the Cleveland Cavaliers in the 2003 NBA Draft.
Led the Cavaliers to two NBA championships in 2016 and 2018.
Known for his powerful dunks, precise shooting, and exceptional defensive skills.
Has been named NBA Most Valuable Player (MVP) three times.
In 2010, he was named the NBA's 10th greatest player of all time.
In 2021, he signed with the Los Angeles Lakers, continuing his illustrious career. 1. Born on December 30, 1984, in Akron, Ohio.
Grew up in the Akron neighborhood of St. Martin de Porres.
Showed exceptional basketball skills from a young age, leading his high school team to multiple state championships.
Played college basketball at the University of Kentucky, where he was a key player in the "Fab Five" era.
Drafted as the first overall pick by the Cleveland Cavaliers in the 2003 NBA Draft.
Led the Cavaliers to their first NBA championship in 2016.
Known for his versatile playing style, including scoring, rebounding, and defensive prowess.
Has won two NBA Most Valuable Player (MVP) awards.
In 2017, he was named the NBA's 73rd greatest player of all time.
In 2021, he signed with the Los Angeles Lakers, where he continues to be a dominant force in the league. 1. Born on December 30, 1984, in Akron, Ohio. ....
Any idea ?
It could be related to some missing stop tokens. Could you please retry the generation using 32000, 32001 and 32007 as the stop tokens?
It could be related to some missing stop tokens. Could you please retry the generation using 32000, 32001 and 32007 as the stop tokens?
Thanks for your guidance. I have test all these 3 numbers. 32000 did not work, the two others are working fine.