Left side padding
#27
by
asarvazyan
- opened
Changes the padding side to the left so the model can be used in a batched manner.
asarvazyan
changed pull request title from
Left side paddin
to Left side padding
Still getting
A decoder-only architecture is being used, but right-padding was detected! For correct generation results, please set `padding_side='left'` when initializing the tokenizer.