Add fast tokenizer

#5
by olivierdehaene HF staff - opened
No description provided.
olivierdehaene changed pull request status to open

@Shitao @olivierdehaene Can this me merged?

Shitao changed pull request status to merged

Sign up or log in to comment