Hugging Face's logo

Spaces:
yhavinga
/
dutch-tokenizer-arena
Running

App Files Community
1
dutch-tokenizer-arena / vocab /code_davinci_002 /__init__.py
xu-song's picture
xu-song
add more tokenizers
a1b0cd0
raw
history blame
46 Bytes
from vocab.text_davinci_003 import tokenizer