Hugging Face's logo

Spaces:
HuggingFaceFW-Dev
/
lang-word-tokenizers
Running

App Files Community
lang-word-tokenizers

Commit History

georgian tokenizer and south azerbeijani
9a7091f
unverified

guipenedo HF staff commited on

added khmer, tibetan and lao
baa687b
unverified

guipenedo HF staff commited on

do not propagate to the root
49dc1e7
unverified

guipenedo HF staff commited on

macrolanguages fix
bd41049
unverified

guipenedo HF staff commited on

updated
0741edf
unverified

guipenedo HF staff commited on

fixes
f2b528f
unverified

guipenedo HF staff commited on

cleaned up unusued parent toks
79ddb0e
unverified

guipenedo HF staff commited on

changed default option
3a9bfe9
unverified

guipenedo HF staff commited on

improved viz to include scripts
6a75090
unverified

guipenedo HF staff commited on

added data
d43fb2c
unverified

guipenedo HF staff commited on

initial commit
08bcb43
verified

guipenedo HF staff commited on