thunlp
/

SubCharTokenization

Model card Files Files and versions Community

SubCharTokenization

Commit History

Add Char model

4871469

chen-yingfa commited on Mar 23, 2022

Add more tokenization methods

202c559

chen-yingfa commited on Dec 27, 2021

Add wubi and no index model

c74dac8

chen-yingfa commited on Dec 27, 2021

Add pinyin

99f90fe

chen-yingfa commited on Dec 27, 2021

initial commit

19edc08

system HF staff commited on Dec 24, 2021