BEE-spoke-data
/

BeeTokenizer

Model card Files Files and versions Community

BeeTokenizer / tokenizer_config.json

Commit History

update tokenizer

ba51bc8
verified

pszemraj commited on Jul 20, 2024

v3

fb40c4a
verified

pszemraj commited on Feb 24, 2024

add tk vocab size 32128

1854984

pszemraj commited on Oct 30, 2023