Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

BEE-spoke-data
/

BeeTokenizer

Model card Files Files and versions Community

1 contributor

History: 2 commits

pszemraj's picture

add tk vocab size 32128

1854984 over 1 year ago

.gitattributes

1.52 kB

initial commit over 1 year ago
special_tokens_map.json

841 Bytes

add tk vocab size 32128 over 1 year ago
tokenizer.json

1.42 MB

add tk vocab size 32128 over 1 year ago
tokenizer_config.json

6.76 kB

add tk vocab size 32128 over 1 year ago