Commit History

Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json
6b47e00
verified

pt-sk commited on

Rename tokenizer/tokenizer_tokenizer_config.json to tokenizer/tokenizer_config.json
a5f3d50
verified

pt-sk commited on

Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json
6c0a65f
verified

pt-sk commited on

Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt
4e4961b
verified

pt-sk commited on

Delete tokenizer/a.py
7cd23ce
verified

pt-sk commited on

Upload 4 files
6f4fcb8
verified

pt-sk commited on

Create tokenizer/a.py
efc0580
verified

pt-sk commited on