gbenson
/

dom-tokenizer-10k

Model card Files Files and versions Community

dom-tokenizer-10k / tokenizer_config.json

Commit History

Switch to cased base model

85a0b70

gbenson commited on May 17, 2024

Configure [BOS] and [EOS] properly

7bc4f29

gbenson commited on May 16, 2024

Upload folder using huggingface_hub

e9fd7a4
verified

gbenson commited on May 16, 2024