LnL-AI
/

dbrx-base-tokenizer

Transformers.js

Inference Endpoints

Model card Files Files and versions Community

dbrx-base-tokenizer / tokenizer_config.json

Commit History

add pad and extra_N special tokens

3a0d911

Qubitium commited on Apr 3

Upload tokenizer_config.json with huggingface_hub

9b12fb7
verified

Qubitium commited on Apr 3