LnL-AI
/

dbrx-base-tokenizer

Transformers.js

Inference Endpoints

Model card Files Files and versions Community

dbrx-base-tokenizer / vocab.json

Qubitium's picture

add pad and extra_N special tokens

3a0d911 7 months ago

history contribute delete

2.01 MB

File too large to display, you can check the raw version instead.