sail
/

scaling-with-vocab-trained-tokenizers

Model card Files Files and versions Community

scaling-with-vocab-trained-tokenizers / hf_slimpajama-6B-4096-BPE

1 contributor

History: 1 commit

tcftrees's picture

Upload folder using huggingface_hub

bdb9681 verified 3 months ago

special_tokens_map.json

411 Bytes

Upload folder using huggingface_hub 3 months ago
tokenizer.model

299 kB
LFS

Upload folder using huggingface_hub 3 months ago
tokenizer_config.json

746 Bytes

Upload folder using huggingface_hub 3 months ago