2c24f34 4e945cf 2c24f34 4e945cf
1
2
3
4
5
6
7
8
9
--- library_name: transformers datasets: - HuggingFaceFW/fineweb --- # Model Card for Model ID This is a BPE tokenizer with 10,048 tokens trained on a portion of FineWeb's 10B token sample.
