File size: 475 Bytes
e72a138 f13efec e72a138 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
---
license: apache-2.0
language:
- en
datasets:
- c4
---
# mpt-125m-c4
## Model Description
Pretrained model for MPT-125M trained on C4 dataset
## Training data
Trained on HuggingFace C4 dataset
## Training procedure
This model was trained on C4 for ~2.5B tokens. Training time was ~1 hour with 104 A100-40gb GPUs.
## Intended Use and Limitations
This model is primarily for generating texts from a prompt. The purpose is to explore pretraining models for research. |