jacobfulano
commited on
Commit
•
90b5eb2
1
Parent(s):
086b093
Update README.md
Browse files
README.md
CHANGED
@@ -28,7 +28,7 @@ It is part of the **family of MosaicBERT-Base models** trained using ALiBi on di
|
|
28 |
* mosaic-bert-base-seqlen-1024
|
29 |
* [mosaic-bert-base-seqlen-2048](https://huggingface.co/mosaicml/mosaic-bert-base-seqlen-2048)
|
30 |
|
31 |
-
|
32 |
|
33 |
## Model Date
|
34 |
|
|
|
28 |
* mosaic-bert-base-seqlen-1024
|
29 |
* [mosaic-bert-base-seqlen-2048](https://huggingface.co/mosaicml/mosaic-bert-base-seqlen-2048)
|
30 |
|
31 |
+
The primary use case of these models is for research on efficient pretraining and finetuning for long context embeddings.
|
32 |
|
33 |
## Model Date
|
34 |
|