Update README.md
Browse files
README.md
CHANGED
|
@@ -4,6 +4,7 @@ datasets:
|
|
| 4 |
- JeanKaddour/minipile
|
| 5 |
language:
|
| 6 |
- en
|
|
|
|
| 7 |
---
|
| 8 |
|
| 9 |
|
|
@@ -41,4 +42,4 @@ Small pretraining experiment:
|
|
| 41 |
- **Rescale NFFN:** False
|
| 42 |
- **Scale Embedding:** False
|
| 43 |
- **Share Embedding:** False
|
| 44 |
-
- **Layerwise Checkpointing:** False
|
|
|
|
| 4 |
- JeanKaddour/minipile
|
| 5 |
language:
|
| 6 |
- en
|
| 7 |
+
pipeline_tag: text-generation
|
| 8 |
---
|
| 9 |
|
| 10 |
|
|
|
|
| 42 |
- **Rescale NFFN:** False
|
| 43 |
- **Scale Embedding:** False
|
| 44 |
- **Share Embedding:** False
|
| 45 |
+
- **Layerwise Checkpointing:** False
|