Update README.md (#1)
Browse files- Update README.md (d0c7733bcd15211252a5f12e01995af1a99ac7e6)
Co-authored-by: Clément Thiriet <[email protected]>
README.md
CHANGED
@@ -10,7 +10,7 @@ language:
|
|
10 |
|
11 |
# Mambaoutai 1.6B
|
12 |
|
13 |
-
Mambaoutai is the result of all the experiments and training runs described in the following blog post
|
14 |
|
15 |
## Usage
|
16 |
|
|
|
10 |
|
11 |
# Mambaoutai 1.6B
|
12 |
|
13 |
+
Mambaoutai is the result of all the experiments and training runs described in the [following blog post](https://www.lighton.ai/fr/blog/blog-4/passing-the-torch-training-a-mamba-model-for-smooth-handover-54), where all details about the model series is shared. Mambaoutai is series of small mamba checkpoints released for the community to explore, trained on French, English and code. We run two different decay phases with the WSD-scheduler, and release model checkpoints pretrained both with and without instruction data.
|
14 |
|
15 |
## Usage
|
16 |
|