Update README.md
Browse files
README.md
CHANGED
@@ -45,7 +45,7 @@ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
|
45 |
|
46 |
- Trained for one epoch on SlimOrca-Dedup
|
47 |
- Learning rate: 1e-5
|
48 |
-
- Cosine learning rate decay
|
49 |
- Optimizer: AdamW
|
50 |
- Batch size: 256
|
51 |
- Trained with FP32
|
|
|
45 |
|
46 |
- Trained for one epoch on SlimOrca-Dedup
|
47 |
- Learning rate: 1e-5
|
48 |
+
- Cosine learning rate decay
|
49 |
- Optimizer: AdamW
|
50 |
- Batch size: 256
|
51 |
- Trained with FP32
|