Update README.md
Browse files
README.md
CHANGED
@@ -18,4 +18,13 @@ Hyperparameters:
|
|
18 |
- Maximum LR of 1e-5
|
19 |
- Cosine schedule with a warmup of 5400 steps
|
20 |
- Batch size of 4 (2 real x 2 accumulated)
|
21 |
-
- Maximum of 5 epochs, early stopping (visual observation), stopped after 3
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
18 |
- Maximum LR of 1e-5
|
19 |
- Cosine schedule with a warmup of 5400 steps
|
20 |
- Batch size of 4 (2 real x 2 accumulated)
|
21 |
+
- Maximum of 5 epochs, early stopping (visual observation), stopped after 3
|
22 |
+
|
23 |
+
Training prompt format:
|
24 |
+
|
25 |
+
```
|
26 |
+
### Query
|
27 |
+
[insert instruction here]
|
28 |
+
### Answer
|
29 |
+
[insert response here]
|
30 |
+
```
|