speakleash
/

Bielik-7B-v0.1

Text Generation

continuously_pretrained

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

chrisociepa commited on Apr 4

Commit

4c29a56

•

1 Parent(s): 4dee57c

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -60,6 +60,7 @@ This filtration and appropriate selection of texts enable the provision of a con
 | **Hyperparameter**          | **Value**        |
 |-----------------------------|------------------|
 | Micro Batch Size            | 4                |
 | Batch Size                  | 4194304          |
 | Learning Rate (cosine)      | 3e-05 -> 2e-05   |

 | **Hyperparameter**          | **Value**        |
 |-----------------------------|------------------|
+| Context length              | 4096             |
 | Micro Batch Size            | 4                |
 | Batch Size                  | 4194304          |
 | Learning Rate (cosine)      | 3e-05 -> 2e-05   |