speakleash
/

Bielik-7B-Instruct-v0.1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

chrisociepa commited on Apr 4

Commit

829494a

•

1 Parent(s): 3c2ba48

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -62,6 +62,7 @@ Bielik-7B-Instruct-v0.1 has been trained with the use of an original open source
 | **Hyperparameter**          | **Value**        |
 |-----------------------------|------------------|
 | Micro Batch Size            | 1                |
 | Batch Size                  | up to 4194304    |
 | Learning Rate (cosine, adaptive) | 7e-6 -> 6e-7 |

 | **Hyperparameter**          | **Value**        |
 |-----------------------------|------------------|
+| Context length              | 4096             |
 | Micro Batch Size            | 1                |
 | Batch Size                  | up to 4194304    |
 | Learning Rate (cosine, adaptive) | 7e-6 -> 6e-7 |