elinas
/

Chronos-Gold-12B-1.0

Text Generation

general-purpose

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

elinas commited on Aug 26

Commit

b13b7f1

•

1 Parent(s): 26535a4

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -16,7 +16,8 @@ library_name: transformers
 Chronos Gold 12B 1.0 is a very unique model that applies to domain areas such as
 geneal chatbot functionatliy, *roleplay*, and storywriting. The model has been observed to write up to 2250 tokens in a single sequence. The model was trained at a
-sequence length of 16384 (16k) and will still retain the *apparent* 128k context length from Mistral-Nemo.
 The base model is `mistralai/Mistral-Nemo-Base-2407` which was heavily modified to produce a more coherent model, comparable to much larger models.

 Chronos Gold 12B 1.0 is a very unique model that applies to domain areas such as
 geneal chatbot functionatliy, *roleplay*, and storywriting. The model has been observed to write up to 2250 tokens in a single sequence. The model was trained at a
+sequence length of 16384 (16k) and will still retain the *apparent* 128k context length from Mistral-Nemo, though it deteriorates over time like regular Nemo does. Recommended
+to keep your sequence length max at 16384.
 The base model is `mistralai/Mistral-Nemo-Base-2407` which was heavily modified to produce a more coherent model, comparable to much larger models.