File size: 2,242 Bytes
dbccae8
626b902
dbccae8
 
 
 
 
 
 
626b902
dbccae8
 
4c57506
dbccae8
1e458ef
 
dbccae8
 
 
626b902
dbccae8
4c57506
dbccae8
 
 
 
 
626b902
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
dbccae8
 
65bbefa
8d4a29b
dbccae8
65bbefa
 
 
 
 
8d4a29b
 
dbccae8
 
 
 
626b902
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
---
base_model: mistralai/Mistral-Nemo-Base-2407
license: cc-by-nc-4.0
tags:
- general-purpose
- roleplay
- storywriting
- merge
- finetune
library_name: transformers
---

# Chronos Gold 12B-1.0

![image/webp](https://cdn-uploads.huggingface.co/production/uploads/630417380907b9a115c6aa9f/3hc8zt8fzKdO3qHK1p1mW.webp)

Chronos Gold 12B 1.0 is a very unique model that applies to domains areas such as
geneal chatbot functionatliy, *roleplay*, and storywriting. The model has been observed to write up to 2250 tokens in a single sequence.

The base model is `mistralai/Mistral-Nemo-Base-2407` which was heavily modified to produce a more coherent model, comparable to much larger models.

**Chronos Gold 12B-1.0** re-creates the uniqueness of the original Chronos with significiantly enhanced prompt adherence (following), coherence, a modern dataset, as well as supporting a majority of "character card" formats in applications like SillyTavern. 

It went through an intelligent merge process as my previous models and was further finetuned on a dataset curated for it.

The specifics of the model will not be disclosed at the time due to dataset ownership. 

## Instruct Template

This model uses `ChatML` - below is an example. It is a preset in many frontends.

```
<|im_start|>system
A system prompt describing how you'd like your bot to act.<|im_end|>
<|im_start|>user
Hello there!<|im_end|>
<|im_start|>assistant
I can assist you or we can disucss other things?<|im_end|>
<|im_start|>user
I was wondering how transformers work?<|im_end|>
<|im_start|>assistant
```

## Quantization

#### FP8
[FP8 Quant by @Pyroserenus](https://huggingface.co./Pyroserenus/Chronos-Gold-12B-1.0-FP8)

#### Exllama2
[6.5bpw by @Pyroserenus](https://huggingface.co./Pyroserenus/Chronos-Gold-12B-1.0-6.5bpw-h6-exl2)

#### LlamaCPP - Coming soon
*placeholder*

## Additional Details 
This model was created by **elinas** on discord.

This is one of multiple models to come out in the series by size and model architecture, so look forward to it!

Please be mindful of the license. This is strictly non-commercial, but free to use at your own leisure personally. Outputs generated by the model are not reflective of my views.

Contact me on Discord for inquiries.