|
--- |
|
base_model: tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b |
|
license: llama3.1 |
|
datasets: |
|
- tohur/natsumura-rp-identity-sharegpt |
|
- tohur/ultrachat_uncensored_sharegpt |
|
- Nopm/Opus_WritingStruct |
|
- ResplendentAI/bluemoon |
|
- tohur/Internal-Knowledge-Map-sharegpt |
|
- felix-ha/tiny-stories |
|
- tdh87/Stories |
|
- tdh87/Just-stories |
|
- tdh87/Just-stories-2 |
|
--- |
|
# natsumura-storytelling-rp-1.0-llama-3.1-8b |
|
This is my Storytelling/RP model for my Natsumura series of 8b models. This model is finetuned on storytelling and roleplaying datasets so should be a great model |
|
to use for character chatbots in applications such as Sillytavern, Agnai, RisuAI and more. And should be a great model to use for fictional writing. Up to a 128k context. |
|
|
|
- **Developed by:** Tohur |
|
- **License:** llama3.1 |
|
- **Finetuned from model :** meta-llama/Meta-Llama-3.1-8B-Instruct |
|
|
|
This model is based on meta-llama/Meta-Llama-3.1-8B-Instruct, and is governed by [Llama 3.1 Community License](https://github.com/meta-llama/llama-models/blob/main/models/llama3_1/LICENSE) |
|
Natsumura is uncensored, which makes the model compliant.It will be highly compliant with any requests, even unethical ones. |
|
You are responsible for any content you create using this model. Please use it responsibly. |
|
|
|
 |
|
|
|
## Usage |
|
|
|
If you are unsure how to use GGUF files, refer to one of [TheBloke's |
|
READMEs](https://huggingface.co./TheBloke/KafkaLM-70B-German-V0.1-GGUF) for |
|
more details, including on how to concatenate multi-part files. |
|
|
|
## Provided Quants |
|
|
|
(sorted by quality.) |
|
|
|
| Quant | Notes | |
|
|:-----|:-----| |
|
| Q2_K | |
|
| Q3_K_S | |
|
| Q3_K_M | lower quality | |
|
| Q3_K_L | | |
|
| Q4_0 | | |
|
| Q4_K_S | fast, recommended | |
|
| Q4_K_M | fast, recommended | |
|
| Q5_0 | | |
|
| Q5_K_S | | |
|
| Q5_K_M | | |
|
| Q6_K | very good quality | |
|
| Q8_0 | fast, best quality | |
|
| f16 | 16 bpw, overkill | |
|
|
|
# use in ollama |
|
``` |
|
ollama pull Tohur/natsumura-storytelling-rp-llama-3.1 |
|
``` |
|
|
|
# Datasets used: |
|
- tohur/natsumura-rp-identity-sharegpt |
|
- tohur/ultrachat_uncensored_sharegpt |
|
- Nopm/Opus_WritingStruct |
|
- ResplendentAI/bluemoon |
|
- tohur/Internal-Knowledge-Map-sharegpt |
|
- felix-ha/tiny-stories |
|
- tdh87/Stories |
|
- tdh87/Just-stories |
|
- tdh87/Just-stories-2 |
|
|
|
## Inference |
|
|
|
I use the following settings for inference: |
|
``` |
|
"temperature": 1.0, |
|
"repetition_penalty": 1.05, |
|
"top_p": 0.95 |
|
"top_k": 40 |
|
"min_p": 0.05 |
|
``` |
|
|
|
# Prompt template: ChatML |
|
|
|
ChatML is the way to go! |
|
``` |
|
<|im_start|>system |
|
You are Natsumura, a helpful AI assistant.<|im_end|> |
|
<|im_start|>user |
|
Tohur: Good day, Natsumura.<|im_end|> |
|
<|im_start|>assistant |
|
Natsumura: |
|
``` |
