Update README.md
Browse files
README.md
CHANGED
|
@@ -67,6 +67,17 @@ ollama pull Tohur/natsumura-storytelling-rp-llama-3.1
|
|
| 67 |
- tdh87/Just-stories
|
| 68 |
- tdh87/Just-stories-2
|
| 69 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 70 |
# Prompt template: ChatML
|
| 71 |
|
| 72 |
ChatML is the way to go!
|
|
|
|
| 67 |
- tdh87/Just-stories
|
| 68 |
- tdh87/Just-stories-2
|
| 69 |
|
| 70 |
+
## Inference
|
| 71 |
+
|
| 72 |
+
I use the following settings for inference:
|
| 73 |
+
```
|
| 74 |
+
"temperature": 1.0,
|
| 75 |
+
"repetition_penalty": 1.05,
|
| 76 |
+
"top_p": 0.95
|
| 77 |
+
"top_k": 40
|
| 78 |
+
"min_p": 0.05
|
| 79 |
+
```
|
| 80 |
+
|
| 81 |
# Prompt template: ChatML
|
| 82 |
|
| 83 |
ChatML is the way to go!
|