|
--- |
|
license: cc-by-4.0 |
|
--- |
|
|
|
# #roleplay |
|
|
|
GGUF-IQ-Imatrix quants for **cgato/L3-TheSpice-8b-v0.1.3**. |
|
|
|
> [!IMPORTANT] |
|
> These quants have been done after the fixes from [llama.cpp/pull/6920](https://github.com/ggerganov/llama.cpp/pull/6920). <br> |
|
> Use **KoboldCpp version 1.64** or higher. |
|
|
|
> [!NOTE] |
|
> **Prompt formatting...** <br> |
|
> Prompt format is relatively simple, author seems to recommend the **Default** context preset and **Instruct Mode - Disabled**. <br> |
|
> I recommend reading original [**model card page information**](https://huggingface.co./cgato/L3-TheSpice-8b-v0.1.3#prompt-format-chat--the-default-ooba-template-and-silly-tavern-template-). |
|
|
|
|
|
 |
|
|
|
|
