Lewdiculous
/

L3-TheSpice-8b-v0.1.3-GGUF-IQ-Imatrix

Inference Endpoints

Model card Files Files and versions Community

Lewdiculous commited on May 1

Commit

e543172

•

1 Parent(s): 4f16930

Update README.md

Files changed (1) hide show

README.md +5 -0

README.md CHANGED Viewed

@@ -3,6 +3,11 @@ license: cc-by-4.0
 ---
 GGUF-IQ-Imatrix quants for **cgato/L3-TheSpice-8b-v0.1.3** as requested in [#29](https://huggingface.co/Lewdiculous/Model-Requests/discussions/29).
 > [!NOTE]
 > Use the **ChatML** presets.

 ---
 GGUF-IQ-Imatrix quants for **cgato/L3-TheSpice-8b-v0.1.3** as requested in [#29](https://huggingface.co/Lewdiculous/Model-Requests/discussions/29).
+> [!IMPORTANT]
+> **Updated!**
+> These quants have been redone with the fixes from [llama.cpp/pull/6920](https://github.com/ggerganov/llama.cpp/pull/6920) in mind. <br>
+> Use **KoboldCpp version 1.64** or higher.
 > [!NOTE]
 > Use the **ChatML** presets.