Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -6,5 +6,6 @@ datasets:
|
|
| 6 |
|
| 7 |
# IQ3 quants of NousResearch/Nous-Hermes-2-Yi-34B
|
| 8 |
|
| 9 |
-
Created using llama.cpp 9e359a4f, with default settings of both convert.py and quantize using the imatrix
|
| 10 |
-
|
|
|
|
|
|
| 6 |
|
| 7 |
# IQ3 quants of NousResearch/Nous-Hermes-2-Yi-34B
|
| 8 |
|
| 9 |
+
Created using llama.cpp 9e359a4f, with default settings of both convert.py and quantize using the imatrix provided by ikawrakow.
|
| 10 |
+
|
| 11 |
+
See https://github.com/ggerganov/llama.cpp/pull/5676 for information on the IQ3 quantization.
|