legraphista
commited on
Commit
β’
d60b6ea
1
Parent(s):
8cdab80
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -30,7 +30,7 @@ tags:
|
|
30 |
# K2-ckpt_360-IMat-GGUF
|
31 |
_Llama.cpp imatrix quantization of LLM360/K2_
|
32 |
|
33 |
-
Original Model: [LLM360/K2](https://huggingface.co/LLM360/K2)
|
34 |
Original dtype: `FP16` (`float16`)
|
35 |
Quantized by: llama.cpp [b3058](https://github.com/ggerganov/llama.cpp/releases/tag/b3058)
|
36 |
IMatrix dataset: [here](https://gist.githubusercontent.com/bartowski1182/eb213dccb3571f863da82e99418f81e8/raw/b2869d80f5c16fd7082594248e80144677736635/calibration_datav3.txt)
|
@@ -67,7 +67,7 @@ Link: [here](https://huggingface.co/legraphista/K2-ckpt_360-IMat-GGUF/blob/main/
|
|
67 |
### All Quants
|
68 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
69 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
70 |
-
| K2-ckpt_360.FP16 | F16 |
|
71 |
| [K2-ckpt_360.Q8_0/*](https://huggingface.co/legraphista/K2-ckpt_360-IMat-GGUF/tree/main/K2-ckpt_360.Q8_0) | Q8_0 | 69.37GB | β
Available | βͺ Static | β Yes
|
72 |
| [K2-ckpt_360.Q6_K/*](https://huggingface.co/legraphista/K2-ckpt_360-IMat-GGUF/tree/main/K2-ckpt_360.Q6_K) | Q6_K | 53.56GB | β
Available | βͺ Static | β Yes
|
73 |
| K2-ckpt_360.Q5_K | Q5_K | - | β³ Processing | βͺ Static | -
|
|
|
30 |
# K2-ckpt_360-IMat-GGUF
|
31 |
_Llama.cpp imatrix quantization of LLM360/K2_
|
32 |
|
33 |
+
Original Model: [LLM360/K2](https://huggingface.co/LLM360/K2/tree/ckpt_360) branch `ckpt_360`
|
34 |
Original dtype: `FP16` (`float16`)
|
35 |
Quantized by: llama.cpp [b3058](https://github.com/ggerganov/llama.cpp/releases/tag/b3058)
|
36 |
IMatrix dataset: [here](https://gist.githubusercontent.com/bartowski1182/eb213dccb3571f863da82e99418f81e8/raw/b2869d80f5c16fd7082594248e80144677736635/calibration_datav3.txt)
|
|
|
67 |
### All Quants
|
68 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
69 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
70 |
+
| [K2-ckpt_360.FP16/*](https://huggingface.co/legraphista/K2-ckpt_360-IMat-GGUF/tree/main/K2-ckpt_360.FP16) | F16 | 130.58GB | β
Available | βͺ Static | β Yes
|
71 |
| [K2-ckpt_360.Q8_0/*](https://huggingface.co/legraphista/K2-ckpt_360-IMat-GGUF/tree/main/K2-ckpt_360.Q8_0) | Q8_0 | 69.37GB | β
Available | βͺ Static | β Yes
|
72 |
| [K2-ckpt_360.Q6_K/*](https://huggingface.co/legraphista/K2-ckpt_360-IMat-GGUF/tree/main/K2-ckpt_360.Q6_K) | Q6_K | 53.56GB | β
Available | βͺ Static | β Yes
|
73 |
| K2-ckpt_360.Q5_K | Q5_K | - | β³ Processing | βͺ Static | -
|