Commit
•
e57bbce
1
Parent(s):
b42051d
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -179,7 +179,7 @@ Link: [here](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/b
|
|
| 179 |
| [llm-compiler-13b-ftd.Q8_0.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.Q8_0.gguf) | Q8_0 | 13.83GB | ✅ Available | ⚪ Static | 📦 No
|
| 180 |
| [llm-compiler-13b-ftd.Q6_K.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.Q6_K.gguf) | Q6_K | 10.68GB | ✅ Available | ⚪ Static | 📦 No
|
| 181 |
| [llm-compiler-13b-ftd.Q4_K.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.Q4_K.gguf) | Q4_K | 7.87GB | ✅ Available | 🟢 IMatrix | 📦 No
|
| 182 |
-
| llm-compiler-13b-ftd.Q3_K | Q3_K |
|
| 183 |
| llm-compiler-13b-ftd.Q2_K | Q2_K | - | ⏳ Processing | 🟢 IMatrix | -
|
| 184 |
|
| 185 |
|
|
@@ -187,7 +187,7 @@ Link: [here](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/b
|
|
| 187 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
| 188 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
| 189 |
| [llm-compiler-13b-ftd.BF16.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.BF16.gguf) | BF16 | 26.03GB | ✅ Available | ⚪ Static | 📦 No
|
| 190 |
-
| llm-compiler-13b-ftd.FP16 | F16 |
|
| 191 |
| [llm-compiler-13b-ftd.Q8_0.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.Q8_0.gguf) | Q8_0 | 13.83GB | ✅ Available | ⚪ Static | 📦 No
|
| 192 |
| [llm-compiler-13b-ftd.Q6_K.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.Q6_K.gguf) | Q6_K | 10.68GB | ✅ Available | ⚪ Static | 📦 No
|
| 193 |
| [llm-compiler-13b-ftd.Q5_K.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.Q5_K.gguf) | Q5_K | 9.23GB | ✅ Available | ⚪ Static | 📦 No
|
|
@@ -196,7 +196,7 @@ Link: [here](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/b
|
|
| 196 |
| llm-compiler-13b-ftd.Q4_K_S | Q4_K_S | - | ⏳ Processing | 🟢 IMatrix | -
|
| 197 |
| llm-compiler-13b-ftd.IQ4_NL | IQ4_NL | - | ⏳ Processing | 🟢 IMatrix | -
|
| 198 |
| llm-compiler-13b-ftd.IQ4_XS | IQ4_XS | - | ⏳ Processing | 🟢 IMatrix | -
|
| 199 |
-
| llm-compiler-13b-ftd.Q3_K | Q3_K |
|
| 200 |
| llm-compiler-13b-ftd.Q3_K_L | Q3_K_L | - | ⏳ Processing | 🟢 IMatrix | -
|
| 201 |
| llm-compiler-13b-ftd.Q3_K_S | Q3_K_S | - | ⏳ Processing | 🟢 IMatrix | -
|
| 202 |
| llm-compiler-13b-ftd.IQ3_M | IQ3_M | - | ⏳ Processing | 🟢 IMatrix | -
|
|
|
|
| 179 |
| [llm-compiler-13b-ftd.Q8_0.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.Q8_0.gguf) | Q8_0 | 13.83GB | ✅ Available | ⚪ Static | 📦 No
|
| 180 |
| [llm-compiler-13b-ftd.Q6_K.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.Q6_K.gguf) | Q6_K | 10.68GB | ✅ Available | ⚪ Static | 📦 No
|
| 181 |
| [llm-compiler-13b-ftd.Q4_K.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.Q4_K.gguf) | Q4_K | 7.87GB | ✅ Available | 🟢 IMatrix | 📦 No
|
| 182 |
+
| [llm-compiler-13b-ftd.Q3_K.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.Q3_K.gguf) | Q3_K | 6.34GB | ✅ Available | 🟢 IMatrix | 📦 No
|
| 183 |
| llm-compiler-13b-ftd.Q2_K | Q2_K | - | ⏳ Processing | 🟢 IMatrix | -
|
| 184 |
|
| 185 |
|
|
|
|
| 187 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
| 188 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
| 189 |
| [llm-compiler-13b-ftd.BF16.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.BF16.gguf) | BF16 | 26.03GB | ✅ Available | ⚪ Static | 📦 No
|
| 190 |
+
| [llm-compiler-13b-ftd.FP16.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.FP16.gguf) | F16 | 26.03GB | ✅ Available | ⚪ Static | 📦 No
|
| 191 |
| [llm-compiler-13b-ftd.Q8_0.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.Q8_0.gguf) | Q8_0 | 13.83GB | ✅ Available | ⚪ Static | 📦 No
|
| 192 |
| [llm-compiler-13b-ftd.Q6_K.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.Q6_K.gguf) | Q6_K | 10.68GB | ✅ Available | ⚪ Static | 📦 No
|
| 193 |
| [llm-compiler-13b-ftd.Q5_K.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.Q5_K.gguf) | Q5_K | 9.23GB | ✅ Available | ⚪ Static | 📦 No
|
|
|
|
| 196 |
| llm-compiler-13b-ftd.Q4_K_S | Q4_K_S | - | ⏳ Processing | 🟢 IMatrix | -
|
| 197 |
| llm-compiler-13b-ftd.IQ4_NL | IQ4_NL | - | ⏳ Processing | 🟢 IMatrix | -
|
| 198 |
| llm-compiler-13b-ftd.IQ4_XS | IQ4_XS | - | ⏳ Processing | 🟢 IMatrix | -
|
| 199 |
+
| [llm-compiler-13b-ftd.Q3_K.gguf](https://huggingface.co/legraphista/llm-compiler-13b-ftd-IMat-GGUF/blob/main/llm-compiler-13b-ftd.Q3_K.gguf) | Q3_K | 6.34GB | ✅ Available | 🟢 IMatrix | 📦 No
|
| 200 |
| llm-compiler-13b-ftd.Q3_K_L | Q3_K_L | - | ⏳ Processing | 🟢 IMatrix | -
|
| 201 |
| llm-compiler-13b-ftd.Q3_K_S | Q3_K_S | - | ⏳ Processing | 🟢 IMatrix | -
|
| 202 |
| llm-compiler-13b-ftd.IQ3_M | IQ3_M | - | ⏳ Processing | 🟢 IMatrix | -
|