Commit
•
9ade91c
1
Parent(s):
94f8c33
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -26,13 +26,13 @@ IMatrix dataset: [here](https://gist.githubusercontent.com/legraphista/d6d93f1a2
|
|
| 26 |
## Files
|
| 27 |
|
| 28 |
### IMatrix
|
| 29 |
-
Status:
|
| 30 |
Link: [here](https://huggingface.co/legraphista/Phi-3-mini-4k-instruct-GGUF/blob/main/imatrix.dat)
|
| 31 |
|
| 32 |
### Common Quants
|
| 33 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
| 34 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
| 35 |
-
| Phi-3-mini-4k-instruct.Q8_0 | Q8_0 |
|
| 36 |
| [Phi-3-mini-4k-instruct.Q6_K.gguf](https://huggingface.co/legraphista/Phi-3-mini-4k-instruct-GGUF/blob/main/Phi-3-mini-4k-instruct.Q6_K.gguf) | Q6_K | 3.14GB | ✅ Available | No | 📦 No
|
| 37 |
| Phi-3-mini-4k-instruct.Q4_K | Q4_K | - | ⏳ Processing | Yes | -
|
| 38 |
| Phi-3-mini-4k-instruct.Q3_K | Q3_K | - | ⏳ Processing | Yes | -
|
|
@@ -42,10 +42,10 @@ Link: [here](https://huggingface.co/legraphista/Phi-3-mini-4k-instruct-GGUF/blob
|
|
| 42 |
### All Quants
|
| 43 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
| 44 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
| 45 |
-
| Phi-3-mini-4k-instruct.FP16 | F16 |
|
| 46 |
-
| Phi-3-mini-4k-instruct.BF16 | BF16 |
|
| 47 |
| [Phi-3-mini-4k-instruct.Q5_K.gguf](https://huggingface.co/legraphista/Phi-3-mini-4k-instruct-GGUF/blob/main/Phi-3-mini-4k-instruct.Q5_K.gguf) | Q5_K | 2.82GB | ✅ Available | No | 📦 No
|
| 48 |
-
| Phi-3-mini-4k-instruct.Q5_K_S | Q5_K_S |
|
| 49 |
| Phi-3-mini-4k-instruct.Q4_K_S | Q4_K_S | - | ⏳ Processing | Yes | -
|
| 50 |
| Phi-3-mini-4k-instruct.Q3_K_L | Q3_K_L | - | ⏳ Processing | Yes | -
|
| 51 |
| Phi-3-mini-4k-instruct.Q3_K_S | Q3_K_S | - | ⏳ Processing | Yes | -
|
|
|
|
| 26 |
## Files
|
| 27 |
|
| 28 |
### IMatrix
|
| 29 |
+
Status: ✅ Available
|
| 30 |
Link: [here](https://huggingface.co/legraphista/Phi-3-mini-4k-instruct-GGUF/blob/main/imatrix.dat)
|
| 31 |
|
| 32 |
### Common Quants
|
| 33 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
| 34 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
| 35 |
+
| [Phi-3-mini-4k-instruct.Q8_0.gguf](https://huggingface.co/legraphista/Phi-3-mini-4k-instruct-GGUF/blob/main/Phi-3-mini-4k-instruct.Q8_0.gguf) | Q8_0 | 4.06GB | ✅ Available | No | 📦 No
|
| 36 |
| [Phi-3-mini-4k-instruct.Q6_K.gguf](https://huggingface.co/legraphista/Phi-3-mini-4k-instruct-GGUF/blob/main/Phi-3-mini-4k-instruct.Q6_K.gguf) | Q6_K | 3.14GB | ✅ Available | No | 📦 No
|
| 37 |
| Phi-3-mini-4k-instruct.Q4_K | Q4_K | - | ⏳ Processing | Yes | -
|
| 38 |
| Phi-3-mini-4k-instruct.Q3_K | Q3_K | - | ⏳ Processing | Yes | -
|
|
|
|
| 42 |
### All Quants
|
| 43 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
| 44 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
| 45 |
+
| [Phi-3-mini-4k-instruct.FP16.gguf](https://huggingface.co/legraphista/Phi-3-mini-4k-instruct-GGUF/blob/main/Phi-3-mini-4k-instruct.FP16.gguf) | F16 | 7.64GB | ✅ Available | No | 📦 No
|
| 46 |
+
| [Phi-3-mini-4k-instruct.BF16.gguf](https://huggingface.co/legraphista/Phi-3-mini-4k-instruct-GGUF/blob/main/Phi-3-mini-4k-instruct.BF16.gguf) | BF16 | 7.64GB | ✅ Available | No | 📦 No
|
| 47 |
| [Phi-3-mini-4k-instruct.Q5_K.gguf](https://huggingface.co/legraphista/Phi-3-mini-4k-instruct-GGUF/blob/main/Phi-3-mini-4k-instruct.Q5_K.gguf) | Q5_K | 2.82GB | ✅ Available | No | 📦 No
|
| 48 |
+
| [Phi-3-mini-4k-instruct.Q5_K_S.gguf](https://huggingface.co/legraphista/Phi-3-mini-4k-instruct-GGUF/blob/main/Phi-3-mini-4k-instruct.Q5_K_S.gguf) | Q5_K_S | 2.64GB | ✅ Available | No | 📦 No
|
| 49 |
| Phi-3-mini-4k-instruct.Q4_K_S | Q4_K_S | - | ⏳ Processing | Yes | -
|
| 50 |
| Phi-3-mini-4k-instruct.Q3_K_L | Q3_K_L | - | ⏳ Processing | Yes | -
|
| 51 |
| Phi-3-mini-4k-instruct.Q3_K_S | Q3_K_S | - | ⏳ Processing | Yes | -
|