legraphista
commited on
Commit
β’
d46ce4e
1
Parent(s):
eea3d0c
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -42,7 +42,7 @@ Link: [here](https://huggingface.co/legraphista/RoMistral-7b-Instruct-IMat-GGUF/
|
|
42 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
43 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
44 |
| [RoMistral-7b-Instruct.FP16.gguf](https://huggingface.co/legraphista/RoMistral-7b-Instruct-IMat-GGUF/blob/main/RoMistral-7b-Instruct.FP16.gguf) | F16 | 14.48GB | β
Available | βͺ No | π¦ No
|
45 |
-
| RoMistral-7b-Instruct.BF16 | BF16 |
|
46 |
| RoMistral-7b-Instruct.Q5_K | Q5_K | - | β³ Processing | βͺ No | -
|
47 |
| RoMistral-7b-Instruct.Q5_K_S | Q5_K_S | - | β³ Processing | βͺ No | -
|
48 |
| RoMistral-7b-Instruct.Q4_K_S | Q4_K_S | - | β³ Processing | π’ Yes | -
|
|
|
42 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
43 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
44 |
| [RoMistral-7b-Instruct.FP16.gguf](https://huggingface.co/legraphista/RoMistral-7b-Instruct-IMat-GGUF/blob/main/RoMistral-7b-Instruct.FP16.gguf) | F16 | 14.48GB | β
Available | βͺ No | π¦ No
|
45 |
+
| [RoMistral-7b-Instruct.BF16.gguf](https://huggingface.co/legraphista/RoMistral-7b-Instruct-IMat-GGUF/blob/main/RoMistral-7b-Instruct.BF16.gguf) | BF16 | 14.48GB | β
Available | βͺ No | π¦ No
|
46 |
| RoMistral-7b-Instruct.Q5_K | Q5_K | - | β³ Processing | βͺ No | -
|
47 |
| RoMistral-7b-Instruct.Q5_K_S | Q5_K_S | - | β³ Processing | βͺ No | -
|
48 |
| RoMistral-7b-Instruct.Q4_K_S | Q4_K_S | - | β³ Processing | π’ Yes | -
|