legraphista
commited on
Commit
β’
cbb5f10
1
Parent(s):
80ffbf9
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -63,8 +63,8 @@ Link: [here](https://huggingface.co/legraphista/Athene-70B-IMat-GGUF/blob/main/i
|
|
63 |
| [Athene-70B.Q8_0/*](https://huggingface.co/legraphista/Athene-70B-IMat-GGUF/tree/main/Athene-70B.Q8_0) | Q8_0 | 74.98GB | β
Available | βͺ Static | β Yes
|
64 |
| [Athene-70B.Q6_K/*](https://huggingface.co/legraphista/Athene-70B-IMat-GGUF/tree/main/Athene-70B.Q6_K) | Q6_K | 57.89GB | β
Available | βͺ Static | β Yes
|
65 |
| Athene-70B.Q4_K | Q4_K | - | β³ Processing | π’ IMatrix | -
|
66 |
-
| Athene-70B.Q3_K | Q3_K |
|
67 |
-
| Athene-70B.Q2_K | Q2_K |
|
68 |
|
69 |
|
70 |
### All Quants
|
@@ -80,14 +80,14 @@ Link: [here](https://huggingface.co/legraphista/Athene-70B-IMat-GGUF/blob/main/i
|
|
80 |
| Athene-70B.Q4_K_S | Q4_K_S | - | β³ Processing | π’ IMatrix | -
|
81 |
| Athene-70B.IQ4_NL | IQ4_NL | - | β³ Processing | π’ IMatrix | -
|
82 |
| Athene-70B.IQ4_XS | IQ4_XS | - | β³ Processing | π’ IMatrix | -
|
83 |
-
| Athene-70B.Q3_K | Q3_K |
|
84 |
| Athene-70B.Q3_K_L | Q3_K_L | - | β³ Processing | π’ IMatrix | -
|
85 |
| Athene-70B.Q3_K_S | Q3_K_S | - | β³ Processing | π’ IMatrix | -
|
86 |
| Athene-70B.IQ3_M | IQ3_M | - | β³ Processing | π’ IMatrix | -
|
87 |
| Athene-70B.IQ3_S | IQ3_S | - | β³ Processing | π’ IMatrix | -
|
88 |
| Athene-70B.IQ3_XS | IQ3_XS | - | β³ Processing | π’ IMatrix | -
|
89 |
| Athene-70B.IQ3_XXS | IQ3_XXS | - | β³ Processing | π’ IMatrix | -
|
90 |
-
| Athene-70B.Q2_K | Q2_K |
|
91 |
| Athene-70B.Q2_K_S | Q2_K_S | - | β³ Processing | π’ IMatrix | -
|
92 |
| Athene-70B.IQ2_M | IQ2_M | - | β³ Processing | π’ IMatrix | -
|
93 |
| Athene-70B.IQ2_S | IQ2_S | - | β³ Processing | π’ IMatrix | -
|
|
|
63 |
| [Athene-70B.Q8_0/*](https://huggingface.co/legraphista/Athene-70B-IMat-GGUF/tree/main/Athene-70B.Q8_0) | Q8_0 | 74.98GB | β
Available | βͺ Static | β Yes
|
64 |
| [Athene-70B.Q6_K/*](https://huggingface.co/legraphista/Athene-70B-IMat-GGUF/tree/main/Athene-70B.Q6_K) | Q6_K | 57.89GB | β
Available | βͺ Static | β Yes
|
65 |
| Athene-70B.Q4_K | Q4_K | - | β³ Processing | π’ IMatrix | -
|
66 |
+
| [Athene-70B.Q3_K.gguf](https://huggingface.co/legraphista/Athene-70B-IMat-GGUF/blob/main/Athene-70B.Q3_K.gguf) | Q3_K | 34.27GB | β
Available | π’ IMatrix | π¦ No
|
67 |
+
| [Athene-70B.Q2_K.gguf](https://huggingface.co/legraphista/Athene-70B-IMat-GGUF/blob/main/Athene-70B.Q2_K.gguf) | Q2_K | 26.38GB | β
Available | π’ IMatrix | π¦ No
|
68 |
|
69 |
|
70 |
### All Quants
|
|
|
80 |
| Athene-70B.Q4_K_S | Q4_K_S | - | β³ Processing | π’ IMatrix | -
|
81 |
| Athene-70B.IQ4_NL | IQ4_NL | - | β³ Processing | π’ IMatrix | -
|
82 |
| Athene-70B.IQ4_XS | IQ4_XS | - | β³ Processing | π’ IMatrix | -
|
83 |
+
| [Athene-70B.Q3_K.gguf](https://huggingface.co/legraphista/Athene-70B-IMat-GGUF/blob/main/Athene-70B.Q3_K.gguf) | Q3_K | 34.27GB | β
Available | π’ IMatrix | π¦ No
|
84 |
| Athene-70B.Q3_K_L | Q3_K_L | - | β³ Processing | π’ IMatrix | -
|
85 |
| Athene-70B.Q3_K_S | Q3_K_S | - | β³ Processing | π’ IMatrix | -
|
86 |
| Athene-70B.IQ3_M | IQ3_M | - | β³ Processing | π’ IMatrix | -
|
87 |
| Athene-70B.IQ3_S | IQ3_S | - | β³ Processing | π’ IMatrix | -
|
88 |
| Athene-70B.IQ3_XS | IQ3_XS | - | β³ Processing | π’ IMatrix | -
|
89 |
| Athene-70B.IQ3_XXS | IQ3_XXS | - | β³ Processing | π’ IMatrix | -
|
90 |
+
| [Athene-70B.Q2_K.gguf](https://huggingface.co/legraphista/Athene-70B-IMat-GGUF/blob/main/Athene-70B.Q2_K.gguf) | Q2_K | 26.38GB | β
Available | π’ IMatrix | π¦ No
|
91 |
| Athene-70B.Q2_K_S | Q2_K_S | - | β³ Processing | π’ IMatrix | -
|
92 |
| Athene-70B.IQ2_M | IQ2_M | - | β³ Processing | π’ IMatrix | -
|
93 |
| Athene-70B.IQ2_S | IQ2_S | - | β³ Processing | π’ IMatrix | -
|