add gguf
Browse files
README.md
CHANGED
|
@@ -299,6 +299,10 @@ model.generate(**gen_input)
|
|
| 299 |
|
| 300 |
Quantizationed versions of this model is available.
|
| 301 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 302 |
## Exl2 [@bartowski](https://hf.co/bartowski):
|
| 303 |
|
| 304 |
- https://huggingface.co/bartowski/Einstein-v4-7B-exl2
|
|
|
|
| 299 |
|
| 300 |
Quantizationed versions of this model is available.
|
| 301 |
|
| 302 |
+
## GGUF [@LoneStriker](https://huggingface.co/LoneStriker)
|
| 303 |
+
|
| 304 |
+
- https://huggingface.co/LoneStriker/Einstein-v4-7B-GGUF
|
| 305 |
+
|
| 306 |
## Exl2 [@bartowski](https://hf.co/bartowski):
|
| 307 |
|
| 308 |
- https://huggingface.co/bartowski/Einstein-v4-7B-exl2
|