Hugging Face's logo

nisten
/
quad-mixtrals-gguf

GGUF
Inference Endpoints
Model card Files Community
quad-mixtrals-gguf

Commit History

Update README.md
678c9e9

nisten commited on

custom 4k quant large
5233ef1

nisten commited on

Upload 4mixq4km.gguf
79c1c17

nisten commited on

optimal 4bit model for google colab t4
0c047f9

nisten commited on

Rename 4mixtq3_k.gguf to 4mixq3_k.gguf
5860884

nisten commited on

Rename 4mixtralq6_k.gguf to 4mixq6_k.gguf
5b4c094

nisten commited on

Rename 4mixtralq3_k_l.gguf to 4mixq3_k_l.gguf
14b201e

nisten commited on

Update README.md
8f79ba9

nisten commited on

Update README.md
994e63d

nisten commited on

Update README.md
641b075

nisten commited on

Update README.md
e065fd7

nisten commited on

Update README.md
0e9fc27

nisten commited on

Update README.md
cdd8bfb

nisten commited on

Update README.md
3a5fe36

nisten commited on

smallest working 2k mixtral
8b281e3

nisten commited on

working 3k quant
d2ade87

nisten commited on

working 6k quant
96e663b

nisten commited on

Rename 4mixtrainq6_k.gguf to 4mixtralq6_k.gguf
945b37c

nisten commited on

working 6k quant
bd6da66

nisten commited on

trainable 4bit experiment
f1da856

nisten commited on

meow7
e4a6241

nisten commited on

meow6
6cf5aa3

nisten commited on

meow5
501eb3d

nisten commited on

Rename 4mixtralq5.gguf to 4mixtralq5_0.gguf
957f47e

nisten commited on

meow2
a6084a1

nisten commited on

Rename 4mixtq4_1.gguf to 4mixtralq4_1.gguf
c62df87

nisten commited on

meow3
40866eb

nisten commited on

Rename 4mixtq4_1.gguf to 4mixtralq4_0.gguf
6feb9a1

nisten commited on

meow
bfb9342

nisten commited on

Update README.md
9768c6c

nisten commited on

initial commit
74f8bad

nisten commited on