Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
nisten
/
quad-mixtrals-gguf
like
32
GGUF
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
79c1c17
quad-mixtrals-gguf
Commit History
Upload 4mixq4km.gguf
79c1c17
nisten
commited on
Dec 26, 2023
optimal 4bit model for google colab t4
0c047f9
nisten
commited on
Dec 26, 2023
Rename 4mixtq3_k.gguf to 4mixq3_k.gguf
5860884
nisten
commited on
Dec 23, 2023
Rename 4mixtralq6_k.gguf to 4mixq6_k.gguf
5b4c094
nisten
commited on
Dec 23, 2023
Rename 4mixtralq3_k_l.gguf to 4mixq3_k_l.gguf
14b201e
nisten
commited on
Dec 23, 2023
Update README.md
8f79ba9
nisten
commited on
Dec 23, 2023
Update README.md
994e63d
nisten
commited on
Dec 23, 2023
Update README.md
641b075
nisten
commited on
Dec 23, 2023
Update README.md
e065fd7
nisten
commited on
Dec 23, 2023
Update README.md
0e9fc27
nisten
commited on
Dec 23, 2023
Update README.md
cdd8bfb
nisten
commited on
Dec 23, 2023
Update README.md
3a5fe36
nisten
commited on
Dec 23, 2023
smallest working 2k mixtral
8b281e3
nisten
commited on
Dec 23, 2023
working 3k quant
d2ade87
nisten
commited on
Dec 23, 2023
working 6k quant
96e663b
nisten
commited on
Dec 23, 2023
Rename 4mixtrainq6_k.gguf to 4mixtralq6_k.gguf
945b37c
nisten
commited on
Dec 23, 2023
working 6k quant
bd6da66
nisten
commited on
Dec 23, 2023
trainable 4bit experiment
f1da856
nisten
commited on
Dec 23, 2023
meow7
e4a6241
nisten
commited on
Dec 23, 2023
meow6
6cf5aa3
nisten
commited on
Dec 23, 2023
meow5
501eb3d
nisten
commited on
Dec 23, 2023
Rename 4mixtralq5.gguf to 4mixtralq5_0.gguf
957f47e
nisten
commited on
Dec 23, 2023
meow2
a6084a1
nisten
commited on
Dec 23, 2023
Rename 4mixtq4_1.gguf to 4mixtralq4_1.gguf
c62df87
nisten
commited on
Dec 23, 2023
meow3
40866eb
nisten
commited on
Dec 23, 2023
Rename 4mixtq4_1.gguf to 4mixtralq4_0.gguf
6feb9a1
nisten
commited on
Dec 23, 2023
meow
bfb9342
nisten
commited on
Dec 23, 2023
Update README.md
9768c6c
nisten
commited on
Dec 22, 2023
initial commit
74f8bad
nisten
commited on
Dec 22, 2023