Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
nisten
/
quad-mixtrals-gguf
like
32
GGUF
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
96e663b
quad-mixtrals-gguf
/
README.md
nisten
Update README.md
9768c6c
10 months ago
preview
code
|
raw
Copy download link
history
blame
No virus
185 Bytes
---
license:
apache-2.0
---
Experimental quants of 4 headed mixtrals in various GGUF formats.
Goal is to have the best performing MoE < 16 Gig .
They still need training/finetuning