File size: 185 Bytes
74f8bad
 
 
9768c6c
 
 
 
 
 
1
2
3
4
5
6
7
8
9
---
license: apache-2.0
---

Experimental quants of 4 headed mixtrals in various GGUF formats. 

Goal is to have the best performing MoE < 16 Gig . 

They still need training/finetuning