Hugging Face's logo

riveRiPH
/
MN-12B-Lyra-v4-6bpw-h8-exl2

Safetensors
English
mistral
6-bit
exl2
Model card Files

Lyra

MN-12B-Lyra-v4-6bpw-h8-exl2

This is a 6bpw h8 exl2 quant of MN-12B-Lyra-v4

Built-in(default) calibration dataset is used.

Downloads last month
22
Inference API
Unable to determine this model's library. Check the docs .

Model tree for riveRiPH/MN-12B-Lyra-v4-6bpw-h8-exl2

Base model

Sao10K/MN-12B-Lyra-v4
Quantized
(1)
this model

Collection including riveRiPH/MN-12B-Lyra-v4-6bpw-h8-exl2