iproskurina
/

Mistral-7B-v0.3-GPTQ-4bit-g128

Text Generation

4-bit precision

Model card Files Files and versions Community

Mistral-7B-v0.3-GPTQ-4bit-g128 / quantize_config.json

Commit History

AutoGPTQ model for mistralai/Mistral-7B-v0.3: 4bits, gr128, desc_act=False

6ae06d4
verified

iproskurina commited on Sep 25

AutoGPTQ model for mistralai/Mistral-7B-v0.3: 4bits, gr128, desc_act=False

9f1f716
verified

iproskurina commited on Sep 24