iproskurina
/

Mistral-7B-v0.3-GPTQ-8bit-g128

Text Generation

8-bit precision

Model card Files Files and versions Community

Mistral-7B-v0.3-GPTQ-8bit-g128 / model.safetensors

Commit History

AutoGPTQ model for mistralai/Mistral-7B-v0.3: 8bits, gr128, desc_act=False

1cda51a
verified

iproskurina commited on Sep 25

Rename gptq_model-8bit-128g.safetensors to model.safetensors

697e76c
verified

iproskurina commited on Sep 24