Hugging Face's logo

shuttleai
/
shuttle-3-mini-GPTQ-Int4

Text Generation
Transformers
Safetensors
qwen2
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
shuttle-3-mini-GPTQ-Int4 / generation_config.json

Commit History

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False
0940d8b
verified

xtristan commited on