shuttleai
/

shuttle-3-mini-GPTQ-Int4

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

shuttle-3-mini-GPTQ-Int4

Commit History

Upload quantize_config.json

c523809
verified

xtristan commited on Sep 23, 2024

Update config.json

6e129ec
verified

xtristan commited on Sep 23, 2024

Upload 4 files

85993fa
verified

xtristan commited on Sep 23, 2024

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False

0940d8b
verified

xtristan commited on Sep 23, 2024

initial commit

5f2f8e5
verified

xtristan commited on Sep 23, 2024