shuttleai
/

shuttle-3-mini-GPTQ-Int4

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

shuttle-3-mini-GPTQ-Int4

1 contributor

History: 3 commits

xtristan's picture

Upload 4 files

85993fa verified 5 months ago

.gitattributes

1.52 kB

initial commit 5 months ago
README.md

5.17 kB

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False 5 months ago
config.json

725 Bytes

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False 5 months ago
generation_config.json

248 Bytes

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False 5 months ago
model-00001-of-00002.safetensors

4.99 GB
LFS

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False 5 months ago
model-00002-of-00002.safetensors

4.99 GB
LFS

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False 5 months ago
model.safetensors.index.json

129 kB

AutoGPTQ model for shuttle-3-mini-GPTQ-Int4: 4bits, gr128, desc_act=False 5 months ago
special_tokens_map.json

613 Bytes

Upload 4 files 5 months ago
tokenizer.json

7.03 MB

Upload 4 files 5 months ago
tokenizer_config.json

4.97 kB

Upload 4 files 5 months ago