iproskurina
/

opt-350m-GPTQ-4bit-g128

Text Generation

4-bit precision

text-generation-inference

Model card Files Files and versions Community

opt-350m-GPTQ-4bit-g128

Commit History

Update README.md

3070dff
verified

iproskurina commited on Sep 23, 2024

AutoGPTQ model for facebook/opt-350m: 4bits, gr128, desc_act=False

f713e7b
verified

iproskurina commited on Sep 23, 2024

AutoGPTQ model for facebook/opt-350m: 4bits, gr128, desc_act=False

86db3a7
verified

iproskurina commited on Sep 23, 2024

Create README.md

ed11ed7
verified

iproskurina commited on Jan 27, 2024

Rename gptq_model-4bit-128g.safetensors to model.safetensors

bfb98fb

iproskurina commited on Dec 21, 2023

Upload tokenizer

521f585

iproskurina commited on Dec 11, 2023

Upload of AutoGPTQ quantized model

c566b31

iproskurina commited on Dec 11, 2023

initial commit

777dc13

iproskurina commited on Dec 11, 2023