AutoAWQ-INT4-gs64 - a fbaldassarri Collection

fbaldassarri 's Collections

AutoRound-INT4-gs128

AutoGPTQ-INT4-gs128

AutoAWQ-INT4-gs128

AutoAWQ-INT4-gs64

AutoRound-INT8-gs128

AutoGPTQ-INT8-gs128

AutoAWQ-INT4-gs64

updated Jan 8

A collection of models quantized in AutoAWQ format using Intel AutoRound, INT4, groupsize 64

fbaldassarri/HuggingFaceTB_SmolLM2-360M-Instruct-auto_awq-int4-gs64-asym

Text Generation • Updated Jan 4 • 11
fbaldassarri/HuggingFaceTB_SmolLM2-360M-auto_awq-int4-gs64-asym

Text Generation • Updated Jan 4 • 9
fbaldassarri/HuggingFaceTB_SmolLM2-360M-auto_awq-int4-gs64-sym

Text Generation • Updated Jan 4 • 9
fbaldassarri/HuggingFaceTB_SmolLM2-135M-auto_awq-int4-gs64-asym

Text Generation • Updated Jan 4 • 11
fbaldassarri/HuggingFaceTB_SmolLM2-135M-auto_awq-int4-gs64-sym

Text Generation • Updated Jan 4 • 9
fbaldassarri/HuggingFaceTB_SmolLM2-135M-Instruct-auto_awq-int4-gs64-asym

Text Generation • Updated Jan 4 • 6
fbaldassarri/HuggingFaceTB_SmolLM2-135M-Instruct-auto_awq-int4-gs64-sym

Text Generation • Updated Jan 4 • 9
fbaldassarri/sapienzanlp_Minerva-350M-base-v1.0-autoawq-int4-gs64-asym

Text Generation • Updated Jan 4 • 6
fbaldassarri/sapienzanlp_Minerva-350M-base-v1.0-autoawq-int4-gs64-sym

Text Generation • Updated Jan 4 • 6
fbaldassarri/HuggingFaceTB_SmolLM2-360M-Instruct-auto_awq-int4-gs64-sym

Text Generation • Updated Jan 5 • 8