fbaldassarri/HuggingFaceTB_SmolLM2-360M-Instruct-auto_awq-int4-gs64-asym
Text Generation
•
Updated
•
8
AutoAWQ-INT4-gs64
A collection of models quantized in AutoAWQ format using Intel AutoRound, INT4, groupsize 64
-
-
fbaldassarri/HuggingFaceTB_SmolLM2-360M-auto_awq-int4-gs64-asym
Text Generation • Updated • 7 -
fbaldassarri/HuggingFaceTB_SmolLM2-360M-auto_awq-int4-gs64-sym
Text Generation • Updated • 5 -
fbaldassarri/HuggingFaceTB_SmolLM2-135M-auto_awq-int4-gs64-asym
Text Generation • Updated • 4 -
fbaldassarri/HuggingFaceTB_SmolLM2-135M-auto_awq-int4-gs64-sym
Text Generation • Updated • 7 -
fbaldassarri/HuggingFaceTB_SmolLM2-135M-Instruct-auto_awq-int4-gs64-asym
Text Generation • Updated • 7 -
fbaldassarri/HuggingFaceTB_SmolLM2-135M-Instruct-auto_awq-int4-gs64-sym
Text Generation • Updated • 7 -
fbaldassarri/sapienzanlp_Minerva-350M-base-v1.0-autoawq-int4-gs64-asym
Text Generation • Updated • 6 -
fbaldassarri/sapienzanlp_Minerva-350M-base-v1.0-autoawq-int4-gs64-sym
Text Generation • Updated • 4 -
fbaldassarri/HuggingFaceTB_SmolLM2-360M-Instruct-auto_awq-int4-gs64-sym
Text Generation • Updated • 7