AutoGPTQ-INT4-gs128 Collection A collection of models quantized in AutoGPTQ format using Intel AutoRound, INT4, groupsize 128 • 80 items • Updated about 6 hours ago
fbaldassarri/allenai_OLMo-2-1124-13B-autogptq-int4-gs128-sym Text Generation • Updated about 6 hours ago
AutoGPTQ-INT4-gs128 Collection A collection of models quantized in AutoGPTQ format using Intel AutoRound, INT4, groupsize 128 • 80 items • Updated about 6 hours ago
fbaldassarri/allenai_OLMo-2-1124-13B-autogptq-int4-gs128-asym Text Generation • Updated about 6 hours ago
AutoRound-INT4-gs128 Collection A collection of models quantized in AutoRound format using Intel AutoRound, INT4, groupsize 128 • 80 items • Updated about 6 hours ago
fbaldassarri/allenai_OLMo-2-1124-13B-autoround-int4-gs128-sym Text Generation • Updated about 6 hours ago
AutoRound-INT4-gs128 Collection A collection of models quantized in AutoRound format using Intel AutoRound, INT4, groupsize 128 • 80 items • Updated about 6 hours ago
fbaldassarri/allenai_OLMo-2-1124-13B-autoround-int4-gs128-asym Text Generation • Updated about 6 hours ago
AutoGPTQ-INT8-gs128 Collection A collection of models quantized in AutoGPTQ format using Intel AutoRound, INT8, groupsize 128 • 8 items • Updated 2 days ago
fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int8-gs128-sym Text Generation • Updated 2 days ago • 5
AutoGPTQ-INT8-gs128 Collection A collection of models quantized in AutoGPTQ format using Intel AutoRound, INT8, groupsize 128 • 8 items • Updated 2 days ago
fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int8-gs128-asym Text Generation • Updated 2 days ago • 4
AutoRound-INT8-gs128 Collection A collection of models quantized in AutoRound format using Intel AutoRound, INT8, groupsize 128 • 8 items • Updated 2 days ago
fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_round-int8-gs128-sym Text Generation • Updated 2 days ago • 7
AutoRound-INT8-gs128 Collection A collection of models quantized in AutoRound format using Intel AutoRound, INT8, groupsize 128 • 8 items • Updated 2 days ago
fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_round-int8-gs128-asym Text Generation • Updated 2 days ago • 4
AutoGPTQ-INT8-gs128 Collection A collection of models quantized in AutoGPTQ format using Intel AutoRound, INT8, groupsize 128 • 8 items • Updated 2 days ago
fbaldassarri/meta-llama_Llama-3.2-3B-auto_gptq-int8-gs128-sym Text Generation • Updated 2 days ago • 5
AutoGPTQ-INT8-gs128 Collection A collection of models quantized in AutoGPTQ format using Intel AutoRound, INT8, groupsize 128 • 8 items • Updated 2 days ago