Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,954

Full-text search

Active filters: gptq

shuyuej/Llama-3.3-70B-Instruct-GPTQ

Updated 21 days ago • 2.29k • 4

fbaldassarri/EleutherAI_pythia-12b-autogptq-int4-gs128-sym

Text Generation • Updated Dec 9, 2024 • 12 • 1

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-sym

Text Generation • Updated Dec 9, 2024 • 19 • 1

marinarosell/Meta-Llama-3-8B-Instruct-GPTQ-4bit

Text Generation • Updated about 1 month ago • 50 • 1

tiiuae/Falcon3-10B-Instruct-GPTQ-Int8

Updated 25 days ago • 466 • 2

tiiuae/Falcon3-3B-Instruct-GPTQ-Int8

Updated 25 days ago • 246 • 1

tiiuae/Falcon3-1B-Instruct-GPTQ-Int8

Updated 25 days ago • 198 • 1

jakiAJK/Microsoft-Phi-4-NyxKrage_GPTQ-4bit

Text Generation • Updated 24 days ago • 282 • 1

huihui-ai/Llama-3.3-70B-Instruct-abliterated-finetuned-GPTQ-Int4

Text Generation • Updated 18 days ago • 391 • 1

kaitchup/QwQ-32B-Preview-AutoRound-GPTQ-2bit

Text Generation • Updated 12 days ago • 22 • 1

OPEA/DeepSeek-V3-int4-sym-gptq-inc

Updated 6 days ago • 2.06k • 10

fbaldassarri/meta-llama_Llama-3.2-3B-auto_round-int8-gs128-sym

Text Generation • Updated 3 days ago • 4 • 1

TheBloke/Xwin-MLewd-7B-V0.2-GPTQ

Text Generation • Updated Oct 31, 2023 • 74 • 21

TheBloke/Utopia-13B-GPTQ

Text Generation • Updated Nov 5, 2023 • 97 • 12

elinas/alpaca-13b-lora-int4

Text Generation • Updated Apr 5, 2023 • 10 • 41

elinas/alpaca-30b-lora-int4

Text Generation • Updated Apr 5, 2023 • 19 • 68

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 44 • 39

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 55 • 121

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 19 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 19 • 2

elinas/vicuna-13b-4bit

Text Generation • Updated Apr 5, 2023 • 17 • 46

TheBloke/koala-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 46 • 31

TheBloke/koala-7B-HF

Text Generation • Updated Jun 5, 2023 • 793 • 20

TheBloke/koala-13B-HF

Text Generation • Updated Jun 5, 2023 • 1.61k • 41

TheBloke/koala-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 24 • 38

TheBloke/galpaca-30B-GPTQ

Text Generation • Updated Aug 21, 2023 • 9 • 48

Ancestral/Dolly_Shygmalion-6b-4bit-128g

Text Generation • Updated Apr 9, 2023 • 22 • 5

Ancestral/PPO_Shygmalion-6b-4bit-128g

Text Generation • Updated Apr 9, 2023 • 7

TheBloke/vicuna-7B-v0-GPTQ

Text Generation • Updated Aug 21, 2023 • 30 • 15

Ancestral/Dolly_Malion-6b-4bit-128g

Text Generation • Updated Apr 10, 2023 • 10