Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,595

Full-text search

Active filters: awq

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 2.45k • 6

Qwen/Qwen2.5-1.5B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 2.4k • 4

Qwen/Qwen2.5-3B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 18.2k • 8

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 12.4k • 16

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 24.2k • 13

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 21.4k • 49

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 630k • 53

ibrahimkettaneh/Qwen2.5-Coder-7B-Instruct-abliterated-AWQ

Updated Oct 8, 2024 • 11 • 2

ibrahimkettaneh/Qwen2.5-72B-Instruct-abliterated-AWQ-Marlin

Updated Oct 9, 2024 • 90 • 2

hugging-quants/gemma-2-9b-it-AWQ-INT4

Text Generation • Updated Oct 17, 2024 • 1.08k • 6

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • Updated Dec 7, 2024 • 168 • 2

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 24k • 18

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 2.98k • 5

Qwen/Qwen2.5-Coder-3B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 522 • 3

xingyaoww/Qwen2.5-Coder-32B-Instruct-AWQ-128k

Text Generation • Updated Nov 11, 2024 • 325 • 6

kosbu/Athene-V2-Chat-AWQ

Text Generation • Updated Nov 29, 2024 • 1.31k • 5

casperhansen/llama-3.3-70b-instruct-awq

Text Generation • Updated Dec 6, 2024 • 39.9k • 22

issai/LLama-3.1-KazLLM-1.0-70B-AWQ4

Text Generation • Updated Dec 10, 2024 • 81 • 2

issai/LLama-3.1-KazLLM-1.0-8B-AWQ4

Text Generation • Updated Dec 10, 2024 • 114 • 2

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-sym

Text Generation • Updated Dec 9, 2024 • 19 • 1

lambdalabs/Llama-3.3-70B-Instruct-AWQ-4bit

Updated Dec 10, 2024 • 439 • 2

tiiuae/Falcon3-10B-Instruct-AWQ

Updated 24 days ago • 257 • 1

Orion-zhen/phi-4-awq

Updated 23 days ago • 306 • 4

kosbu/QVQ-72B-Preview-AWQ

Image-Text-to-Text • Updated 18 days ago • 3.53k • 5

adriabama06/SmallThinker-3B-Preview-AWQ

Text Generation • Updated 8 days ago • 54 • 1

OPEA/DeepSeek-V3-int4-sym-awq-inc-cpu

Updated 1 day ago • 46 • 1

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 10 • 3

casperhansen/falcon-7b-awq

Text Generation • Updated Nov 4, 2023 • 62 • 1

casperhansen/vicuna-7b-v1.5-awq

Text Generation • Updated Oct 31, 2023 • 19 • 3

casperhansen/vicuna-7b-v1.5-awq-gemv

Text Generation • Updated Oct 31, 2023 • 10 • 1