Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,816

Full-text search

Active filters: awq

bsmit1659/Phi-3-mini-128k-instruct-0.2-awq

Text Generation • Updated Jul 3, 2024 • 12

PrunaAI/mistralai-Mistral-7B-v0.1-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 16

rubra-ai/Meta-Llama-3-70B-Instruct-AWQ

Text Generation • Updated Jul 4, 2024 • 15

ravi-wcg/Llama-3-8B-AWQ-4bit

Text Generation • Updated Jul 4, 2024 • 12

ravi-wcg/Llama-3-8B-Instruct-AWQ-4bit

Text Generation • Updated Jul 4, 2024 • 14

Weni/ZeroShot-Agents-Llama3-4.0.47-SFT-AWQ

Text Generation • Updated Jul 4, 2024 • 12

Weni/ZeroShot-Agents-Llama3-4.0.48-SFT-AWQ

Text Generation • Updated Jul 5, 2024 • 12

Weni/ZeroShot-Agents-Llama3-4.0.49-DPO-AWQ

Text Generation • Updated Jul 5, 2024 • 14

ellamind/qwen2-72b-instruct-awq-de

Text Generation • Updated Jul 22, 2024 • 13

emaibb/magnum-72b-v1-awq

Text Generation • Updated Jul 5, 2024 • 12 • 3

Weni/ZeroShot-Agents-Llama3-4.0.50-SFT-AWQ

Text Generation • Updated Jul 5, 2024 • 13

elysiantech/gemma-2b-awq-4bit

Text Generation • Updated Jul 5, 2024 • 12

elysiantech/phi-3-mini-4k-instruct-awq-4bit

Text Generation • Updated Jul 6, 2024 • 13

Weni/ZeroShot-Agents-Llama3-4.0.52-SFT-AWQ

Text Generation • Updated Jul 6, 2024 • 13

Weni/ZeroShot-Agents-Llama3-4.0.53-SFT-AWQ

Text Generation • Updated Jul 6, 2024 • 15

Weni/ZeroShot-Agents-Llama3-4.0.54-SFT-AWQ

Text Generation • Updated Jul 6, 2024 • 12

Weni/ZeroShot-Agents-Llama3-4.0.55-SFT-AWQ

Text Generation • Updated Jul 7, 2024 • 15

pankajmathur/orca_mini_v7_7b-AWQ

Text Generation • Updated 28 days ago • 88 • 1

pankajmathur/orca_mini_v6_8b-AWQ

Text2Text Generation • Updated 28 days ago • 67 • 1

pankajmathur/orca_mini_v6_8b_dpo-AWQ

Text2Text Generation • Updated 28 days ago • 68 • 1

Weni/ZeroShot-Agents-Llama3-4.0.56-SFT-AWQ

Text Generation • Updated Jul 7, 2024 • 12

Weni/ZeroShot-Agents-Llama3-4.0.57-SFT-AWQ

Text Generation • Updated Jul 7, 2024 • 14

solidrust/dolphin-2.9.3-mistral-7B-32k-AWQ

Text Generation • Updated Sep 3, 2024 • 15

shunran/L3-ChaoticSoliloquy-v1.5-4x8B-awq

Text Generation • Updated Jul 8, 2024 • 13

nihaomur/Llama-3-Taiwan-8B-Instruct-AWQ-4bit

Text Generation • Updated Jul 19, 2024 • 16 • 1

solidrust/Phi-3-mini-128k-instruct-AWQ

Text Generation • Updated Sep 3, 2024 • 225 • 1

solidrust/Phi-3-mini-4k-instruct-AWQ

Text Generation • Updated Sep 3, 2024 • 13

Weni/ZeroShot-Agents-Llama3-4.0.58-SFT-AWQ

Text Generation • Updated Jul 8, 2024 • 15

Weni/ZeroShot-Agents-Llama3-4.0.57-SFT-140-AWQ

Text Generation • Updated Jul 8, 2024 • 12

h2oai/llama-3-70b-instruct-awq

Text Generation • Updated Jul 8, 2024 • 12