Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

14,520

Full-text search

Active filters: llama-cpp

roleplaiapp/DeepSeek-R1-Distill-Qwen-7B-Q3_K_S-GGUF

Text Generation • Updated 20 days ago • 54 • 1

NikolayKozloff/DeepSeek-R1-Distill-Qwen-14B-Q5_K_M-GGUF

Updated 20 days ago • 487 • 2

roleplaiapp/DeepSeek-R1-Distill-Qwen-14B-Q8_0-GGUF

Text Generation • Updated 20 days ago • 9.13k • 1

NikolayKozloff/DeepSeek-R1-Distill-Qwen-1.5B-Q8_0-GGUF

Updated 20 days ago • 550 • 1

roleplaiapp/DeepSeek-R1-Distill-Qwen-7B-Q4_0-GGUF

Text Generation • Updated 20 days ago • 1.67k • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_M-GGUF

Text Generation • Updated 20 days ago • 160 • 1

NikolayKozloff/DeepSeek-R1-Distill-Qwen-14B-Q5_K_S-GGUF

Updated 20 days ago • 93 • 1

roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Q5_K_M-GGUF

Text Generation • Updated 20 days ago • 614 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q4_0-GGUF

Text Generation • Updated 20 days ago • 2.64k • 1

NikolayKozloff/DeepSeek-R1-Distill-Qwen-14B-Q4_K_M-GGUF

Updated 20 days ago • 732 • 1

ggml-org/DeepSeek-R1-Distill-Qwen-1.5B-Q4_0-GGUF

Updated 20 days ago • 3.86k • 2

ggml-org/DeepSeek-R1-Distill-Qwen-32B-Q8_0-GGUF

Updated 20 days ago • 7.98k • 5

ibrahimkettaneh/DeepSeek-R1-Distill-Llama-8B-Abliterated-Q4_K_M-GGUF

Updated 20 days ago • 24k • 2

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q6_K-GGUF

Text Generation • Updated 20 days ago • 340 • 1

netease-youdao/Confucius-o1-14B-GGUF

Updated 19 days ago • 424 • 1

NikolayKozloff/Llasa-1B-Q8_0-GGUF

Text-to-Speech • Updated 20 days ago • 907 • 3

srinivasbilla/llasa-3b-Q4_K_M-GGUF

Updated 19 days ago • 298 • 3

srinivasbilla/llasa-3b-Q8_0-GGUF

Updated 19 days ago • 999 • 2

Triangle104/Dria-Agent-a-3B-Q5_K_M-GGUF

Text Generation • Updated 19 days ago • 10 • 1

NikolayKozloff/q1-3B-PRIME-Q8_0-GGUF

Text Generation • Updated 19 days ago • 34 • 2

ClaudioItaly/Magdala-9B-Q4_K_M-GGUF

Updated 19 days ago • 25 • 1

matrixportal/DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M-GGUF

Updated 19 days ago • 234 • 1

Cran-May/Lamarck-14B-v0.7-Q4_K_M-GGUF

Text Generation • Updated 19 days ago • 116 • 1

ClaudioItaly/Vangelus-Poetic-9B-Q4_K_M-GGUF

Updated 19 days ago • 24 • 1

matrixportal/LLama3.1-Hawkish-Theia-Fireball-8B-GGUF

Text Generation • Updated 18 days ago • 86 • 1

roleplaiapp/ALIA-40b-Q8_0-GGUF

Text Generation • Updated 18 days ago • 90 • 1

ozone-ai/llama-3.1-0x-mini-Q4_K_M-GGUF

Text2Text Generation • Updated 18 days ago • 104 • 1

ozone-ai/llama-3.1-0x-mini-Q3_K_S-GGUF

Text2Text Generation • Updated 18 days ago • 28 • 1

jlopez-dl/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q5_K_M-GGUF

Updated 17 days ago • 1.09k • 1

DataSoul/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview-Q4_K_M-GGUF

Updated 18 days ago • 116 • 1