Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

14,522

Full-text search

Active filters: llama-cpp

RedSQID/sororicide-12B-Farer-Mell-Unslop-Q4_K_M-GGUF

Updated 18 days ago • 65 • 1

IntelligentEstate/Pancho-V1va-Replicant-qw25-Q8_0-GGUF

Updated 16 days ago • 39 • 2

kagevazquez/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q4_K_M-GGUF

Updated 18 days ago • 1.05k • 1

CronoBJS/FuseO1-DeepSeekR1-Qwen2.5-Coder-14B-Preview-Q4_K_M-GGUF

Updated 18 days ago • 7.52k • 1

ClaudioItaly/Vangelus-Secundus-Q5_K_M-GGUF

Updated 17 days ago • 22 • 1

maicog/DeepSeek-R1-Distill-Llama-8B-abliterated-Q4_K_S-GGUF

Updated 17 days ago • 2.08k • 3

NikolayKozloff/salt-asr_wav-uni_1_tts_wav-uni_1-12k-Q8_0-GGUF

Updated 17 days ago • 79 • 1

matrixportal/Bio-Medical-Llama-3-2-1B-CoT-012025-GGUF

Updated 17 days ago • 84 • 1

zelk12/MT-Gen6-gemma-2-9B-Q6_K-GGUF

Text Generation • Updated 17 days ago • 161 • 1

havenwood/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q5_K_M-GGUF

Updated 17 days ago • 2.12k • 1

ggml-org/LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUF

Updated 17 days ago • 73 • 2

Ashcomposer/jina-embeddings-v2-base-zh-Q8_0-GGUF

Feature Extraction • Updated 17 days ago • 74 • 1

harkov000/R1-DarkIdol-8B-v0.4-Q6_K-GGUF

Updated 16 days ago • 111 • 2

sm54/FuseO1-DeepSeekR1-QwQ-SkyT1-Flash-32B-Preview-Q4_K_M-GGUF

Updated 16 days ago • 741 • 6

mitkox/DeepSeek-R1-ReDistill-Qwen-1.5B-v1.0-Q4_K_M-GGUF

Text Generation • Updated 16 days ago • 75 • 1

BernTheCreator/DeepSeek-R1-Distill-Qwen-7B-Q4_0-GGUF

Updated 16 days ago • 1.21k • 1

shawn1251/granite-guardian-3.1-2b-Q4_K_M-GGUF

Text Generation • Updated 16 days ago • 23 • 1

Triangle104/DeepSeek-R1-Distill-Qwen-1.5B-uncensored-Q6_K-GGUF

Updated 16 days ago • 163 • 1

fernandoruiz/salamandra-7b-instruct-Q4_0-GGUF

Text Generation • Updated 15 days ago • 36 • 1

G17c21ds/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q8_0-GGUF

Updated 15 days ago • 3.88k • 2

djuna/MN-Chinofun-12B-4-Q6_K-GGUF

Updated 15 days ago • 80 • 1

djuna/MN-Chinofun-12B-4.1-Q6_K-GGUF

Updated 14 days ago • 49 • 1

OddTheGreat/Unity-12B-Q4_K_M-GGUF

Updated 14 days ago • 45 • 1

NikolayKozloff/Confucius-o1-14B-Q6_K-GGUF

Updated 14 days ago • 26 • 1

NikolayKozloff/Confucius-o1-14B-Q5_K_M-GGUF

Updated 14 days ago • 24 • 1

NikolayKozloff/Confucius-o1-14B-Q5_K_S-GGUF

Updated 14 days ago • 21 • 1

NikolayKozloff/Confucius-o1-14B-Q4_K_M-GGUF

Updated 14 days ago • 37 • 1

Triangle104/Qwen2.5-14B-Instruct-1M-Q4_K_M-GGUF

Text Generation • Updated 14 days ago • 24 • 1

Triangle104/Qwen2.5-14B-Instruct-1M-Q5_K_S-GGUF

Text Generation • Updated 14 days ago • 53 • 2

Triangle104/Qwen2.5-14B-Instruct-1M-Q8_0-GGUF

Text Generation • Updated 14 days ago • 58 • 1