Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

14,945

Full-text search

Active filters: llama-cpp

roleplaiapp/FastHunyuan-gguf-Q4_K_M-GGUF

Text Generation • Updated 13 days ago • 26 • 1

itchindigo/NeuralSillyMaid-Q4_K_M-GGUF

Updated 13 days ago • 18 • 1

itchindigo/NeuralLemonKuno-Q4_K_M-GGUF

Updated 13 days ago • 17 • 1

Otakadelic/MT-Gen6fix-gemma-2-9B-Q8_0-GGUF

Text Generation • Updated 13 days ago • 186 • 1

BernTheCreator/GodSlayer-12B-ABYSS-Q4_0-GGUF

Updated 13 days ago • 36 • 1

BarBarickoza/Picaro-MagNante-v4-v1-12b-Q6_K-GGUF

Updated 13 days ago • 28 • 1

Alex01837178373/QVikhr-2.5-1.5B-Instruct-SMPO-Q4_0-GGUF

Updated 12 days ago • 54 • 1

BarBarickoza/Dans-Picaro-MagNante-v4-v1-12b-V3-Q6_K-GGUF

Updated 12 days ago • 51 • 2

mpkmkk/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2-Q4_K_M-GGUF

Updated 12 days ago • 6.7k • 1

matrixportal/Qwen2.5-7B-CelestialHarmony-1M-GGUF

Updated 12 days ago • 99 • 1

Triangle104/DeepSeek-R1-Distill-Qwen-7B-uncensored-Q4_K_M-GGUF

Updated 12 days ago • 474 • 1

Triangle104/Wingless_Imp_8B-Q4_K_S-GGUF

Updated 12 days ago • 27 • 1

Triangle104/Wingless_Imp_8B-Q4_K_M-GGUF

Updated 12 days ago • 27 • 1

Triangle104/Wingless_Imp_8B-Q5_K_S-GGUF

Updated 12 days ago • 22 • 1

Triangle104/Wingless_Imp_8B-Q5_K_M-GGUF

Updated 12 days ago • 26 • 1

Triangle104/Wingless_Imp_8B-Q6_K-GGUF

Updated 12 days ago • 29 • 1

Triangle104/Wingless_Imp_8B-Q8_0-GGUF

Updated 12 days ago • 50 • 1

rafaelldietrich/Mistral-7B-Business-F16-GGUF

Question Answering • Updated 12 days ago • 40 • 1

Triangle104/Gemmasutra-9B-v1.1-Q5_K_M-GGUF

Updated 12 days ago • 26 • 1

Triangle104/Dans-DangerousWinds-V1.1.1-24b-Q4_K_M-GGUF

Updated 12 days ago • 172 • 1

Triangle104/Dans-DangerousWinds-V1.1.1-24b-Q6_K-GGUF

Updated 12 days ago • 309 • 1

Triangle104/Dans-DangerousWinds-V1.1.1-24b-Q8_0-GGUF

Updated 12 days ago • 53 • 1

AlirezaF138/Hormoz-8B-GGUF

Updated 11 days ago • 824 • 1

avemio-digital/German-RAG-HERMES-MOBIUS-R1-LLAMA-Q8_0-GGUF

Updated 11 days ago • 64 • 1

Trappu/Picaro-v1-210-24B-Q5_K_M-GGUF

Updated 11 days ago • 34 • 1

Otakadelic/MT1-Gen6-gemma-2-9B-Q8_0-GGUF

Text Generation • Updated 11 days ago • 59 • 1

NikolayKozloff/Art-Skynet-3B-Q8_0-GGUF

Updated 11 days ago • 84 • 2

NikolayKozloff/Llama-3.1-8B-BeyondReality-Q8_0-GGUF

Updated 11 days ago • 93 • 1

Otakadelic/MT1-Gen6-gemma-2-9B-Q4_K_M-GGUF

Text Generation • Updated 10 days ago • 30 • 1

Sebrom1156/Qwen2.5-Coder-7B-Instruct-Q5_K_S-GGUF

Text Generation • Updated 10 days ago • 51 • 1