Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

14,714

Full-text search

Active filters: llama-cpp

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q5_K_S-GGUF

Text Generation • Updated 16 days ago • 28 • 1

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q5_K_M-GGUF

Text Generation • Updated 16 days ago • 35 • 1

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q6_K-GGUF

Text Generation • Updated 16 days ago • 316 • 1

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q8_0-GGUF

Text Generation • Updated 16 days ago • 501 • 1

Triangle104/DeepSeek-R1-Distill-Qwen-14B-uncensored-Q4_K_S-GGUF

Updated 16 days ago • 6.96k • 4

Triangle104/DeepSeek-R1-Distill-Qwen-14B-uncensored-Q4_K_M-GGUF

Updated 16 days ago • 2.95k • 1

roleplaiapp/Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q6_K-GGUF

Text Generation • Updated 15 days ago • 225 • 1

roleplaiapp/Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q3_K_L-GGUF

Text Generation • Updated 15 days ago • 1.52k • 1

DoppelReflEx/MN-12B-Kakigori-Q6_K-GGUF

Updated 15 days ago • 59 • 1

Theros/Qwen2.5-ColdBrew-R1-Q4_K_M-GGUF

Updated 15 days ago • 21 • 1

reedmayhew/DeepSeek-R1-2025Navigator-Llama-3.1-8B-hf-Q4_K_M-GGUF

Updated 15 days ago • 55 • 1

NikolayKozloff/Virtuoso-Lite-Q8_0-GGUF

Updated 15 days ago • 8 • 1

NikolayKozloff/Virtuoso-Lite-Q6_K-GGUF

Updated 15 days ago • 10 • 1

ZeroXClem/Qwen2.5-7B-CelestialHarmony-1M-Q4_K_M-GGUF

Updated 15 days ago • 51 • 2

cwjoneill/finetuned_llama3.2-F16-GGUF

Updated 14 days ago • 42 • 1

pradma/DeepSeek-R1-Distill-Qwen-7B-abliterated-Q8_0-GGUF

Updated 14 days ago • 322 • 1

NikolayKozloff/YuE-s1-7B-anneal-en-cot-Q8_0-GGUF

Text Generation • Updated 14 days ago • 15 • 1

NikolayKozloff/YuE-s2-1B-general-Q8_0-GGUF

Text Generation • Updated 14 days ago • 34 • 1

NikolayKozloff/Mistral-Small-24B-Instruct-2501-Q2_K-GGUF

Updated 14 days ago • 153 • 2

NikolayKozloff/Mistral-Small-24B-Instruct-2501-Q3_K_S-GGUF

Updated 14 days ago • 52 • 1

Hasso5703/Mistral-Small-24B-Instruct-2501-Q4_0-GGUF

Updated 14 days ago • 164 • 1

Hasso5703/Mistral-Small-24B-Instruct-2501-Q2_K-GGUF

Updated 14 days ago • 17 • 1

Triangle104/Mistral-Small-24B-Instruct-2501-Q5_K_S-GGUF

Updated 14 days ago • 23 • 1

lolnoyarite/Mistral-Small-24B-Base-2501-Q4_K_M-GGUF

Updated 14 days ago • 283 • 1

IntelligentEstate/Israfel_Qwen2.6-iQ4_K_M-GGUF

Text Generation • Updated 11 days ago • 66 • 2

NikolayKozloff/Llama-3.1-8B-ReasonChatV1-Q8_0-GGUF

Updated 14 days ago • 25 • 1

NikolayKozloff/DeepSeek-R1-ReDistill-Llama3-8B-v1.1-Q8_0-GGUF

Text Generation • Updated 14 days ago • 811 • 1

NikolayKozloff/DeepSeek-R1-ReDistill-Qwen-1.5B-v1.0-Q8_0-GGUF

Text Generation • Updated 14 days ago • 34 • 1

NikolayKozloff/DeepSeek-R1-ReDistill-Qwen-1.5B-v1.1-Q8_0-GGUF

Text Generation • Updated 14 days ago • 126 • 1

Triangle104/DeepSeek-R1-Distill-Qwen-7B-abliterated-Q4_K_M-GGUF

Updated 14 days ago • 1.66k • 2