Edit Models filters

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

14,159

Full-text search

Active filters: llama-cpp

NikolayKozloff/Human-Like-Mistral-Nemo-Instruct-2407-Q8_0-GGUF

Text Generation • Updated 19 days ago • 24 • 1

NikolayKozloff/Human-Like-Mistral-Nemo-Instruct-2407-Q6_K-GGUF

Text Generation • Updated 19 days ago • 7 • 1

NikolayKozloff/Human-Like-Mistral-Nemo-Instruct-2407-Q5_K_M-GGUF

Text Generation • Updated 19 days ago • 15 • 1

NikolayKozloff/Human-Like-LLama3-8B-Instruct-Q8_0-GGUF

Text Generation • Updated 19 days ago • 30 • 1

NikolayKozloff/Human-Like-Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • Updated 19 days ago • 34 • 1

ClaudioItaly/1852-Dark-9B-Q4_K_M-GGUF

Updated 19 days ago • 20 • 1

benhaotang/phi4-qwq-sky-t1-Q4_K_M-GGUF

Updated 18 days ago • 103 • 1

IAmTheCollector/MN-Slush-GGLD-Wayfarer-GGUF

Updated 18 days ago • 125 • 2

matrixportal/llama3-8B-DarkIdol-2.2-Uncensored-1048K-GGUF

Updated 18 days ago • 423 • 1

Triangle104/internlm3-8b-instruct-abliterated-Q5_K_M-GGUF

Text Generation • Updated 17 days ago • 40 • 1

Triangle104/EVA-Qwen2.5-14B-v0.2-Q4_K_M-GGUF

Updated 17 days ago • 32 • 1

Triangle104/Q2.5-EvaHumane-RP-Q4_K_M-GGUF

Updated 17 days ago • 37 • 1

ClaudioItaly/1800-9B-V3-Q4_K_M-GGUF

Updated 17 days ago • 53 • 1

NikolayKozloff/NxMobileLM-1.5B-SFT-Q8_0-GGUF

Text Generation • Updated 17 days ago • 31 • 2

vinhnx90/llama-3-8b-bnb-4bit-F16-GGUF

Updated 17 days ago • 34 • 1

Triangle104/EVA-Qwen2.5-32B-v0.2-Q5_K_M-GGUF

Updated 16 days ago • 54 • 1

roleplaiapp/AceInstruct-7B-Q2_K-GGUF

Text Generation • Updated 16 days ago • 38 • 1

NikolayKozloff/Art-v0-3B-Q8_0-GGUF

Updated 16 days ago • 28 • 1

Triangle104/Annunaki-12b-Q4_K_M-GGUF

Updated 16 days ago • 33 • 1

ClaudioItaly/Vangelus-Secundus-Q4_K_M-GGUF

Updated 15 days ago • 23 • 1

NikolayKozloff/DeepSeek-R1-Distill-Llama-8B-Q8_0-GGUF

Updated 15 days ago • 401 • 1

manarj789/DeepSeek-R1-Distill-Qwen-32B-Q8_0-GGUF

Updated 15 days ago • 254 • 1

NikolayKozloff/DeepSeek-R1-Distill-Qwen-7B-Q8_0-GGUF

Updated 15 days ago • 412 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q4_0-GGUF

Text Generation • Updated 15 days ago • 2.97k • 2

roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Q4_K_S-GGUF

Text Generation • Updated 15 days ago • 117 • 1

roleplaiapp/DeepSeek-R1-Distill-Qwen-7B-Q3_K_S-GGUF

Text Generation • Updated 15 days ago • 43 • 1

NikolayKozloff/DeepSeek-R1-Distill-Qwen-14B-Q5_K_M-GGUF

Updated 15 days ago • 239 • 2

roleplaiapp/DeepSeek-R1-Distill-Qwen-14B-Q8_0-GGUF

Text Generation • Updated 15 days ago • 365 • 1

NikolayKozloff/DeepSeek-R1-Distill-Qwen-1.5B-Q8_0-GGUF

Updated 15 days ago • 207 • 1

roleplaiapp/DeepSeek-R1-Distill-Qwen-7B-Q4_0-GGUF

Text Generation • Updated 15 days ago • 734 • 1