Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

40

Full-text search

Active filters: ollama

prithivMLmods/Tulu-MathLingo-8B-GGUF

Text Generation • Updated 1 day ago • 140 • 5

Shyamnath/Llama-3.2-3b-Uncensored-GGUF

Text Generation • Updated Oct 21 • 307 • 3

ghost-x/ghost-8b-beta-1608-gguf

Text Generation • Updated Aug 26 • 272 • 6

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated 18 days ago • 58

mradermacher/Llama-SmolTalk-3.2-1B-Instruct-GGUF

Updated about 1 month ago • 687 • 1

QuantFactory/Llama-SmolTalk-3.2-1B-Instruct-GGUF

Text Generation • Updated about 1 month ago • 950 • 2

bartowski/Llama-SmolTalk-3.2-1B-Instruct-GGUF

Text Generation • Updated 29 days ago • 738 • 1

prithivMLmods/Llama-Magpie-3.2-3B-Instruct-GGUF

Text Generation • Updated 25 days ago • 864 • 8

prithivMLmods/SmolLM2-Math-IIO-1.7B-Instruct

Text Generation • Updated 22 days ago • 120 • 8

hierholzer/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated 14 days ago • 503 • 1

prithivMLmods/Llama-Chat-Summary-3.2-3B-GGUF

Text Generation • Updated 8 days ago • 461 • 7

Float16-cloud/llama3.1-typhoon2-8b-instruct-gguf

Text Generation • Updated 4 days ago • 151 • 1

pacozaa/mistral-unsloth-chatml-first

Updated Apr 14 • 17

pacozaa/tinyllama-alpaca-lora

pacozaa/bonito-gguf

Updated Apr 14 • 5

pacozaa/TinyLlama-1.1B-intermediate-step-1431k-3T-GGUF

Updated Apr 19 • 10

pacozaa/mistral-sharegpt90k

Updated Aug 2 • 6

pacozaa/mistral-sharegpt90k-merged_16bit

Text Generation • Updated Jul 30 • 23

TrabEsrever/dolphin-2.9-llama3-70b-GGUF

daekeun-ml/Phi-3-medium-4k-instruct-ko-poc-gguf-v0.1

Text Generation • Updated May 26 • 19 • 1

hierholzer/Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated 14 days ago • 557 • 3

LucasInsight/Meta-Llama-3.1-8B-Instruct

Updated Aug 20 • 64

LucasInsight/Meta-Llama-3-8B-Instruct

Updated Aug 20 • 24

cahaj/Phi-3.5-mini-instruct-text2sql-GGUF

Updated Aug 29 • 35

Agnuxo/Tinytron-Qwen-0.5B-Instruct_CODE_Python_Spanish_English_16bit

Agnuxo/Tinytron-Qwen-0.5B-TinyLlama-Instruct_CODE_Python-extra_small_quantization_GGUF_3bit

Agnuxo/Tinytron-Qwen-0.5B-Instruct_CODE_Python-Spanish_English_GGUF_4bit

Agnuxo/Tinytron-Qwen-0.5B-TinyLlama-Instruct_CODE_Python-Spanish_English_GGUF_q5_k

Agnuxo/Tinytron-Qwen-0.5B-TinyLlama-Instruct_CODE_Python-Spanish_English_GGUF_q6_k

Agnuxo/Tinytron-Qwen-0.5B-Instruct_CODE_Python-GGUF_Spanish_English_8bit