Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

8,660

Full-text search

Active filters: imatrix

bartowski/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 12k • 50

mradermacher/L3-Dark-Planet-8B-V2-Eight-Orbs-Of-Power-i1-GGUF

Updated Sep 19, 2024 • 34 • 2

DavidAU/Mistral-Small-Instruct-2409-22B-NEO-Imatrix-GGUF

Text Generation • Updated Nov 14, 2024 • 652 • 6

v000000/L3.1-Niitorm-8B-DPO-t0.0001-GGUFs-IMATRIX

Updated Oct 6, 2024 • 70 • 3

bartowski/Llama-3_1-Nemotron-51B-Instruct-GGUF

Text Generation • Updated 11 days ago • 2.66k • 5

mradermacher/magnum-v3-27b-kto-i1-GGUF

Updated Sep 25, 2024 • 403 • 2

mradermacher/Qwen2.5-0.5B-Instruct-i1-GGUF

Updated Oct 11, 2024 • 16 • 1

LPN64/LongCite-llama3.1-8b-GGUF

Text Generation • Updated Oct 1, 2024 • 152 • 6

mradermacher/Llama-3.1-8B-Lexi-Uncensored-V2-i1-GGUF

Updated Sep 27, 2024 • 975 • 6

mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF

Updated Sep 26, 2024 • 1.65k • 5

DavidAU/Llama-3.2-1B-Instruct-NEO-SI-FI-GGUF

Text Generation • Updated Nov 14, 2024 • 667 • 7

DavidAU/Llama-3.2-1B-Instruct-NEO-WEE-HORROR-GGUF

Text Generation • Updated Nov 14, 2024 • 303 • 4

DavidAU/Llama-3.2-3B-Instruct-NEO-SI-FI-GGUF

Text Generation • Updated Nov 14, 2024 • 775 • 5

DavidAU/Llama-3.2-3B-Instruct-NEO-WEE-HORROR-GGUF

Text Generation • Updated Nov 14, 2024 • 631 • 2

mradermacher/T.E-8.1-i1-GGUF

Updated Sep 29, 2024 • 65 • 2

mradermacher/L3.1-Aglow-Vulca-v0.1-8B-i1-GGUF

Updated Sep 29, 2024 • 37 • 2

bartowski/CalmeRys-78B-Orpo-v0.1-GGUF

Text Generation • Updated Sep 30, 2024 • 614 • 5

mradermacher/AA-chameleon-7b-plus-i1-GGUF

Updated Oct 1, 2024 • 293 • 1

mradermacher/Daring-Mythalion-13B-i1-GGUF

Updated 17 days ago • 98 • 1

alfredplpl/gemma-2-2b-jpn-it-gguf

Updated 25 days ago • 1.21k • 16

mradermacher/Llama-3.2-1B-Instruct-Uncensored-i1-GGUF

Updated Oct 11, 2024 • 566 • 3

mradermacher/Mistral-Nemo-Instruct-MCAI-SFT-DPO-revision-only-i1-GGUF

Updated 27 days ago • 184 • 1

mradermacher/Rombos-LLM-V2.5-Qwen-32b-i1-GGUF

Updated Oct 11, 2024 • 1.44k • 1

mradermacher/Rombos-LLM-V2.5-Qwen-72b-i1-GGUF

Updated Oct 11, 2024 • 233 • 2

mradermacher/EVA-Qwen2.5-14B-v0.1-i1-GGUF

Updated Oct 11, 2024 • 263 • 4

webbigdata/gemma-2-2b-jpn-it-translate-gguf

Updated Oct 22, 2024 • 2k • 5

mradermacher/MoE-Girl-1BA-7BT-i1-GGUF

Updated Oct 11, 2024 • 385 • 3

arcee-ai/SuperNova-Medius-GGUF

Updated Oct 17, 2024 • 3.94k • 54

mradermacher/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-MADNESS-i1-GGUF

Updated Oct 11, 2024 • 131 • 2

mradermacher/Orca-2-13b-Alpaca-Uncensored-i1-GGUF

Updated Oct 11, 2024 • 208 • 1