Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

8,659

Full-text search

Active filters: imatrix

legraphista/Palmyra-Fin-70B-32K-IMat-GGUF

Text Generation • Updated Aug 2, 2024 • 381 • 8

mradermacher/Infinity-Instruct-7M-0729-mistral-7B-i1-GGUF

Updated 27 days ago • 65 • 1

anthracite-org/magnum-v2-12b-gguf

Text Generation • Updated Aug 22, 2024 • 2.61k • 33

Reiterate3680/guns-and-roses-r1-GGUF

Text Generation • Updated Aug 24, 2024 • 2.63k • 4

mradermacher/mistral-nemo-gutenberg-12B-v2-i1-GGUF

Updated Aug 14, 2024 • 62 • 3

bartowski/Hermes-3-Llama-3.1-70B-GGUF

Text Generation • Updated Aug 20, 2024 • 590 • 9

DavidAU/Command-R-01-Ultra-NEO-DARK-HORROR-V1-V2-35B-IMATRIX-GGUF

Text Generation • Updated Nov 14, 2024 • 3.59k • 9

mradermacher/Roleplay-Hermes-3-Llama-3.1-8B-i1-GGUF

Updated Aug 16, 2024 • 428 • 3

mradermacher/Hermes-3-Llama-3.1-70B-i1-GGUF

Updated Aug 16, 2024 • 145 • 2

mradermacher/Hermes-3-Llama-3.1-8B-i1-GGUF

Updated Aug 16, 2024 • 240 • 3

legraphista/Hermes-3-Llama-3.1-8B-IMat-GGUF

Text Generation • Updated Aug 16, 2024 • 243 • 1

ClaudioItaly/Hermes-3-Llama-3.1-8B-Q5_K_M-GGUF

Updated Aug 16, 2024 • 2 • 1

legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF

Text Generation • Updated Aug 16, 2024 • 163 • 1

mradermacher/Nemo-12B-Marlin-v7-i1-GGUF

Updated Aug 17, 2024 • 173 • 2

bartowski/Hermes-3-Llama-3.1-405B-GGUF

Text Generation • Updated Sep 27, 2024 • 1.88k • 12

mradermacher/magnum-v2-72b-i1-GGUF

Updated Sep 8, 2024 • 150 • 5

mradermacher/Chronos-Gold-12B-1.0-i1-GGUF

Updated Sep 16, 2024 • 19.9k • 11

mradermacher/mistral-nemo-gutenberg-12B-v4-i1-GGUF

Updated Aug 23, 2024 • 131 • 2

mradermacher/Nemo-12B-Marlin-v8-i1-GGUF

Updated Aug 24, 2024 • 169 • 3

mradermacher/kainaticulous-rp-7b-i1-GGUF

Updated Sep 8, 2024 • 122 • 2

backyardai/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 30, 2024 • 120 • 2

bartowski/c4ai-command-r-plus-08-2024-GGUF

Text Generation • Updated Aug 30, 2024 • 2.25k • 18

legraphista/c4ai-command-r-plus-08-2024-IMat-GGUF

Text Generation • Updated Aug 31, 2024 • 77 • 6

DavidAU/L3-Dark-Planet-8B-NEO-Imatrix-GGUF

Text Generation • Updated Nov 14, 2024 • 133 • 4

mradermacher/deepseek-coder-1.3b-instruct-i1-GGUF

Updated Sep 3, 2024 • 112 • 1

Ffftdtd5dtft/Hermes-3-Llama-3.1-8B-IQ1_S-GGUF

Updated Sep 4, 2024 • 52 • 1

mradermacher/Exper-Alfa-V1-i1-GGUF

Updated Sep 4, 2024 • 60 • 1

DavidAU/L3-Dark-Planet-Horror-City-8B-NEO-Imatrix-GGUF

Text Generation • Updated Nov 14, 2024 • 171 • 6

mradermacher/New-Dawn-Ultra-Llama-3-70B-32K-v1.0-i1-GGUF

Updated Sep 6, 2024 • 202 • 3

speakleash/Bielik-11B-v2.3-Instruct-GGUF

Text Generation • Updated Nov 26, 2024 • 1.57k • 22