Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

8,659

Full-text search

Active filters: imatrix

mradermacher/DeepSeek-V2-Lite-Chat-i1-GGUF

Updated Aug 2, 2024 • 786 • 1

mradermacher/Llama3-UmbralMind-v1-15M-i1-GGUF

Updated 27 days ago • 131 • 2

mradermacher/L3-Umbral-Mind-RP-v3.0-8B-i1-GGUF

Updated Aug 2, 2024 • 92 • 6

mradermacher/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-i1-GGUF

Updated Aug 2, 2024 • 622 • 3

mradermacher/ArliAI-Llama-3-8B-Formax-v1.0-i1-GGUF

Updated 27 days ago • 150 • 1

mradermacher/L3-8B-Stheno-v3.2-abliterated-i1-GGUF

Updated Aug 2, 2024 • 161 • 4

mradermacher/Mahou-1.3d-mistral-7B-i1-GGUF

Updated 24 days ago • 180 • 1

lmstudio-community/mathstral-7B-v0.1-GGUF

Text Generation • Updated Jul 16, 2024 • 3.63k • 9

catbash/Mistral-7B-v0.1-flashback-v2-instruct-Q5_K_M-GGUF

Text Generation • Updated Jul 17, 2024 • 15 • 2

DavidAU/12-X-Quants-of-13B-Tiefighter-NEO-V3-GGUF

Text Generation • Updated Nov 14, 2024 • 306 • 1

mradermacher/gemma-2-9b-it-SimPO-i1-GGUF

Updated Aug 2, 2024 • 177 • 7

mradermacher/saiga_gemma2_10b-i1-GGUF

Updated 27 days ago • 196 • 3

mradermacher/L3-Himerus-Basis.C-13B-i1-GGUF

Updated 27 days ago • 56 • 1

bartowski/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29, 2024 • 2.68k • 57

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29, 2024 • 2.61M • 38

mmnga/Llama-3.1-70B-Instruct-gguf

Updated Jul 24, 2024 • 174 • 2

lmstudio-community/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 28, 2024 • 342 • 37

legraphista/Mistral-Large-Instruct-2407-IMat-GGUF

Text Generation • Updated Jul 25, 2024 • 559 • 30

lmstudio-community/Phi-3.1-mini-128k-instruct-GGUF

Text Generation • Updated Jul 25, 2024 • 3.8k • 4

mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF

Updated Aug 2, 2024 • 1.46k • 10

mradermacher/Meta-Llama-3.1-13B-Instruct-abliterated-i1-GGUF

Updated Aug 2, 2024 • 377 • 4

mradermacher/L3-TheGreenLion-8b-SFT-v0.1.2-i1-GGUF

Updated 27 days ago • 50 • 1

mradermacher/G2-DA-Nyxora-27b-V2-i1-GGUF

Updated Aug 2, 2024 • 161 • 1

mradermacher/Nemomix-v0.1-12B-i1-GGUF

Updated 27 days ago • 102 • 2

mradermacher/Gemmasutra-Pro-27B-v1-i1-GGUF

Updated Aug 2, 2024 • 138 • 1

lmstudio-community/gemma-2-2b-it-GGUF

Text Generation • Updated Jul 31, 2024 • 7.83k • 20

ThomasBaruzier/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 17, 2024 • 110 • 2

mradermacher/llama3-8b-cpt-sea-lionv2-instruct-i1-GGUF

Updated 27 days ago • 75 • 1

mradermacher/MN-12B-Starcannon-v2-i1-GGUF

Updated 27 days ago • 256 • 8

Reiterate3680/MN-12B-Starcannon-v2-GGUF

Text Generation • Updated Aug 5, 2024 • 7 • 2