Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

8,658

Full-text search

Active filters: imatrix

mradermacher/Phoenix-i1-GGUF

Updated 27 days ago • 364 • 1

Lewdiculous/llama3-8B-aifeifei-1.2-GGUF-IQ-Imatrix

Updated Jun 8, 2024 • 4 • 2

Lewdiculous/llama3-8B-aifeifei-1.3-GGUF-IQ-Imatrix

Updated Jun 12, 2024 • 21 • 3

InferenceIllusionist/L3-70B-Euryale-v2.1-iMat-GGUF

Updated Jun 15, 2024 • 281 • 1

DavidAU/Psyonic-Cetacean-Ultra-Quality-20b-GGUF-imat-plus2

Text Generation • Updated Nov 14, 2024 • 92 • 6

mradermacher/Hathor_RP-v.01-L3-8B-i1-GGUF

Updated 27 days ago • 130 • 2

mradermacher/Samantha-Qwen2-7B-i1-GGUF

Updated 27 days ago • 130 • 2

legraphista/DeepSeek-Coder-V2-Lite-Instruct-IMat-GGUF

Text Generation • Updated Jun 17, 2024 • 841 • 6

mradermacher/Storm-7B-i1-GGUF

Updated Aug 2, 2024 • 154 • 1

mradermacher/magnum-72b-v1-i1-GGUF

Updated 27 days ago • 448 • 10

mradermacher/L3-Nymeria-15B-i1-GGUF

Updated Aug 2, 2024 • 191 • 11

mradermacher/NeuralStar_Story-9b-i1-GGUF

Updated 28 days ago • 277 • 2

mradermacher/Domain-Fusion-L3-8B-i1-GGUF

Updated 27 days ago • 250 • 2

bartowski/DeepSeek-Coder-V2-Instruct-GGUF

Text Generation • Updated Jun 23, 2024 • 63 • 28

mradermacher/Prox-Llama-3-8B-i1-GGUF

Updated Aug 2, 2024 • 217 • 1

mradermacher/Hathor_Unstable-L3-8B-v0.3-i1-GGUF

Updated 27 days ago • 210 • 1

mradermacher/Hathor_Enigmatica-L3-8B-v0.4-i1-GGUF

Updated 27 days ago • 173 • 1

mradermacher/Llama3-Sophie-i1-GGUF

Updated 27 days ago • 135 • 2

DavidAU/TinyLlama-1.1B-Chat-v1.0-Ultra-NEO-V1-Imatrix-GGUF

Text Generation • Updated Nov 14, 2024 • 102 • 1

mradermacher/L3-8B-Lunaris-v1-i1-GGUF

Updated Aug 2, 2024 • 1.07k • 13

mradermacher/Yi-34B-i1-GGUF

Updated about 1 month ago • 94 • 1

bartowski/gemma-2-27b-it-GGUF

Text Generation • Updated Aug 3, 2024 • 39.2k • 162

lmstudio-community/gemma-2-9b-it-GGUF

Text Generation • Updated Jul 16, 2024 • 8.03k • 21

lmstudio-community/gemma-2-27b-it-GGUF

Text Generation • Updated Jul 2, 2024 • 7.57k • 11

grapevine-AI/gemma-2-27b-it-gguf

Updated Oct 26, 2024 • 490 • 13

mradermacher/QuartetAnemoi-70B-t0.0001-i1-GGUF

Updated Aug 2, 2024 • 280 • 9

mradermacher/MG-FinalMix-72B-i1-GGUF

Updated Aug 2, 2024 • 12 • 2

mradermacher/llama3-8B-DarkIdol-2.2-Uncensored-1048K-i1-GGUF

Updated Aug 2, 2024 • 462 • 5

lmstudio-community/Phi-3.1-mini-4k-instruct-GGUF

Text Generation • Updated Aug 1, 2024 • 1.51k • 23

mradermacher/L3-8B-Everything-COT-i1-GGUF

Updated Aug 2, 2024 • 77 • 1