Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

9,511

Full-text search

Active filters: imatrix

mradermacher/Chocolatine-14B-Instruct-DPO-v1.2-i1-GGUF

Updated Aug 18, 2024 • 58 • 3

mradermacher/Carasique-v0.3a-i1-GGUF

Updated Aug 18, 2024 • 16 • 1

mradermacher/Mistral-Scary-Story-Finetune-i1-GGUF

Updated Aug 18, 2024 • 6

mradermacher/Dolus-14b-Mini-i1-GGUF

Updated Aug 18, 2024 • 15 • 1

mradermacher/Fireball-MathCoder-Llama-3.1-8B-v1dpo-16bit-i1-GGUF

Updated Aug 18, 2024 • 35

mradermacher/Mahou-Gutenberg-Nemo-12B-i1-GGUF

Updated Aug 18, 2024 • 66 • 2

mradermacher/Carasique-v0.3b-i1-GGUF

Updated Aug 18, 2024 • 26 • 1

MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF

Text Generation • Updated Aug 18, 2024 • 65 • 7

mradermacher/Magnum-Instruct-DPO-12B-i1-GGUF

Updated Aug 18, 2024 • 2 • 1

mradermacher/Swallow-MX-8x7b-NVE-v0.1-i1-GGUF

Updated Aug 18, 2024 • 2

Trisert/Meta-Llama-3.1-8B-Instruct-abliterated-IQ4_NL-GGUF

Updated Aug 18, 2024 • 15

Trisert/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Aug 18, 2024 • 1

anthracite-org/magnum-v2-123b-gguf

Text Generation • Updated Aug 22, 2024 • 501 • 12

mradermacher/L3.1-70b-Inori-i1-GGUF

Updated Aug 19, 2024 • 75 • 1

mradermacher/Fireball-Llama-3.1-8B-Instruct-v1-16bit-i1-GGUF

Updated Aug 19, 2024 • 105

mradermacher/MN-12B-Starcannon-v5-unofficial-i1-GGUF

Updated Aug 19, 2024 • 11 • 1

mradermacher/Samantha-hermes3-8b-model-fixed-i1-GGUF

Updated Aug 19, 2024 • 69 • 1

Cran-May/openbuddy-llama3.1-8b-v22.3-131k-Q4_K_S-GGUF

Text Generation • Updated Aug 19, 2024 • 1

Cran-May/openbuddy-llama3.1-8b-v22.3-131k-Q4_K_M-GGUF

Text Generation • Updated Aug 19, 2024

Reiterate3680/AuraFinal12B-GGUF

Text Generation • Updated Aug 19, 2024 • 1 • 1

OpenBuddy/openbuddy-llama3.1-8b-v22.3-131k-Q4_K_M-GGUF

Text Generation • Updated Aug 19, 2024 • 6

mradermacher/SaulLM-141-Base-i1-GGUF

Updated Aug 25, 2024 • 21

Reiterate3680/Hollow-Tail-V1-12B-GGUF

Text Generation • Updated Aug 19, 2024 • 5 • 1

Cran-May/ghost-8b-beta-1608-Q4_K_M-GGUF

Text Generation • Updated Aug 19, 2024 • 6

cris177/PixelPI_LM

Updated Aug 19, 2024

mradermacher/L3.1-70b-Ginny-i1-GGUF

Updated Aug 20, 2024 • 1

anthracite-org/magnum-v2-72b-gguf

Text Generation • Updated Sep 26, 2024 • 1.07k • 2

DarqueDante/Llama-3.1-8B-Stheno-v3.4-IQ4_XS-GGUF

Updated Aug 19, 2024 • 7

duyntnet/storytime-13b-imatrix-GGUF

Text Generation • Updated Aug 20, 2024 • 145

mradermacher/Llama-3.1-8B-Stheno-v3.4-i1-GGUF

Updated Aug 20, 2024 • 222 • 1