Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,722

Full-text search

Active filters: quantized

jburmeister/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Aug 22 • 36

jburmeister/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Aug 22 • 102

jburmeister/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • Updated Aug 22 • 32

jburmeister/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Aug 22 • 193

MaziyarPanahi/calme-2.1-phi3.5-4b-GGUF

Text Generation • Updated Aug 23 • 262 • 1

legraphista/unsloth-Phi-3.5-mini-instruct-IMat-GGUF

Text Generation • Updated Aug 25 • 321

qualcomm/MediaPipe-Face-Detection-Quantized

Object Detection • Updated 4 days ago

MaziyarPanahi/xLAM-8x22b-r-GGUF

Text Generation • Updated Sep 6 • 601 • 1

legraphista/c4ai-command-r-plus-08-2024-IMat-GGUF

Text Generation • Updated Aug 31 • 1.69k • 5

legraphista/xLAM-7b-r-IMat-GGUF

Text Generation • Updated Aug 31 • 732

legraphista/xLAM-8x7b-r-IMat-GGUF

Text Generation • Updated Aug 31 • 883 • 1

legraphista/xLAM-8x22b-r-IMat-GGUF

Text Generation • Updated Sep 1 • 871

byroneverson/gemma-2-27b-it-abliterated-gguf

Text Generation • Updated Sep 9 • 562 • 12

legraphista/granite-20b-code-instruct-IMat-GGUF

Text Generation • Updated Sep 1 • 659

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated Sep 4 • 951k • 4

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

Text Generation • Updated Sep 4 • 952k • 1

legraphista/Yi-Coder-1.5B-IMat-GGUF

Text Generation • Updated Sep 5 • 167

legraphista/Yi-Coder-1.5B-Chat-IMat-GGUF

Text Generation • Updated Sep 5 • 656

legraphista/Yi-Coder-9B-Chat-IMat-GGUF

Text Generation • Updated Sep 5 • 343 • 1

legraphista/Yi-Coder-9B-IMat-GGUF

Text Generation • Updated Sep 5 • 191

legraphista/Reflection-Llama-3.1-70B-IMat-GGUF

Text Generation • Updated Sep 9 • 1.15k • 8

legraphista/DeepSeek-V2.5-IMat-GGUF

Text Generation • Updated Sep 8 • 915 • 4

legraphista/DeepSeek-Coder-V2-Instruct-0724-IMat-GGUF

Text Generation • Updated Sep 9 • 801 • 2

MaziyarPanahi/DeepSeek-V2.5-GGUF

Text Generation • Updated Sep 11 • 1.07k • 3

MaziyarPanahi/ref_70_e3-GGUF

Text Generation • Updated Sep 10 • 224

legraphista/Llama-3.1-SuperNova-Lite-IMat-GGUF

Text Generation • Updated Sep 11 • 428 • 1

MaziyarPanahi/reader-lm-0.5b-GGUF

Text Generation • Updated Sep 11 • 275 • 2

MaziyarPanahi/reader-lm-1.5b-GGUF

Text Generation • Updated Sep 11 • 278 • 1

legraphista/reader-lm-0.5b-IMat-GGUF

Text Generation • Updated Sep 11 • 487

legraphista/reader-lm-1.5b-IMat-GGUF

Text Generation • Updated Sep 11 • 595