Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

105,963

Full-text search

Active filters: conversational

mradermacher/Fusion2-14B-Instruct-i1-GGUF

Updated Dec 6, 2024 • 4 • 1

mlx-community/Llama-3.3-70B-Instruct-3bit

Text Generation • Updated Dec 6, 2024 • 1.63k • 5

mlx-community/Llama-3.3-70B-Instruct-6bit

Text Generation • Updated Dec 6, 2024 • 259 • 5

mlx-community/Llama-3.3-70B-Instruct-8bit

Text Generation • Updated Dec 6, 2024 • 3.31k • 9

mradermacher/Qwen2.5-Math-14B-Instruct-Alpha-GGUF

Updated Dec 6, 2024 • 54 • 1

casperhansen/llama-3.3-70b-instruct-awq

Text Generation • Updated Dec 6, 2024 • 39.9k • 22

mmnga/Llama-3.3-70B-Instruct-gguf

Updated Dec 7, 2024 • 5.22k • 3

mradermacher/MedWest-7B-GGUF

Updated Dec 7, 2024 • 18 • 1

ibm-granite/granite-3.1-2b-instruct

Text Generation • Updated 23 days ago • 11k • 19

yujiepan/llama-3.3-tiny-random

Text Generation • Updated Dec 6, 2024 • 362 • 1

ibm-granite/granite-3.1-1b-a400m-instruct

Text Generation • Updated 23 days ago • 4.24k • 10

yujiepan/hymba-tiny-random

Text Generation • Updated Dec 6, 2024 • 29 • 1

unsloth/Qwen2-VL-2B

Image-Text-to-Text • Updated Dec 6, 2024 • 168 • 1

kadirnar/Llama3.3-70b-Vision

Text Generation • Updated Dec 7, 2024 • 112 • 6

kadirnar/Llama-3.2-1B-Vision

Text Generation • Updated Dec 6, 2024 • 57 • 1

mradermacher/MedWest-7B-i1-GGUF

Updated Dec 7, 2024 • 20 • 1

osllmai-community/Llama-3.3-70B-Instruct

Text Generation • Updated Dec 10, 2024 • 195 • 1

mradermacher/NekoMix-12B-i1-GGUF

Updated Dec 7, 2024 • 243 • 2

DevQuasar/meta-llama.Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 8, 2024 • 630 • 3

ibm-granite/granite-3.0-8b-lora-intrinsics-v0.1

Text Generation • Updated 18 days ago • 23 • 1

mradermacher/Llama-3.3-70B-Instruct-GGUF

Updated 27 days ago • 189 • 3

mradermacher/Llama-3.3-70B-Instruct-i1-GGUF

Updated Dec 8, 2024 • 5.43k • 4

tensorblock/Qwen2.5-3B-Instruct-Uncensored-Test-GGUF

Updated Dec 7, 2024 • 543 • 1

suayptalha/FastLlama-3.2-1B-Instruct

Text Generation • Updated 20 days ago • 1.05k • 11

sapienzanlp/Minerva-7B-instruct-v1.0-GGUF

Text Generation • Updated Dec 7, 2024 • 150 • 3

ThomasBaruzier/Llama-3.3-70B-Instruct-GGUF

Updated 27 days ago • 5.86k • 1

issai/LLama-3.1-KazLLM-1.0-70B

Text Generation • Updated Dec 9, 2024 • 288 • 7

issai/LLama-3.1-KazLLM-1.0-70B-AWQ4

Text Generation • Updated Dec 10, 2024 • 81 • 2

mradermacher/MT1-Gen3-BB-gemma-2-MTg2S2-9B-GGUF

Updated Dec 7, 2024 • 6 • 1

Lucy-in-the-Sky/deepthought-8b-abliterated-Q8_0-GGUF

Question Answering • Updated Dec 7, 2024 • 114 • 2