Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,133

Full-text search

Active filters: chat

Qwen/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated Sep 20 • 8.99k • 19

Qwen/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 20 • 11.8k • 24

Qwen/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Sep 20 • 8.4k • 34

bartowski/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 19 • 23.6k • 48

lmstudio-community/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 19 • 750 • 3

bartowski/Qwen2.5-72B-Instruct-exl2

Text Generation • Updated Sep 17 • 89 • 12

bartowski/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated Nov 8 • 7.6k • 26

lmstudio-community/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated Sep 19 • 14.6k • 5

bartowski/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Sep 19 • 2.78k • 5

bartowski/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated Sep 19 • 3.24k • 4

lmstudio-community/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Sep 19 • 11.9k • 7

bartowski/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Sep 19 • 9.47k • 24

bartowski/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • Updated Sep 19 • 8.58k • 7

lmstudio-community/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • Updated Sep 19 • 683 • 2

Qwen/Qwen2-7B-Instruct-MLX

Text Generation • Updated Sep 18 • 293 • 2

Qwen/Qwen2.5-Coder-1.5B-Instruct

Text Generation • Updated Nov 18 • 19.8k • 51

Qwen/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • Updated Nov 12 • 5.63k • 17

bartowski/Qwen2.5-Math-72B-Instruct-GGUF

Text Generation • Updated Sep 19 • 1.51k • 2

lmstudio-community/Qwen2.5-Math-72B-Instruct-GGUF

Text Generation • Updated Sep 19 • 11.7k • 2

mlx-community/Qwen2.5-0.5B-Instruct-4bit

Text Generation • Updated Sep 18 • 271 • 2

bartowski/Qwen2.5-Math-1.5B-Instruct-GGUF

Text Generation • Updated Sep 19 • 616 • 1

mlx-community/Qwen2.5-14B-Instruct-8bit

Text Generation • Updated Sep 18 • 80 • 2

mlx-community/Qwen2.5-7B-Instruct-8bit

Text Generation • Updated Sep 18 • 110 • 3

mlx-community/Qwen2.5-14B-Instruct-4bit

Text Generation • Updated Sep 18 • 60.9k • 4

mlx-community/Qwen2.5-7B-Instruct-4bit

Text Generation • Updated Nov 6 • 28.5k • 7

mlx-community/Qwen2.5-Coder-7B-Instruct-bf16

Text Generation • Updated Sep 18 • 51 • 1

mlx-community/Qwen2.5-Coder-7B-Instruct-4bit

Text Generation • Updated Sep 18 • 90.2k • 2

mlx-community/Qwen2.5-32B-Instruct-8bit

Text Generation • Updated Sep 18 • 75 • 2

mlx-community/Qwen2.5-32B-Instruct-4bit

Text Generation • Updated Sep 18 • 1.35k • 1

gaianet/Qwen2.5-3B-Instruct-GGUF

Text Generation • Updated Sep 19 • 28 • 1