Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Misc with no match

Carbon Emissions

Mixture of Experts

Models

217

Full-text search

Active filters: granite

instructlab/granite-7b-lab-GGUF

Updated Apr 24, 2024 • 2.78k • 24

ibm-granite/granite-20b-code-base-8k

Text Generation • Updated Sep 2, 2024 • 267 • 13

ibm-granite/granite-8b-code-base-4k

Text Generation • Updated Sep 2, 2024 • 362 • 29

ibm-granite/granite-3b-code-base-2k

Text Generation • Updated Sep 2, 2024 • 5.79k • 36

ibm-granite/granite-8b-code-instruct-4k

Text Generation • Updated Sep 2, 2024 • 917 • 108

mlx-community/granite-20b-code-instruct-4bit

Text Generation • Updated May 14, 2024 • 38

mlx-community/granite-20b-code-instruct-8bit

Text Generation • Updated May 14, 2024 • 27

mlx-community/granite-20b-code-base-4bit

Text Generation • Updated May 14, 2024 • 24

mlx-community/granite-20b-code-base-8bit

Text Generation • Updated May 14, 2024 • 23

mlx-community/granite-34b-code-base-4bit

Text Generation • Updated May 14, 2024 • 21 • 1

mlx-community/granite-34b-code-base-8bit

Text Generation • Updated May 14, 2024 • 36 • 1

mlx-community/granite-34b-code-instruct-4bit

Text Generation • Updated May 14, 2024 • 48 • 1

mlx-community/granite-34b-code-instruct-8bit

Text Generation • Updated May 14, 2024 • 25

newsletter/granite-3b-code-instruct-Q6_K-GGUF

Text Generation • Updated May 10, 2024 • 1

newsletter/granite-8b-code-instruct-Q6_K-GGUF

Text Generation • Updated May 10, 2024

newsletter/granite-20b-code-instruct-Q6_K-GGUF

Text Generation • Updated May 10, 2024 • 1

upendrab/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 10, 2024

cobrakenji/granite-8b-code-instruct-Q3_K_M-GGUF

Text Generation • Updated May 11, 2024

cobrakenji/granite-20b-code-instruct-Q5_K_M-GGUF

Text Generation • Updated Jun 10, 2024 • 6

cobrakenji/granite-3b-code-base-Q5_K_M-GGUF

Text Generation • Updated May 11, 2024 • 8

cobrakenji/granite-34b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 10, 2024 • 7 • 2

cpellens/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 11, 2024 • 3

TomWest/granite-8b-code-instruct-Q5_K_S-GGUF

Text Generation • Updated May 13, 2024 • 4

cobrakenji/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 13, 2024 • 1

MoMonir/granite-8b-code-instruct-GGUF

Text Generation • Updated May 14, 2024 • 11

cobrakenji/granite-20b-code-base-Q3_K_M-GGUF

Text Generation • Updated May 16, 2024 • 6

cobrakenji/granite-34b-code-base-Q2_K-GGUF

Text Generation • Updated May 16, 2024 • 6

celek/granite-3b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 16, 2024

mayank-mishra/granite-20b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated May 19, 2024

ibm-granite/granite-20b-code-base-8k-GGUF

Text Generation • Updated Sep 2, 2024 • 22 • 4