Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,407

Full-text search

Active filters: 5-bit

DrNicefellow/Qwen2.5-14B-Instruct-5.0bpw-exl2

Updated Sep 21 • 4

DrNicefellow/Qwen2.5-Coder-7B-Instruct-5.0bpw-exl2

Updated Sep 21 • 3

DrNicefellow/Qwen2.5-Math-7B-Instruct-5.0bpw-exl2

Updated Sep 21 • 1

MikeRoz/ArliAI_Llama-3.1-70B-ArliAI-RPMax-v1.1-5.0bpw-h6-exl2

Updated Sep 27 • 2

BigHuggyD/gghfez_SmartMaid-123b_exl2_5.0bpw_h6

riveRiPH/Lyra4-Gutenberg2-12B-5bpw-h6-exl2

Text Generation • Updated Sep 30 • 8

SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-5.0bpw

Updated Oct 1 • 1

Kotokin/Magnum-v1-72b-Qwen2.5-5bpw

Updated Oct 4 • 4

altomek/Llama-3.1-70B-Instruct-5bpw-EXL2

Text Generation • Updated Oct 10 • 4

schnapper79/lumikabra-behemoth-123b-exl2-5.0bpw

Text Generation • Updated Oct 11 • 30

BigHuggyD/TheDrummer_Behemoth-123B-v1_exl2_5.0bpw_h6

Updated Oct 11 • 18

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-5.0-bpw

Updated Oct 11 • 6

Ya211/llamaEXL

Text Generation • Updated about 1 month ago • 12

schnapper79/lumikabra_behemoth_195b-exl2-5.0bpw

Text Generation • Updated 30 days ago • 21

BigHuggyD/schnapper79_lumikabra-195B_v0.3_exl2_5.0bpw_h6

Text Generation • Updated 26 days ago • 23

MaziyarPanahi/Chocolatine-3B-Instruct-DPO-Revised-GGUF

Text Generation • Updated 23 days ago • 257

MaziyarPanahi/Chocolatine-3B-Instruct-DPO-v1.2-GGUF

Text Generation • Updated 23 days ago • 438

MaziyarPanahi/Phi-3-mini-4K-instruct-cpo-simpo-GGUF

Text Generation • Updated 23 days ago • 237

Proverbial1/magnum-v4-123b_exl2_5.0bpw_h8

Text Generation • Updated 22 days ago • 39

MikeRoz/ArliAI_Llama-3.1-70B-ArliAI-RPMax-v1.2-5.0bpw-h6-exl2

Updated 22 days ago • 23

MaziyarPanahi/granite-3.0-2b-instruct-GGUF

Text Generation • Updated 20 days ago • 519

jth01/aya-expanse-8b-5.0bpw-exl2

Text Generation • Updated 19 days ago • 9

async0x42/ArliAI_Mistral-Nemo-12B-ArliAI-RPMax-v1.2-exl2_5bpw

Updated 18 days ago • 11

async0x42/EVA-UNIT-01_EVA-Qwen2.5-32B-v0.0-exl2_5bpw

Text Generation • Updated 17 days ago • 8

async0x42/Gryphe_Pantheon-RP-Pure-1.6.2-22b-Small-exl2_5bpw

Updated 17 days ago • 10

async0x42/TheDrummer_Cydonia-22B-v1.2-exl2_5.0bpw

Updated 17 days ago • 17

async0x42/Rombos-LLM-V2.5-Qwen-32b-exl2_5.0bpw

Text Generation • Updated 17 days ago • 7

James2313123/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS_5bpw-h8-EXL2

Updated 16 days ago • 11

James2313123/L3-DARKEST-PLANET-Seven-Rings-Of-DOOM-16.5B_5bpw-h8-EXL2

Updated 16 days ago • 12

async0x42/Rombos-Coder-V2.5-Qwen-7b-exl2_5.0bpw

Updated 15 days ago • 5