Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,402

Full-text search

Active filters: 5-bit

SicariusSicariiStuff/PygmalionAI_pygmalion-7b-EXL2-5.0bpw

Text Generation • Updated Aug 20 • 2

LoneStriker/Phi-3.5-mini-instruct-5.0bpw-h6-exl2

Text Generation • Updated Aug 20 • 13

drexample/magnum-v2-123b-exl2-5.0bpw

Text Generation • Updated Aug 21 • 6 • 1

jburmeister/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Aug 22 • 36

jburmeister/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Aug 22 • 102

jburmeister/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Aug 22 • 193

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_5.0bpw_h6

Text Generation • Updated Aug 22 • 17

SicariusSicariiStuff/Phi-3.5-mini-instruct_Uncensored-EXL2-5.0bpw

Text Generation • Updated Aug 24 • 4

MaziyarPanahi/calme-2.1-phi3.5-4b-GGUF

Text Generation • Updated Aug 23 • 262 • 1

bullerwins/Hermes-3-Llama-3.1-8B-exl2_5.0bpw

bullerwins/Hermes-3-Llama-3.1-70B-exl2_5.0bpw

SicariusSicariiStuff/2B-ad-EXL2-5.0bpw

yiximail/L3.1-70B-Euryale-v2.2-5bpw-h6-exl2

Updated Aug 28 • 5

MaziyarPanahi/xLAM-8x22b-r-GGUF

Text Generation • Updated Sep 6 • 601 • 1

pigfoot/Llama-3-Taiwan-8B-Instruct-V1-5bpw-exl2

Text Generation • Updated Aug 30 • 7

LoneStriker/LongWriter-llama3.1-8b-5.0bpw-h6-exl2

Text Generation • Updated Aug 30 • 5

MikeRoz/c4ai-command-r-plus-08-2024-5.0bpw-h8-exl2

Text Generation • Updated Sep 1 • 7 • 1

bullerwins/c4ai-command-r-08-2024-exl2_5.0bpw

Text Generation • Updated Aug 31 • 16

Proverbial1/Luminum-v0.1-123B_exl2_5.0bpw_h8

Text Generation • Updated Sep 1 • 25

BigHuggyD/c4ai-command-r-plus-08-2024_exl2_5.0bpw_h6

Text Generation • Updated Sep 1 • 6

bullerwins/c4ai-command-r-plus-08-2024-exl2_5.0bpw

Text Generation • Updated Sep 2 • 15

bigstorm/Mistral-Large-Instruct-2407-5.0bpw-8hb-exl2

Updated Sep 4 • 2

BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_5.0bpw_h6

Text Generation • Updated Sep 7 • 11

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated Sep 4 • 951k • 4

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

Text Generation • Updated Sep 4 • 952k • 1

LoneStriker/Yi-Coder-9B-Chat-5.0bpw-h6-exl2

Text Generation • Updated Sep 4 • 5

LoneStriker/Yi-Coder-9B-5.0bpw-h6-exl2

Updated Sep 4 • 2

bullerwins/Reflection-70B-exl2_5.0bpw

Text Generation • Updated Sep 6 • 11 • 1

LoneStriker/Reflection-Llama-3.1-70B-5.0bpw-h6-exl2

Text Generation • Updated Sep 6 • 9

MaziyarPanahi/DeepSeek-V2.5-GGUF

Text Generation • Updated Sep 11 • 1.07k • 3