Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

11,188

Full-text search

Active filters: bitsandbytes

tiiuae/falcon-mamba-7b-4bit

Text Generation • Updated Oct 10 • 163 • 11

unsloth/Mistral-Large-Instruct-2407-bnb-4bit

Text Generation • Updated Sep 11 • 327 • 9

unsloth/gemma-2-2b-it-bnb-4bit

Text Generation • Updated Sep 3 • 7.52k • 13

PrunaAI/THUDM-LongWriter-glm4-9b-bnb-4bit-smashed

Updated Aug 16 • 12 • 2

alicekyting/whisper-large-v3-4bit

Automatic Speech Recognition • Updated Aug 22 • 16 • 1

unsloth/Phi-3.5-mini-instruct-bnb-4bit

Text Generation • Updated Aug 20 • 77.4k • 10

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24 • 1.31k • 34

ms57rd/Llama-3.1-8B-quantized-EEG-TimeLLM

Updated Aug 25 • 56 • 7

cmarkea/CodeLlama-34b-Instruct-hf-4bit

Text Generation • Updated Sep 19 • 15 • 1

cmarkea/Meta-Llama-3.1-70B-Instruct-4bit

Text Generation • Updated Sep 19 • 75 • 1

unsloth/c4ai-command-r-08-2024-bnb-4bit

Text Generation • Updated Sep 4 • 90 • 7

sayakpaul/flux.1-dev-nf4-with-bnb-integration

Updated Sep 1 • 199 • 11

Dharine/cropmodel-10k_mistral

Text Generation • Updated Sep 2 • 402 • 2

Solshine/jais-adapted-7b-chat-Natural-Farmer-lora-tuned-model-full

Text Generation • Updated Sep 4 • 19 • 4

unsloth/Llama-3.1-Storm-8B-bnb-4bit

Text Generation • Updated Sep 4 • 2.99k • 2

unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit

Text Generation • Updated Sep 11 • 1.34k • 3

unsloth/Reflection-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 8 • 74 • 15

nicoboss/Meta-Llama-3.1-405B-Instruct-Uncensored-Lora

Updated Sep 14 • 17 • 6

unsloth/Qwen2.5-7B-Instruct-bnb-4bit

Text Generation • Updated Sep 23 • 52.1k • 5

unsloth/Qwen2.5-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 23 • 2.59k • 3

unsloth/Qwen2.5-14B-bnb-4bit

Text Generation • Updated Sep 23 • 3.74k • 4

unsloth/Qwen2.5-14B-Instruct-bnb-4bit

Text Generation • Updated Sep 23 • 7.76k • 1

unsloth/Qwen2.5-Math-7B-bnb-4bit

Text Generation • Updated Sep 23 • 863 • 1

unsloth/Qwen2.5-Coder-1.5B-bnb-4bit

Text Generation • Updated Sep 23 • 1.6k • 1

unsloth/Qwen2.5-Coder-7B-bnb-4bit

Text Generation • Updated Sep 23 • 1.64k • 2

unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit

Text Generation • Updated Sep 23 • 2.53k • 4

velvetScar/llm2vec-llama-3.1-8B

Sentence Similarity • Updated Sep 23 • 15 • 1

unsloth/Qwen2.5-Math-72B-bnb-4bit

Text Generation • Updated Sep 23 • 72 • 1

unsloth/Qwen2.5-Math-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 23 • 332 • 1

mychen76/Llama-3.1_Intuitive-Thinker

Text Generation • Updated Sep 26 • 22 • 2