Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

14,697

Full-text search

Active filters: bitsandbytes

prithivMLmods/QwQ-4B-Instruct

Text Generation • Updated 7 days ago • 221 • 8

unsloth/Llama-3.3-70B-Instruct-bnb-4bit

Text Generation • Updated 17 days ago • 121k • 20

sohail-shaikh-s07/distil-gpt-2-ava-test-v1

Text Generation • Updated 3 days ago • 35 • 3

SeanScripts/Molmo-72B-0924-nf4

Image-Text-to-Text • Updated Oct 2 • 502 • 7

ai-sage/GigaChat-20B-A3B-instruct-int8

Updated 10 days ago • 308 • 4

CaioXapelaum/Qwen-2.5-0.5B-Instruct-4bit

Text Generation • Updated 9 days ago • 55 • 2

samadpls/querypls-prompt2sql

Text2Text Generation • Updated Nov 2 • 28 • 6

alignment-handbook/zephyr-7b-sft-qlora

Updated Jan 9 • 425 • 8

Undi95/Llama2-13B-no_robots-alpaca-lora

Text Generation • Updated Nov 17, 2023 • 745 • 10

piotr-ai/polanka-7b-v0.1

Text Generation • Updated Nov 14, 2023 • 1.86k • 8

ramy21/tinyllama2

Text Generation • Updated Dec 22, 2023 • 69 • 1

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11 • 13.1k • 24

ecastera/eva-mistral-dolphin-7b-spanish

Text Generation • Updated Mar 16 • 119 • 11

unsloth/tinyllama-bnb-4bit

Text Generation • Updated Sep 3 • 5.68k • 9

unsloth/solar-10.7b-bnb-4bit

Text Generation • Updated Mar 22 • 86 • 3

roshanrai1304/llama_2_finetune_on_real_estate_data

Text Generation • Updated Feb 1 • 319 • 2

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 752 • 23

Shashwath01/Idefic_medical_VQA_merged_4bit

Image-Text-to-Text • Updated Sep 26 • 53 • 5

NexaAIDev/Octopus-v1-gemma-7B

Text Generation • Updated Apr 3 • 30 • 3

Lightricks/T5-XXL-8bit

Updated Feb 29 • 189 • 4

Rodeszones/CogVLM-grounding-generalist-hf-quant4

Object Detection • Updated Aug 16 • 93 • 9

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27 • 475 • 173

camenduru/EvoVLM-JP-v1-7B-8bit

Image-Text-to-Text • Updated Mar 21 • 14 • 1

ChaimaMess/llama-2-7b-squad

Text Generation • Updated Mar 25 • 32 • 1

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Sep 27 • 398 • 248

Shaleen123/phi-2-maths

Text Generation • Updated Apr 5 • 118 • 2

mistral-community/Mixtral-8x22B-v0.1-4bit

Text Generation • Updated Apr 10 • 96 • 54

Volko76/Qwen1.5-0.5B-French

Updated Apr 11 • 3 • 1

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated Nov 22 • 301k • 189

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated Nov 22 • 44.2k • 131