Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,595

Full-text search

Active filters: awq

infly/INF-34B-Chat-AWQ

Text Generation • Updated Jul 25, 2024 • 14 • 3

PrunaAI/AI-MO-NuminaMath-7B-TIR-AWQ-4bit-smashed

Text Generation • Updated Jul 18, 2024 • 9

Ichigo2899/mistralai-Mistral-Nemo-Instruct-2407-AWQ

Text Generation • Updated Jul 18, 2024 • 32 • 1

PrunaAI/keeeeenw-MicroLlama-AWQ-4bit-smashed

Text Generation • Updated Jul 18, 2024 • 6

PrunaAI/unsloth-gemma-7b-it-AWQ-4bit-smashed

Text Generation • Updated Jul 18, 2024 • 9

PrunaAI/sethuiyer-Medichat-Llama3-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 7

hsan512/vistral_lora_merged_ver3-awq

Text Generation • Updated Jul 19, 2024 • 7

linl03/Llama-3-8B-AWQ-4bit

Text Generation • Updated Jul 19, 2024 • 9

PrunaAI/abacaj-llama-161M-100B-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 10

PrunaAI/dmis-lab-meerkat-7b-v1.0-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 7

PrunaAI/h2oai-h2o-danube3-500m-base-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 9

PrunaAI/amazon-MegaBeam-Mistral-7B-300k-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 8

PrunaAI/sail-Sailor-0.5B-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 11

PrunaAI/unsloth-Phi-3-medium-4k-instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 11

PrunaAI/unsloth-llama-3-8b-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 11

PrunaAI/ChaoticNeutrals-Poppy_Porpoise-v0.7-L3-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 5

PrunaAI/cognitivecomputations-dolphin-2.9.3-llama-3-8b-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 10

PrunaAI/Vikhrmodels-Vikhr-7B-instruct_0.4-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 9

PrunaAI/HuggingFaceTB-SmolLM-1.7B-Instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 7

PrunaAI/01-ai-Yi-6B-Chat-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 7

PrunaAI/flammenai-Mahou-1.2-llama3-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 12

broyal/gemma-7b-AWQ

Text Generation • Updated Jul 19, 2024 • 11

PrunaAI/ajibawa-2023-Code-Llama-3-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 9

PrunaAI/nayohan-llama3-instrucTrans-enko-8b-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 13

PrunaAI/instructlab-merlinite-7b-lab-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 8

google/gemma-7b-AWQ

Text Generation • Updated Jul 23, 2024 • 14

AnthonyDi/parserNemoAWQ

Text Generation • Updated Jul 19, 2024 • 8

PrunaAI/dicta-il-dictalm2.0-instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 20, 2024 • 6

lk11/Llama-3-8B-AWQ-4bit

Text Generation • Updated Jul 24, 2024 • 6

PrunaAI/LumiOpen-Viking-7B-AWQ-4bit-smashed

Text Generation • Updated Jul 20, 2024 • 9