Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,595

Full-text search

Active filters: awq

agentsea/internlm-xcomposer2-4khd-7b-4bit

Feature Extraction • Updated Jul 15, 2024 • 12

PrunaAI/Locutusque-Llama-3-Orca-2.0-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 17

PrunaAI/ResplendentAI-Aura_v2_7B-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 24

PrunaAI/Qwen-Qwen1.5-1.8B-Chat-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 22

PrunaAI/vonjack-Phi-3-mini-4k-instruct-LLaMAfied-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 7

PrunaAI/soketlabs-pragna-1b-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 20

PrunaAI/BEE-spoke-data-smol_llama-220M-GQA-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 22

PrunaAI/mlabonne-NeuralPipe-7B-slerp-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 23

PrunaAI/qnguyen3-Master-Yi-9B-AWQ-4bit-smashed

Text Generation • Updated Jul 15, 2024 • 18

Ichigo2899/Qwen-CodeQwen1.5-7B-Chat-AWQ

Text Generation • Updated Jul 16, 2024 • 21

PrunaAI/cognitivecomputations-dolphin-2.9.3-mistral-7B-32k-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 21

PrunaAI/DeepMount00-Mistral-RAG-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 21

PrunaAI/ibm-granite-granite-3b-code-instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 31

PrunaAI/DiscoResearch-Llama3-German-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 24

PrunaAI/TheDrummer-Moistral-11B-v4-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 20

PrunaAI/Orenguteng-Llama-3-8B-LexiFun-Uncensored-V1-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 22

SorawitChok/SeaLLM3-7B-Chat-AWQ

Text Generation • Updated Jul 16, 2024 • 260

aws-prototyping/MegaBeam-Mistral-7B-300k-AWQ

Text Generation • Updated Jul 16, 2024 • 25 • 1

PrunaAI/zhengr-MixTAO-7Bx2-MoE-v8.1-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 23

PrunaAI/prometheus-eval-prometheus-7b-v2.0-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 141

huhuaixu/kdd_cup_24_track3

Text Generation • Updated Jul 16, 2024 • 25

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-32k-v0.1-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 20

PrunaAI/cognitivecomputations-Llama-3-8B-Instruct-abliterated-v2-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 24

PrunaAI/Replete-AI-Replete-Coder-Qwen2-1.5b-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 20

DrSri/GLM-4-9b-Quantized-AWQ

Text Generation • Updated Jul 17, 2024 • 19 • 1

AnhQuangNguyen/new-function-calling

Text Generation • Updated Jul 16, 2024 • 20

PrunaAI/NexaAIDev-Octopus-v2-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 18

PrunaAI/stockmark-stockmark-13b-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 23

PrunaAI/yaojialzc-Gigi-Llama3-8B-Chinese-zh-AWQ-4bit-smashed

Text Generation • Updated Jul 16, 2024 • 19

arcee-ai/Arcee-Nova-AWQ

Text Generation • Updated Jul 16, 2024 • 16