Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,816

Full-text search

Active filters: awq

QFactor/Hermes-2-Theta-Llama-3-70B-AWQ

Text Generation • Updated Jun 28, 2024 • 203

PrunaAI/readomni-dao-9b-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 12

macadeliccc/Qwen2-7B-AWQ

Text Generation • Updated Jun 28, 2024 • 14

PrunaAI/Symbol-LLM-Symbol-LLM-13B-Instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 11

PrunaAI/victunes-TherapyBeagle-11B-v1-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 15

PrunaAI/internlm-AlchemistCoder-DS-6.7B-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 12

PrunaAI/winglian-llama-3-8b-256k-PoSE-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 10

PrunaAI/llmware-slim-sentiment-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 10

PrunaAI/mayflowergmbh-Wiedervereinigung-7b-dpo-laser-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 10

PrunaAI/sambanovasystems-SambaLingo-Japanese-Base-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 11

PrunaAI/sambanovasystems-SambaLingo-Russian-Base-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 14

Udith-Sandaruwan/Llama-3-8B-AWQ-4bit

Text Generation • Updated Jun 30, 2024 • 11

PrunaAI/mrfakename-refusal-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 10

cc8055/tinyllamafullprecision20k-AWQ

Text Generation • Updated Jul 1, 2024 • 13

DavidHuggingFace/Heimer-dpo-TinyLlama-1.1B-AWQ

Text Generation • Updated Jul 1, 2024 • 14

davidsvaughn/feedback-wizard-4bit-awq

Text Generation • Updated Jul 1, 2024 • 34

internlm/internlm2_5-7b-chat-4bit

Text Generation • Updated Jul 2, 2024 • 96 • 5

Weni/ZeroShot-Agents-Llama3-4.0.42-ORPO-AWQ

Text Generation • Updated Jul 2, 2024 • 12

Udith-Sandaruwan/opt-125m-AWQ-4bit

Text Generation • Updated Jul 2, 2024 • 7

Weni/ZeroShot-Agents-Llama3-4.0.43-ORPO-AWQ

Text Generation • Updated Jul 2, 2024 • 20

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-AWQ

Text Generation • Updated Jul 9, 2024 • 8

Weni/ZeroShot-Agents-Llama3-4.0.44-ORPO-AWQ

Text Generation • Updated Jul 3, 2024 • 13

Weni/ZeroShot-Agents-Llama3-4.0.45-ORPO-AWQ

Text Generation • Updated Jul 3, 2024 • 12

Weni/ZeroShot-Agents-Llama3-4.0.46-ORPO-AWQ

Text Generation • Updated Jul 4, 2024 • 11

OliP/Phi-3-mini-128k-instruct-awq

Text Generation • Updated Jul 9, 2024 • 11 • 2

casperhansen/deepseek-coder-v2-instruct-awq

Text Generation • Updated Jul 3, 2024 • 227 • 11

typealias/internlm2_5-7b-chat-4bit

Text Generation • Updated Jul 3, 2024 • 11

zhiG/Llama-3-Swallow-70B-Instruct-v0.1-awq-4bit

Text Generation • Updated Jul 3, 2024 • 21

PrunaAI/Sao10K-L3-8B-Chara-v1-Alpha-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 12

PrunaAI/eryk-mazus-polka-1.1b-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 12