Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,078

Full-text search

Active filters: gptq

Xu-Ouyang/pythia-160m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 12

Xu-Ouyang/pythia-160m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 12

Xu-Ouyang/pythia-160m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 12

Xu-Ouyang/pythia-1b-deduped-int3-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 22, 2024 • 14

Xu-Ouyang/pythia-1.4b-deduped-int3-step129000-GPTQ-wikitext2

Text Generation • Updated Jul 22, 2024 • 13

Xu-Ouyang/pythia-1b-deduped-int3-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 22, 2024 • 13

Xu-Ouyang/pythia-1b-deduped-int3-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 22, 2024 • 13

Xu-Ouyang/pythia-1b-deduped-int3-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 22, 2024 • 12

Xu-Ouyang/pythia-1b-deduped-int4-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 22, 2024 • 12

Xu-Ouyang/pythia-1b-deduped-int4-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 22, 2024 • 13

Xu-Ouyang/pythia-1b-deduped-int4-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 22, 2024 • 12

Xu-Ouyang/pythia-1b-deduped-int4-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 22, 2024 • 12

Xu-Ouyang/pythia-1b-deduped-int4-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 22, 2024 • 13

Xu-Ouyang/pythia-1b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 22, 2024 • 12

Xu-Ouyang/pythia-1b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 22, 2024 • 13

Xu-Ouyang/pythia-1b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 22, 2024 • 13

Xu-Ouyang/pythia-1b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 22, 2024 • 12

Xu-Ouyang/pythia-1b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 22, 2024 • 12

parasail-ai/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Jul 13, 2024 • 104 • 1

Lawnel/Meta-llama-3-8B-GPTQ

Text Generation • Updated Jul 13, 2024 • 12

parasail-ai/aya-23-8B-GPTQ-4bit

Text Generation • Updated Jul 15, 2024 • 6 • 2

gdsaikrishna/Qwen1_7B_base_gptq_int3_g64_wikitext2

Text Generation • Updated Jul 15, 2024 • 11

gdsaikrishna/Qwen1_7B_base_gptq_int3_g32_wikitext2

Text Generation • Updated Jul 15, 2024 • 12

luis5tb/prometheus-eval-8x7b-gptq-marlin

Text Generation • Updated Jul 15, 2024 • 14

HRuiii/Llama-2-7b-GPTQ-8bit

Text Generation • Updated Jul 15, 2024 • 13

HRuiii/Llama-2-7b-GPTQ-4bit

Text Generation • Updated Jul 15, 2024 • 14

Ksgk-fy/maria_v113_gptq_prompt

Text Generation • Updated Jul 15, 2024 • 17

Xu-Ouyang/Qwen-7B-int3-GPTQ-wikitext2

Text Generation • Updated Jul 15, 2024 • 13

Xu-Ouyang/Qwen-7B-int4-GPTQ-wikitext2

Text Generation • Updated Jul 15, 2024 • 17

luis5tb/prometheus-eval-8x7b-gptq-marlin-vmwareds

Text Generation • Updated Jul 16, 2024 • 12