Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
gptq
AutoTrain Compatible
text-generation-inference
4-bit precision
Inference Endpoints
8-bit precision
custom_code
Merge
Eval Results
Mixture of Experts
text-embeddings-inference
Misc with no match
Carbon Emissions
Apply filters
Models
3,984
Full-text search
Edit filters
Sort: Trending
Active filters:
gptq
Clear all
TheBloke/Yarn-Mistral-7B-128k-GPTQ
Text Generation
•
Updated
Nov 2, 2023
•
51
•
13
TheBloke/deepseek-llm-67b-chat-GPTQ
Text Generation
•
Updated
Nov 29, 2023
•
10
•
5
TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ
Text Generation
•
Updated
Dec 14, 2023
•
137
•
96
TheBloke/Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ
Text Generation
•
Updated
Jan 16
•
1.02k
•
26
explodinggradients/Ragas-critic-llm-Qwen1.5-GPTQ
Text Generation
•
Updated
Apr 8
•
156
•
10
javiagu/KULLM3_GPTQ
Text Generation
•
Updated
May 3
•
39
•
1
mgoin/Meta-Llama-3-70B-Instruct-GPTQ
Text Generation
•
Updated
Apr 18
•
29
•
2
astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit
Text Generation
•
Updated
Apr 22
•
11.5k
•
25
TechxGenus/Meta-Llama-3-70B-Instruct-GPTQ
Text Generation
•
Updated
Apr 19
•
729
•
16
study-hjt/Qwen1.5-32B-Chat-GPTQ-Int8
Text Generation
•
Updated
Apr 26
•
14
•
1
openerotica/Llama-3-lima-nsfw-16k-test-GPTQ
Text Generation
•
Updated
May 17
•
66
•
5
Qwen/Qwen2-72B-Instruct-GPTQ-Int8
Text Generation
•
Updated
30 days ago
•
9.77k
•
14
Qwen/Qwen2-57B-A14B-Instruct-GPTQ-Int4
Text Generation
•
Updated
30 days ago
•
622
•
22
Qwen/Qwen2-1.5B-Instruct-GPTQ-Int4
Text Generation
•
Updated
30 days ago
•
10.1k
•
3
Qwen/Qwen2-1.5B-Instruct-GPTQ-Int8
Text Generation
•
Updated
30 days ago
•
1.27k
•
3
kaitchup/Qwen2-7B-gptq-2bit
Text Generation
•
Updated
Jun 11
•
1
bklynhlth/WillisDiarize-v1-quantized
Text Generation
•
Updated
Aug 14
•
4
•
1
zgce/Yi-1.5-34B-Chat-GPTQ-Int8
Text Generation
•
Updated
Jun 11
•
194
•
1
cstr/Spaetzle-v85-7b-int4-inc
Text Generation
•
Updated
Jun 24
•
4
•
2
ModelCloud/gemma-2-9b-it-gptq-4bit
Text Generation
•
Updated
Jul 9
•
14.2k
•
3
Granther/Gemma-2-9B-Instruct-4Bit-GPTQ
Text Generation
•
Updated
Jul 8
•
460
•
1
neuralmagic/Meta-Llama-3-8B-Instruct-quantized.w8a16
Text Generation
•
Updated
Jul 18
•
601
•
1
neuralmagic/Meta-Llama-3-70B-Instruct-quantized.w8a16
Text Generation
•
Updated
Jul 18
•
236
•
2
AI-MO/NuminaMath-7B-TIR-GPTQ
Text Generation
•
Updated
Jul 9
•
279
•
4
pentagoniac/SEMIKONG-8b-GPTQ
Text Generation
•
Updated
Jul 9
•
497
•
8
model-scope/glm-4-9b-chat-GPTQ-Int4
Text Generation
•
Updated
Jul 17
•
735
•
4
neuralmagic/Qwen2-72B-Instruct-quantized.w4a16
Text Generation
•
Updated
Jul 18
•
289
•
4
parasail-ai/aya-23-8B-GPTQ-4bit
Text Generation
•
Updated
Jul 15
•
15
•
2
ModelCloud/Mistral-Nemo-Instruct-2407-gptq-4bit
Text Generation
•
Updated
Jul 23
•
857
•
3
ModelCloud/DeepSeek-V2-Chat-0628-gptq-4bit
Text Generation
•
Updated
Jul 20
•
176
•
3
Previous
1
2
3
4
...
133
Next