-
-
-
-
-
-
Inference status
Active filters:
4-bit
TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ
Text Generation
•
Updated
•
8.37k
•
313
TheBloke/airoboros-13B-gpt4-1.4-GPTQ
Text Generation
•
Updated
•
92
•
37
TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
596
•
135
TheBloke/airoboros-13b-gpt4-1.4-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
32
•
31
TheBloke/Manticore-13B-Chat-Pyg-Guanaco-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
739
•
19
TheBloke/Chronoboros-33B-GPTQ
Text Generation
•
Updated
•
51
•
28
TheBloke/Llama-2-7B-GPTQ
Text Generation
•
Updated
•
18.6k
•
80
TheBloke/Llama-2-70B-Chat-GPTQ
Text Generation
•
Updated
•
12.1k
•
259
TheBloke/OpenAssistant-Llama2-13B-Orca-v2-8K-3166-GPTQ
Text Generation
•
Updated
•
21
•
25
TheBloke/MythoMax-L2-13B-GPTQ
Text Generation
•
Updated
•
6.18k
•
181
TheBloke/CodeLlama-7B-Instruct-GPTQ
Text Generation
•
Updated
•
148k
•
44
clibrain/Llama-2-7b-ft-instruct-es-gptq-4bit
Text Generation
•
Updated
•
63
•
9
TheBloke/Phind-CodeLlama-34B-v2-GPTQ
Text Generation
•
Updated
•
177
•
89
casperhansen/opt-125m-awq
Text Generation
•
Updated
•
86
•
2
TheBloke/Mythalion-13B-AWQ
Text Generation
•
Updated
•
11.5k
•
10
TheBloke/WizardLM-7B-uncensored-AWQ
Text Generation
•
Updated
•
50
•
3
TheBloke/storytime-13B-GPTQ
Text Generation
•
Updated
•
383
•
26
TheBloke/Mistral-7B-Instruct-v0.1-AWQ
Text Generation
•
Updated
•
105k
•
35
TheBloke/Mistral-7B-OpenOrca-AWQ
Text Generation
•
Updated
•
6.32k
•
41
TheBloke/Mistral-7B-OpenOrca-GPTQ
Text Generation
•
Updated
•
76.9k
•
100
TheBloke/llava-v1.5-13B-AWQ
Text Generation
•
Updated
•
186
•
31
TheBloke/LLaMA2-13B-Tiefighter-AWQ
Text Generation
•
Updated
•
328
•
37
TheBloke/AquilaChat2-34B-16K-AWQ
Text Generation
•
Updated
•
9
•
4
TheBloke/AquilaChat2-34B-16K-GPTQ
Text Generation
•
Updated
•
12
•
6
TheBloke/Yarn-Mistral-7B-128k-AWQ
Text Generation
•
Updated
•
778
•
69
TheBloke/Yarn-Mistral-7B-128k-GPTQ
Text Generation
•
Updated
•
51
•
13
TheBloke/goliath-120b-AWQ
Text Generation
•
Updated
•
27
•
10
unsloth/llama-2-7b-bnb-4bit
Text Generation
•
Updated
•
9.42k
•
8
TheBloke/deepseek-llm-67b-chat-GPTQ
Text Generation
•
Updated
•
10
•
5
TheBloke/OpenHermes-2.5-neural-chat-7B-v3-2-7B-AWQ
Text Generation
•
Updated
•
40
•
5