-
-
-
-
-
-
Inference status
Active filters:
int4
ecastera/ecastera-eva-westlake-7b-spanish-int4-gguf
Updated
•
8
•
2
zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w4a4
Text Generation
•
Updated
•
40
•
1
ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v2.5
Text Generation
•
Updated
•
680
•
5
Advantech-EIOT/intel_llama-2-chat-7b
Text Generation
•
Updated
•
7
neuralmagic/zephyr-7b-beta-marlin
Text Generation
•
Updated
•
1.46k
neuralmagic/TinyLlama-1.1B-Chat-v1.0-marlin
Text Generation
•
Updated
•
2.47k
•
1
neuralmagic/OpenHermes-2.5-Mistral-7B-marlin
Text Generation
•
Updated
•
696
•
2
neuralmagic/Nous-Hermes-2-Yi-34B-marlin
Text Generation
•
Updated
•
17
•
5
softmax/Llama-2-70b-chat-hf-marlin
Text Generation
•
Updated
•
195
softmax/falcon-180B-chat-marlin
Text Generation
•
Updated
•
19
study-hjt/Meta-Llama-3-8B-Instruct-GPTQ-Int4
Text Generation
•
Updated
•
38
study-hjt/Meta-Llama-3-70B-Instruct-GPTQ-Int4
Text Generation
•
Updated
•
25
•
6
study-hjt/Meta-Llama-3-70B-Instruct-AWQ
Text Generation
•
Updated
•
17
study-hjt/Qwen1.5-110B-Chat-GPTQ-Int4
Text Generation
•
Updated
•
14
•
2
study-hjt/CodeQwen1.5-7B-Chat-GPTQ-Int4
Text Generation
•
Updated
•
13
study-hjt/Qwen1.5-110B-Chat-AWQ
Text Generation
•
Updated
•
9
modelscope/Yi-1.5-34B-Chat-AWQ
Text Generation
•
Updated
•
25
•
1
modelscope/Yi-1.5-6B-Chat-GPTQ
Text Generation
•
Updated
•
23
modelscope/Yi-1.5-6B-Chat-AWQ
Text Generation
•
Updated
•
26
modelscope/Yi-1.5-9B-Chat-GPTQ
Text Generation
•
Updated
•
21
•
1
modelscope/Yi-1.5-9B-Chat-AWQ
Text Generation
•
Updated
•
20
modelscope/Yi-1.5-34B-Chat-GPTQ
Text Generation
•
Updated
•
35
•
1
jojo1899/Phi-3-mini-128k-instruct-ov-int4
Text Generation
•
Updated
•
15
jojo1899/Llama-2-13b-chat-hf-ov-int4
Text Generation
•
Updated
•
187
jojo1899/Mistral-7B-Instruct-v0.2-ov-int4
Text Generation
•
Updated
•
193
model-scope/glm-4-9b-chat-GPTQ-Int4
Text Generation
•
Updated
•
62
•
6
ModelCloud/Mistral-Nemo-Instruct-2407-gptq-4bit
Text Generation
•
Updated
•
750
•
4
ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit
Text Generation
•
Updated
•
208
•
3
ModelCloud/Meta-Llama-3.1-8B-gptq-4bit
Text Generation
•
Updated
•
30
ModelCloud/Meta-Llama-3.1-70B-Instruct-gptq-4bit
Text Generation
•
Updated
•
199
•
4