FINGU-AI/QWEN2.5-32B-2600s-FP8
Updated
•
61
Edit Models filters
Active filters:
compressed-tensors
v2ray/GPT4chan-8B-FP8
Text Generation
•
Updated
•
5
leon-se/Idefics3-8B-Llama3-FP8-Dynamic
Updated
•
36
horheynm/TinyLlama-1.1B-Chat-v1.0-FP8_DYNAMIC-e2e
Updated
•
8
nm-testing/TinyLlama-1.1B-Chat-v1.0-kv_cache_default_tinyllama-e2e
Updated
•
19
nm-testing/Phi-3-mini-4k-instruct-kv_cache_default_phi3-e2e
Updated
•
13
zygi/Qwen2.5-72B-Instruct-abliterated-FP8-Dynamic
Updated
•
43
Infermatic/70B-L3.3-mhnnn-x1-FP8-Dynamic
Text Generation
•
Updated
•
7
noneUsername/huihui-ai-phi-4-abliterated-W8A8
Updated
•
4
nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-Dynamic-compressed
Updated
•
28
nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-Dynamic-uncompressed
Updated
•
20
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-compressed
Updated
•
30
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-uncompressed
Updated
•
14
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-G128-compressed
Updated
•
33
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-G128-uncompressed
Updated
•
17
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Dynamic-Per-Token-compressed
Updated
•
25
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Dynamic-Per-Token-uncompressed
Updated
•
12
nm-testing/llama2.c-stories42M-quantized-fp8-Dynamic
Updated
•
7
nm-testing/TinyLlama-1.1B-Chat-v1.0-sparse2of4_only-e2e
Updated
•
46
nm-testing/TinyLlama-1.1B-Chat-v1.0-sparse2of4_fp8_dynamic-e2e
Updated
•
8
nfunctor/SuperNova-Medius-FP8-Dynamic
Text Generation
•
Updated
•
60
novita-ai/dolphin-2.9.2-qwen2-72b-fp8
Updated
•
48
soprasteria/Lucie-7B-Instruct-FP8-KV
Updated
soprasteria/Mistral-Nemo-Instruct-2407-FP8-KV
Updated
•
70
neuralmagic/granite-3.1-2b-base-quantized.w8a8
Text Generation
•
Updated
•
26
neuralmagic/granite-3.1-2b-base-quantized.w4a16
Text Generation
•
Updated
•
36
neuralmagic/granite-3.1-2b-base-FP8-dynamic
Text Generation
•
Updated
•
40
neuralmagic/granite-3.1-8b-base-quantized.w8a8
Text Generation
•
Updated
•
11
neuralmagic/granite-3.1-8b-base-quantized.w4a16
Text Generation
•
Updated
•
32
stan-hua/Qwen2.5-0.5B-Instruct-LC-RTN-W4A16
Updated
•
4