v2ray/GPT4chan-8B-FP8
Text Generation
•
Updated
•
4
Edit Models filters
Active filters:
compressed-tensors
leon-se/Idefics3-8B-Llama3-FP8-Dynamic
Updated
•
36
horheynm/TinyLlama-1.1B-Chat-v1.0-FP8_DYNAMIC-e2e
Updated
•
7
nm-testing/TinyLlama-1.1B-Chat-v1.0-kv_cache_default_tinyllama-e2e
Updated
•
12
nm-testing/Phi-3-mini-4k-instruct-kv_cache_default_phi3-e2e
Updated
•
9
zygi/Qwen2.5-72B-Instruct-abliterated-FP8-Dynamic
Updated
•
42
Infermatic/70B-L3.3-mhnnn-x1-FP8-Dynamic
Text Generation
•
Updated
•
6
noneUsername/huihui-ai-phi-4-abliterated-W8A8
Updated
•
4
nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-Dynamic-compressed
Updated
•
26
nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-Dynamic-uncompressed
Updated
•
18
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-compressed
Updated
•
28
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-uncompressed
Updated
•
12
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-G128-compressed
Updated
•
31
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-G128-uncompressed
Updated
•
15
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Dynamic-Per-Token-compressed
Updated
•
23
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Dynamic-Per-Token-uncompressed
Updated
•
10
nm-testing/llama2.c-stories42M-quantized-fp8-Dynamic
Updated
•
5
nm-testing/TinyLlama-1.1B-Chat-v1.0-sparse2of4_only-e2e
Updated
•
28
nm-testing/TinyLlama-1.1B-Chat-v1.0-sparse2of4_fp8_dynamic-e2e
Updated
•
5
nfunctor/SuperNova-Medius-FP8-Dynamic
Text Generation
•
Updated
•
59
novita-ai/dolphin-2.9.2-qwen2-72b-fp8
Updated
•
47
soprasteria/Lucie-7B-Instruct-FP8-KV
Updated
soprasteria/Mistral-Nemo-Instruct-2407-FP8-KV
Updated
•
70
neuralmagic/granite-3.1-2b-base-quantized.w8a8
Text Generation
•
Updated
•
15
neuralmagic/granite-3.1-2b-base-quantized.w4a16
Text Generation
•
Updated
•
22
neuralmagic/granite-3.1-2b-base-FP8-dynamic
Text Generation
•
Updated
•
14
neuralmagic/granite-3.1-8b-base-quantized.w8a8
Text Generation
•
Updated
•
7
neuralmagic/granite-3.1-8b-base-quantized.w4a16
Text Generation
•
Updated
•
22
stan-hua/Qwen2.5-0.5B-Instruct-LC-RTN-W4A16
Updated
•
3
stan-hua/Qwen2.5-0.5B-Instruct-LC-RTN-W8A8
Updated
•
3