-
-
-
-
-
-
Inference status
Active filters:
quark
fxmarty/llama-tiny-testing-quark-indev
fxmarty/llama-tiny-int4-per-group-sym
Updated
•
10
fxmarty/llama-tiny-w-fp8-a-fp8
fxmarty/llama-tiny-w-fp8-a-fp8-o-fp8
fxmarty/llama-tiny-w-int8-per-tensor
fxmarty/llama-small-int4-per-group-sym-awq
Updated
•
15
fxmarty/quark-legacy-int8
Updated
•
19
fxmarty/llama-tiny-w-int8-b-int8-per-tensor
Updated
•
13
fxmarty/llama-small-int4-per-group-sym-awq-old
amd-quark/llama-tiny-w-int8-per-tensor
Updated
•
239
amd-quark/llama-tiny-w-int8-b-int8-per-tensor
Updated
•
239
amd-quark/llama-tiny-w-fp8-a-fp8
Updated
•
237
amd-quark/llama-tiny-w-fp8-a-fp8-o-fp8
Updated
•
240
amd-quark/llama-tiny-int4-per-group-sym
Updated
•
237
amd-quark/llama-small-int4-per-group-sym-awq
Updated
•
239
amd-quark/quark-legacy-int8
Updated
•
208
amd/Llama-3.1-8B-Instruct-FP8-KV-Quark-test
Updated
•
415
amd/Llama-3.1-8B-Instruct-w-int8-a-int8-sym-test
EmbeddedLLM/Llama-3.1-8B-Instruct-w_fp8_per_channel_sym
Text Generation
•
Updated
•
4