stan-hua/Qwen2-7B-Instruct-LC-SmoothQuant-RTN-W8A16
Updated
•
8
Edit Models filters
Active filters:
compressed-tensors
stan-hua/Qwen2-72B-LC-RTN-W4A16
Updated
•
9
alpindale/Magnum-Picaro-0.7-v2-12b-W8A8-Dynamic-Per-Token
Updated
•
10
nexa-collaboration/output_llama3.2_1b_2of4_stage_finetuning
Updated
•
14
nexa-collaboration/output_llama3.2_1b_2of4_stage_quantization
Updated
•
18
nexa-collaboration/output_llama3-2_1b_2of4_ckpt
Text Generation
•
Updated
•
89
soprasteria/Phi-3.5-vision-instruct-FP8-KV
Updated
•
110
IntervitensInc/Molmo-7B-D-0924-FP8-Dynamic
Updated
•
20
Lekhansh/Llama-3.2-3B-Instruct-combinedTask-extraData-overtrained-merged-W8A8-Dynamic-Per-Token
Updated
•
10
otherhalf-dev/Qwen2-VL-72B-Instruct-abliterated-FP8
Updated
•
2
nm-testing/llama-2-7b-sparse2of4
Updated
•
110
BigHuggyD/KaraKaraWitch_Llama-MiraiFanfare-2-3.3-70B-FP8-Dynamic
Text Generation
•
Updated
•
12
alpindale/magnum-v2-12b-FP8
Updated
•
77
NeoChen1024/Dolphin3.0-Llama3.1-8B-W8A8
Updated
•
9
NeoChen1024/dolphin-2.9.3-mistral-7B-32k-W8A8
Updated
•
9
NeoChen1024/Dolphin3.0-Llama3.1-8B-FP8_DYNAMIC
Updated
•
17
xiaoxixiaoxi/Qwen2.5-32B-Instruct-quantized_w4a16_wy
Updated
•
14
nm-testing/DeepSeek-V2.5-1210-quantized.w4a16
Updated
•
104
neuralmagic/granite-3.1-8b-instruct-FP8-dynamic
Text Generation
•
Updated
•
36
neuralmagic/granite-3.1-2b-instruct-FP8-dynamic
Text Generation
•
Updated
•
16
neuralmagic/granite-3.1-8b-instruct-quantized.w8a8
Text Generation
•
Updated
•
131
neuralmagic/granite-3.1-2b-instruct-quantized.w8a8
Text Generation
•
Updated
•
175
neuralmagic/granite-3.1-2b-instruct-quantized.w4a16
Text Generation
•
Updated
•
205
nm-testing/granite-3.1-3b-a800m-instruct-w4a16
Updated
•
9
ajinkya-tejankar/Llama-3.1-8B-Instruct-FP8-Dynamic
Updated
•
32
nexa-collaboration/output_llama3-1_8b_2of4_ckpt
Text Generation
•
Updated
•
9
nexa-collaboration/output_llama3.1_8b_2of4_stage_quantization
Updated
•
5
nexa-collaboration/output_llama3.1_8b_2of4_stage_finetuning
Updated
•
8
SicariusSicariiStuff/Negative_LLAMA_70B_FP8
Updated
•
11
FINGU-AI/QWEN2.5-32B-2600s-FP8
Updated
•
56