ExceedZhang
/

DeepSeek-R1-Distill-Qwen-14B-W4A16-G128

compressed-tensors

Model card Files Files and versions Community

DeepSeekR1蒸馏Qwen2.5 14B版本经过 Int4 GPTQ Marlin算法量化的版本

Downloads last month: 4

Safetensors

Model size

3.31B params

Tensor type

I64

·

I32

·

BF16

·

Inference API

Unable to determine this model's library. Check the docs .

Model tree for ExceedZhang/DeepSeek-R1-Distill-Qwen-14B-W4A16-G128

Base model

deepseek-ai/DeepSeek-R1-Distill-Qwen-32B

Quantized

(52)

this model

Dataset used to train ExceedZhang/DeepSeek-R1-Distill-Qwen-14B-W4A16-G128