This is a MLC converted weight from Qwen2.5-Coder-14B-Instruct model in MLC format q4f16_1.

The model can be used for projects MLC-LLM and WebLLM.

Downloads last month
5
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The HF Inference API does not support text-generation models for mlc-llm library.

Model tree for huggingkot/Qwen2.5-Coder-14B-Instruct-q4f16_1-MLC

Base model

Qwen/Qwen2.5-14B
Quantized
(66)
this model

Collection including huggingkot/Qwen2.5-Coder-14B-Instruct-q4f16_1-MLC