Volko76
/

Qwen2.5-0.5B-Instruct-4.5bpw-exl2

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Qwen2.5-0.5B-Instruct-4.5bpw-exl2 / out_tensor /model.layers.14.self_attn.k_proj.safetensors

Commit History

Upload folder using huggingface_hub

a352389
verified

Volko76 commited on Nov 3, 2024