ukung
/

Qwen2-7B-Instruct-GGUF

Inference Endpoints

Model card Files Files and versions Community

Qwen2-7B-Instruct-GGUF

1 contributor

History: 11 commits

ukung's picture

Upload Qwen2-7B-Instruct-q4_k_m.gguf with huggingface_hub

11491a1 verified 5 months ago

.gitattributes

2.17 kB

Upload Qwen2-7B-Instruct-q4_k_m.gguf with huggingface_hub 5 months ago
Qwen2-7B-Instruct-q2_k.gguf

3.02 GB
LFS

Upload Qwen2-7B-Instruct-q2_k.gguf with huggingface_hub 5 months ago
Qwen2-7B-Instruct-q3_k_l.gguf

4.09 GB
LFS

Upload Qwen2-7B-Instruct-q3_k_l.gguf with huggingface_hub 5 months ago
Qwen2-7B-Instruct-q3_k_m.gguf

3.81 GB
LFS

Upload Qwen2-7B-Instruct-q3_k_m.gguf with huggingface_hub 5 months ago
Qwen2-7B-Instruct-q3_k_s.gguf

3.49 GB
LFS

Upload Qwen2-7B-Instruct-q3_k_s.gguf with huggingface_hub 5 months ago
Qwen2-7B-Instruct-q4_0.gguf

4.43 GB
LFS

Upload Qwen2-7B-Instruct-q4_0.gguf with huggingface_hub 5 months ago
Qwen2-7B-Instruct-q4_1.gguf

4.87 GB
LFS

Upload Qwen2-7B-Instruct-q4_1.gguf with huggingface_hub 5 months ago
Qwen2-7B-Instruct-q4_k_m.gguf

4.68 GB
LFS

Upload Qwen2-7B-Instruct-q4_k_m.gguf with huggingface_hub 5 months ago
Qwen2-7B-Instruct-q5_0.gguf

5.32 GB
LFS

Upload Qwen2-7B-Instruct-q5_0.gguf with huggingface_hub 5 months ago
Qwen2-7B-Instruct-q6_k.gguf

6.25 GB
LFS

Upload Qwen2-7B-Instruct-q6_k.gguf with huggingface_hub 5 months ago
Qwen2-7B-Instruct-q8_0.gguf

8.1 GB
LFS

Upload Qwen2-7B-Instruct-q8_0.gguf with huggingface_hub 5 months ago