Hugging Face's logo

legraphista
/
Qwen2-57B-A14B-Instruct-GGUF

Text Generation
GGUF
English
chat
quantized
GGUF
quantization
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
conversational
Model card Files Community
Qwen2-57B-A14B-Instruct-GGUF
File size: 4,155 Bytes 
317fdef
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
319e9db
f826189
d79efc8
1f5d245
3c1e118
c078253
df2960d
9914a0f
909f0d2
7b42bfe
bf24768
b287bf3
62de764
2ca6d89
404a8b2
f5e48f7
0681a32
efdca4e
2024f8c
4679071
e179b89
689f30c
2243f63
3ea3ece
d8afd9d
7bda79c
bd348f1
97b09ed
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
 
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.Q8_0/Qwen2-57B-A14B-Instruct.Q8_0-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.Q8_0/Qwen2-57B-A14B-Instruct.Q8_0-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.Q8_0/Qwen2-57B-A14B-Instruct.Q8_0-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.Q6_K/Qwen2-57B-A14B-Instruct.Q6_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.Q6_K/Qwen2-57B-A14B-Instruct.Q6_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.BF16/Qwen2-57B-A14B-Instruct.BF16-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.BF16/Qwen2-57B-A14B-Instruct.BF16-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.BF16/Qwen2-57B-A14B-Instruct.BF16-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.BF16/Qwen2-57B-A14B-Instruct.BF16-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.BF16/Qwen2-57B-A14B-Instruct.BF16-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.FP16/Qwen2-57B-A14B-Instruct.FP16-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.FP16/Qwen2-57B-A14B-Instruct.FP16-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.FP16/Qwen2-57B-A14B-Instruct.FP16-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.FP16/Qwen2-57B-A14B-Instruct.FP16-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.FP16/Qwen2-57B-A14B-Instruct.FP16-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-57B-A14B-Instruct.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text