Hugging Face's logo

legraphista
/
Athene-70B-IMat-GGUF

Text Generation
GGUF
English
RLHF
Nexusflow
Athene
Chat Model
quantized
GGUF
quantization
imat
imatrix
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
conversational
Model card Files Community
1
Athene-70B-IMat-GGUF
File size: 4,890 Bytes 
e38138f
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30304a6
90cde5b
3b7d425
8a2e2a6
5a0d465
5c57606
fd8f613
cda89fd
f286219
80593cc
7a633dd
ab32113
f6d614b
4d350c3
b8cb784
abb7746
26d6081
fc6ee56
b805834
150db89
3b8a82d
466f06c
4c61ecb
7f37578
586db47
12648d9
6b95377
80ffbf9
a16e28a
78627a1
14ab3e5
7958017
e92a831
2c6d316
c7577af
4941ac0
46a473c
d346978
312fae1
dbf0f6e
6b94b8f
8c31990
17a556b
e969e64
2e85fc6
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
 
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q8_0/Athene-70B.Q8_0-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q8_0/Athene-70B.Q8_0-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q8_0/Athene-70B.Q8_0-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q6_K/Athene-70B.Q6_K-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q8_0/Athene-70B.Q8_0-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q6_K/Athene-70B.Q6_K-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q6_K/Athene-70B.Q6_K-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.BF16/Athene-70B.BF16-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Athene-70B.BF16/Athene-70B.BF16-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.BF16/Athene-70B.BF16-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.BF16/Athene-70B.BF16-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.BF16/Athene-70B.BF16-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.BF16/Athene-70B.BF16-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.FP16/Athene-70B.FP16-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.FP16/Athene-70B.FP16-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.FP16/Athene-70B.FP16-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.FP16/Athene-70B.FP16-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.FP16/Athene-70B.FP16-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q5_K/Athene-70B.Q5_K-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.FP16/Athene-70B.FP16-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q5_K/Athene-70B.Q5_K-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q5_K/Athene-70B.Q5_K-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q5_K_S/Athene-70B.Q5_K_S-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q5_K_S/Athene-70B.Q5_K_S-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q5_K_S/Athene-70B.Q5_K_S-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Athene-70B.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text