Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
TQ2.5-14B-Neon-v1-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
TQ2.5-14B-Neon-v1-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
9137a8419f21bdeeb03aeebe06ab63e2a79b615bcd2a11728ebbd48ad05101b5
537ba53
verified
7 days ago
.gitattributes
Safe
1.91 kB
9137a8419f21bdeeb03aeebe06ab63e2a79b615bcd2a11728ebbd48ad05101b5
7 days ago
README.md
Safe
2.95 kB
9137a8419f21bdeeb03aeebe06ab63e2a79b615bcd2a11728ebbd48ad05101b5
7 days ago
TQ2.5-14B-Neon-v1-GGUF_imatrix.dat
8.56 MB
LFS
9137a8419f21bdeeb03aeebe06ab63e2a79b615bcd2a11728ebbd48ad05101b5
7 days ago
TQ2.5-14B-Neon-v1.Q5_K_M.gguf
Safe
10.5 GB
LFS
4eaaabb7c391869f8e175a3c0604b22f35b0eed758e621805b0164725b003762
7 days ago
TQ2.5-14B-Neon-v1.Q5_K_S.gguf
Safe
10.3 GB
LFS
fbcdf748e57e4e299aaa58911cfec8dc4a029f9cddc856e0156cbc4737f863b4
7 days ago
TQ2.5-14B-Neon-v1.Q6_K.gguf
Safe
12.1 GB
LFS
7dba894466b004b2de4ff34ad66888ec2c0dd8e9487085e667d9e59736c2800d
7 days ago
TQ2.5-14B-Neon-v1.Q8_0.gguf
Safe
15.7 GB
LFS
ce1c05e9a55919994bf2f6bc0a5af7efaacf6ebbf2eaba465347be6f51025583
7 days ago
TQ2.5-14B-Neon-v1.fp16.gguf
Safe
29.5 GB
LFS
ff0906aa1ec20e32f8c4f2cec6853b0c3b3cca3e047ac53225c26686c6c5f068
7 days ago