Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
light-3B-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
2e5c833
light-3B-GGUF
1 contributor
History:
5 commits
MaziyarPanahi
4f4135f8062d2c371f0e62a10a3657970df67940f4668232a484a859657ad0b7
2e5c833
verified
19 days ago
.gitattributes
1.74 kB
4f4135f8062d2c371f0e62a10a3657970df67940f4668232a484a859657ad0b7
19 days ago
light-3B.Q5_K_M.gguf
2.44 GB
LFS
b01ad70bc078324059bd6242951fde5c601ce56ea3fd5e38a1ad11d70e93deb6
19 days ago
light-3B.Q5_K_S.gguf
2.38 GB
LFS
3c2e7126e0353cf1ab8b7aa2ab7d0ffbdcc2e3f4147eb513b44f60d85e917197
19 days ago
light-3B.Q6_K.gguf
2.79 GB
LFS
331036c27bcc2784dee933de748930fe457c6c931d0ef85a53b84e72f757b660
19 days ago
light-3B.Q8_0.gguf
3.62 GB
LFS
4f4135f8062d2c371f0e62a10a3657970df67940f4668232a484a859657ad0b7
19 days ago
