Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
granite-3.2-2b-instruct-abliterated-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
granite-3.2-2b-instruct-abliterated-GGUF
1 contributor
History:
6 commits
MaziyarPanahi
ab7735ea4dacfa47130ac306b669d37d5e1fe2e507738d4a2d3e399f6d867d84
edf11ad
verified
5 days ago
.gitattributes
1.93 kB
ab7735ea4dacfa47130ac306b669d37d5e1fe2e507738d4a2d3e399f6d867d84
5 days ago
README.md
3.14 kB
e70800ab4140cbc9b29971a5f3274cdbbc17a74db055d6d15af536226b82eee6
5 days ago
granite-3.2-2b-instruct-abliterated.Q5_K_M.gguf
1.8 GB
LFS
e70800ab4140cbc9b29971a5f3274cdbbc17a74db055d6d15af536226b82eee6
5 days ago
granite-3.2-2b-instruct-abliterated.Q5_K_S.gguf
1.76 GB
LFS
3d30775d71febb6f5682e4f71dea21804cf6601fde53f6b75735d09c646304d5
5 days ago
granite-3.2-2b-instruct-abliterated.Q6_K.gguf
2.08 GB
LFS
ab7735ea4dacfa47130ac306b669d37d5e1fe2e507738d4a2d3e399f6d867d84
5 days ago
granite-3.2-2b-instruct-abliterated.Q8_0.gguf
2.69 GB
LFS
be74940fd59d0f6d2cfd8a53cc79ca3d0ad508ba1779797ea6930e7948a52d1c
5 days ago
granite-3.2-2b-instruct-abliterated.fp16.gguf
5.07 GB
LFS
f3fc61738d0b7cdf6f7251be649fee6a82f4dec45d182e1122a418af82b0d144
5 days ago
