Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Phi-3-mini-4k-instruct-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
Phi-3-mini-4k-instruct-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
4ca757ad8d143873db23a068ca8dce0b0af44092433f19391f6589b3062efefa
1127436
verified
26 days ago
.gitattributes
Safe
1.94 kB
4ca757ad8d143873db23a068ca8dce0b0af44092433f19391f6589b3062efefa
26 days ago
Phi-3-mini-4k-instruct-GGUF_imatrix.dat
3.42 MB
LFS
4ca757ad8d143873db23a068ca8dce0b0af44092433f19391f6589b3062efefa
26 days ago
Phi-3-mini-4k-instruct.Q5_K_M.gguf
Safe
2.72 GB
LFS
53f9b6ee73b860458c20b7103e21bf3676205c801e4a20f1d18b975c51cf4b91
26 days ago
Phi-3-mini-4k-instruct.Q5_K_S.gguf
Safe
2.64 GB
LFS
8abf08b3200f8d14053a56748e2067bf3786433e925335d87d2b5f46f93f8968
26 days ago
Phi-3-mini-4k-instruct.Q6_K.gguf
Safe
3.14 GB
LFS
1a8b2946e1f141b57400d2c96a82f7bada4ac602be580d02af18a7affe9991cf
26 days ago
Phi-3-mini-4k-instruct.Q8_0.gguf
Safe
4.06 GB
LFS
136ce1d6ac1d87fb4f4b46abf811bb334dc8e9a2b10aefab69a051e769afb5a9
26 days ago
Phi-3-mini-4k-instruct.fp16.gguf
Safe
7.64 GB
LFS
31eec1c95f5aa9cc92ab53cec954931fe11428410577023c4458b8d39ec00343
26 days ago
README.md
Safe
2.98 kB
4ca757ad8d143873db23a068ca8dce0b0af44092433f19391f6589b3062efefa
26 days ago
