Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
NeuralsirkrishnaInex12-7B-GGUF
like
1
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
NeuralsirkrishnaInex12-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
9ccf8d7d2c0313a848052a487663713c59d4a9d1c025a6f67c609c9fd9ffcf2f
95f60e3
verified
10 months ago
.gitattributes
Safe
2.33 kB
8a77c9bfb8cd0fa0123e39270c973a9eb9f505459383ecfff1e56eb03b5b16e3
10 months ago
NeuralsirkrishnaInex12-7B.IQ3_XS.gguf
Safe
3.02 GB
LFS
9a1d4c7bf293ae3308e6a839ac752a202707e837f96c7517a9588e7a5dd696a4
10 months ago
NeuralsirkrishnaInex12-7B.IQ4_XS.gguf
Safe
3.94 GB
LFS
b1f0f86527057a3c111f350ae585a84a94ffe0edb9af744b2bd691a784b37863
10 months ago
NeuralsirkrishnaInex12-7B.Q2_K.gguf
Safe
2.72 GB
LFS
68b97156c92ff2030a43cc3aea77f1e3e4c27a3829216929b7297eb168509a40
10 months ago
NeuralsirkrishnaInex12-7B.Q3_K_L.gguf
Safe
3.82 GB
LFS
1bfad87f3bda9d129592591a86af745f77cccd03ba9136de8d77ed05a0973589
10 months ago
NeuralsirkrishnaInex12-7B.Q3_K_M.gguf
Safe
3.52 GB
LFS
4bc753abd7f9d0ada29685d8536c9faae213cbf9b22fd877c39ee2be1303d49c
10 months ago
NeuralsirkrishnaInex12-7B.Q3_K_S.gguf
Safe
3.16 GB
LFS
cbbb4c976adcf306fb569354d4d28475cc3bee25b52e08e81d3053cc885c4073
10 months ago
NeuralsirkrishnaInex12-7B.Q4_K_M.gguf
Safe
4.37 GB
LFS
5f7cbbf14349f0eba61af502bf00a6a8d5331eb14301605ff886ce9f23c41fd2
10 months ago
NeuralsirkrishnaInex12-7B.Q4_K_S.gguf
Safe
4.14 GB
LFS
c7b7bf5b610c5ea6b4e0d1e29dcaf96d947290d0069721adfaf640984bbd9fae
10 months ago
NeuralsirkrishnaInex12-7B.Q5_K_M.gguf
5.13 GB
LFS
e2789d789aafbbf88b878b779351914321a07d802ba52d74a700100d08f820a4
10 months ago
NeuralsirkrishnaInex12-7B.Q5_K_S.gguf
5 GB
LFS
baa5ba8158222a5230087514e83076296076060856beed5c331d9e9413365b51
10 months ago
NeuralsirkrishnaInex12-7B.Q6_K.gguf
5.94 GB
LFS
8a77c9bfb8cd0fa0123e39270c973a9eb9f505459383ecfff1e56eb03b5b16e3
10 months ago
README.md
Safe
11.1 kB
9ccf8d7d2c0313a848052a487663713c59d4a9d1c025a6f67c609c9fd9ffcf2f
10 months ago
