Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
NeuralsirkrishnaInex12-7B-GGUF
like
1
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
7d15acd
NeuralsirkrishnaInex12-7B-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
5f7cbbf14349f0eba61af502bf00a6a8d5331eb14301605ff886ce9f23c41fd2
7d15acd
verified
11 months ago
.gitattributes
2.04 kB
5f7cbbf14349f0eba61af502bf00a6a8d5331eb14301605ff886ce9f23c41fd2
11 months ago
NeuralsirkrishnaInex12-7B.IQ3_XS.gguf
3.02 GB
LFS
9a1d4c7bf293ae3308e6a839ac752a202707e837f96c7517a9588e7a5dd696a4
11 months ago
NeuralsirkrishnaInex12-7B.IQ4_XS.gguf
3.94 GB
LFS
b1f0f86527057a3c111f350ae585a84a94ffe0edb9af744b2bd691a784b37863
11 months ago
NeuralsirkrishnaInex12-7B.Q2_K.gguf
2.72 GB
LFS
68b97156c92ff2030a43cc3aea77f1e3e4c27a3829216929b7297eb168509a40
11 months ago
NeuralsirkrishnaInex12-7B.Q3_K_L.gguf
3.82 GB
LFS
1bfad87f3bda9d129592591a86af745f77cccd03ba9136de8d77ed05a0973589
11 months ago
NeuralsirkrishnaInex12-7B.Q3_K_M.gguf
3.52 GB
LFS
4bc753abd7f9d0ada29685d8536c9faae213cbf9b22fd877c39ee2be1303d49c
11 months ago
NeuralsirkrishnaInex12-7B.Q3_K_S.gguf
3.16 GB
LFS
cbbb4c976adcf306fb569354d4d28475cc3bee25b52e08e81d3053cc885c4073
11 months ago
NeuralsirkrishnaInex12-7B.Q4_K_M.gguf
4.37 GB
LFS
5f7cbbf14349f0eba61af502bf00a6a8d5331eb14301605ff886ce9f23c41fd2
11 months ago
