Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment28Experiment26-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Experiment28Experiment26-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
9da20bc370d9a970a7755c485236baf9bb51d5b460f9ff254ea5869aa2252ff4
94798d0
verified
11 months ago
.gitattributes
Safe
2.35 kB
112e662019388a448b6bafc40c54d3edf8a7c7d914a14b6418c2752192190e09
11 months ago
Experiment28Experiment26-7B.IQ3_XS.gguf
Safe
3.02 GB
LFS
ba1911e4df63c302a9ba972fa23dc3bd956f28ea8b87c84cd3e2122b7b184110
11 months ago
Experiment28Experiment26-7B.IQ4_XS.gguf
Safe
3.94 GB
LFS
8ea9fe6cc6690da65e95da31657af5b7ac4b8355785d1acf30f5b11f07e629cd
11 months ago
Experiment28Experiment26-7B.Q2_K.gguf
2.72 GB
LFS
b34a9afcc2e266b29cd09471fd258bc6342abbe235378b19cd7db72ff02e9f14
11 months ago
Experiment28Experiment26-7B.Q3_K_L.gguf
3.82 GB
LFS
1652bfad633fe50c7c6482f4ce1dc478c17ef47b009a53e3cf25e2c1e442ee29
11 months ago
Experiment28Experiment26-7B.Q3_K_M.gguf
3.52 GB
LFS
fe0ad2e83f2bab1d3f1c1b790e0acc1c2a972b4a87211e55c0879aa1c7ef3983
11 months ago
Experiment28Experiment26-7B.Q3_K_S.gguf
3.16 GB
LFS
0155136134ace5db33678f31d0a40f5bb0113f3f43520a5b2c9128379984b78e
11 months ago
Experiment28Experiment26-7B.Q4_K_M.gguf
4.37 GB
LFS
a94bcbe07de0dcc3ce4b66380452a9d9a88b258f110470ed7bb97f300dea3cf3
11 months ago
Experiment28Experiment26-7B.Q4_K_S.gguf
4.14 GB
LFS
1376170838e39f651f4af65ab43df3776f32b46a54633d5ff957c85f0cb69d4e
11 months ago
Experiment28Experiment26-7B.Q5_K_M.gguf
5.13 GB
LFS
51b5d792435d095ad43d8fffd83ed1cf40ef2b72339c353812012127895ce88a
11 months ago
Experiment28Experiment26-7B.Q5_K_S.gguf
5 GB
LFS
c70a3d8dee31e307b0194d2a0469d6533d52f2774490c08fece1b626d085818d
11 months ago
Experiment28Experiment26-7B.Q6_K.gguf
5.94 GB
LFS
112e662019388a448b6bafc40c54d3edf8a7c7d914a14b6418c2752192190e09
11 months ago
README.md
Safe
11.1 kB
9da20bc370d9a970a7755c485236baf9bb51d5b460f9ff254ea5869aa2252ff4
11 months ago