Hugging Face's logo

tensorblock
/
Mistral-Nemo-Base-2407-GGUF

Transformers
GGUF
English
mistral
unsloth
TensorBlock
GGUF
Inference Endpoints
Model card Files Community
morriszms commited on
Commit
f1ad1f2
·
verified ·
1 Parent(s): e107a53

Upload folder using huggingface_hub

Browse files
Files changed (13) hide show
  1. Mistral-Nemo-Base-2407-Q2_K.gguf +2 -2
  2. Mistral-Nemo-Base-2407-Q3_K_L.gguf +2 -2
  3. Mistral-Nemo-Base-2407-Q3_K_M.gguf +2 -2
  4. Mistral-Nemo-Base-2407-Q3_K_S.gguf +2 -2
  5. Mistral-Nemo-Base-2407-Q4_0.gguf +2 -2
  6. Mistral-Nemo-Base-2407-Q4_K_M.gguf +2 -2
  7. Mistral-Nemo-Base-2407-Q4_K_S.gguf +2 -2
  8. Mistral-Nemo-Base-2407-Q5_0.gguf +2 -2
  9. Mistral-Nemo-Base-2407-Q5_K_M.gguf +2 -2
  10. Mistral-Nemo-Base-2407-Q5_K_S.gguf +2 -2
  11. Mistral-Nemo-Base-2407-Q6_K.gguf +2 -2
  12. Mistral-Nemo-Base-2407-Q8_0.gguf +2 -2
  13. README.md +8 -14
Mistral-Nemo-Base-2407-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7edb5ed169e7e10aac856fa869b1d9ba968703e994410df37a419b35c585d390
3
- size 4791046752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7a63dd6a7c4573b138155225c592be4432497727c1325f49153b38d4811e386
3
+ size 4791046816
Mistral-Nemo-Base-2407-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e06c49e8cda6333ac3400d382c8f2969fa9b8b7f7a5a72ed05a0b007abdda86f
3
- size 6561501792
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f20a948378ecb6a8bd876ea73bb569d962ee503c6dfb00817315224d508ec895
3
+ size 6561501856
Mistral-Nemo-Base-2407-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:22cc454043ccc42483fc9217929af3b64cc27a5d65550fa3296cc4218d920404
3
- size 6083088992
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb19e6ef73dcad9f664deddd9f953ccee89c66c871cae75dcd56b4fe9443fa56
3
+ size 6083089056
Mistral-Nemo-Base-2407-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:78769c6c26cff5c5d40b283658a14a721418d791fad521ef99f34e486c11e9c1
3
- size 5534224992
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76ae386deedbeecce208b523c202989e0b8abfca52784a35ab3c630c59042094
3
+ size 5534225056
Mistral-Nemo-Base-2407-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:db6c66815c9828b5230da6de814b9d6098bb9f0a99e07a53036d1a3f0dfa2bed
3
- size 7071699552
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b2d5d7da7186a0c31c443b13bef7a204809b44ad6541595fe1640bbd3163e99
3
+ size 7071699616
Mistral-Nemo-Base-2407-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:38efb50dde3698d9d5f45d6b5ec366d5d98e96d42fc8917785a69d883079032e
3
- size 7477203552
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c497c83b3c59029ae9508eca1f489fabfb67217d18c2c2eab6a9ed48604fb928
3
+ size 7477203616
Mistral-Nemo-Base-2407-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e05da8f90e151a0e9841dfae90894edb9e223b9c68f92d1a560b4a2ac0bfee1c
3
- size 7120196192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd8be56a5a6945a875ad07e348871a4050c353a76a0a9100e0585d304bf81118
3
+ size 7120196256
Mistral-Nemo-Base-2407-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c3de3cdf1898060dc9aad5ee880dc8ece20d433ddedf71e2566f7fe9af7f4c4f
3
- size 8518734432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2379c03e593f07350b354b60b8afbd01eb4338b89b9edd89208e9191699d9cdb
3
+ size 8518734496
Mistral-Nemo-Base-2407-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f3e08980069f902f1e0a80359f68c9d9cd2eaa8c92737ede9a2218bbad317fb5
3
- size 8727630432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c425f2cfc8557271afbe232fa85abb33fcf2b621350dd5e9ccd3f85ccf96ed92
3
+ size 8727630496
Mistral-Nemo-Base-2407-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:74d0374029e1ad345417da648231a449bf5841faa7512e59cb7acac3d5af9b4f
3
- size 8518734432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4050a374e08c7be05ac54289d2c5e2995b05b5470bacd048fc470483e6cc8e0
3
+ size 8518734496
Mistral-Nemo-Base-2407-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1373ad66418aa1e8ca3ebd95ab43c9ea401e3a34e8bd783c1abbe2b97c1eae5f
3
- size 10056208992
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa3731de73f8e2eb7d16ebea795ddd67c45df30f34fbc421f0aa60cbd1774779
3
+ size 10056209056
Mistral-Nemo-Base-2407-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2bf19ba6eed53ddb07f1ee53161df9022eafaefe8369fbeaacfd28e7fec60606
3
- size 13022368352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:991c0ccda1771aa0708258273b9ded3b504991f1123d6054622c6565257e2f42
3
+ size 13022368416
README.md CHANGED
@@ -1,21 +1,15 @@
1
  ---
2
- license: apache-2.0
3
  language:
4
  - en
5
- - fr
6
- - de
7
- - es
8
- - it
9
- - pt
10
- - ru
11
- - zh
12
- - ja
13
- extra_gated_description: If you want to learn more about how we process your personal
14
- data, please read our <a href="https://mistral.ai/terms/">Privacy Policy</a>.
15
- base_model: mistralai/Mistral-Nemo-Base-2407
16
  tags:
 
 
 
17
  - TensorBlock
18
  - GGUF
 
19
  ---
20
 
21
  <div style="width: auto; margin-left: auto; margin-right: auto">
@@ -29,9 +23,9 @@ tags:
29
  </div>
30
  </div>
31
 
32
- ## mistralai/Mistral-Nemo-Base-2407 - GGUF
33
 
34
- This repo contains GGUF format model files for [mistralai/Mistral-Nemo-Base-2407](https://huggingface.co/mistralai/Mistral-Nemo-Base-2407).
35
 
36
  The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
37
 
 
1
  ---
 
2
  language:
3
  - en
4
+ library_name: transformers
5
+ license: apache-2.0
 
 
 
 
 
 
 
 
 
6
  tags:
7
+ - mistral
8
+ - unsloth
9
+ - transformers
10
  - TensorBlock
11
  - GGUF
12
+ base_model: unsloth/Mistral-Nemo-Base-2407
13
  ---
14
 
15
  <div style="width: auto; margin-left: auto; margin-right: auto">
 
23
  </div>
24
  </div>
25
 
26
+ ## unsloth/Mistral-Nemo-Base-2407 - GGUF
27
 
28
+ This repo contains GGUF format model files for [unsloth/Mistral-Nemo-Base-2407](https://huggingface.co/unsloth/Mistral-Nemo-Base-2407).
29
 
30
  The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
31