Hugging Face's logo

SanctumAI
/
Meta-Llama-3-8B-Instruct-GGUF

Text Generation
Transformers
GGUF
PyTorch
English
llama
facebook
meta
llama-3
Inference Endpoints
conversational
Model card Files Community
3
AndreyBest commited on
Commit
f688151
•
1 Parent(s): 99f6027

Uploading updated quants for the Meta-Llama-3-8B-Instruct-GGUF model

Browse files
Files changed (17) hide show
  1. meta-llama-3-8b-instruct.Q2_K.gguf +2 -2
  2. meta-llama-3-8b-instruct.Q3_K_L.gguf +2 -2
  3. meta-llama-3-8b-instruct.Q3_K_M.gguf +2 -2
  4. meta-llama-3-8b-instruct.Q3_K_S.gguf +2 -2
  5. meta-llama-3-8b-instruct.Q4_0.gguf +2 -2
  6. meta-llama-3-8b-instruct.Q4_1.gguf +2 -2
  7. meta-llama-3-8b-instruct.Q4_K.gguf +2 -2
  8. meta-llama-3-8b-instruct.Q4_K_M.gguf +2 -2
  9. meta-llama-3-8b-instruct.Q4_K_S.gguf +2 -2
  10. meta-llama-3-8b-instruct.Q5_0.gguf +2 -2
  11. meta-llama-3-8b-instruct.Q5_1.gguf +2 -2
  12. meta-llama-3-8b-instruct.Q5_K.gguf +2 -2
  13. meta-llama-3-8b-instruct.Q5_K_M.gguf +2 -2
  14. meta-llama-3-8b-instruct.Q5_K_S.gguf +2 -2
  15. meta-llama-3-8b-instruct.Q6_K.gguf +2 -2
  16. meta-llama-3-8b-instruct.Q8_0.gguf +2 -2
  17. meta-llama-3-8b-instruct.f16.gguf +2 -2
meta-llama-3-8b-instruct.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cc90076e7bc41aa2ba93232511fb81f2ecd1a00523ab1058d38be5e0bb4a303c
3
- size 3179644192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cfad79633c99f4c525d4e47c459769610f2e1d08f6a77f160c8e6dca57e4899b
3
+ size 3179131168
meta-llama-3-8b-instruct.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6146122113d7e1163761fc956fa01f9c93db8c5813734e750c2d18117ea0fe68
3
- size 4322469152
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fd3271ef75520bbe632098feae9c8d229172cdaf36f6977404e95175c7e8599
3
+ size 4321956128
meta-llama-3-8b-instruct.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c18202175f8024f84d05bc586a3cf449c177157f0ac1e7276f933ea3cce7f909
3
- size 4019430688
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4928c34b86e85af813b99bf258c90a9b73650a5ac9d9bc3b0b77fdb4714ccd8e
3
+ size 4018917664
meta-llama-3-8b-instruct.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:46d827cec93595d3ada9eba7ac56b63e82ab304ef35cd86e0f64e85a51e2ccef
3
- size 3665012000
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc91785e437cc9e61b5156c047fce33ea7d31b264c17880273659619fcc71053
3
+ size 3664498976
meta-llama-3-8b-instruct.Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c525bccfff6ac0145d668c58e16af00c389f808304c915d6737633dc5177f8eb
3
- size 4661724448
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28e13782379b00ad23c67f17e84098cb58388a8c485368c364acf0f2110eff08
3
+ size 4661211424
meta-llama-3-8b-instruct.Q4_1.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6aa98aa725de062239b58bee3b856f83aaa6a1e430f9e22db3227af903843bfa
3
- size 5130765600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e5eb84118db5e13fe7d2cbbb7128118a02b82b99cd575549438befbf5ee839bf
3
+ size 5130252576
meta-llama-3-8b-instruct.Q4_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:74ed48768fc33e71510688593af2d3c6b9cc8707526242f9df7cac29c723d6f7
3
- size 4921247008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:578144806824ebe3735f8ec34effc14cad90e6bc2ebbf643709db5532681886d
3
+ size 4920733984
meta-llama-3-8b-instruct.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:74ed48768fc33e71510688593af2d3c6b9cc8707526242f9df7cac29c723d6f7
3
- size 4921247008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:578144806824ebe3735f8ec34effc14cad90e6bc2ebbf643709db5532681886d
3
+ size 4920733984
meta-llama-3-8b-instruct.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4ed21a8939b54eaf289f0f886e5e4e2d563e8d2abd20eba7d374cf10d43f4e7f
3
- size 4693181728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0da3ee0406eaf8bda567bf2f0246f38c6c6f7218471f7a028d163c96927a3213
3
+ size 4692668704
meta-llama-3-8b-instruct.Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:70d2f634d5c79b6ffc46508ef52baad605b434bf67d907472874ddf29dc1f005
3
- size 5599806752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c4b492778abf8a14a99acd3db5a4a4be36857eef12d97f0181679351ecda7800
3
+ size 5599293728
meta-llama-3-8b-instruct.Q5_1.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1fc435d32972867f10d8e04f45a75862a5e15ddc7a1809432699b62255a09231
3
- size 6068847904
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d831b0cf82288f125436bf5e590e9a3db12597a13f7344e39913f0aac0242f99
3
+ size 6068334880
meta-llama-3-8b-instruct.Q5_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8cf3021ecfcf51d8e98f1bf47c7492d1b3d927e4fdcca3f997b6bc84af1395f9
3
- size 5733500192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fee5394696544b76f05b68bbcc714d6476985cbfa6df4e58742a6834d083d5f7
3
+ size 5732987168
meta-llama-3-8b-instruct.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8cf3021ecfcf51d8e98f1bf47c7492d1b3d927e4fdcca3f997b6bc84af1395f9
3
- size 5733500192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fee5394696544b76f05b68bbcc714d6476985cbfa6df4e58742a6834d083d5f7
3
+ size 5732987168
meta-llama-3-8b-instruct.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9d8f136b2e4295e15e5fd5f80be8a162c26314905d9448cb0abbb84c9651cf31
3
- size 5599806752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8dab2ee5352885399246b18e79196dad813701aac69f78ea0f70a2fd30cfa4ba
3
+ size 5599293728
meta-llama-3-8b-instruct.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e1c185855c8cfc868d85b80d6cb492e72a5d66636aa6bc2d0a8cbf3289e8c50a
3
- size 6596519200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3760a88fdd2e1167644268ec14e7961943729c829d25b5f0ec963c3e54136702
3
+ size 6596006176
meta-llama-3-8b-instruct.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3ccda46558b98c172c120ed9522d5c22e25a842ba11335b44c392d2797499fb7
3
- size 8541283616
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:11a9680b016831751725242113e886dfc611e13889a9f47bff36e836a9f86337
3
+ size 8540770592
meta-llama-3-8b-instruct.f16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:93e3331df657165963e12f80bb875896a3ebf1e8794eca0f744025b715c56f07
3
- size 16069403872
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2296999531d6120801529a45b1d103f7370c5970be939ebfc2ba5d0833e9e1e
3
+ size 16068890912