Hugging Face's logo

backyardai
/
Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation
GGUF
PyTorch
facebook
meta
llama
llama-3
Inference Endpoints
conversational
Model card Files Community
brooketh commited on
Commit
cb6129a
•
1 Parent(s): 5820fe2

Upload Meta-Llama-3.1-8B-Instruct-GGUF

Browse files
Files changed (22) hide show
  1. Meta-Llama-3.1-8B-Instruct.F32.gguf +1 -1
  2. Meta-Llama-3.1-8B-Instruct.IQ1_M.gguf +1 -1
  3. Meta-Llama-3.1-8B-Instruct.IQ1_S.gguf +1 -1
  4. Meta-Llama-3.1-8B-Instruct.IQ2_M.gguf +1 -1
  5. Meta-Llama-3.1-8B-Instruct.IQ2_S.gguf +1 -1
  6. Meta-Llama-3.1-8B-Instruct.IQ2_XS.gguf +1 -1
  7. Meta-Llama-3.1-8B-Instruct.IQ2_XXS.gguf +1 -1
  8. Meta-Llama-3.1-8B-Instruct.IQ3_M.gguf +1 -1
  9. Meta-Llama-3.1-8B-Instruct.IQ3_S.gguf +1 -1
  10. Meta-Llama-3.1-8B-Instruct.IQ3_XS.gguf +1 -1
  11. Meta-Llama-3.1-8B-Instruct.IQ3_XXS.gguf +1 -1
  12. Meta-Llama-3.1-8B-Instruct.IQ4_XS.gguf +1 -1
  13. Meta-Llama-3.1-8B-Instruct.Q3_K_L.gguf +1 -1
  14. Meta-Llama-3.1-8B-Instruct.Q3_K_M.gguf +1 -1
  15. Meta-Llama-3.1-8B-Instruct.Q3_K_S.gguf +1 -1
  16. Meta-Llama-3.1-8B-Instruct.Q4_K_M.gguf +1 -1
  17. Meta-Llama-3.1-8B-Instruct.Q4_K_S.gguf +1 -1
  18. Meta-Llama-3.1-8B-Instruct.Q5_K_M.gguf +1 -1
  19. Meta-Llama-3.1-8B-Instruct.Q5_K_S.gguf +1 -1
  20. Meta-Llama-3.1-8B-Instruct.Q6_K.gguf +1 -1
  21. Meta-Llama-3.1-8B-Instruct.Q8_0.gguf +1 -1
  22. Meta-Llama-3.1-8B-Instruct.imatrix +1 -1
Meta-Llama-3.1-8B-Instruct.F32.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:04d9da57856c763ec7737a2bdb2fb504bcf35c2a2aea333cbd8882b4b25b4c04
3
  size 32128881312
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1ace9355899d494c2e3498173423d181c1179430ff6e5858abcbf4a9918ccd2e
3
  size 32128881312
Meta-Llama-3.1-8B-Instruct.IQ1_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a88827fa81ee65e2baa5fd3df0ff11bc85a78b4583a471c0e42ca770dd57e377
3
  size 2161972160
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f67e74a7d4e3f2ce95708699d687b1469009afee0aee37d793611a8a8143cf03
3
  size 2161972160
Meta-Llama-3.1-8B-Instruct.IQ1_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5c71021768a5360bb9ac767688a4c4d732614fec32ead5baad6c627336bfa6f5
3
  size 2019627968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:727c41bad8d4908c2a8c5d5aafe0187379862db4c96ddb17199ec263cb53ffb6
3
  size 2019627968
Meta-Llama-3.1-8B-Instruct.IQ2_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1ced46b8cd16c8eb6fb031161e0cb9353af69e2850bfb52eff6be80e18ce1936
3
  size 2948281280
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec0e8ad9f172fb92fb22cae1498067f7db0ff60278198e15ae3362bd0076d37f
3
  size 2948281280
Meta-Llama-3.1-8B-Instruct.IQ2_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bd5d7e58b2a0360f5c6ebca83602bf8ee6cc81fd8e8cb188a37da831c628374e
3
  size 2758489024
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:576424c4155271bcede2221c8f2a8007ad23fc9ea5df2852701aba5009d42264
3
  size 2758489024
Meta-Llama-3.1-8B-Instruct.IQ2_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a3acd3ce93b32c59d64e7c4da78314ee337d16f01bbed3569095485da679af59
3
  size 2605781952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c17ebd514f703f1bf44937e5c2dbe3779ca1960c17ee82fafecd04fab3d8d288
3
  size 2605781952
Meta-Llama-3.1-8B-Instruct.IQ2_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e6c6f9f1729dafef6e35a9495c0055a062ebcb464ccefe4d1da36d7139d0623a
3
  size 2399212480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78eb4d13f0dcc832ae9463647007e8579e95a27181e7db49ab769bd0cde6c21f
3
  size 2399212480
Meta-Llama-3.1-8B-Instruct.IQ3_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:70f1ebba9f8eee2abdac1a5faecbb66661f986aae0fc08ee485dd4b1b4020e96
3
  size 3784823744
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:932dd7f5d4f1084cdee0e6a8a70be1f31453bf624a96c9eed695676db047f740
3
  size 3784823744
Meta-Llama-3.1-8B-Instruct.IQ3_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:090f26a11526cf56607198d6bcd78a1e33fb44496fdd8e9e1479b6126848013d
3
  size 3682325440
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:97b23dca1acebfb48e95d237b299f0de1a11580f1ba19ad7c38dcd36d99c02ef
3
  size 3682325440
Meta-Llama-3.1-8B-Instruct.IQ3_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9e07fa368b96668a78be6be716a244f4a6f62a4af74ae22dc38bc9277790c7bd
3
  size 3518747584
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10bf59c3922631c3185c3b79d22c7dc56204eddd815128ecc7865561a3283c31
3
  size 3518747584
Meta-Llama-3.1-8B-Instruct.IQ3_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:88e1650126a6342d6742c56349bfa87cb757dfaee48d21e936e3d92591f89801
3
  size 3274912704
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5942fcc7175f0924ab5007919670e6ac54282d3c84ba9aaa0680a4fa0aa8737
3
  size 3274912704
Meta-Llama-3.1-8B-Instruct.IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:23c6c4713928ebf9d133e7162adfd4c958dc1aa1cd578f4907411a229334f3e7
3
  size 4447663040
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49db2c7f46add1260bc92a7bcef5041989af29ae42fad25c2929b191a7a92453
3
  size 4447663040
Meta-Llama-3.1-8B-Instruct.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:52e09aa67825b040b8880316a5792adaa6b3418b6aa84e5dff4a45357647f312
3
  size 4321956512
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:980587cc4ba0cd8d431d3f16ff1cc93f42c53d9e91b0895be6a13361f8daea81
3
  size 4321956512
Meta-Llama-3.1-8B-Instruct.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fdd315bc165d183d270e925e286b54b7780a9014f7e48627f6d5525cc2e85676
3
  size 4018918048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a17e7aaee76b11b16d907aebe3fd9c9e8e9d85352432f7b3f62eec0076519e6
3
  size 4018918048
Meta-Llama-3.1-8B-Instruct.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0f146fb45f57a5eb69c1fc946e8fdd79000ee02405645590f91ce6fe320dd910
3
  size 3664499360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93d4b0a28b8a53592ae2508745e460d172a8b9d1c4f9a18b815b56a71a1ce713
3
  size 3664499360
Meta-Llama-3.1-8B-Instruct.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:26188af804cf8f8303e7518607dfc9becb6f6c568af5fc7c4d2001fb8c8eee04
3
  size 4920734368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69f42f46a34cbcc382a5e87333bf59fc5074beea182eb99a3a9928c1b113cf91
3
  size 4920734368
Meta-Llama-3.1-8B-Instruct.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0ccea339850d9f087275b2f951e3add38e34499219f1e35d73919377e92316e8
3
  size 4692669088
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:30a41e28340e3321bcac864ad3a2e03a0fb6831743ce56e37b9feb8c0ca67ae0
3
  size 4692669088
Meta-Llama-3.1-8B-Instruct.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a150cced160e4b1a1a65f57faacb320897259b882719633385f3133c7a6dbf2a
3
  size 5732987552
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:650be5f6c78356fe320ee92265875ee2970d960a35626e81d87543f7e40b934c
3
  size 5732987552
Meta-Llama-3.1-8B-Instruct.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4cdc3b239475402060d4e4e0fc493249004728b1de49cc4be79f396e45e5589e
3
  size 5599294112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd6cd8f2affea76e246719a0f6ba4bf27850d1c0fa5b3ce372558554e479dfcb
3
  size 5599294112
Meta-Llama-3.1-8B-Instruct.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cda103a755376e2c74bf4f6b4f8e442cc94016def1e3ab5771fa795cb9019b39
3
  size 6596006560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d6dc101cea336b14d70712f06c19b1c860c06d941fc8d2b60535e6b05ea1798
3
  size 6596006560
Meta-Llama-3.1-8B-Instruct.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:256d535b5044217b2fc8443b17df5c5c3a3e247241c5171e51b5e3a81644eaf2
3
  size 8540770976
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f3772912a6d68f24ec279516f7daff88f491d4b4b89504cf05d710e5294c3d51
3
  size 8540770976
Meta-Llama-3.1-8B-Instruct.imatrix CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:10b00cf6b8770f7775fee6fb4d303e7bffad9d5a49ca0d1a42efba60425ab9b0
3
  size 4988216
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bda9ed9a804e909008b542c3f1ded001f9355ccbacedd6871702f9a19e355d70
3
  size 4988216