ThomasBaruzier
/

Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3.1-70B-Instruct-GGUF

Commit History

Upload Meta-Llama-3.1-70B-Instruct-Q8_0-00002-of-00002.gguf

1115076
verified

ThomasBaruzier commited on Aug 2

Upload Meta-Llama-3.1-70B-Instruct-Q6_K-00001-of-00002.gguf

6247888
verified

ThomasBaruzier commited on Aug 2

Upload Meta-Llama-3.1-70B-Instruct-Q6_K-00002-of-00002.gguf

74bac70
verified

ThomasBaruzier commited on Aug 2

Upload Meta-Llama-3.1-70B-Instruct-Q5_K_M.gguf

175fe5f
verified

ThomasBaruzier commited on Aug 2

Upload Meta-Llama-3.1-70B-Instruct-Q5_0.gguf

de25e03
verified

ThomasBaruzier commited on Aug 2

Upload Meta-Llama-3.1-70B-Instruct-Q5_K_S.gguf

9223467
verified

ThomasBaruzier commited on Aug 2

Upload Meta-Llama-3.1-70B-Instruct-Q4_1.gguf

71e6f93
verified

ThomasBaruzier commited on Aug 2

Upload Meta-Llama-3.1-70B-Instruct-Q4_K_M.gguf

7b73ce3
verified

ThomasBaruzier commited on Aug 1

Upload Meta-Llama-3.1-70B-Instruct-Q4_K_S.gguf

7fd40e9
verified

ThomasBaruzier commited on Aug 1

Upload Meta-Llama-3.1-70B-Instruct-Q4_0.gguf

f922cb0
verified

ThomasBaruzier commited on Aug 1

Upload Meta-Llama-3.1-70B-Instruct-IQ4_NL.gguf

278788e
verified

ThomasBaruzier commited on Aug 1

Upload Meta-Llama-3.1-70B-Instruct-IQ4_XS.gguf

158c76f
verified

ThomasBaruzier commited on Aug 1

Upload Meta-Llama-3.1-70B-Instruct-Q3_K_L.gguf

1cbb967
verified

ThomasBaruzier commited on Aug 1

Upload Meta-Llama-3.1-70B-Instruct-Q3_K_M.gguf

4ee2a2f
verified

ThomasBaruzier commited on Aug 1

Upload Meta-Llama-3.1-70B-Instruct-IQ3_M.gguf

4c41503
verified

ThomasBaruzier commited on Aug 1

Update README.md

f750902
verified

ThomasBaruzier commited on Aug 1

Upload Meta-Llama-3.1-70B-Instruct-Q3_K_S.gguf

a397627
verified

ThomasBaruzier commited on Aug 1

Upload Meta-Llama-3.1-70B-Instruct-IQ3_S.gguf

d9cfe01
verified

ThomasBaruzier commited on Aug 1

Upload Meta-Llama-3.1-70B-Instruct-IQ3_XS.gguf

0667dde
verified

ThomasBaruzier commited on Aug 1

Upload Meta-Llama-3.1-70B-Instruct-IQ3_XXS.gguf

cd184b6
verified

ThomasBaruzier commited on Aug 1

Upload Meta-Llama-3.1-70B-Instruct-Q2_K.gguf

8c51ef6
verified

ThomasBaruzier commited on Aug 1

Upload Meta-Llama-3.1-70B-Instruct-Q2_K_S.gguf

b4988d0
verified

ThomasBaruzier commited on Aug 1

Upload Meta-Llama-3.1-70B-Instruct-IQ2_M.gguf

90eadb5
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-70B-Instruct-IQ2_S.gguf

463e1e3
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-70B-Instruct-IQ2_XS.gguf

0c9ed7a
verified

ThomasBaruzier commited on Jul 31

Update README.md

ec10dd5
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-70B-Instruct-IQ2_XXS.gguf

66765fc
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-70B-Instruct-IQ1_M.gguf

15026ac
verified

ThomasBaruzier commited on Jul 31

Rename Meta-Llama-3.1-70B-Instruct-IQ1_S.gguf.fix to Meta-Llama-3.1-70B-Instruct-IQ1_S.gguf

fb8a99b
verified

ThomasBaruzier commited on Jul 31

Upload Meta-Llama-3.1-70B-Instruct-IQ1_S.gguf.fix

6b1b02a
verified

ThomasBaruzier commited on Jul 31

Update README.md

5c7011c
verified

ThomasBaruzier commited on Jul 31

Update README.md

85bb630
verified

ThomasBaruzier commited on Jul 31

Update README.md

a2a2ed8
verified

ThomasBaruzier commited on Jul 31

Delete Meta-Llama-3.1-70B-Instruct-F16/Meta-Llama-3.1-70B-Instruct-F16-00003-of-00003.gguf

887b194
verified

ThomasBaruzier commited on Jul 30

Delete Meta-Llama-3.1-70B-IQ1_S.gguf

b7066ae
verified

ThomasBaruzier commited on Jul 30

Delete Meta-Llama-3.1-70B-Instruct-F16/Meta-Llama-3.1-70B-Instruct-F16-00002-of-00003.gguf

00e1f13
verified

ThomasBaruzier commited on Jul 30

Update README.md

6b0592e
verified

ThomasBaruzier commited on Jul 29

Update README.md

b974946
verified

ThomasBaruzier commited on Jul 29

Update README.md

3990bf7
verified

ThomasBaruzier commited on Jul 28

Rename ggml-model-IQ1_S.gguf to Meta-Llama-3.1-70B-IQ1_S.gguf

ff9e587
verified

ThomasBaruzier commited on Jul 28

Upload ggml-model-IQ1_S.gguf to

e04e71b
verified

ThomasBaruzier commited on Jul 28

Upload Meta-Llama-3.1-70B-Instruct-F16-00002-of-00003.gguf to Meta-Llama-3.1-70B-Instruct-F16

040231f
verified

ThomasBaruzier commited on Jul 28

Upload Meta-Llama-3.1-70B-Instruct-F16-00003-of-00003.gguf to Meta-Llama-3.1-70B-Instruct-F16

d7c1f41
verified

ThomasBaruzier commited on Jul 28

Update README.md

4e192e5
verified

ThomasBaruzier commited on Jul 27

Upload imatrix.dat

c030d44
verified

ThomasBaruzier commited on Jul 27

Upload calibration_datav3.txt

1237252
verified

ThomasBaruzier commited on Jul 27

Update .gitattributes

27333fc
verified

ThomasBaruzier commited on Jul 27

Update README.md

882b4dd
verified

ThomasBaruzier commited on Jul 27

initial commit

b1a147e
verified

ThomasBaruzier commited on Jul 27