starble-dev
/

Meta-Llama-3.1-8B-Instruct-GGUF

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3.1-8B-Instruct-GGUF / .gitattributes

Commit History

Upload Meta-Llama-3.1-8B-Instruct-Q8_0.gguf

226e08b
verified

starble-dev commited on Jul 24

Upload Meta-Llama-3.1-8B-Instruct-Q6_K.gguf

08cb3f1
verified

starble-dev commited on Jul 24

Upload Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf

7352b71
verified

starble-dev commited on Jul 24

Upload Meta-Llama-3.1-8B-Instruct-Q5_K_S.gguf

79acd6e
verified

starble-dev commited on Jul 24

Upload Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf

bc3f314
verified

starble-dev commited on Jul 24

Upload Meta-Llama-3.1-8B-Instruct-Q4_K_S.gguf

7fde549
verified

starble-dev commited on Jul 24

Upload Meta-Llama-3.1-8B-Instruct-Q3_K_L.gguf

1ab542f
verified

starble-dev commited on Jul 24

Upload Meta-Llama-3.1-8B-Instruct-Q3_K_M.gguf

5aaf3f1
verified

starble-dev commited on Jul 24

Upload Meta-Llama-3.1-8B-Instruct-Q3_K_S.gguf

af9406c
verified

starble-dev commited on Jul 24

Upload Meta-Llama-3.1-8B-Instruct-Q2_K.gguf

fb3d19e
verified

starble-dev commited on Jul 24

initial commit

9bafb67
verified

starble-dev commited on Jul 24