Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF / meta-llama-3.1-8b-instruct-q4_0.gguf

q4_0 : match AWQ format (F16 input / output tensors)

0aba27d verified 18 days ago

6.04 GB

This file is stored with Git LFS . It is too big to display, but you can still download it.

Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.