MaziyarPanahi
/

Llama-3-16B-Instruct-v0.1-GGUF

Text Generation

4-bit precision

8-bit precision

Model card Files Files and versions Community

Llama-3-16B-Instruct-v0.1-GGUF

1 contributor

History: 7 commits

MaziyarPanahi's picture

low quality - will make one with imatrix

eb6caf0 verified 7 months ago

.gitattributes

2.47 kB

Upload folder using huggingface_hub (#1) 7 months ago
Llama-3-16B-Instruct-v0.1.Q2_K.gguf

6.39 GB
LFS

Upload folder using huggingface_hub (#1) 7 months ago
Llama-3-16B-Instruct-v0.1.Q3_K_L.gguf

8.89 GB
LFS

Upload folder using huggingface_hub (#1) 7 months ago
Llama-3-16B-Instruct-v0.1.Q3_K_M.gguf

8.21 GB
LFS

Upload folder using huggingface_hub (#1) 7 months ago
Llama-3-16B-Instruct-v0.1.Q3_K_S.gguf

7.42 GB
LFS

Upload folder using huggingface_hub (#1) 7 months ago
Llama-3-16B-Instruct-v0.1.Q4_K_M.gguf

10.2 GB
LFS

Upload folder using huggingface_hub (#1) 7 months ago
Llama-3-16B-Instruct-v0.1.Q4_K_S.gguf

9.64 GB
LFS

Upload folder using huggingface_hub (#1) 7 months ago
Llama-3-16B-Instruct-v0.1.Q5_K_M.gguf

11.9 GB
LFS

Upload folder using huggingface_hub (#1) 7 months ago
Llama-3-16B-Instruct-v0.1.Q5_K_S.gguf

11.6 GB
LFS

Upload folder using huggingface_hub (#1) 7 months ago
Llama-3-16B-Instruct-v0.1.Q6_K.gguf

13.8 GB
LFS

Upload folder using huggingface_hub (#1) 7 months ago
Llama-3-16B-Instruct-v0.1.Q8_0.gguf

17.8 GB
LFS

Upload folder using huggingface_hub (#1) 7 months ago
Llama-3-16B-Instruct-v0.1.fp16.gguf

33.5 GB
LFS

Upload folder using huggingface_hub (#1) 7 months ago
README.md

1.55 kB

Update README.md (#3) 7 months ago
config.json

31 Bytes

Upload folder using huggingface_hub 7 months ago