Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q2_K 911e1cc verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q5_1 80f87e3 verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q5_0 a940757 verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q4_1 c19746d verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q6_K 2979e80 verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 BF16 1927c5c verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 F16 d18b812 verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q8_0 48dfbf8 verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q5_K_M 0479f7e verified jartine commited on Apr 19
Quantize Meta-Llama-3-8B-Instruct with llamafile-0.7.1 Q4_0 d656e11 verified jartine commited on Apr 19