Quantize Meta-Llama-3-70B-Instruct with llamafile-0.8.4 Q3_K_S 0770dd6 verified jartine commited on May 11, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.3 Q3_K_M 18b1706 verified jartine commited on Apr 20, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.3 Q2_K 052c7c7 verified jartine commited on Apr 20, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.2 Q8_0 ca29edc verified jartine commited on Apr 19, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.2 Q8_0 0a463e7 verified jartine commited on Apr 19, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.2 F16 8b09f85 verified jartine commited on Apr 19, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.2 F16 eb933db verified jartine commited on Apr 19, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.2 F16 826c529 verified jartine commited on Apr 19, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.2 Q5_K_M fb01a5d verified jartine commited on Apr 19, 2024
Quantize Meta-Llama-3-70B-Instruct with llamafile-0.7.2 Q4_0 18730ef verified jartine commited on Apr 19, 2024