Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q2_K 276646b verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_1 3d77221 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_0 2af1104 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_1 8ac62df verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q6_K 4e7c685 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 BF16 8e26aea verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q8_0 3839d84 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_K_M c5fa3a5 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_0 556284a verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q6_K 72d92cc verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_K_S 09f2ae9 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_K 1a09948 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_K_M 2bcc43a verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_K_S 8c9a271 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_K c255134 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K_L 54179e5 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K_M 9854006 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K_S 86ddc4e verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K 57412fc verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q2_K 0c51908 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_1 7fdbcb3 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_0 f51d687 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_1 2f4ad9d verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 BF16 4432405 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 F16 e3cd3f3 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q8_0 3cff2b7 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_K_M 57b9574 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_0 98328f7 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_S 04f6b23 verified jartine commited on Apr 1
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_M 48a6160 verified jartine commited on Apr 1
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_M f8f92c5 verified jartine commited on Apr 1
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_S c9b8a87 verified jartine commited on Apr 1
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_K_M 8ca85dc verified jartine commited on Apr 1
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_K_S 9cec5f6 verified jartine commited on Apr 1
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q3_K_L 6469062 verified jartine commited on Apr 1
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q3_K_M 7aee2e0 verified jartine commited on Apr 1
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q3_K_S 4984a8d verified jartine commited on Apr 1