Commit History

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q8_0
3839d84
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_K_M
c5fa3a5
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_0
556284a
verified

jartine commited on

Delete mistral-7b-instruct-v0.2.Q5_K.llamafile
75a59f0
verified

jartine commited on

Delete mistral-7b-instruct-v0.2.Q4_K.llamafile
8606e99
verified

jartine commited on

Delete mistral-7b-instruct-v0.2.Q3_K.llamafile
6caa989
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q6_K
72d92cc
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_K_S
09f2ae9
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_K
1a09948
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_K_M
2bcc43a
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_K_S
8c9a271
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_K
c255134
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K_L
54179e5
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K_M
9854006
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K_S
86ddc4e
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K
57412fc
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q2_K
0c51908
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_1
7fdbcb3
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_0
f51d687
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_1
2f4ad9d
verified

jartine commited on

Update README.md
c49fd32
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 BF16
4432405
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 F16
e3cd3f3
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q8_0
3cff2b7
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_K_M
57b9574
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_0
98328f7
verified

jartine commited on

Quantize Mistral using llama.cpp PR #6412
1b7651d
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_S
04f6b23
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K
9cb5c75
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_M
48a6160
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 F16
fe448e3
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 BF16
585c23f
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q8_0
51a9579
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q6_K
33f6022
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_M
f8f92c5
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K_S
c9b8a87
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K
0348a03
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_K_M
8ca85dc
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_K_S
9cec5f6
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_K
7dd9c2f
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q3_K_L
6469062
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q3_K_M
7aee2e0
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q3_K_S
4984a8d
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q3_K
e20d532
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q2_K
c94d035
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_1
6f8748b
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_0
44f8fbe
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_1
817c085
verified

jartine commited on

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_0
a56fd92
verified

jartine commited on

Wrap mistral-7b-instruct-v0.2.Q8_0.gguf with llamafile v0.6.2
0dfcfb1
verified

jartine commited on