GGUF and quantization perfomance?

#2
by Aloukik21 - opened

How can we quantize the weights?

Sign up or log in to comment