What framework do you use to quantize this model?

#8
by sipie800 - opened

Do you use vllm or something else ?

Sign up or log in to comment