14B or 32B nexaquant?
#2
by
UICO
- opened
Is it possible to quantize a 14b or 32b model? This would be helpful on low-VRAM devices. 0.0
Is it possible to quantize a 14b or 32b model? This would be helpful on low-VRAM devices. 0.0