GPTQ version?
#2
by
rombodawg
- opened
Can you make gptq versions? Even if you only make the 14b model i would really appreciate it! So i can use it with oobagooba text gen web ui
As far as I know, there is no GPTQ implementation for RWKV as of yet, is there? If so, you can redirect me to the link, then sure, I'll do it for the 14B and other sizes.