Your 32k version of the 70b model is really amazing. Still no exl2 quants to this 8b.
· Sign up or log in to comment