Is there a 1.3b gguf?
You dont need it... it takes like 5gb to run it.
Wait.. what? 5gb? Is that Q_4?
1.3b at fp 16 takes my 3060 5gb vram to run
· Sign up or log in to comment
