Quants that run fast on single 3090/4090 card with 24GB of VRAM and 4096 context length
-
TeeZee/2xbagel-dpo-34b-v0.2-bpw3.0-h6-exl2
Text Generation • Updated • 12 • 1 -
TeeZee/2xNous-Capybara-34B-bpw3-h6-exl2
Text Generation • Updated • 15 -
TeeZee/Psyfighter2-Orca2-13B-ties-bpw8.0-h8-exl2
Text Generation • Updated • 16 -
TeeZee/chronomaid-storytelling-13B-bpw8.0-h8-exl2
Text Generation • Updated • 17