Hugging Face's logo

LoneStriker
/
Nous-Capybara-34B-4.0bpw-h6-exl2

Text Generation
Transformers
PyTorch
English
llama
sft
StableLM
text-generation-inference
Inference Endpoints
Model card Files Community
1
New discussion

Which of these 34B model BPW will fit on a single 24GB card's (4090) VRAM?

9
#1 opened about 1 year ago by clevnumb