elinas

/

llama-30b-hf-transformers-4.29

like 27

Hello,
I wanted to use this model in a VM with max RAM of 128 GB. During model loading, I could see memory use go up to 114, then the VM crashed. Thus my question: how much GB RAM do I need to use this model?
Many thanks and best regards.