Hugging Face's logo

shenzhi-wang
/
Llama3-70B-Chinese-Chat

Text Generation
Transformers
Safetensors
English
Chinese
llama
llama-factory
orpo
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
12

请问加载这个模型要多少GPU？我24000+的提示out of memory

#10
by zyc1128 - opened
Discussion
zyc1128

nvidia

shenzhi-wang
 Owner

https://huggingface.co./shenzhi-wang/Llama3-70B-Chinese-Chat/discussions/12

请参考这个discussion

Sign up or log in to comment