auto-gptq==0.5.0
transformers>=4.31.0
sentencepiece
torch