huggingface_hub
safetensors
git+https://github.com/huggingface/transformers
git+https://github.com/huggingface/accelerate
git+https://github.com/huggingface/diffusers
git+https://github.com/huggingface/peft
optimum-quanto
sentencepiece
torch
torchaudio
torchvision
pytorch_lightning
aria2
gdown
gguf>=0.9.1
numpy
psutil