torch
transformers
accelerate
aiohttp
fastapi
httpx
numpy
peft
sentencepiece
protobuf