llama-cpp-python
ctransformers
gradio
torch
numpy
sentencepiece