requirements.txt

datasets
transformers==4.42.3
accelerate
Pyvi
nltk
https://gitlab.com/trungtv/vi_spacy/-/raw/master/vi_core_news_lg/dist/vi_core_news_lg-0.0.1.tar.gz

streamlit==1.33.0
torch==2.3.0
pytorch_lightning
tokenizers==0.19.0
sentencepiece