zfzhang-thu commited on
Commit
ab17c1a
·
1 Parent(s): 0b360fe

add sentencepiece package for LlamaTokenizer

Browse files
Files changed (1) hide show
  1. requirements.txt +1 -0
requirements.txt CHANGED
@@ -6,3 +6,4 @@ peft==0.12.0
6
  timm==1.0.8
7
  torch==2.2.0
8
  transformers==4.40.2
 
 
6
  timm==1.0.8
7
  torch==2.2.0
8
  transformers==4.40.2
9
+ sentencepiece==0.2.0