mtasic85's picture
train tokenizer
99a750a
|
raw
history blame
231 Bytes
# Train
## Environment
```bash
cd scripts
python -m venv venv
source venv/bin/activate
pip install -U -r requirements.in
```
## Tokenizer
```bash
python -B train_tokenizer.py
```
## Model
```bash
python -B train_model.py
```