model

scripts/TRAIN.md

@@ -1,6 +1,6 @@
 # Train
 
-## Environment
+## Tokenizer
 
 ```bash
 cd scripts
@@ -9,14 +9,32 @@ source venv/bin/activate
 pip install -U -r requirements.in
 ```
 
-## Tokenizer
-
 ```bash
 python -B train_tokenizer.py
 ```
 
+## Dataset
+
+```bash
+cd scripts
+python -m venv venv-lit
+source venv-lit/bin/activate
+pip install -U -r requirements-lit.in
+```
+
+```bash
+python -B prepare_pretrain_dataset.py
+```
+
 ## Model
 
 ```bash
-python -B train_model.py
+cd scripts
+python -m venv venv-lit
+source venv-lit/bin/activate
+pip install -U -r requirements-lit.in
+```
+
+```bash
+litgpt pretrain --data LitData --data.data_path "../data/" --config ./model.yaml
 ```