Commit
•
444e414
1
Parent(s):
9276f51
Update README.md
Browse files
README.md
CHANGED
|
@@ -31,11 +31,13 @@ Training details:
|
|
| 31 |
- optimizer: paged_adamw_32bit
|
| 32 |
|
| 33 |
|
| 34 |
-
|
| 35 |
|
| 36 |
```bash
|
| 37 |
git clone https://github.com/hiyouga/LLaMA-Factory.git
|
| 38 |
|
|
|
|
|
|
|
| 39 |
deepspeed --num_gpus 8 src/train_bash.py \
|
| 40 |
--deepspeed ${Your_Deepspeed_Config_Path} \
|
| 41 |
--stage orpo \
|
|
|
|
| 31 |
- optimizer: paged_adamw_32bit
|
| 32 |
|
| 33 |
|
| 34 |
+
To reproduce:
|
| 35 |
|
| 36 |
```bash
|
| 37 |
git clone https://github.com/hiyouga/LLaMA-Factory.git
|
| 38 |
|
| 39 |
+
cd LLaMA-Factory
|
| 40 |
+
|
| 41 |
deepspeed --num_gpus 8 src/train_bash.py \
|
| 42 |
--deepspeed ${Your_Deepspeed_Config_Path} \
|
| 43 |
--stage orpo \
|