Commit
•
c7692fe
1
Parent(s):
ddcbd3c
Update README.md
Browse files
README.md
CHANGED
|
@@ -20,10 +20,9 @@ LoRA адаптер для ruGPT3.5-13B обученный на датасете
|
|
| 20 |
|
| 21 |
Конфигурация: https://github.com/EvilFreelancer/impruver/blob/main/configs/ruGPT35_13B_fc_lora.yml
|
| 22 |
|
| 23 |
-
|
| 24 |
-
# Training time
|
| 25 |
-
# - 1x RTX 4090 ~ 20Gb VRAM ~ 11h 8m
|
| 26 |
|
|
|
|
| 27 |
output_dir: ./models/ruGPT35_13B_lora_fc
|
| 28 |
train_path: ./train.ruGPT35_13B_fc.jsonl
|
| 29 |
val_path: ./val.ruGPT35_13B_fc.jsonl
|
|
|
|
| 20 |
|
| 21 |
Конфигурация: https://github.com/EvilFreelancer/impruver/blob/main/configs/ruGPT35_13B_fc_lora.yml
|
| 22 |
|
| 23 |
+
Адаптер обучался на 1x RTX 4090, для этого потребовалось примерно 20Gb VRAM и заняло 11h 8m.
|
|
|
|
|
|
|
| 24 |
|
| 25 |
+
```yaml
|
| 26 |
output_dir: ./models/ruGPT35_13B_lora_fc
|
| 27 |
train_path: ./train.ruGPT35_13B_fc.jsonl
|
| 28 |
val_path: ./val.ruGPT35_13B_fc.jsonl
|