Commit
·
2616703
1
Parent(s):
c2f5171
Update README.md
Browse files
README.md
CHANGED
|
@@ -12,6 +12,7 @@ Pre-trained model: Jellywibble/dalio-pretrained-book-bs4-seed1 (based-off OPT30B
|
|
| 12 |
Fine-tuning dataset: Jellywibble/dalio_handwritten-conversations
|
| 13 |
|
| 14 |
## Model Parameters
|
|
|
|
| 15 |
- base_mode_name Jellywibble/dalio-pretrained-book-bs4-seed1
|
| 16 |
- dataset_name Jellywibble/dalio_handwritten-conversations
|
| 17 |
- block size 500
|
|
|
|
| 12 |
Fine-tuning dataset: Jellywibble/dalio_handwritten-conversations
|
| 13 |
|
| 14 |
## Model Parameters
|
| 15 |
+
- 4xA40 (eff. batch size = 4)
|
| 16 |
- base_mode_name Jellywibble/dalio-pretrained-book-bs4-seed1
|
| 17 |
- dataset_name Jellywibble/dalio_handwritten-conversations
|
| 18 |
- block size 500
|