Update README.md
Browse files
README.md
CHANGED
@@ -8,9 +8,10 @@ tags:
|
|
8 |
datasets: pt-sk/research_papers_short
|
9 |
metrics: CrossEntropyLoss
|
10 |
---
|
|
|
11 |
|
12 |
-
Optimizer: AdamW
|
13 |
-
Leanring Rate: 0.001
|
14 |
|
15 |
|
16 |
|
|
|
8 |
datasets: pt-sk/research_papers_short
|
9 |
metrics: CrossEntropyLoss
|
10 |
---
|
11 |
+
This model using Mamba Architecuture trained on a research abstract dataset.
|
12 |
|
13 |
+
* Optimizer: AdamW
|
14 |
+
* Leanring Rate: 0.001
|
15 |
|
16 |
|
17 |
|