Update README.md
Browse files
README.md
CHANGED
|
@@ -8,9 +8,20 @@ base_model:
|
|
| 8 |
pipeline_tag: text-generation
|
| 9 |
library_name: transformers
|
| 10 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
# ARWKV-7B-GATE-MLP (Preview 0.1)
|
| 12 |
|
| 13 |
-
<img src="./figures/architecture.png" alt="ARWKV Hybrid Architecture"
|
| 14 |
|
| 15 |
*Preview version with **RWKV-7** time mixing and Transformer MLP*
|
| 16 |
|
|
|
|
| 8 |
pipeline_tag: text-generation
|
| 9 |
library_name: transformers
|
| 10 |
---
|
| 11 |
+
<div align="center">
|
| 12 |
+
<img src="./figures/banner.jpg" style="border-radius: 10px; width: 100%; height: 100%; object-fit: cover; box-shadow: 10px 10px 20px rgba(0, 0, 0, 0.5); border: 2px solid white;" alt="ARWKV" />
|
| 13 |
+
</div>
|
| 14 |
+
|
| 15 |
+
|
| 16 |
+
<h1 align="center">ARWKV🪿</h1>
|
| 17 |
+
|
| 18 |
+
<p align="center">
|
| 19 |
+
<a href="#"><b>Paper Link</b>👁️</a>
|
| 20 |
+
</p>
|
| 21 |
+
|
| 22 |
# ARWKV-7B-GATE-MLP (Preview 0.1)
|
| 23 |
|
| 24 |
+
<img src="./figures/architecture.png" alt="ARWKV Hybrid Architecture" width="30%">
|
| 25 |
|
| 26 |
*Preview version with **RWKV-7** time mixing and Transformer MLP*
|
| 27 |
|