Commit
·
156a17d
1
Parent(s):
ce30232
add v5 and v5.1 models
Browse filesSigned-off-by: daquexian <[email protected]>
- RWKV-5-ABC-82M-v1-20230901-ctx1024-ncnn.bin +3 -0
- RWKV-5-ABC-82M-v1-20230901-ctx1024-ncnn.config +6 -0
- RWKV-5-ABC-82M-v1-20230901-ctx1024-ncnn.param +0 -0
- RWKV-5-World-0.1B-v1-20230803-ctx4096-ncnn.bin +3 -0
- RWKV-5-World-0.1B-v1-20230803-ctx4096-ncnn.config +6 -0
- RWKV-5-World-0.1B-v1-20230803-ctx4096-ncnn.param +0 -0
RWKV-5-ABC-82M-v1-20230901-ctx1024-ncnn.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e4ef189eb245b30994558a51781297ad3e662f87ce8540890be36bad3c3fe9a0
|
3 |
+
size 331519488
|
RWKV-5-ABC-82M-v1-20230901-ctx1024-ncnn.config
ADDED
@@ -0,0 +1,6 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
version: 5.1
|
2 |
+
head_size: 8
|
3 |
+
n_layer: 24
|
4 |
+
n_embd: 512
|
5 |
+
n_att: 512
|
6 |
+
n_ffn: 1792
|
RWKV-5-ABC-82M-v1-20230901-ctx1024-ncnn.param
ADDED
The diff for this file is too large to render.
See raw diff
|
|
RWKV-5-World-0.1B-v1-20230803-ctx4096-ncnn.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d82d4e2e474959bdef53c36b32f305e216c58601ec3fa4d8c72f0ad598600443
|
3 |
+
size 773549184
|
RWKV-5-World-0.1B-v1-20230803-ctx4096-ncnn.config
ADDED
@@ -0,0 +1,6 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
version: 5
|
2 |
+
head_size: 12
|
3 |
+
n_layer: 12
|
4 |
+
n_embd: 768
|
5 |
+
n_att: 768
|
6 |
+
n_ffn: 3072
|
RWKV-5-World-0.1B-v1-20230803-ctx4096-ncnn.param
ADDED
The diff for this file is too large to render.
See raw diff
|
|