KaleiNeely commited on
Commit
156a17d
·
1 Parent(s): ce30232

add v5 and v5.1 models

Browse files

Signed-off-by: daquexian <[email protected]>

RWKV-5-ABC-82M-v1-20230901-ctx1024-ncnn.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4ef189eb245b30994558a51781297ad3e662f87ce8540890be36bad3c3fe9a0
3
+ size 331519488
RWKV-5-ABC-82M-v1-20230901-ctx1024-ncnn.config ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ version: 5.1
2
+ head_size: 8
3
+ n_layer: 24
4
+ n_embd: 512
5
+ n_att: 512
6
+ n_ffn: 1792
RWKV-5-ABC-82M-v1-20230901-ctx1024-ncnn.param ADDED
The diff for this file is too large to render. See raw diff
 
RWKV-5-World-0.1B-v1-20230803-ctx4096-ncnn.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d82d4e2e474959bdef53c36b32f305e216c58601ec3fa4d8c72f0ad598600443
3
+ size 773549184
RWKV-5-World-0.1B-v1-20230803-ctx4096-ncnn.config ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ version: 5
2
+ head_size: 12
3
+ n_layer: 12
4
+ n_embd: 768
5
+ n_att: 768
6
+ n_ffn: 3072
RWKV-5-World-0.1B-v1-20230803-ctx4096-ncnn.param ADDED
The diff for this file is too large to render. See raw diff