RWKV

/

rwkv-6-world-1b6

like 7

Follow

RWKV 122

Hi, Thanks for sharing this repo!
model and tokenizer seem like still RWKV-5. Is it correct(just typo?)? or will you plan an update model?

model = AutoModelForCausalLM.from_pretrained("RWKV/rwkv-5-world-1b6", trust_remote_code=True, torch_dtype=torch.float16).to(0)
tokenizer = AutoTokenizer.from_pretrained("RWKV/rwkv-5-world-1b6", trust_remote_code=True, padding_side='left', pad_token="<s>")

Thanks in advance.