latestissue

/

rwkv-4-world-ggml

like 3

I'd use this branch until it's merged upstream:
https://github.com/Mathmagician8191/rwkv.cpp

Then you'll need to put an appropriate librwkv.so file matching your OS into the rwkvcpp folder:

https://github.com/saharNooby/rwkv.cpp/releases/tag/master-5b41cd7

Then 'cd rwkv', 'python3 chat_with_bot.py [model_path]'

(Do configure prompts for your own language and edit the 'chat_with_bot.py' accordingly.)