---
language:
- en
tags:
- pytorch
- text-generation
- causal-lm
- rwkv
license: apache-2.0
datasets:
- the_pile

---

# RWKV-4 "Raven"-series Models

## Model Description

These are RWKV-4-Pile models finetuned on Alpaca, CodeAlpaca, Guanaco, GPT4All.

Gradio Demo: https://huggingface.co./spaces/BlinkDL/Raven-RWKV-7B

Use https://github.com/BlinkDL/ChatRWKV to run them.

See https://github.com/BlinkDL/RWKV-LM for details on the RWKV Language Model (100% RNN).

* RWKV-4-Raven-v7-Eng (99% English + 1% Multilang)
* RWKV-4-Raven-v7-EngAndMore (97% English + 3% Multilang)
* RWKV-4-Raven-v6-EngChnJpn (98% English + 1% Chn Jpn + 1% Multilang)
* RWKV-4-Raven-v6-ChnEng (40% English + 60% Chinese)

Previous Raven models are in:
https://huggingface.co./BlinkDL/rwkv-4-pile-7b
https://huggingface.co./BlinkDL/rwkv-4-pile-14b