RWKV-Red-Team
/

ARWKV-7B-Preview-0.1

Text Generation

Model card Files Files and versions Community

xiaol commited on 19 days ago

Commit

1153ebc

·

verified ·

1 Parent(s): 3721c13

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -56,7 +56,7 @@ tokenizer = AutoTokenizer.from_pretrained(
 | Architecture | RWKV-7 TimeMix + SwiGLU | Hybrid design |
 | Context Window | 2048 training CTX | *Preview limitation* |
 | Training Tokens | 40M | Distillation-focused |
-| Precision | FP16 inference recommended | 15%↑ vs BF16 |
 ## 🏗️ Architecture Highlights
 ### Core Modification Flow

 | Architecture | RWKV-7 TimeMix + SwiGLU | Hybrid design |
 | Context Window | 2048 training CTX | *Preview limitation* |
 | Training Tokens | 40M | Distillation-focused |
+| Precision | FP16 inference recommended(16G Vram required) | 15%↑ vs BF16 |
 ## 🏗️ Architecture Highlights
 ### Core Modification Flow