BlinkDL/RWKV-LM ? reverse-engineered prompt
Reverse engineered prompt
Build me a working RWKV 7 demo and reference implementation in Python that I can run locally to train and test a small model, then chat with it. I want the code to be easy to follow, with a simple training script, a generation script, and a basic chat mode that shows it can run in both normal transformer style and RNN style. Please make it efficient on a single GPU if possible, keep memory use low, and add clear comments so I can understand what each part is doing.
If there are any current setup details or dependency versions I should know about, check the latest docs online and use the safest working options. I’d also like a small example config and a quick start section so I can run it without digging through the whole repo. If useful, include a minimal web or terminal demo for chatting with the model after training.
Are you gonna build this?
make sure you review the code using coderabbit