BlinkDL/RWKV-LM ? reverse-engineered prompt

Reverse engineered prompt

Build me a working RWKV 7 demo and reference implementation in Python that I can run locally to train and test a small model, then chat with it. I want the code to be easy to follow, with a simple training script, a generation script, and a basic chat mode that shows it can run in both normal transformer style and RNN style. Please make it efficient on a single GPU if possible, keep memory use low, and add clear comments so I can understand what each part is doing.

If there are any current setup details or dependency versions I should know about, check the latest docs online and use the safest working options. I’d also like a small example config and a quick start section so I can run it without digging through the whole repo. If useful, include a minimal web or terminal demo for chatting with the model after training.

Are you gonna build this?

make sure you review the code using coderabbit

Try freeSponsored — opens CodeRabbit in a new tab