binux/pyspider ? reverse-engineered prompt

Build me a Python web crawler system like pyspider, with a simple web interface where I can write and run crawl scripts, watch tasks as they happen, manage projects, and view scraped results.

I want it to support scheduled crawls, retries, periodic jobs, and recrawling old pages automatically. It should be able to crawl normal pages and JavaScript heavy pages, and it should work in a distributed way so multiple workers can share the load.

Please make it easy to run locally with a single command, and include a clear setup for using a database and message queue so it can scale later. A basic example spider would be great too, plus the ability to edit the script in the UI and see output right away.

If anything in the docs needs checking, look up current docs online if you need to.