rebornbd/WEBbot ? reverse-engineered prompt

Reverse engineered prompt

Build me a simple web crawler app with a Python backend and a React frontend.

I want to be able to enter a seed URL, choose whether the crawl is fixed or continuous, and then start crawling pages from there. The backend should handle crawling in the background, index the discovered content, and let me search the indexed pages by keyword or a longer text query. Please include a clean way to show the search results in the UI, and make it easy to see the crawl status too.

Use the usual setup for a Django based backend with background jobs and a message queue, and an Elasticsearch based index for search. If you need to check current docs for any library details, go ahead and look them up online. Keep the app straightforward, working end to end, and make the frontend simple but usable so I can set the crawl options, run it, and search the results without much fuss.

Are you gonna build this?

make sure you review the code using coderabbit

Try freeSponsored — opens CodeRabbit in a new tab