unclecode/crawl4AI ? reverse-engineered prompt

Reverse engineered prompt

Build me a Python tool that can crawl websites and turn pages into clean Markdown that is easy to feed into AI apps, RAG pipelines, or data scripts.

I want it to work both from code and from a simple command line, so I can point it at a URL, get back readable markdown, or ask it to extract specific information like product prices or article details. It should handle single page crawls and deeper site crawling, and it should be fast enough for larger jobs without feeling fragile. If possible, make it support browser based crawling, sessions, cookies, and other basics that help with real websites, plus a way to run it in Docker.

Please make the output clean and practical, with headings, tables, and links preserved where useful. If you need current browser or Playwright setup details, look up the latest docs online.

Are you gonna build this?

make sure you review the code using coderabbit

Try freeSponsored — opens CodeRabbit in a new tab