Anakin-Inc/anakin ? reverse-engineered prompt
Reverse engineered prompt
Build me a self hosted web scraping app that can turn any URL into clean markdown or structured JSON.
I want it to be easy to run with one command, with a simple API I can call from curl or from another app, and a small web dashboard where I can paste in a URL, see the results, and track recent jobs. It should handle normal pages fast, and fall back to a browser for tricky sites, with proxy support for harder pages. If a page fails or looks blocked, try another approach automatically.
Make the output good for LLMs, so strip away the junk and keep the useful content. Also include an option to do async jobs for slower pages, plus batch scraping for a handful of URLs at once. If it helps, use current docs online for any libraries or setup details.
Are you gonna build this?
make sure you review the code using coderabbit