D4vinci/Scrapling ? reverse-engineered prompt
Reverse engineered prompt
Build me a Python web scraping library that can handle both simple page fetches and bigger crawls.
I want it to be able to grab pages, extract data with CSS and XPath style selectors, and keep working even when a site changes a bit. It should also have a stealth mode for tougher sites, work with both normal and async requests, and support browser based fetching when needed. For larger jobs, add a spider style crawler with concurrent crawling, pause and resume, proxy rotation, and basic stats so I can see what’s happening while it runs.
Please make it feel easy to use from Python, with a small clean API and a simple example script or two. If it helps, look up current docs online for any scraping or browser automation details you need.
Are you gonna build this?
make sure you review the code using coderabbit