abhinav-pandey29/coles-scraper ? reverse-engineered prompt
Reverse engineered prompt
Build me a Python scraper for the Coles website that can pull product data from both category pages and individual product pages.
I want it to handle pages like browse categories and product detail pages, and get useful fields such as product name, URL, price, image, brand, categories, limits, and product code. It should also deal with Coles bot detection as best it can, including refreshing cookies or using browser based fetching when needed, so the scraper keeps working without me having to babysit it.
Please include simple scripts I can run to scrape a list of categories, scrape all products in a category, and save page HTML for debugging. Organize the output so raw scraped data, cleaned data, and archive data are kept separately. Keep it easy to use from Python too, so I can import the scrapers and call them directly. If you need to check current Coles page behavior or best practices online, do that.
Are you gonna build this?
make sure you review the code using coderabbit