jha-vineet69/AgriMarket ? reverse-engineered prompt
Reverse engineered prompt
Build me a Python scraper for the Agmarknet portal that can collect historical agricultural market data for different commodities and markets in India.
I want it to open the site, work through the pages that only show 50 rows at a time, keep clicking through until all the data is collected, and then save the results in a clean CSV file. It should be able to handle the slow loading on the site without breaking, so please include sensible pauses and waiting where needed.
Use Selenium to interact with the page and BeautifulSoup to extract the table data. I’d also like the code to be easy to read and commented so I can understand how it works and tweak it later for daily prices if needed.
If there’s anything about the site that may have changed, please check the current page structure or look up the latest docs online before coding.
Are you gonna build this?
make sure you review the code using coderabbit