apify/crawlee ? reverse-engineered prompt

Build me a Node.js and TypeScript web scraping library that helps people create reliable crawlers without a lot of setup. I want it to handle normal HTTP pages and full browser pages, so users can scrape simple sites quickly but also open real browsers when a site needs JavaScript.

It should let someone start from a URL, follow links, save scraped results as JSON, and download files like HTML, PDFs, images, and other assets. Please include a persistent URL queue, retries, error handling, session management, proxy rotation, and automatic scaling based on the computer’s resources. Make the crawlers act more human like by default with realistic headers and browser fingerprints.

Support Playwright and Puppeteer for browser crawling, and fast HTML parsing for simpler pages. Add a small CLI that creates a starter crawler project, plus clear examples showing how to scrape page titles, follow links, and store results locally. Use current docs online if you need to.