san089/Udacity-Data-Engineering-Projects ? reverse-engineered prompt

Reverse engineered prompt

Build me a data engineering project repo with a handful of realistic mini projects, mostly in Python, that show how to take raw JSON or API data and turn it into useful tables and pipelines.

I want examples for loading song and user activity data into Postgres, modeling a similar dataset in Cassandra for a few common lookup questions, building a warehouse flow on AWS with Redshift, and a data lake style pipeline that reads from S3 and writes cleaned data back out. Also include an Airflow pipeline to orchestrate a few ETL jobs, plus a simple script that pulls data from an API and stores it in Postgres.

If it makes sense, add basic infrastructure setup for the cloud pieces and a clear README for each project so someone can run and understand them. Keep it practical and educational, and look up current docs online if you need to.

Are you gonna build this?

make sure you review the code using arcumet

Try freeSponsored — opens Arcumet in a new tab