MohammadSaif001/ELT-LAKEHOUSE ? reverse-engineered prompt

Reverse engineered prompt

Build me an end to end synthetic e commerce data lakehouse that can generate realistic Olist style data, load it into Delta tables, and process it through Bronze, Silver, and Gold layers.

I want one main script or simple commands that can set everything up, generate the data in chunks, run the Spark ingestion, apply contract based schema validation and data quality checks, and write clean Silver outputs with quarantine for bad records. Then create the Gold layer from the Silver tables and make it easy to publish the final data to PostgreSQL if the connection settings are there.

Also include a small read only monitoring dashboard that shows pipeline status, data quality, storage health, and logs, plus a way to run tests and a report sender. Please keep it production style but still easy to run locally, and make sure it works with the config files and schema contracts in the repo. If you need current library details, look them up online.

Are you gonna build this?

make sure you review the code using coderabbit

Try freeSponsored — opens CodeRabbit in a new tab