angadkumar9128/retail-data-engineering-analytics-pipeline-with-airflow-and-dbt ? reverse-engineered prompt

Reverse engineered prompt

Build me an end to end retail analytics pipeline for Walmart data that turns raw source files into clean reporting tables. I want it to follow a bronze, silver, gold style flow, with Airflow handling the scheduling and dbt doing the transformations on Databricks or Delta Lake.

The pipeline should ingest the raw data, clean and standardize it, then build business friendly tables for sales, orders, customers, stores, and products. I also want the model to support snapshots for slowly changing dimensions, some reusable intermediate models, and final fact and dimension tables that are ready for dashboards and reporting.

Please include data quality checks and basic tests so I can trust the outputs, plus clear project docs and an easy way to run the whole workflow locally if possible. If you need to, look up current docs online for any setup details or best practices.

Are you gonna build this?

make sure you review the code using coderabbit

Try freeSponsored — opens CodeRabbit in a new tab