Shubham39874/crypto-pipeline ? reverse-engineered prompt

Build me a small end to end crypto streaming pipeline in Python that feels production ready.

I want it to generate high frequency crypto price events, send them through Kafka, check the data as it comes in, and save it into a simple lakehouse style setup with raw, cleaned, and aggregated layers. Please make sure bad records get rejected, prices are validated, and the pipeline keeps running smoothly with decent logging and basic error handling.

I also want a simple Streamlit dashboard that shows the latest telemetry, pipeline health, and a few useful market metrics so I can see the data moving in real time.

If it helps, use Docker so I can bring the whole thing up locally with one command, and keep the code organized into separate producer and consumer scripts. Look up current docs online if you need to.