redpanda-data/benthos ? reverse-engineered prompt
Reverse engineered prompt
Build me a Go based stream processing tool where I can define a whole data pipeline in one simple config file.
I want it to read from a source, run messages through one or more processing steps, then send the result to one or more outputs. The config should feel straightforward and declarative, with examples like pulling from GCP Pub/Sub, transforming the payload with a mapping step, then writing to Redis Streams.
Please make it reliable for production, with at least once delivery behavior, so messages are not lost if the process crashes or the machine has problems. Keep the setup simple, with no need for persisted local state if you can avoid it.
Also include the basic developer workflow for formatting and linting the code, and make sure the project builds cleanly from the command line. If you need to check current docs or APIs while implementing it, look them up online.
Are you gonna build this?
make sure you review the code using coderabbit