linkedin/kafka-remote-storage-azure — reverse-engineered prompt

Reverse engineered prompt

GitHub

Build me a Java Gradle project for a Kafka tiered storage plugin that stores older Kafka log data in Azure Blob Storage. It should act as a Remote Storage Manager for Kafka KIP 405, with the basic actions Kafka needs, copy log segments and index files to Azure blobs, read them back, and delete them when Kafka asks.

Use Azure storage account name and key authentication, support a configurable blob endpoint so I can test locally with Azurite, and include a simple in memory blob cache. Please add unit tests that can run against the Azurite blob emulator.

I also want sample Kafka server properties that show how to enable remote log storage, point Kafka at this plugin, set the Azure account, key, endpoint, and remote log metadata settings. The build should produce one shaded jar that I can put on the Kafka classpath and run with kafka server start. Keep it simple and easy to understand.

Want more depth? Deep Reverse