kafka-consumer-apiazure-eventhub

Azure Eventhub capture functionality and how to replay


What exactly the Azure EventHub capture is? Is it a mechanism to have infinite retention of events in a persistent storage like Azure blobs inside a storage account in the form of avro/parquet? If so, how do i replay these events (those captured in azure storage via the EventHub capture) from beginning using a normal kafka consumer.


Solution

  • To tackle your particular situation - No you can't use a regular kafka consumer to replay eventhub capture data (which is usually stored as an avro file in a blob storage container). You can maybe write something to push these messages back into an eventhub to consume them, or just consume them directly