apache-kafkaapache-kafka-streamskafka-producer-api

Kafka Streams - a deleted target topic


For testing purposes I deleted the target topic and was expecting the application to timeout after some time. However after some research I understood that Kafka Streams retries a message by default until the target topic comes online again and the configurations under StreamsConfig (task.timeout.ms, request.timeout.ms and retries = 0) are set for the Kafka Producer.

Could anyone reassure me that this conclusion was true and if not could you advise on the configurations that I need in order to force Kafka Streams to stop retrying after some period of time.


Solution

  • For this particular problem, Kafka Streams will currently retry forever, because the received TimeoutException is a Retriable exception.

    It's a known issue: https://issues.apache.org/jira/browse/KAFKA-16508