amazon-web-servicesapache-kafkakafka-consumer-apiaws-mskamazon-msk

How to check the undelivered messages in Amazon MSK?


I was going through AWS 's service MSK which is Managed Service for Kafka. I wanted to check how many messages have not been consumed by the consumer after I send them from a producer.

Is the only way to do it via enabling the Monitoring options AWS provides?

Because I tried the general Kafka commands and other Stackoverflow answers related to Kafka, they have not worked for MSK. And why can't we do this? When I hit the --describe option with my zookeeper string in my instnace, there is no LAG column there either.


Solution

  • Execute below command from local Kafka/bin directory

    bin/kafka-consumer-groups.sh --bootstrap-server kafka-bootstrap-ip:9092 --describe --group my-group 
    
    1. Update kafka-bootstrap-ip with actual kafka cluster ip address.

    2. Update my-group with actual group name