apache-kafkadata-ingestion

Is there any api or tool for getting ingestion ratio in a kafka topic


How can I find the ingestion ratio? i.e., no of events/bytes ingested every second/minute interval


Solution

  • As mentioned in the other answer, Kafka exports metrics via JMX that cover bytes in/out rates as well as a number of other interesting data points. For the full details, see the Monitoring section in the docs.

    It's recommended to collect and graph any of these metrics in you are planning to run a Kafka cluster.

    Now if you just want to quickly get these values while developing, you have a couple of other options:

    For these to work, you must enable the JVM to expose JMX on a port.