We are using kafka cluster and we want monitor this cluster.
Current our approach:
telegraf jolokia plugin
or jmxtrans
)But we faced with problem of static configuration of kafka broker's list.
We can configure only static list via Jmxtrans
or Telegraf jolokia plugin
.
We would like dynamic list (example configure only kafka cluster zookeeper connection for getting brokers list in each iteration of collecting metrics) for case scaling up/down of kafka.
May be do exist another instruments for monitoring dynamic kafka cluster?
My finally solution next:
zkCli
is used for all kafka nodes discoveryjolokia
requet to each kafka node, aggregates and format to influx plugin.