we have ambari cluster version - 2.6.1 and hadoop version 2.6.4
number of datanode are - 10
from ambari dashboard we can see the window that show the follwing:
DataNodes Live
9/10
but after few min all datanode are alive as:
DataNodes Live
10/10
and again after few min we see again
DataNodes Live
9/10
its seems that namenode has not received heartbeat msg from a datanode for more than interval, then datanode will be marked and as "dead"
we check the follwing:
what we can do else in order to verify why DataNode alive isn't stable ?
we increased the data node heap size from default value - 2G to 6G since then , now data node alive from ambari dashboard are stable