hadoophiveparametersmapreduceapache-tez

TEZ parameter equivalent to "mapreduce.map.failures.maxpercent"

In previous versions of Hadoop where MR is used we have a set parameter for ignoring certain percentage of vertex failures.In the new versions where MR is deprecated, is there any equivalent parameter for mapreduce.map.failures.maxpercent in TEZ?

Solution

  • I this Jira new configuration property tez.vertex.failures.maxpercent was added:

    Float value. Specifies the allowable percentage in the range 0.0-100.0f of task failures per vertex that will allow the vertex to succeed with failures. Default is 0.0f

    See also TezConfiguration.java