Tez not running on HDP 2.4 with DAS 6.1.2

Comments

2 comments

  • Konsta Danyliuk

    Hello Michael,

    In order to resolve Tez errors caused by Container exited with a non-zero exit code 1

    I would suggest to try the following steps:

    1. Please ensure that you have correct Yarn classpath set at Datameer cluster settings.

    • Type the command yarn classpath at your namenode cli and ensure that corresponding setting at your Datameer cluster matches to it's output.

    Related documentation Job Failure - ExitCodeException exitCode=1

    2. Check whether native Hadoop libraries have been properly set

    • Find where native hadoop libraries live: sudo find / -name libhadoop.so
    • Set below custom properties at your cluster settings
    yarn.app.mapreduce.am.env=LD_LIBRARY_PATH=$LD_LIBRARY_PATH:<absolute-path-to-native-libs>

    yarn.app.mapreduce.am.admin.user.env=LD_LIBRARY_PATH=$LD_LIBRARY_PATH:<absolute-path-to-native-libs>

    mapreduce.admin.user.env=LD_LIBRARY_PATH=$LD_LIBRARY_PATH:<absolute-path-to-native-libs>

    mapred.child.env=LD_LIBRARY_PATH=$LD_LIBRARY_PATH:<absolute-path-to-native-libs>

    tez.am.launch.env=LD_LIBRARY_PATH=$LD_LIBRARY_PATH:<absolute-path-to-native-libs>

    tez.task.launch.env=LD_LIBRARY_PATH=$LD_LIBRARY_PATH:<absolute-path-to-native-libs>

    Let me know if this helps you resolve the issue.

     

    0
    Comment actions Permalink
  • Michael Ahn

    Fixing the YARN class path helped. I did not think in that direction because MR2 and Spark worked. Thanks

    0
    Comment actions Permalink

Please sign in to leave a comment.