Problem
An ExportJob to Tableau server is failing with the below exception:
Container container_00_0000033534016_00000_01_000004 finished with diagnostics set to [Container failed, exitCode=134. Exception from container-launch.
Container id: container_00_0000033534016_00000_01_000004
Exit code: 134
Stack trace: ExitCodeException exitCode=134:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:543)
at org.apache.hadoop.util.Shell.run(Shell.java:460)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:720)
Cause
As data is exported in TDE format, depending on the amount of data, it is possible for the TDE process to be terminated due to exceeding the allocated container size.
TDE is a columnar format and the implementation of those formats typically requires a significant amount of memory for buffering.
exitCode=134 breaks down as 128+6, where 6 - SIGABRT. The container is being killed by the Node Manager or the OS itself. Node Manager logs may contain additional detail.
Solution
As a first step, try to increase the overall container size for this particular ExportJob, with the below custom properties:
das.job.map-task.memory=<Desired memory MB>
das.job.reduce-task.memory=<Desired memory MB>
das.job.application-manager.memory=<Desired memory MB>
das.job.container.memory-heap-fraction=0.7
If this doesn't help, please get in touch with Datameer Support.
Comments
0 comments
Please sign in to leave a comment.