File Upload Fails in TEZ Execution Framework with java.io.IOException

Problem

When a user submits a File Upload, the job fails when executed in the TEZ framework. The following stacktrace is included in the Job log for the failed job.

Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied. user=myusername is not the owner of inode=12345678-1234-abcd-abcd-0123456789ab
at org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.checkOwner(DefaultAuthorizationProvider.java:169)
at org.apache.hadoop.hdfs.server.namenode.DefaultAuthorizationProvider.checkPermission(DefaultAuthorizationProvider.java:157)
at org.apache.sentry.hdfs.SentryAuthorizationProvider.checkPermission(SentryAuthorizationProvider.java:174)
at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:138)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:6287)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkPermission(FSNamesystem.java:6269)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOwner(FSNamesystem.java:6188)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.setPermissionInt(FSNamesystem.java:1707)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.setPermission(FSNamesystem.java:1687)

Cause

This is a known issue affecting Datameer 5.5. 

Solution

To work-around this issue, the File Uploads need to include one additional configuration option. Specifically, on the Configure tab of the wizard, expand the Advanced section and add the following to the 'Custom Properties' section:

das.execution-framework=Local

This issue was resolved in Datameer 5.6 and later. 

If required, please contact Datameer Support for further information.