Hive Export Job Fails with datameer.com.google.common.base.VerifyException

Symptoms

The following exception has been observed for Hive Export jobs in environments that are not configured to impersonate:

• ... INFO [<timestamp>] [ConcurrentJobExecutor-0] (HiveServer2ThriftClient.java:222) - Applying connection properties '{hive.server2.proxy.user=system}' ERROR [<timestamp>] [ConcurrentJobExecutor-0] (ClusterSession.java:198) - Failed to run cluster job 'Export job (15212): <jobName>#export(Export record processor)' [0 sec] datameer.com.google.common.util.concurrent.UncheckedExecutionException: datameer.com.google.common.base.VerifyException: Failed to validate proxy privilege of ORDMONS1 for system *org.apache.hive.service.cli.HiveSQLException:Failed to validate proxy privilege of <DatameerSystemUser> for system:14:13 ... 

• This is a known defect affecting Datameer 5.11, 6.0 and 6.1. It is known internally as DAP-28581.

• Then the Export Job fails because of the user system is not available in Hive or via Sentry

• The "das.job.hdfs.ownership" property is not specified in the Datameer environment

Resolution

To work around this issue, follow these steps:

1. Login as a Datameer admin
2. Under tab Administration and Hadoop Cluster
3. Set in Custom Properties

• das.job.hdfs.ownership=<DatameerSystemUser> 

A permanent fix may be available in a maintenance release. Please check with Datameer Support or your Technical Account Manager for further information.