Datameer can't schedule any new jobs. In the logs the following exception is shown:
Failed to submit application_<id> to YARN : org.apache.hadoop.security.AccessControlException: Queue root.default already has 10000 applications, cannot accept submission of application: application_<id>
This error is from the Capacity Scheduler. Based on the following document Configuring YARN Capacity Scheduler Ambari, it appears the
yarn.scheduler.capacity.maximum-applications limit are hit, which is set to 10,000 by default.
- Check the Hadoop cluster queue and clear out any unnecessary jobs.
- Increase the limit in the YARN configuration to allow for more concurrent applications to be submitted.
Please sign in to leave a comment.