I am current doing an Hadoop environment review and i find that jobs contain the following line.
INFO [2017-02-01 03:00:06.126] [JobScheduler worker1-thread-8833] (MrPlanRunnerV2.java:61) - Allow running Datameer job with up to 1 concurrent cluster jobs.
Does it indicate that Tez Exe Framework should run just 1 datameer job at a time, resulting in queuing of Datameer jobs ?
Does it mean that for 1 datameer job , 1 Tez job is allocated.
If it is Scenario 1 , is there a way to increase concurrent Datameer jobs execution on hadoop framework so that many Datameer jobs can execute in parallel and help clear up processing window.
Please sign in to leave a comment.