Workbook execution failing
Map_for_sheets__Column_transposer__Final: Shuffle failed with too many fetch failures and insufficient progress!failureCounts=41, pendingInputs=575, fetcherHealthy=false, reducerProgressedEnough=false, reducerStalled=false
Nearly 1.24Billion records to be processed and the datameer jobs fails with above error messages. any help on how to infer the above message is well appreciated. Thanks
-
Ganesh,
Good afternoon!
Has this job failed in the past or is this the first time we are seeing this sort of failure?
If the job were to execute again, would it succeed or is this failure consistent?
Perhaps you can share more logging from both the cluster and Datameer sides?
We have a community article that addresses fetch failure. The errors contained within are not quite what you are seeing, but I'll link it below so that you can validate the content:
https://support.datameer.com/hc/en-us/articles/115000709503-Shuffle-Failures
Thanks,
Brian
Please sign in to leave a comment.
Comments
1 comment