How to Implement Debug Logging

Goal

In case of execution errors or a long runtime of workbooks, it might be necessary to implement additional logging to debug a workbook and find out the cause which is preventing it from a successful run. 

Learn

First, configure the artifact in question for a specific execution framework. Then implement the enhanced logging. 

For Tez related job set within the workbook-specific Custom Properties  

das.debug.tasks.logs.collect.force=true
das.execution-framework=Tez
tez.task.log.level=DEBUG;org.apache.parquet=INFO
tez.am.log.level=DEBUG

Set the Default log severity to

TRACE

And Logging Customization of

log4j.category.datameer=TRACE
log4j.category.org.apache.hadoop=DEBUG

Further Information

Include Hadoop Task Logs