Is it safe to delete contents in <datameer private folder>/joblogs in HDFS?

Follow

Nikhil Srinidhi

• November 22, 2016 21:04

I'm trying to clear up space on HDFS and noticed that /<datameer private folder>/joblogs is taking up nearly 1 TB. 

How do I go about deleting it? Can I delete it through Datameer application or just delete straight off HDFS?

 

 

0

• Official comment

  

  Joel Stewart

  • November 22, 2016 21:28

  This content is maintained by the Datameer server itself. By default, job logs should be kept in the HDFS folder you shared for 28 days. After 28 days, they are marked for deletion and then Datameer Housekeeping will remove the log entries.

  I do not recommend manually deleting these files from HDFS since these entries are stored in the Datameer metadata database as well. Manually deleting this data would cause it to get out of sync. 

  Comment actions Permalink

Please sign in to leave a comment.