Cannot configure email account for Email Analytics App

Answered

Follow

Rahul Dhond

• November 19, 2015 17:23

Hello,
I am trying to run the email analytics app but am stuck at the first step (configuring email). I am entering my yahoo email id with password and it populates the rest of the fields (mail server settings etc) but then I get an error and nothing gets pulled/populated into Datameer.
What am I doing wrong?
thanks & regards,
Rahul

0

• 

  Rahul Dhond

  • November 19, 2015 18:57

  Import Job gets created (I can even see my emails being brought in during the steps) but when I run the import job nothing actually gets pulled and saved..(0 records)..
  Can you please let me know what am I doing wrong?

  0

  Comment actions Permalink
• 

  Rahul Dhond

  • November 19, 2015 19:02

  ErrorLogException: Failed to read record source, byte position is 0
  ErrorLogException: The following split: 'MailMessageInputSplit[offset=0,length=1836]', has been dropped from import.

  0

  Comment actions Permalink
• 

  Joel Stewart

  • November 19, 2015 19:26

  Rahul could you share the contents of the Job log in full? That would help determine where the issue may lie?

  0

  Comment actions Permalink
• 

  Rahul Dhond

  • November 19, 2015 20:03

  !message:ErrorLogException: Failed to read record source, byte position is 0
  !Error Repeated:4 times
  !Reason:IOException: java.lang.NullPointerException
  !Source Split:DasDelegateSplit: MailMessageInputSplit[offset=0,length=1836] - plugin-mail
  !stack:datameer.dap.sdk.ErrorLogException: Failed to read record source, byte position is 0
  at datameer.dap.common.job.mr.input.ImportExceptionHandler.handleRecordException(ImportExceptionHandler.java:80)
  at datameer.dap.common.job.mr.input.BaseImportRecordReader.readNextRecordSource(BaseImportRecordReader.java:100)
  at datameer.dap.common.job.mr.input.DapImportRecordReader.consumeNextRecord(DapImportRecordReader.java:71)
  at datameer.dap.common.job.mr.input.DapImportRecordReader.next(DapImportRecordReader.java:49)
  at datameer.dap.common.job.mr.input.DapImportRecordReader.next(DapImportRecordReader.java:25)
  at datameer.dap.common.graphv2.RecordSequences$2.computeNext(RecordSequences.java:93)
  at datameer.dap.common.graphv2.RecordSequences$2.computeNext(RecordSequences.java:89)
  at datameer.dap.sdk.sequence.Sequence$Simple.moveToNext(Sequence.java:157)
  at datameer.dap.sdk.sequence.Sequence$13.moveToNext(Sequence.java:602)
  at datameer.dap.sdk.sequence.Sequence$13.moveToNext(Sequence.java:602)
  at datameer.dap.sdk.sequence.Sequence$14.computeNext(Sequence.java:647)
  at datameer.dap.sdk.sequence.Sequence$Simple.moveToNext(Sequence.java:157)
  at datameer.dap.sdk.sequence.Sequence$14.computeNext(Sequence.java:647)
  at datameer.dap.sdk.sequence.Sequence$Simple.moveToNext(Sequence.java:157)
  at datameer.dap.sdk.sequence.Sequence$13.moveToNext(Sequence.java:602)
  at datameer.dap.common.graphv2.local.LocalClusterJob.runImpl(LocalClusterJob.java:342)
  at datameer.dap.common.graphv2.local.LocalClusterJob.runImpl(LocalClusterJob.java:71)
  at datameer.dap.common.graphv2.ClusterJob.run(ClusterJob.java:128)
  at datameer.dap.common.graphv2.ClusterSession.execute(ClusterSession.java:181)
  at datameer.dap.common.graphv2.ClusterSession.runAllClusterJobs(ClusterSession.java:332)
  at datameer.dap.common.graphv2.MrPlanRunnerV2.run(MrPlanRunnerV2.java:103)
  at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
  at datameer.dap.common.security.DatameerSecurityService.runAsUser(DatameerSecurityService.java:96)
  at datameer.dap.common.security.DatameerSecurityService.runAsUser(DatameerSecurityService.java:173)
  at datameer.dap.common.security.RunAsThread$1.run(RunAsThread.java:34)
  at datameer.dap.common.security.RunAsThread$1.run(RunAsThread.java:30)
  at java.security.AccessController.doPrivileged(Native Method)
  at javax.security.auth.Subject.doAs(Unknown Source)
  at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
  at datameer.dap.common.filesystem.Impersonator.doAs(Impersonator.java:31)
  at datameer.dap.common.security.RunAsThread.run(RunAsThread.java:30)
  Caused by: java.io.IOException: java.lang.NullPointerException
  at datameer.das.plugins.mail.schema.MailMessageRecordSourceReader.readNext(MailMessageRecordSourceReader.java:104)
  at datameer.das.plugins.mail.schema.MailMessageRecordSourceReader.readNext(MailMessageRecordSourceReader.java:25)
  at datameer.dap.common.job.mr.input.BaseImportRecordReader.readNextRecordSource(BaseImportRecordReader.java:89)
  ... 29 more
  Caused by: java.lang.NullPointerException
  at datameer.das.plugins.mail.schema.MailMessageFilter.acceptMessage(MailMessageFilter.java:29)
  at datameer.das.plugins.mail.schema.MailMessageRecordSourceReader.readNext(MailMessageRecordSourceReader.java:93)
  ... 31 more

  !message:ErrorLogException: The following split: 'MailMessageInputSplit[offset=0,length=1836]', has been dropped from import.
  !Successive Record Errors:5
  !Reason:IOException: java.lang.NullPointerException
  !Source Split:DasDelegateSplit: MailMessageInputSplit[offset=0,length=1836] - plugin-mail
  !stack:datameer.dap.sdk.ErrorLogException: The following split: 'MailMessageInputSplit[offset=0,length=1836]', has been dropped from import.
  at datameer.dap.common.job.mr.input.ImportExceptionHandler.handleSplitException(ImportExceptionHandler.java:30)
  at datameer.dap.common.job.mr.input.BaseImportRecordReader.readNextRecordSource(BaseImportRecordReader.java:97)
  at datameer.dap.common.job.mr.input.DapImportRecordReader.consumeNextRecord(DapImportRecordReader.java:71)
  at datameer.dap.common.job.mr.input.DapImportRecordReader.next(DapImportRecordReader.java:49)
  at datameer.dap.common.job.mr.input.DapImportRecordReader.next(DapImportRecordReader.java:25)
  at datameer.dap.common.graphv2.RecordSequences$2.computeNext(RecordSequences.java:93)
  at datameer.dap.common.graphv2.RecordSequences$2.computeNext(RecordSequences.java:89)
  at datameer.dap.sdk.sequence.Sequence$Simple.moveToNext(Sequence.java:157)
  at datameer.dap.sdk.sequence.Sequence$13.moveToNext(Sequence.java:602)
  at datameer.dap.sdk.sequence.Sequence$13.moveToNext(Sequence.java:602)
  at datameer.dap.sdk.sequence.Sequence$14.computeNext(Sequence.java:647)
  at datameer.dap.sdk.sequence.Sequence$Simple.moveToNext(Sequence.java:157)
  at datameer.dap.sdk.sequence.Sequence$14.computeNext(Sequence.java:647)
  at datameer.dap.sdk.sequence.Sequence$Simple.moveToNext(Sequence.java:157)
  at datameer.dap.sdk.sequence.Sequence$13.moveToNext(Sequence.java:602)
  at datameer.dap.common.graphv2.local.LocalClusterJob.runImpl(LocalClusterJob.java:342)
  at datameer.dap.common.graphv2.local.LocalClusterJob.runImpl(LocalClusterJob.java:71)
  at datameer.dap.common.graphv2.ClusterJob.run(ClusterJob.java:128)
  at datameer.dap.common.graphv2.ClusterSession.execute(ClusterSession.java:181)
  at datameer.dap.common.graphv2.ClusterSession.runAllClusterJobs(ClusterSession.java:332)
  at datameer.dap.common.graphv2.MrPlanRunnerV2.run(MrPlanRunnerV2.java:103)
  at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
  at datameer.dap.common.security.DatameerSecurityService.runAsUser(DatameerSecurityService.java:96)
  at datameer.dap.common.security.DatameerSecurityService.runAsUser(DatameerSecurityService.java:173)
  at datameer.dap.common.security.RunAsThread$1.run(RunAsThread.java:34)
  at datameer.dap.common.security.RunAsThread$1.run(RunAsThread.java:30)
  at java.security.AccessController.doPrivileged(Native Method)
  at javax.security.auth.Subject.doAs(Unknown Source)
  at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
  at datameer.dap.common.filesystem.Impersonator.doAs(Impersonator.java:31)
  at datameer.dap.common.security.RunAsThread.run(RunAsThread.java:30)
  Caused by: java.io.IOException: java.lang.NullPointerException
  at datameer.das.plugins.mail.schema.MailMessageRecordSourceReader.readNext(MailMessageRecordSourceReader.java:104)
  at datameer.das.plugins.mail.schema.MailMessageRecordSourceReader.readNext(MailMessageRecordSourceReader.java:25)
  at datameer.dap.common.job.mr.input.BaseImportRecordReader.readNextRecordSource(BaseImportRecordReader.java:89)
  ... 29 more
  Caused by: java.lang.NullPointerException
  at datameer.das.plugins.mail.schema.MailMessageFilter.acceptMessage(MailMessageFilter.java:29)
  at datameer.das.plugins.mail.schema.MailMessageRecordSourceReader.readNext(MailMessageRecordSourceReader.java:93)
  ... 31 more

  0

  Comment actions Permalink
• 

  Joel Stewart

  • November 20, 2015 15:10

  Thanks Rahul. We'll work on trying to reproduce this by setting up a Yahoo mail connection as well.

  0

  Comment actions Permalink
• 

  Venu Reddy

  • November 25, 2015 22:22

  Hi Rahul, when we tested the feature in-house, and it failed the same way. We opened a defect to investigate further, will update you on the progress.

  0

  Comment actions Permalink
• 

  Rahul Dhond

  • December 03, 2015 07:10

  Hello,
  I was wondering if there has been any progress on this issue. Please let me know. Many Thanks.
  regards,
  Rahul

  0

  Comment actions Permalink
• 

  Venu Reddy

  • December 07, 2015 17:20

  Hi Rahul, it's being assessed by product management at this point. We'll let you know as soon as there is an update.

  0

  Comment actions Permalink

Please sign in to leave a comment.