Datameer drops records while importing larger file


1 comment

  • Konsta Danyliuk

    Hello Lee,

    When Datameer drops records during ingestion, this most probably means that there is something in that dataset it "doesn't like", e.g. particular records don't match the schema.

    To find out the reason why some records were dropped you may check corresponding log file.

    It usually called error-merged.log and available at Job Details page (navigate JobHistory -> Job ID) under Errors section (at very bottom). Alternatively you could download full JobTrace which contains this file a well.

    Here are our support articles about job trace:

    How to Collect a Job Trace
    How to Interpret the Contents of a Job Trace


    Comment actions Permalink

Please sign in to leave a comment.