getting INT96 primtive error while accessing parquet file

Follow

piyush srivastava

• January 18, 2018 17:30

Trying to create data link using parquet file, it is throwing primitive type INT96 error, please advise.

0

• 

  Joel Stewart

  • January 19, 2018 02:04

  Can you share more details about the exception that you observed? Is there a stacktrace that you can share?

  Also, what is the source of this particular data set? Do you know the protocol version of Parquet that was used to create the data? What is the version of Datameer that you're attempting to read it from (we can lookup the Parquet version Datameer corresponds to)?

  Speaking generally, type exceptions are usually casting errors for specific data sets that are just failing to read a particular record. 

  0

  Comment actions Permalink
• 

  piyush srivastava

  • January 19, 2018 16:12

  Parquet file we selected is version 2.1. This error "primitive type INT96 is not supported" is occuring in case of table having timestamp field. I tried other table which has only string it din't throw this error.

  This stage we can't modify the structure of table, please advise how to create data link for hive table in this case.

  0

  Comment actions Permalink
• 

  Alan

  • January 19, 2018 16:36

  Hi Piyush,

  Please be aware that the apache project has deprecated INT96 as a data type.  You can find the details of that here: https://issues.apache.org/jira/browse/PARQUET-323

  However, we do support this data type in Datameer 6.3 and higher.  Should you want to use INT96, an upgrade to 6.3 is required.

  Let me know if you have any further questions,

  Alan

  0

  Comment actions Permalink

Please sign in to leave a comment.