Datameer --> Snowflake : Timestamp Issue

Follow

Anson Chan

• December 17, 2020 14:44

Hello Team,

We are utlizing Datameer to perform analysis before exporting the output to Snowflake for data warehouse.

In the process, we hit an obstacle which we are unable to solve.

It is about Dates.

For example, under Datameer, we defined a date to have the following pattern.

Sep 5, 2018 04:05:16 AM

When it goes to Snowflake, the date became 50467-09-18 23:46:40.000

we are unable to find any documentation to solve this issue.

please advise.

thank you,

anson

0

• 

  Konsta Danyliuk

  • December 30, 2020 10:56

  Hello Anson.
  I hope you are enjoying the holiday time.
  
  I've tried to export the date column to Snowflake in my lab and got a similar result. The Datameer date value Dec 30, 2020 10:48:27 AM landed on Snowflake table at the TIMESTAMP_NTZ(9) column as 52967-06-27 23:39:05.000.

  As a workaround, you could convert the date column in the Workbook to string before export via e.g. FORMATDATE(#ColumnName;"yyyy-MM-dd HH:ss:mm"). During the export, this column will be exported as stings and appear in Snowflake exactly as "yyyy-MM-dd HH:ss:mm" (varchar), e.g. 2020-12-30 10:22:56.

  I will also raise the concern to our engineering team so this is addressed in future versions or at least explained in the documentation.

  0

  Comment actions Permalink
• 

  Alan

  • December 30, 2020 15:41

  Hi Anson,

  Can you please check your junk mail or spam for emails from me?  I've reached out to you on a few occasions directly

  0

  Comment actions Permalink
• 

  Anson Chan

  • January 01, 2021 16:47

  Hello Konsta, Alan,

  Many thanks for the response. Yes, I've returned your enquiry and provided the information required.

  Happy new year!

  Anson

  0

  Comment actions Permalink

Please sign in to leave a comment.