How to import Hive Partitioned data

Follow

Siva K

• May 04, 2016 00:32

I have to import the data from Hive table which is partitioned like ( year=2016/Month=2/day=27/file*.*

How can I import these data in recursive mode.

 

 

0

• 

  Gido

  • May 04, 2016 11:18

  If there are existing time-based partitions available on the Hive connection, these will be available when importing data.

  If you like to access external stored Hive tables (files) directly on HDFS, you can specify the folder structure with a %pattern% and define which files from the included folders should be included in the partition. 

  0

  Comment actions Permalink
• 

  Souradeep

  • August 28, 2018 22:55

  How can i import hive partition keys as attributes? I have 4 hive partition keys which are being used to read the data but these are not available in the data as columns. Is there a way to get these partition keys in the workbook?

  0

  Comment actions Permalink
• 

  Joel Stewart

  • August 29, 2018 18:24

  Hive data sets in Datameer allow access to the columns of data only and not external attributes such as the partition keys. If your schema will allow, you can add the partition keys as additional columns so that you can access them directly in Datameer.

  0

  Comment actions Permalink

Please sign in to leave a comment.