Importing Mainframe file into hadoop using Datameer

Follow

Rajat Mishra

• October 11, 2016 19:25

Hi , 

I'm new to datameer and were planning to propose this to our client for next project. So , I had few questions related to the integration of mainframe files into the hadoop using Datameer . 

1. Which different type of character set formats (like CP037) are supported?
2. Does it support EBCDIC (Extended Binary Coded Decimal Interchange
Code) format import?
3. Does it support binary format import from Mainframe?
4. Does it support compressed (zipped) data import?
5. Does it support comp (compressed) data type?
6. How many hierarchical levels are supported?
7. Import jobs to Hadoop are run in Memory or Hadoop?
8. Will it require a separate lincence for integration and analysis for its bundled into one?
9. How Datameer installed on Hadoop? (data nodes, edge mode, name node)

Hoping for quick response

Thanks,
Rajat

0

• Official comment

  

  Joel Stewart

  • October 11, 2016 22:40

  Hi Rajat, thanks for the questions and interest in Datameer for this project. 

  Datameer can read many different character formats including CP037 (or IBM037). This does include many EBCDIC type formats. 

  Yes, Datameer can import binary data from mainframe files. Yes, it can import compressed data as well. 

  I don't understand the context about the hierarchical levels question, can you elaborate a bit on that circumstance? 

  With Datameer's Smart Execution, jobs can run locally on in Hadoop. Most commonly, they are run on Hadoop though. Datameer is installed on an edge node most commonly, but could be entirely outside of the cluster too. 

  A Datameer Enterprise license includes access to integration, analysis and visualization altogether. 

  Comment actions Permalink
• 

  Rajat Mishra

  • October 13, 2016 03:00

  Thanks joel !!!.

  The hierarchy level i'm talking about is the number present in the cobol copybook. For eg .

  01 TCRMCONTRACTBOBJ.
     05  OBJECT-NAME      PIC X(40).
     05  CONTRACTID PIC 9(18).
     05  CURRENCYTYPE     PIC X(2).
     05  CURRENCYVALUE    PIC X(4).
     05  TCRMCCBOBJ-COUNT PIC 99.
     05  C-TCRMANKEYBOBJ-COUNT PIC 99.
     05  TCRMCCBOBJ-OFFSET PIC 9(8) OCCURS 0 TO 99 TIMES
               DEPENDING ON TCRMCCBOBJ-COUNT.
     05  C-TCRMANKEYBOBJ-OFFSET PIC 9(8) OCCURS 0 TO 99
               TIMES DEPENDING ON C-TCRMANKEYBOBJ-COUNT.
  
  in the above copybook there 2 level 01 and 05 . In some copybook 05 is further goes down to 10 and so on. 
   
  
  Thanks again!!

   

   

  0

  Comment actions Permalink
• 

  Joel Stewart

  • October 13, 2016 16:25

  Within a copybook, there is no limit to the hierarchy size. However, copybook files with multiple variable length data types are not supported. If there is a variable length data field, it must be the last item of the copybook. 

  0

  Comment actions Permalink

Please sign in to leave a comment.