File Upload getting

Follow

Stanley

• May 20, 2017 15:02

I was in the process of uploading a csv file to Datameer. My first file worked but the second one gets stuck at 20%. I tried refreshing and restarting the application but it is still getting stuck. Any thoughts on how to resolve?

Thanks!

Stanley

0

• 

  Joel Stewart

  • May 21, 2017 23:53

  Hi Stanley, what type of file is it and what size is the file? 

  If you're able to look in the <INSTALLDIR>/logs/conductor.log file, perhaps there are some errors or warnings that could explain the slowness you're observing. 

  0

  Comment actions Permalink
• 

  Stanley

  • May 22, 2017 00:24

  Hi Joel, So looked through the documentation and realized that you can only upload upto a 500MB file. My file was larger than that. 

  Is my next best option to try an Import Job? The data is in a csv file that I can load to a MSSQL database.

  0

  Comment actions Permalink
• 

  Joel Stewart

  • May 22, 2017 03:54

  Yes, an Import Job is a must more effective way to handle data sets larger than 500 MB including data sets into the TB and PB size. 

  CSV is an okay format for an Import Job (as is MySQL). You'll just want to create a Connection in Datameer first. If you can connect via SSH or SFTP then leaving the file as a raw CSV seems best. If a JDBC connection to MySQL is the easiest option in your environment, this is suitable as well. 

  0

  Comment actions Permalink
• 

  Stanley

  • May 25, 2017 00:36

  Thanks Joel!

  0

  Comment actions Permalink

Please sign in to leave a comment.