I have a large set of excel files with many sheets that get updated weekly. Due to the way permissions work across our servers we have been unable to get datameer to work with SFTP, so now I'm exploring using file-uploads but file-uploads have their own unique behavior in datameer. (We will continue to explore getting SFTP to work, but the network admins seem to indicate that it's not a high priority in the near future)
It turns out using the Rest-api to "run" a file-upload causes, as far as I can tell, datameer to re-run using the copy of the file that it created in the /user/datameer/fileupload directory on HDFS.
Is there any way to force it to reupload from the original source file in an automated manner?
Do I have to create a script that manually copies the files into datameer's HDFS directory and then re-run the file upload?
Is there any other combination of workarounds that would allow me to automate this process?
Please sign in to leave a comment.