Limit the size of a file created by an ExportJob

Goal

How can the file size of Datameer Export Jobs be limited?

Learn

For file-based Export Jobs, Datameer allows limiting the size of exported files. It is possible to set this threshold at: Export Job Configuration -> Data Details -> Advanced Settings -> Maximum file size (MB) filed.

Keep in mind that the limit is applied to uncompressed data at the moment when it is being initially written to the target location. Compression (if configured) happens after the uncompressed files are written for every exported file individually.

For example, when data is exported as compressed CSV files and a file size limit of 50 MB is set, Datameer: 
a) Exports uncompressed data considering that max allowed size for an individual file.
b) Compresses every file.
This leads to an expected situation when even with a 50 MB per-file size limit, an Export Job ends up writing ten 5MB files. This means that ten 50 MB files were compressed with a compression ratio of 10:1.