SMTP Notifications with an Office 365 Account
Hi, Good Afternoon,
We are trying to get Datameer to send Email from one of our Exchange Accounts, I did all the recommendations that people from Microsoft kindly provided but we are still getting error messages like:
Mail server connection failed; nested exception is javax.mail.MessagingException: Could not connect to SMTP host: outlook.office365.com, port: 587; nested exception is: java.net.SocketException: Connection reset. Failed messages: javax.mail.MessagingException: Could not connect to SMTP host: outlook.office365.com, port: 587; nested exception is: java.net.SocketException: Connection reset
Mail server connection failed; nested exception is javax.mail.MessagingException: Exception reading response; nested exception is: java.net.SocketException: Connection reset. Failed messages: javax.mail.MessagingException: Exception reading response; nested exception is: java.net.SocketException: Connection reset
Every different configuration I try, ends up in some error message, I have tried port 25, and 587 with two different SMTP servers from office365 (Microsoft Support provided both addresses) and different accounts ¿Have you guys tested this feature with this kind of email accounts/SMTP Servers? ¿is there something else I am missing? I hope you can point us in the right direction so we can get this done.
Thanks in advance for your time, best regards.
-
Based on the exception, it looks like there is a network limitation to reach out to outlook.office365.com from the Datameer server. To verify the connection, could you please execute the following commands from the Datameer host?
-
telnet outlook.office365.com 587
-
telnet outlook.office365.com 25
A successful telnet connection from the Datameer node will confirm if the networks are connected successfully. Here is an example of success from my network:
jstewart$ telnet outlook.office365.com 587
Trying 40.97.162.162...
Connected to outlook-namnorthwest2.office365.com.
Escape character is '^]'.
220 MWHPR20CA0020.outlook.office365.com Microsoft ESMTP MAIL Service ready at Thu, 27 Apr 2017 19:43:22 +0000
^]
telnet> quit
Connection closed. -
-
Hi,
The server does respond to Telnet:
Also, the error message is not always the same:
I have tried many different configurations, from a number of different networks but i don't seem to get it to work with Office365 (I Have tested it in a Netowork with an SMTP installed on their own domain). I am not sure what am i missing.
Thanks, Best Regards.
-
Hi Jesus,
First, can you please clarify why you posted in the community when you have support channel via Oxxo and Banco Azteca?
In regard to the connection, it could be that the mail is not letting a client connect. We tested the connection successfully for a Hotmail account by enabling access as shown in the attachment. Without that, we also got a similar error.
-
Hi Venu,
I tried lifting a Ticket, but the Zendesk responded that i needed to put the ticket on either Oxxo or Banco Azteca, and this one is something we are trying to accomplish by our development team at Raken. I am searching for such an option on the Office365 administration, ¿on which OS did you successfully tested?
Thanks, Best Regards
-
Thank you Jesus, the connection string should go directly to the smtp-mail.outlook.com server on port 587 (the settings are just on the POP menu, but POP is for in-bound email not out-bound). This matches the second example you shared which shows a "Connection reset" error. Since this is the error, could you please try to telnet to this same server/port from the same machine to confirm that the network connectivity is successful?
-
telnet smtp-mail.outlook.com 587
-
-
Hi, This is the entire Day's conductor log:
INFO [2017-05-04 10:28:10.551] [main] (DesktopLauncher.java:619) - Desktop launcher using port 32826 for HTTP
INFO [2017-05-04 10:28:13.364] [main] (SearchPathUtil.java:33) - Reading from conf/default.properties
INFO [2017-05-04 10:28:13.442] [main] (SearchPathUtil.java:33) - Reading from conf/trial.properties
INFO [2017-05-04 10:28:13.442] [main] (DatameerProperties.java:296) - Set ehcache.disk-store-root = C:\Users\NEPO\AppData\Local\Datameer\6.1.14\cache (overwrites default '${localfs.cache-root}')
INFO [2017-05-04 10:28:13.442] [main] (DatameerProperties.java:296) - Set plugin.configs.dir = C:\Users\NEPO\AppData\Local\Datameer\6.1.14\conf\plugins (overwrites default 'conf/plugins')
INFO [2017-05-04 10:28:13.442] [main] (DatameerProperties.java:296) - Set hsql.db.file = C:\Users\NEPO\AppData\Local\Datameer\6.1.14\data\database\hsql-db (overwrites default '${localfs.root}/database/hsql-db')
INFO [2017-05-04 10:28:13.442] [main] (DatameerProperties.java:280) - Set system property db.mode = hsql-file
INFO [2017-05-04 10:28:13.442] [main] (DatameerProperties.java:277) - Keep system property ehcache.disk-store-root = C:\Users\NEPO\AppData\Local\Datameer\6.1.14\cache
INFO [2017-05-04 10:28:13.442] [main] (DatameerProperties.java:280) - Set system property enable.widget.linking = false
INFO [2017-05-04 10:28:13.442] [main] (DatameerProperties.java:280) - Set system property check-serializable = false
INFO [2017-05-04 10:28:13.442] [main] (DatameerProperties.java:280) - Set system property local-execution.temp-dir = C:\Users\NEPO\AppData\Local\Datameer\6.1.14\temp/local-execution
INFO [2017-05-04 10:28:13.442] [main] (DatameerProperties.java:280) - Set system property preferences.store = preferences-store.xml
INFO [2017-05-04 10:28:13.442] [main] (DatameerProperties.java:280) - Set system property db.host = localhost
INFO [2017-05-04 10:28:13.442] [main] (DatameerProperties.java:280) - Set system property net.sf.ehcache.pool.sizeof.AgentSizeOf.bypass = true
INFO [2017-05-04 10:28:13.442] [main] (DatameerProperties.java:280) - Set system property pdf.generator.export.path = C:\Users\NEPO\AppData\Local\Datameer\6.1.14\data/pdf-generator
INFO [2017-05-04 10:28:13.442] [main] (DatameerProperties.java:280) - Set system property das.big-decimal.precision = 32
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property net.sf.ehcache.configurationResourceName = /ehcache-hibernate.xml
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property integratedTutorial.url = resources.datameer.com/tutorial/3x/
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property share.infographics.only.with.uuid = false
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property das.default-timezone = default
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property integratedTutorial.enabled = true
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property embedded-mode.max-concurrent-datameer-jobs = 5
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property db.password = ****
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property pdf.generator.native.bin.root = ../../plugins/plugin-pdf/lib/native
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property maximum.map.task.contexts.in.store = 10000
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property db.port = 3306
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property tez-execution.temp-dir = C:\Users\NEPO\AppData\Local\Datameer\6.1.14\temp/tez-execution
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:277) - Keep system property plugin.configs.dir = C:\Users\NEPO\AppData\Local\Datameer\6.1.14\conf\plugins
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property java.awt.headless = true
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property server.address = 127.0.0.1:8080
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property logUi.enabled = false
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property db.username = dap
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:277) - Keep system property hsql.db.file = C:\Users\NEPO\AppData\Local\Datameer\6.1.14\data\database\hsql-db
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property db.name = dap
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property enable.fte = false
INFO [2017-05-04 10:28:13.458] [main] (DatameerProperties.java:280) - Set system property hbm2ddl = validate
INFO [2017-05-04 10:28:13.458] [main] (DefaultTimeZone.java:42) - Loading default time zone of America/Mexico_City
INFO [2017-05-04 10:28:13.489] [main] (DefaultTimeZone.java:44) - Changing default time zone of from America/Mexico_City to America/Mexico_City
INFO [2017-05-04 10:28:13.489] [main] (DatameerProperties.java:246) - Application starts with trial.properties
INFO [2017-05-04 10:28:13.567] [main] (DatameerEventBusImpl.java:51) - Datameer Event Bus is running asynchronously (with 4 background threads)
INFO [2017-05-04 10:28:13.583] [main] (PluginRegistryInitializer.java:30) - Initializing plugin registry...
INFO [2017-05-04 10:28:13.942] [main] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 10:28:13.973] [main] (PluginRegistryImpl.java:110) - Create new PluginRegistryImpl instance and scan plugin directories.
INFO [2017-05-04 10:28:13.973] [main] (PluginRegistryImpl.java:674) - Deleting folders in 'C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins' starting with 'das-plugins'
INFO [2017-05-04 10:28:13.973] [main] (PluginRegistryImpl.java:683) - Deleting existing plugin temp folder C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493325896652.tmp
INFO [2017-05-04 10:28:25.161] [main] (PluginRegistryImpl.java:669) - Using plugin temp folder: C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp
INFO [2017-05-04 10:28:25.161] [main] (PluginRegistryImpl.java:217) - Initializing plugins from [C:\Users\NEPO\Datameer-6.1.14\plugins]
INFO [2017-05-04 10:28:25.161] [main] (PluginManifestParser.java:89) - Plugins: looking in: C:\Users\NEPO\Datameer-6.1.14\plugins
INFO [2017-05-04 10:28:25.254] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-avro-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-avro-6.1.14.zip
INFO [2017-05-04 10:28:25.301] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-cobol-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-cobol-6.1.14.zip
INFO [2017-05-04 10:28:25.317] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-crypto-jce-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-crypto-jce-6.1.14.zip
INFO [2017-05-04 10:28:25.770] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-das-functions-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-das-functions-6.1.14.zip
INFO [2017-05-04 10:28:25.989] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-datamining-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-datamining-6.1.14.zip
INFO [2017-05-04 10:28:26.036] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-demo-data-injector-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-demo-data-injector-6.1.14.zip
INFO [2017-05-04 10:28:26.254] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-example-injector-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-example-injector-6.1.14.zip
INFO [2017-05-04 10:28:26.489] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-hbase-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-hbase-6.1.14.zip
INFO [2017-05-04 10:28:27.176] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-hive-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-hive-6.1.14.zip
INFO [2017-05-04 10:28:27.192] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-html-input-type-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-html-input-type-6.1.14.zip
INFO [2017-05-04 10:28:27.286] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-image-library-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-image-library-6.1.14.zip
INFO [2017-05-04 10:28:27.317] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-json-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-json-6.1.14.zip
INFO [2017-05-04 10:28:27.520] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-ldap-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-ldap-6.1.14.zip
INFO [2017-05-04 10:28:27.536] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-local-filesystem-connection-injector-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-local-filesystem-connection-injector-6.1.14.zip
INFO [2017-05-04 10:28:27.536] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-log4jparser-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-log4jparser-6.1.14.zip
INFO [2017-05-04 10:28:27.583] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-mail-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-mail-6.1.14.zip
INFO [2017-05-04 10:28:27.598] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-mbox-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-mbox-6.1.14.zip
INFO [2017-05-04 10:28:27.614] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-netfilter-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-netfilter-6.1.14.zip
INFO [2017-05-04 10:28:27.614] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-openstack-swift-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-openstack-swift-6.1.14.zip
INFO [2017-05-04 10:28:27.786] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-parquet-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-parquet-6.1.14.zip
INFO [2017-05-04 10:28:27.786] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-sequencefile-v6-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-sequencefile-v6-6.1.14.zip
INFO [2017-05-04 10:28:30.848] [main] (ZipUtil.java:149) - Settting executable rights to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-spark-exec-6.1.14.zip\plugin-spark-exec-6.1.14\spark\bin\spark-class
INFO [2017-05-04 10:28:30.848] [main] (ZipUtil.java:149) - Settting executable rights to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-spark-exec-6.1.14.zip\plugin-spark-exec-6.1.14\spark\bin\spark-submit
INFO [2017-05-04 10:28:30.848] [main] (ZipUtil.java:149) - Settting executable rights to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-spark-exec-6.1.14.zip\plugin-spark-exec-6.1.14\spark\bin\load-spark-env.sh
INFO [2017-05-04 10:28:30.848] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-spark-exec-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-spark-exec-6.1.14.zip
INFO [2017-05-04 10:28:31.161] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-spark-thrift-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-spark-thrift-6.1.14.zip
INFO [2017-05-04 10:28:31.364] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-spreadsheet-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-spreadsheet-6.1.14.zip
INFO [2017-05-04 10:28:31.411] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-tableau-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-tableau-6.1.14.zip
INFO [2017-05-04 10:28:31.911] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-textmining-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-textmining-6.1.14.zip
INFO [2017-05-04 10:28:32.067] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-tez-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-tez-6.1.14.zip
INFO [2017-05-04 10:28:32.489] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-webservice-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-webservice-6.1.14.zip
INFO [2017-05-04 10:28:32.614] [main] (PluginManifestParser.java:97) - Uncompressing plug-in plugin-xml-6.1.14.zip to C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-xml-6.1.14.zip
INFO [2017-05-04 10:28:32.614] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\Datameer-6.1.14\plugins
WARN [2017-05-04 10:28:32.629] [main] (PluginManifestParser.java:122) - Failed to parse C:\Users\NEPO\Datameer-6.1.14\plugins\plugin.xml. java.lang.RuntimeException: java.io.FileNotFoundException: C:\Users\NEPO\Datameer-6.1.14\plugins\plugin.xml (El sistema no puede encontrar el archivo especificado)
INFO [2017-05-04 10:28:32.629] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-avro-6.1.14.zip\plugin-avro-6.1.14
INFO [2017-05-04 10:28:32.739] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-avro (Avro Plugin) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-avro-6.1.14.zip\plugin-avro-6.1.14
INFO [2017-05-04 10:28:32.739] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-cobol-6.1.14.zip\plugin-cobol-6.1.14
INFO [2017-05-04 10:28:32.739] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-cobol (Cobol Copybook Plug-In) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-cobol-6.1.14.zip\plugin-cobol-6.1.14
INFO [2017-05-04 10:28:32.739] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-crypto-jce-6.1.14.zip\plugin-crypto-jce-6.1.14
INFO [2017-05-04 10:28:32.754] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-crypto-jce (Java Cryptography Extension (JCE) Plugin) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-crypto-jce-6.1.14.zip\plugin-crypto-jce-6.1.14
INFO [2017-05-04 10:28:32.754] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-das-functions-6.1.14.zip\plugin-das-functions-6.1.14
INFO [2017-05-04 10:28:32.754] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-das-functions (Functions Plug-In) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-das-functions-6.1.14.zip\plugin-das-functions-6.1.14
INFO [2017-05-04 10:28:32.754] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-datamining-6.1.14.zip\plugin-datamining-6.1.14
INFO [2017-05-04 10:28:32.786] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-datamining (Data Mining Plug-In) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-datamining-6.1.14.zip\plugin-datamining-6.1.14
INFO [2017-05-04 10:28:32.786] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-demo-data-injector-6.1.14.zip\plugin-demo-data-injector-6.1.14
INFO [2017-05-04 10:28:32.817] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-demo-data-injector (Demo Data Injector) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-demo-data-injector-6.1.14.zip\plugin-demo-data-injector-6.1.14
INFO [2017-05-04 10:28:32.817] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-example-injector-6.1.14.zip\plugin-example-injector-6.1.14
INFO [2017-05-04 10:28:32.817] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-example-injector (Example Injector) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-example-injector-6.1.14.zip\plugin-example-injector-6.1.14
INFO [2017-05-04 10:28:32.817] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-hbase-6.1.14.zip\plugin-hbase-6.1.14
INFO [2017-05-04 10:28:32.817] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-hbase-0.98.4 (HBase 0.98.4 plug-in) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-hbase-6.1.14.zip\plugin-hbase-6.1.14
INFO [2017-05-04 10:28:32.817] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-hive-6.1.14.zip\plugin-hive-6.1.14
INFO [2017-05-04 10:28:32.817] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-hive-0.14.0 (Hive 0.14.0 plug-in) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-hive-6.1.14.zip\plugin-hive-6.1.14
INFO [2017-05-04 10:28:32.817] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-html-input-type-6.1.14.zip\plugin-html-input-type-6.1.14
INFO [2017-05-04 10:28:32.817] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-html-input-type (Datameer HTML Input Type Plug-In) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-html-input-type-6.1.14.zip\plugin-html-input-type-6.1.14
INFO [2017-05-04 10:28:32.817] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-image-library-6.1.14.zip\plugin-image-library-6.1.14
INFO [2017-05-04 10:28:32.817] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-image-library (Image library Injector) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-image-library-6.1.14.zip\plugin-image-library-6.1.14
INFO [2017-05-04 10:28:32.817] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-json-6.1.14.zip\plugin-json-6.1.14
INFO [2017-05-04 10:28:32.817] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-json (JSON Plugin) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-json-6.1.14.zip\plugin-json-6.1.14
INFO [2017-05-04 10:28:32.817] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-ldap-6.1.14.zip\plugin-ldap-6.1.14
INFO [2017-05-04 10:28:32.833] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-ldap (LDAP Plugin) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-ldap-6.1.14.zip\plugin-ldap-6.1.14
INFO [2017-05-04 10:28:32.833] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-local-filesystem-connection-injector-6.1.14.zip\plugin-local-filesystem-connection-injector-6.1.14
INFO [2017-05-04 10:28:32.848] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-local-filesystem-connection-injector (Local Filesystem Connection Injector) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-local-filesystem-connection-injector-6.1.14.zip\plugin-local-filesystem-connection-injector-6.1.14
INFO [2017-05-04 10:28:32.848] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-log4jparser-6.1.14.zip\plugin-log4jparser-6.1.14
INFO [2017-05-04 10:28:32.864] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-log4jparser (Apache Log4j Parser) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-log4jparser-6.1.14.zip\plugin-log4jparser-6.1.14
INFO [2017-05-04 10:28:32.864] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-mail-6.1.14.zip\plugin-mail-6.1.14
INFO [2017-05-04 10:28:32.864] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-mail (Mail Plug-In) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-mail-6.1.14.zip\plugin-mail-6.1.14
INFO [2017-05-04 10:28:32.864] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-mbox-6.1.14.zip\plugin-mbox-6.1.14
INFO [2017-05-04 10:28:32.879] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-mbox (MBox Plug-In) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-mbox-6.1.14.zip\plugin-mbox-6.1.14
INFO [2017-05-04 10:28:32.879] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-netfilter-6.1.14.zip\plugin-netfilter-6.1.14
INFO [2017-05-04 10:28:32.879] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-netfilter (Netfilter Plug-In) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-netfilter-6.1.14.zip\plugin-netfilter-6.1.14
INFO [2017-05-04 10:28:32.879] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-openstack-swift-6.1.14.zip\plugin-openstack-swift-6.1.14
INFO [2017-05-04 10:28:32.879] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-openstack-swift (OpenStack Swift Plugin) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-openstack-swift-6.1.14.zip\plugin-openstack-swift-6.1.14
INFO [2017-05-04 10:28:32.879] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-parquet-6.1.14.zip\plugin-parquet-6.1.14
INFO [2017-05-04 10:28:32.879] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-parquet (Parquet Plugin) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-parquet-6.1.14.zip\plugin-parquet-6.1.14
INFO [2017-05-04 10:28:32.879] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-sequencefile-v6-6.1.14.zip\plugin-sequencefile-v6-6.1.14
INFO [2017-05-04 10:28:32.895] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-sequencefile-v6 (SequenceFile v6 Plugin) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-sequencefile-v6-6.1.14.zip\plugin-sequencefile-v6-6.1.14
INFO [2017-05-04 10:28:32.895] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-spark-exec-6.1.14.zip\plugin-spark-exec-6.1.14
INFO [2017-05-04 10:28:32.895] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-spark-exec (Spark Execution Framework Plug-In) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-spark-exec-6.1.14.zip\plugin-spark-exec-6.1.14
INFO [2017-05-04 10:28:32.895] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-spark-thrift-6.1.14.zip\plugin-spark-thrift-6.1.14
INFO [2017-05-04 10:28:32.895] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-spark-thrift (Spark Thrift (Import/Export) Plugin) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-spark-thrift-6.1.14.zip\plugin-spark-thrift-6.1.14
INFO [2017-05-04 10:28:32.895] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-spreadsheet-6.1.14.zip\plugin-spreadsheet-6.1.14
INFO [2017-05-04 10:28:32.911] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-spreadsheet (Spreadsheet Plugin) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-spreadsheet-6.1.14.zip\plugin-spreadsheet-6.1.14
INFO [2017-05-04 10:28:32.911] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-tableau-6.1.14.zip\plugin-tableau-6.1.14
INFO [2017-05-04 10:28:32.911] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-tableau (Tableau Plugin) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-tableau-6.1.14.zip\plugin-tableau-6.1.14
INFO [2017-05-04 10:28:32.911] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-textmining-6.1.14.zip\plugin-textmining-6.1.14
INFO [2017-05-04 10:28:32.926] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-textmining (Textmining Plug-In) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-textmining-6.1.14.zip\plugin-textmining-6.1.14
INFO [2017-05-04 10:28:32.926] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-tez-6.1.14.zip\plugin-tez-6.1.14
INFO [2017-05-04 10:28:32.926] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-tez (Tez Execution Framework Plug-In) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-tez-6.1.14.zip\plugin-tez-6.1.14
INFO [2017-05-04 10:28:32.926] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-webservice-6.1.14.zip\plugin-webservice-6.1.14
INFO [2017-05-04 10:28:32.942] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-webservice (Webservice Plugin) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-webservice-6.1.14.zip\plugin-webservice-6.1.14
INFO [2017-05-04 10:28:32.942] [main] (PluginManifestParser.java:105) - Attempting to locate plugin in C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-xml-6.1.14.zip\plugin-xml-6.1.14
INFO [2017-05-04 10:28:32.958] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: plugin-xml (XML Plugin) from C:\Users\NEPO\AppData\Local\Datameer\6.1.14\plugins\das-plugins1493911693973.tmp\plugin-xml-6.1.14.zip\plugin-xml-6.1.14
INFO [2017-05-04 10:28:32.973] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: das.common (Datameer Common Plug-in) from C:\Users\NEPO\Datameer-6.1.14\webapps\WEB-INF\classes
INFO [2017-05-04 10:28:32.973] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: das.conductor (Datameer Conductor Plug-in) from C:\Users\NEPO\Datameer-6.1.14\webapps\WEB-INF\lib\dap-conductor-6.1.14.jar
INFO [2017-05-04 10:28:32.973] [main] (PluginManifestParser.java:332) - Succesfully parsed plugin manifest: das.sdk (Datameer SDK Plug-in) from C:\Users\NEPO\Datameer-6.1.14\webapps\WEB-INF\lib\dap-sdk-6.1.14.jar
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:179) - Found plug-ins (includes=null, excludes=null):
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-avro (Avro Plugin, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-cobol (Cobol Copybook Plug-In, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-crypto-jce (Java Cryptography Extension (JCE) Plugin, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-das-functions (Functions Plug-In, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-datamining (Data Mining Plug-In, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-demo-data-injector (Demo Data Injector, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-example-injector (Example Injector, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-hbase-0.98.4 (HBase 0.98.4 plug-in, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-hive-0.14.0 (Hive 0.14.0 plug-in, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-html-input-type (Datameer HTML Input Type Plug-In, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-image-library (Image library Injector, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-json (JSON Plugin, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-ldap (LDAP Plugin, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-local-filesystem-connection-injector (Local Filesystem Connection Injector, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-log4jparser (Apache Log4j Parser, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-mail (Mail Plug-In, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-mbox (MBox Plug-In, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-netfilter (Netfilter Plug-In, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-openstack-swift (OpenStack Swift Plugin, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-parquet (Parquet Plugin, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-sequencefile-v6 (SequenceFile v6 Plugin, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-spark-exec (Spark Execution Framework Plug-In, included)
INFO [2017-05-04 10:28:32.973] [main] (PluginRegistryImpl.java:184) - plugin-spark-thrift (Spark Thrift (Import/Export) Plugin, included)
INFO [2017-05-04 10:28:32.989] [main] (PluginRegistryImpl.java:184) - plugin-spreadsheet (Spreadsheet Plugin, included)
INFO [2017-05-04 10:28:32.989] [main] (PluginRegistryImpl.java:184) - plugin-tableau (Tableau Plugin, included)
INFO [2017-05-04 10:28:32.989] [main] (PluginRegistryImpl.java:184) - plugin-textmining (Textmining Plug-In, included)
INFO [2017-05-04 10:28:32.989] [main] (PluginRegistryImpl.java:184) - plugin-tez (Tez Execution Framework Plug-In, included)
INFO [2017-05-04 10:28:32.989] [main] (PluginRegistryImpl.java:184) - plugin-webservice (Webservice Plugin, included)
INFO [2017-05-04 10:28:32.989] [main] (PluginRegistryImpl.java:184) - plugin-xml (XML Plugin, included)
INFO [2017-05-04 10:28:32.989] [main] (PluginRegistryImpl.java:184) - das.common (Datameer Common Plug-in, included)
INFO [2017-05-04 10:28:32.989] [main] (PluginRegistryImpl.java:184) - das.conductor (Datameer Conductor Plug-in, included)
INFO [2017-05-04 10:28:32.989] [main] (PluginRegistryImpl.java:184) - das.sdk (Datameer SDK Plug-in, included)
INFO [2017-05-04 10:28:32.989] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-textmining (Textmining Plug-In)
INFO [2017-05-04 10:28:33.317] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-avro (Avro Plugin)
INFO [2017-05-04 10:28:33.395] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-mbox (MBox Plug-In)
INFO [2017-05-04 10:28:33.411] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-demo-data-injector (Demo Data Injector)
INFO [2017-05-04 10:28:33.426] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-xml (XML Plugin)
INFO [2017-05-04 10:28:33.614] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-tez (Tez Execution Framework Plug-In)
INFO [2017-05-04 10:28:33.879] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-local-filesystem-connection-injector (Local Filesystem Connection Injector)
INFO [2017-05-04 10:28:33.879] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-crypto-jce (Java Cryptography Extension (JCE) Plugin)
INFO [2017-05-04 10:28:33.895] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: das.common (Datameer Common Plug-in)
INFO [2017-05-04 10:28:37.786] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-spark-exec (Spark Execution Framework Plug-In)
INFO [2017-05-04 10:28:38.145] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-hive-0.14.0 (Hive 0.14.0 plug-in)
INFO [2017-05-04 10:28:38.364] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-image-library (Image library Injector)
INFO [2017-05-04 10:28:38.379] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-das-functions (Functions Plug-In)
INFO [2017-05-04 10:28:39.473] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-spreadsheet (Spreadsheet Plugin)
INFO [2017-05-04 10:28:39.489] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-example-injector (Example Injector)
INFO [2017-05-04 10:28:39.489] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-hbase-0.98.4 (HBase 0.98.4 plug-in)
INFO [2017-05-04 10:28:39.551] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-json (JSON Plugin)
INFO [2017-05-04 10:28:39.614] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: das.sdk (Datameer SDK Plug-in)
INFO [2017-05-04 10:28:39.645] [main] (SearchPathUtil.java:33) - Reading from conf/skin-default.properties
INFO [2017-05-04 10:28:40.614] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-datamining (Data Mining Plug-In)
INFO [2017-05-04 10:28:41.333] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-parquet (Parquet Plugin)
INFO [2017-05-04 10:28:41.379] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-spark-thrift (Spark Thrift (Import/Export) Plugin)
INFO [2017-05-04 10:28:41.473] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-openstack-swift (OpenStack Swift Plugin)
INFO [2017-05-04 10:28:41.520] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-mail (Mail Plug-In)
INFO [2017-05-04 10:28:41.583] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-tableau (Tableau Plugin)
INFO [2017-05-04 10:28:41.661] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-log4jparser (Apache Log4j Parser)
INFO [2017-05-04 10:28:41.676] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-webservice (Webservice Plugin)
INFO [2017-05-04 10:28:42.629] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-ldap (LDAP Plugin)
INFO [2017-05-04 10:28:42.817] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-netfilter (Netfilter Plug-In)
INFO [2017-05-04 10:28:42.817] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-sequencefile-v6 (SequenceFile v6 Plugin)
INFO [2017-05-04 10:28:42.833] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: das.conductor (Datameer Conductor Plug-in)
INFO [2017-05-04 10:28:44.551] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-cobol (Cobol Copybook Plug-In)
INFO [2017-05-04 10:28:44.629] [main] (ConductorPluginRegistryConfiguration.java:93) - Scanning plugin: plugin-html-input-type (Datameer HTML Input Type Plug-In)
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:172) - Finish scanning of plugins with results:
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:567) - Installed extension points: 25
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.plugin.tez.session.TezSessionFactoryExtension'
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:579) - plugin='plugin-tez', installed extensions=1
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.das.plugin.hbase.connection.configuration'
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:579) - plugin='plugin-hbase-0.98.4', installed extensions=1
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.sdk.function.FunctionType'
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:579) - plugin='plugin-html-input-type', installed extensions=6
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:579) - plugin='plugin-textmining', installed extensions=14
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:579) - plugin='plugin-xml', installed extensions=2
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:579) - plugin='plugin-das-functions', installed extensions=258
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.sdk.event.DatameerEventBusExtension'
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:582) - * (no plugin applies to this currently)
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.webservice.AbstractUniProtImportType'
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:582) - * (no plugin applies to this currently)
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.sdk.widget.WidgetType'
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:582) - * (no plugin applies to this currently)
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.sdk.importjob.extensions.ImportFilterExtension'
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:582) - * (no plugin applies to this currently)
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.sdk.hadoop.HadoopConfigurationExtension'
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:582) - * (no plugin applies to this currently)
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.sdk.infographic.PdfGeneratorExtension'
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:582) - * (no plugin applies to this currently)
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.common.formula.SheetType'
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:579) - plugin='das.common', installed extensions=12
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.common.partition.extension.DatameerPartitioningExtension'
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:579) - plugin='das.common', installed extensions=1
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:579) - plugin='plugin-hive-0.14.0', installed extensions=1
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.sdk.injector.WidgetInjector'
INFO [2017-05-04 10:28:44.817] [main] (PluginRegistryImpl.java:582) - * (no plugin applies to this currently)
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.common.entity.properties.GridMode'
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='das.common', installed extensions=3
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.sdk.authentication.AuthenticatorExtension'
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-ldap', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.common.sheetstorage.SheetStorage'
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:582) - * (no plugin applies to this currently)
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.sdk.datastore.DataStoreType'
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-openstack-swift', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='das.common', installed extensions=9
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-spark-thrift', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-hive-0.14.0', installed extensions=3
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-mail', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='das.sdk', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-tableau', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-hbase-0.98.4', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-webservice', installed extensions=15
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.sdk.datamining.DataMiningComponent'
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-datamining', installed extensions=4
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.sdk.exportjob.ExportFileType'
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-parquet', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='das.common', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-avro', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='das.sdk', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.common.graphv2.ExecutionFramework'
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-tez', installed extensions=5
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='das.common', installed extensions=3
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-spark-exec', installed extensions=3
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.sdk.injector.PluginDataInjector'
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-image-library', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-example-injector', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-demo-data-injector', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-local-filesystem-connection-injector', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.sdk.plugin.preference.PluginPreferencePage'
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-hive-0.14.0', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.sdk.importjob.ImportFileType'
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-parquet', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-html-input-type', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='das.common', installed extensions=7
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-mbox', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-netfilter', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-cobol', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-json', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-spreadsheet', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-avro', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-log4jparser', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-xml', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-sequencefile-v6', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.dap.sdk.crypto.DatameerCrypto'
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-crypto-jce', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='das.sdk', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.das.plugin.sequencefile.importjob.MetadataSchemaStrategy'
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:579) - plugin='plugin-sequencefile-v6', installed extensions=1
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:569) - extensionPoint='datameer.plugins.cobol.RecordDeterminerExtension'
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:582) - * (no plugin applies to this currently)
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:595) - Registered Plugins:
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:601) - Textmining Plug-In (plugin-textmining, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-textmining-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:601) - Avro Plugin (plugin-avro, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-avro-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:601) - MBox Plug-In (plugin-mbox, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-mbox-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:601) - Demo Data Injector (plugin-demo-data-injector, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-demo-data-injector-6.1.14.zip, copyToCluster=false)
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:601) - XML Plugin (plugin-xml, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-xml-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:601) - Tez Execution Framework Plug-In (plugin-tez, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-tez-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:601) - Local Filesystem Connection Injector (plugin-local-filesystem-connection-injector, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-local-filesystem-connection-injector-6.1.14.zip, copyToCluster=false)
INFO [2017-05-04 10:28:44.864] [main] (PluginRegistryImpl.java:601) - Java Cryptography Extension (JCE) Plugin (plugin-crypto-jce, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-crypto-jce-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Datameer Common Plug-in (das.common, zip=null, copyToCluster=false)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Spark Execution Framework Plug-In (plugin-spark-exec, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-spark-exec-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Hive 0.14.0 plug-in (plugin-hive-0.14.0, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-hive-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Image library Injector (plugin-image-library, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-image-library-6.1.14.zip, copyToCluster=false)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Functions Plug-In (plugin-das-functions, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-das-functions-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Spreadsheet Plugin (plugin-spreadsheet, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-spreadsheet-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Example Injector (plugin-example-injector, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-example-injector-6.1.14.zip, copyToCluster=false)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - HBase 0.98.4 plug-in (plugin-hbase-0.98.4, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-hbase-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - JSON Plugin (plugin-json, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-json-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Datameer SDK Plug-in (das.sdk, zip=null, copyToCluster=false)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Data Mining Plug-In (plugin-datamining, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-datamining-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Parquet Plugin (plugin-parquet, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-parquet-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Spark Thrift (Import/Export) Plugin (plugin-spark-thrift, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-spark-thrift-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - OpenStack Swift Plugin (plugin-openstack-swift, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-openstack-swift-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Mail Plug-In (plugin-mail, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-mail-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Tableau Plugin (plugin-tableau, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-tableau-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Apache Log4j Parser (plugin-log4jparser, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-log4jparser-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Webservice Plugin (plugin-webservice, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-webservice-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - LDAP Plugin (plugin-ldap, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-ldap-6.1.14.zip, copyToCluster=false)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Netfilter Plug-In (plugin-netfilter, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-netfilter-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - SequenceFile v6 Plugin (plugin-sequencefile-v6, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-sequencefile-v6-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Datameer Conductor Plug-in (das.conductor, zip=null, copyToCluster=false)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Cobol Copybook Plug-In (plugin-cobol, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-cobol-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:601) - Datameer HTML Input Type Plug-In (plugin-html-input-type, zip=C:\Users\NEPO\Datameer-6.1.14\plugins\plugin-html-input-type-6.1.14.zip, copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:607) - Registered Extension-Points:
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Tez session factory (id='datameer.plugin.tez.session.TezSessionFactoryExtension' plugin='plugin-tez', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - HBase Connection Configuration Point (id='datameer.das.plugin.hbase.connection.configuration' plugin='plugin-hbase-0.98.4', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Function type (id='datameer.dap.sdk.function.FunctionType' plugin='das.sdk', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Event Bus Subscribers (id='datameer.dap.sdk.event.DatameerEventBusExtension' plugin='das.sdk', copyToCluster=false)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Import UniProtImportType (id='datameer.webservice.AbstractUniProtImportType' plugin='das.sdk', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Widget type (id='datameer.dap.sdk.widget.WidgetType' plugin='das.sdk', copyToCluster=false)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Import filter extension (id='datameer.dap.sdk.importjob.extensions.ImportFilterExtension' plugin='das.sdk', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Hadoop configuration (id='datameer.dap.sdk.hadoop.HadoopConfigurationExtension' plugin='das.sdk', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - PDF Generator API for Infographics (id='datameer.dap.sdk.infographic.PdfGeneratorExtension' plugin='das.sdk', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Sheet types (id='datameer.dap.common.formula.SheetType' plugin='das.sdk', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Datameer partition extensionpoint (id='datameer.dap.common.partition.extension.DatameerPartitioningExtension' plugin='das.sdk', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Widget injectors type (id='datameer.dap.sdk.injector.WidgetInjector' plugin='das.sdk', copyToCluster=false)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Grid modes (id='datameer.dap.common.entity.properties.GridMode' plugin='das.sdk', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Authenticator (id='datameer.dap.sdk.authentication.AuthenticatorExtension' plugin='das.sdk', copyToCluster=false)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Sheet Storage (id='datameer.dap.common.sheetstorage.SheetStorage' plugin='das.sdk', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Data store type (id='datameer.dap.sdk.datastore.DataStoreType' plugin='das.sdk', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Data Mining Component (id='datameer.dap.sdk.datamining.DataMiningComponent' plugin='das.sdk', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Export filetype (id='datameer.dap.sdk.exportjob.ExportFileType' plugin='das.sdk', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - New graph API execution framework (id='datameer.dap.common.graphv2.ExecutionFramework' plugin='das.sdk', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Data injectors (id='datameer.dap.sdk.injector.PluginDataInjector' plugin='das.sdk', copyToCluster=false)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Preference page (id='datameer.dap.sdk.plugin.preference.PluginPreferencePage' plugin='das.sdk', copyToCluster=false)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Import filetype (id='datameer.dap.sdk.importjob.ImportFileType' plugin='das.sdk', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Datameer Crypto plugins (id='datameer.dap.sdk.crypto.DatameerCrypto' plugin='das.sdk', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - SequenceFile Metadata Strategy (id='datameer.das.plugin.sequencefile.importjob.MetadataSchemaStrategy' plugin='plugin-sequencefile-v6', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:612) - Record Determiner (id='datameer.plugins.cobol.RecordDeterminerExtension' plugin='plugin-cobol', copyToCluster=true)
INFO [2017-05-04 10:28:44.879] [main] (PluginRegistryImpl.java:618) - Registered Import-Adapter:
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:626) - Spark SQL:
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 1. Spark Thrift Server
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:626) - Others:
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 2. Email - POP/IMAP
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 3. File Upload
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 4. HBase 0.98.4.x
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 5. Hive 0.14.0.x
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 6. Hive Server2 0.14.0.x
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 7. Sentry Aware Hive Server2 0.14.0.x
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 8. Tableau Server 9.x
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:626) - Files:
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 9. Custom Protocol (including http/https)
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 10. Datameer server filesystem
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 11. FTP
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 12. HDFS
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 13. OpenStack Swift
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 14. S3
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 15. S3 Block
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 16. SFTP
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 17. SSH
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:626) - Web Services:
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 18. Amazon Ec2
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 19. GitHub
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 20. Google Adsense
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 21. Google Analytics
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 22. Google Fusion Tables
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 23. Google Plus
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 24. Google Spreadsheet
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 25. Google Webmaster Tools API
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 26. Jira
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 27. Marketo REST - Lead List
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 28. Marketo SOAP - Lead Activity
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 29. New York Times Api
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 30. Salesforce
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 31. Twitter Rest API
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:628) - 32. Zendesk
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:636) - File Types:
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:638) - 1. Apache Log
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:638) - 2. Avro Record Files
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:638) - 3. Cobol Copybook
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:638) - 4. CSV / TSV
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:638) - 5. Excel Workbook (2007 or newer)
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:638) - 6. Fixed Width
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:638) - 7. HTML File Type
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:638) - 8. IIS Log
INFO [2017-05-04 10:28:44.926] [main] (PluginRegistryImpl.java:638) - 9. JSON
INFO [2017-05-04 10:28:44.942] [main] (PluginRegistryImpl.java:638) - 10. Key/Value pairs
INFO [2017-05-04 10:28:44.942] [main] (PluginRegistryImpl.java:638) - 11. Log4j Log File
INFO [2017-05-04 10:28:44.942] [main] (PluginRegistryImpl.java:638) - 12. MBox
INFO [2017-05-04 10:28:44.942] [main] (PluginRegistryImpl.java:638) - 13. Netfilter / IP-Tables
INFO [2017-05-04 10:28:44.942] [main] (PluginRegistryImpl.java:638) - 14. Parquet File Format v2.1
INFO [2017-05-04 10:28:44.942] [main] (PluginRegistryImpl.java:638) - 15. Regex Parsable Text
INFO [2017-05-04 10:28:44.942] [main] (PluginRegistryImpl.java:638) - 16. Sequence File with Metadata
INFO [2017-05-04 10:28:44.942] [main] (PluginRegistryImpl.java:638) - 17. Twitter Data
INFO [2017-05-04 10:28:44.942] [main] (PluginRegistryImpl.java:638) - 18. XML
INFO [2017-05-04 10:28:44.942] [main] (PluginRegistryImpl.java:115) - --- JVM Information ---
INFO [2017-05-04 10:28:44.942] [main] (PluginRegistryImpl.java:116) - JVM: Java HotSpot(TM) 64-Bit Server VM, 1.7 (Oracle Corporation)
INFO [2017-05-04 10:28:44.942] [main] (PluginRegistryImpl.java:117) - JVM arguments: -Dexe4j.semaphoreName=Local\c:_users_nepo_datameer-6.1.14_datameer.exe -Dexe4j.isInstall4j=true -Dexe4j.moduleName=C:\Users\NEPO\Datameer-6.1.14\Datameer.exe -Dexe4j.processCommFile=C:\Users\NEPO\AppData\Local\Temp\e4j_p4000.tmp -Dexe4j.tempDir= -Dexe4j.unextractedPosition=0 -Djava.library.path=C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Bitvise SSH Client;C:\Program Files (x86)\Skype\Phone\;c:\users\nepo\datameer-6.1.14\jre\bin -Dexe4j.consoleCodepage=cp0 -Djava.library.path=${installer:sys.installationDir}/lib -Dinstall4j.launcherId=27 -Dinstall4j.swt=false -Dorg.apache.jasper.compiler.disablejsr199=true -XX:MaxPermSize=384m -Xms256m -Xmx2048m -XX:MaxNewSize=192m -XX:SurvivorRatio=6 -Dfile.encoding=utf-8 -Ddeploy.mode=trial -Ddas.user.data=C:\Users\NEPO\AppData\Local\Datameer\6.1.14 -Djava.library.path=C:\Users\NEPO\Datameer-6.1.14\lib
INFO [2017-05-04 10:28:44.942] [main] (PluginRegistryImpl.java:128) - Log4j: 'desktop/log4j-desktop.properties' (configured path)
INFO [2017-05-04 10:28:44.942] [main] (PluginRegistryImpl.java:119) - Max memory : 2.0 GB
INFO [2017-05-04 10:28:44.942] [main] (PluginRegistryImpl.java:121) - Free memory: 1.8 GB, before Plugin Registry start-up: 1.9 GB
INFO [2017-05-04 10:28:44.942] [main] (PluginRegistryImpl.java:122) - ---------------------
INFO [2017-05-04 10:28:45.036] [main] (ContextListener.java:104) - JVM: Java HotSpot(TM) 64-Bit Server VM, 1.7 (Oracle Corporation)
INFO [2017-05-04 10:28:45.036] [main] (ContextListener.java:105) - JVM Arguments: -Dexe4j.semaphoreName=Local\c:_users_nepo_datameer-6.1.14_datameer.exe -Dexe4j.isInstall4j=true -Dexe4j.moduleName=C:\Users\NEPO\Datameer-6.1.14\Datameer.exe -Dexe4j.processCommFile=C:\Users\NEPO\AppData\Local\Temp\e4j_p4000.tmp -Dexe4j.tempDir= -Dexe4j.unextractedPosition=0 -Djava.library.path=C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Bitvise SSH Client;C:\Program Files (x86)\Skype\Phone\;c:\users\nepo\datameer-6.1.14\jre\bin -Dexe4j.consoleCodepage=cp0 -Djava.library.path=${installer:sys.installationDir}/lib -Dinstall4j.launcherId=27 -Dinstall4j.swt=false -Dorg.apache.jasper.compiler.disablejsr199=true -XX:MaxPermSize=384m -Xms256m -Xmx2048m -XX:MaxNewSize=192m -XX:SurvivorRatio=6 -Dfile.encoding=utf-8 -Ddeploy.mode=trial -Ddas.user.data=C:\Users\NEPO\AppData\Local\Datameer\6.1.14 -Djava.library.path=C:\Users\NEPO\Datameer-6.1.14\lib
INFO [2017-05-04 10:28:45.036] [main] (ContextListener.java:222) - System-property 'java.library.path': C:\Users\NEPO\Datameer-6.1.14\lib
INFO [2017-05-04 10:28:45.036] [main] (PluginRegistryImpl.java:128) - Log4j: 'desktop/log4j-desktop.properties' (configured path)
INFO [2017-05-04 10:28:49.520] [main] (DatameerCryptoProvider.java:96) - Loading the Datameer Crypto Instance using 'noop'.
INFO [2017-05-04 10:28:49.520] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'das.superuser.password'
INFO [2017-05-04 10:28:49.520] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'db.password'
INFO [2017-05-04 10:28:49.520] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'mail.password'
INFO [2017-05-04 10:28:49.520] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'admin.password'
INFO [2017-05-04 10:28:49.629] [main] (PersistenceUnitPropertiesResolver.java:46) - Postprocessing PersistenceUnitInfo: name 'hsql-memory', root URL [file:/C:/Users/NEPO/Datameer-6.1.14/webapps/WEB-INF/classes]
INFO [2017-05-04 10:28:49.645] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'das.superuser.password'
INFO [2017-05-04 10:28:49.645] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'mail.password'
INFO [2017-05-04 10:28:49.645] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'admin.password'
INFO [2017-05-04 10:28:49.645] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'db.password'
INFO [2017-05-04 10:28:49.645] [main] (PersistenceUnitPropertiesResolver.java:46) - Postprocessing PersistenceUnitInfo: name 'hsql-file', root URL [file:/C:/Users/NEPO/Datameer-6.1.14/webapps/WEB-INF/classes]
INFO [2017-05-04 10:28:49.645] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'das.superuser.password'
INFO [2017-05-04 10:28:49.645] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'mail.password'
INFO [2017-05-04 10:28:49.645] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'admin.password'
INFO [2017-05-04 10:28:49.645] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'db.password'
INFO [2017-05-04 10:28:49.645] [main] (PersistenceUnitPropertiesResolver.java:46) - Postprocessing PersistenceUnitInfo: name 'mysql', root URL [file:/C:/Users/NEPO/Datameer-6.1.14/webapps/WEB-INF/classes]
INFO [2017-05-04 10:28:49.645] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'das.superuser.password'
INFO [2017-05-04 10:28:49.645] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'mail.password'
INFO [2017-05-04 10:28:49.645] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'admin.password'
INFO [2017-05-04 10:28:49.645] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'db.password'
INFO [2017-05-04 10:28:54.036] [main] (?:?) - checkpointClose start
INFO [2017-05-04 10:28:54.036] [main] (?:?) - checkpointClose synched
INFO [2017-05-04 10:28:54.067] [main] (?:?) - checkpointClose script done
INFO [2017-05-04 10:28:54.083] [main] (?:?) - checkpointClose end
INFO [2017-05-04 10:28:57.051] [main] (LocalFileEntryFactory.java:38) - Cleanup cache: C:\Users\NEPO\AppData\Local\Datameer\6.1.14\dfscache
INFO [2017-05-04 10:29:01.723] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'das.superuser.password'
INFO [2017-05-04 10:29:01.723] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'db.password'
INFO [2017-05-04 10:29:01.723] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'mail.password'
INFO [2017-05-04 10:29:01.723] [main] (DatameerCryptoProvider.java:76) - Decrypting property 'admin.password'
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:28) - Registered JDBC drivers:
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 1. Amazon Redshift (JDBC 4.1 driver - recommended)
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 2. Amazon Redshift (PostgreSQL driver)
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 3. DB2
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 4. DB2 8.2
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 5. HSQL_file
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 6. HSQL_http
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 7. MsSql
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 8. MySQL
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 9. Netezza
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 10. Oracle
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 11. PostgreSQL
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 12. PostgreSQL82/Greenplum
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 13. Sybase IQ
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 14. Teradata
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 15. Teradata Aster
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 16. Vertica 5.0
INFO [2017-05-04 10:29:02.551] [main] (JdbcDriverRegistry.java:31) - 17. Vertica 5.1+
INFO [2017-05-04 10:29:03.833] [main] (DatameerEventBusImpl.java:182) - Registered a subscriber on Datameer Event Bus of type 'datameer.dap.conductor.advancedscheduling.AdvancedSchedulingService$AdvancedSchedulingEventHandler'
INFO [2017-05-04 10:29:03.833] [main] (DatameerEventBusImpl.java:182) - Registered a subscriber on Datameer Event Bus of type 'datameer.dap.conductor.app.ApplicationManager$ApplicationExecutionEventHandler'
INFO [2017-05-04 10:29:04.583] [main] (DatameerEventBusImpl.java:182) - Registered a subscriber on Datameer Event Bus of type 'datameer.dap.conductor.event.DataPermissionEventToHdfsSynchronizer'
INFO [2017-05-04 10:29:04.583] [main] (DatameerEventBusImpl.java:182) - Registered a subscriber on Datameer Event Bus of type 'datameer.dap.conductor.event.FilePermissionEventToDataPermissionEventPublisher'
INFO [2017-05-04 10:29:04.598] [main] (DatameerEventBusImpl.java:182) - Registered a subscriber on Datameer Event Bus of type 'datameer.dap.conductor.event.FilePermissionEventToDataPermissionSynchronizer'
INFO [2017-05-04 10:29:04.598] [main] (DatameerEventBusImpl.java:182) - Registered a subscriber on Datameer Event Bus of type 'datameer.dap.conductor.event.FilesystemArtifactSnapshotPublisher'
INFO [2017-05-04 10:29:05.020] [main] (HousekeepingConfiguration.java:150) - ------ Housekeeping Configuration ------
INFO [2017-05-04 10:29:05.020] [main] (HousekeepingConfiguration.java:151) - housekeeping.sleep-time : 3600s
INFO [2017-05-04 10:29:05.020] [main] (HousekeepingConfiguration.java:152) - housekeeping.execution.max-age : 28 days, 0 sec
INFO [2017-05-04 10:29:05.020] [main] (HousekeepingConfiguration.java:153) - housekeeping.run.delete.outdated-job-executions : 50
INFO [2017-05-04 10:29:05.020] [main] (HousekeepingConfiguration.java:154) - housekeeping.keep-deleted-data : 30 mins, 0 sec
INFO [2017-05-04 10:29:05.020] [main] (HousekeepingConfiguration.java:155) - housekeeping.run.mark-for-deletion.outdated-data-objects : 200
INFO [2017-05-04 10:29:05.020] [main] (HousekeepingConfiguration.java:156) - housekeeping.run.delete.outdated-data-objects : 25
INFO [2017-05-04 10:29:05.020] [main] (HousekeepingConfiguration.java:157) - housekeeping.run.delete.outdated-data-artifacts : 100
INFO [2017-05-04 10:29:05.020] [main] (HousekeepingConfiguration.java:158) - housekeeping.temporary-files.max-age : 3 days, 0 sec
INFO [2017-05-04 10:29:05.020] [main] (HousekeepingConfiguration.java:159) - housekeeping.temporary-folder-files.max-age : 30 days, 0 sec
INFO [2017-05-04 10:29:05.020] [main] (HousekeepingConfiguration.java:160) - housekeeping.run.delete.outdated-temporary-files : 50
INFO [2017-05-04 10:29:05.129] [main] (JobScheduler.java:344) - Starting controller JobScheduler
INFO [2017-05-04 10:29:05.379] [main] (DatameerEventBusImpl.java:182) - Registered a subscriber on Datameer Event Bus of type 'datameer.dap.conductor.mail.MailServiceSubscriber'
INFO [2017-05-04 10:29:05.504] [main] (WorkbookPreviewService2.java:87) - Workbook preview service cache root: C:\Users\NEPO\AppData\Local\Datameer\6.1.14\cache\workbook-previews
INFO [2017-05-04 10:29:06.083] [main] (RestAuthenticationOriginFilter.java:41) - enabled=true
INFO [2017-05-04 10:29:06.676] [main] (PluginRegistryImpl.java:294) - Activating Plugin classes which have 'auto-activate=true':
INFO [2017-05-04 10:29:06.676] [main] (PluginRegistryImpl.java:298) - Activate Plugin: plugin-tez
INFO [2017-05-04 10:29:06.676] [main] (PluginRegistryImpl.java:298) - Activate Plugin: das.common
INFO [2017-05-04 10:29:06.708] [main] (CommonPlugin.java:26) - Hadoop-Distribution: 2.6.0 (apache-2.6.0)
INFO [2017-05-04 10:29:06.708] [main] (PluginRegistryImpl.java:298) - Activate Plugin: plugin-spark-exec
INFO [2017-05-04 10:29:06.708] [main] (PluginRegistryImpl.java:298) - Activate Plugin: plugin-hive-0.14.0
INFO [2017-05-04 10:29:06.723] [main] (HivePlugin.java:50) - Removing Hive Data Store type extension point 'datameer.dap.sdk.datastore.DataStoreType' from plugin registry for the extension 'datameer.SentryHiveServer2DataStoreType-default'
INFO [2017-05-04 10:29:06.723] [main] (HivePlugin.java:54) - Hive is instantiated on conductor side, starting the scheduled partition cache.
INFO [2017-05-04 10:29:06.739] [main] (AuthenticatorService.java:109) - Switching authenticator to 'Internal'
INFO [2017-05-04 10:29:06.739] [main] (CsrfFilter.java:169) - Settings whitelist to: []
INFO [2017-05-04 10:29:06.786] [main] (HadoopImpersonationService.java:29) - Injecting instance datameer.dap.conductor.service.HadoopImpersonationServiceImpl@28199361
INFO [2017-05-04 10:29:06.786] [main] (DataInjectorService.java:69) - Running system injectors...
INFO [2017-05-04 10:29:06.879] [pool-5-thread-1] (HivePartitionCacheTimerTask.java:236) - Start to load remote partitions from '0' import job models and cache it to disk 'C:\Users\NEPO\AppData\Local\Datameer\6.1.14\cache\plugin-hive\cache'.
INFO [2017-05-04 10:29:06.973] [main] (DataInjectorService.java:80) - Inject data from datameer.dap.conductor.util.spring.deploy.impl.CustomRoleInjector
INFO [2017-05-04 10:29:07.098] [main] (DataInjectorService.java:80) - Inject data from datameer.dap.conductor.util.spring.deploy.impl.AdminUserInjector
INFO [2017-05-04 10:29:07.098] [main] (DataInjectorService.java:80) - Inject data from datameer.dap.conductor.util.spring.deploy.impl.AnalystUserInjector
INFO [2017-05-04 10:29:07.114] [main] (DataInjectorService.java:80) - Inject data from datameer.dap.conductor.util.spring.deploy.impl.SchemaVersionInjector
INFO [2017-05-04 10:29:07.114] [main] (SchemaVersionInjector.java:64) - Continuing with schema version 6.1.0
INFO [2017-05-04 10:29:07.114] [main] (DataInjectorService.java:80) - Inject data from datameer.dap.conductor.webapp.service.SchemaVersionChecker
INFO [2017-05-04 10:29:07.161] [pool-5-thread-1] (HivePartitionCacheTimerTask.java:245) - Found at least one partition to cache: 'false'
INFO [2017-05-04 10:29:07.161] [pool-5-thread-1] (HivePartitionCacheTimerTask.java:247) - Updating the cache under folder 'C:\Users\NEPO\AppData\Local\Datameer\6.1.14\cache\plugin-hive\cache' is finished.
INFO [2017-05-04 10:29:07.161] [main] (DataInjectorService.java:80) - Inject data from datameer.dap.conductor.util.spring.deploy.impl.BootstrapInjector
INFO [2017-05-04 10:29:07.176] [main] (BootstrapInjector.java:56) - Injected mandatory folder: /
INFO [2017-05-04 10:29:07.208] [main] (BootstrapInjector.java:56) - Injected mandatory folder: /.system
INFO [2017-05-04 10:29:07.208] [main] (BootstrapInjector.java:56) - Injected mandatory folder: /Users
INFO [2017-05-04 10:29:07.239] [main] (DataInjectorService.java:80) - Inject data from datameer.dap.conductor.util.spring.deploy.impl.SetupPropertiesInjector
INFO [2017-05-04 10:29:07.254] [main] (DataInjectorService.java:72) - Running system injectors took 468 ms!
INFO [2017-05-04 10:29:07.254] [main] (DataInjectorService.java:69) - Running user injectors...
INFO [2017-05-04 10:29:07.254] [main] (DataInjectorService.java:80) - Inject data from datameer.dap.conductor.util.spring.deploy.upgrade.UpgradeDataInjector
INFO [2017-05-04 10:29:07.270] [main] (Upgrades.java:83) - Loaded infographics update scripts: []
INFO [2017-05-04 10:29:07.286] [main] (DataInjectorService.java:80) - Inject data from datameer.dap.conductor.launcher.DesktopDataInjector
INFO [2017-05-04 10:29:07.364] [main] (HadoopPropertiesUtil.java:36) - Initialized hadoop properties from file /default-mr2.properties
INFO [2017-05-04 10:29:07.364] [main] (DesktopDataInjector.java:38) - Overriding Hadoop temporary directory for Desktop App.
INFO [2017-05-04 10:29:07.364] [main] (DataInjectorService.java:80) - Inject data from datameer.dap.conductor.util.spring.deploy.impl.ConnectionInjector
INFO [2017-05-04 10:29:07.379] [main] (HadoopClusterService.java:183) - Loading the current hadoop configuration freshly
INFO [2017-05-04 10:29:07.379] [main] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
ERROR [2017-05-04 10:29:07.379] [main] (Shell.java:373) - Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:355)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:370)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:363)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:79)
at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1711)
at datameer.dap.sdk.util.HadoopConstants.addAdditionProperties(HadoopConstants.java:126)
at datameer.dap.common.entity.properties.HadoopConfiguration.createUnconfiguredConf(HadoopConfiguration.java:329)
at datameer.dap.common.entity.properties.GridMode.createConductorConfiguration(GridMode.java:484)
at datameer.dap.common.entity.properties.HadoopConfiguration.createConductorConfiguration(HadoopConfiguration.java:506)
at datameer.dap.conductor.service.HadoopClusterService$3.run(HadoopClusterService.java:185)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at datameer.dap.conductor.persistence.TransactionHandler.executeInTransaction(TransactionHandler.java:108)
at datameer.dap.conductor.persistence.TransactionHandler.executeInTransaction(TransactionHandler.java:41)
at datameer.dap.conductor.service.HadoopClusterService.initConfigurationIfNeeded(HadoopClusterService.java:180)
at datameer.dap.conductor.service.HadoopClusterService.getCurrentConfiguration(HadoopClusterService.java:82)
at datameer.dap.conductor.util.spring.deploy.impl.ConnectionInjector.injectUploadDataStore(ConnectionInjector.java:81)
at datameer.dap.conductor.util.spring.deploy.impl.ConnectionInjector.injectConnections(ConnectionInjector.java:60)
at datameer.dap.conductor.util.spring.deploy.impl.ConnectionInjector.injectData(ConnectionInjector.java:55)
at datameer.dap.conductor.util.spring.deploy.DataInjectorService.injectData(DataInjectorService.java:81)
at datameer.dap.conductor.util.spring.deploy.DataInjectorService.runInjectors(DataInjectorService.java:71)
at datameer.dap.conductor.util.spring.deploy.DataInjectorService.access$100(DataInjectorService.java:33)
at datameer.dap.conductor.util.spring.deploy.DataInjectorService$2.run(DataInjectorService.java:63)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at datameer.dap.common.security.DatameerSecurityService.runAsUser(DatameerSecurityService.java:109)
at datameer.dap.common.security.DatameerSecurityService.runAsUser(DatameerSecurityService.java:186)
at datameer.dap.conductor.util.spring.deploy.DataInjectorService.inject(DataInjectorService.java:59)
at datameer.dap.conductor.webapp.ContextListener.injectData(ContextListener.java:189)
at datameer.dap.conductor.webapp.ContextListener.contextInitialized(ContextListener.java:144)
at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:800)
at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:444)
at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:791)
at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:294)
at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)
at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)
at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
at org.eclipse.jetty.server.Server.start(Server.java:387)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
at org.eclipse.jetty.server.Server.doStart(Server.java:354)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at datameer.dap.desktop.Conductor.start(Conductor.java:202)
at datameer.dap.desktop.DesktopLauncher.startConductor(DesktopLauncher.java:254)
at datameer.dap.desktop.DesktopLauncher.main(DesktopLauncher.java:523)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at com.exe4j.runtime.LauncherEngine.launch(Unknown Source)
at com.exe4j.runtime.WinLauncher.main(Unknown Source)
at com.install4j.runtime.launcher.WinLauncher.main(Unknown Source)
WARN [2017-05-04 10:29:07.458] [main] (NativeCodeLoader.java:62) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
INFO [2017-05-04 10:29:07.458] [main] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 10:29:07.473] [main] (TezExecutionFramework.java:24) - Loading Tez security classes.
INFO [2017-05-04 10:29:10.129] [main] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 10:29:10.239] [main] (DataInjectorService.java:80) - Inject data from datameer.dap.conductor.util.spring.deploy.impl.DefaultJdbcDriverInjector
WARN [2017-05-04 10:29:10.254] [main] (DefaultJdbcDriverInjector.java:51) - No class for built in db type found: MySQL
INFO [2017-05-04 10:29:10.254] [main] (DataInjectorService.java:80) - Inject data from datameer.dap.conductor.util.spring.deploy.impl.PluginJsonDataInjector
INFO [2017-05-04 10:29:10.254] [main] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 10:29:10.270] [main] (ExampleDataInjectorPlugin.java:114) - Inject examples = false
INFO [2017-05-04 10:29:10.270] [main] (DataInjectorService.java:80) - Inject data from datameer.dap.conductor.util.spring.deploy.impl.SystemJobInjector
INFO [2017-05-04 10:29:10.270] [main] (SystemJobInjector.java:38) - Injecting any missing SystemJobConfigurations.
INFO [2017-05-04 10:29:10.270] [main] (DataInjectorService.java:72) - Running user injectors took 3 sec, 16 ms!
INFO [2017-05-04 10:29:10.286] [main] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 10:29:10.286] [main] (ContextListener.java:264) - Cleaning temp folder file:/C:/Users/NEPO/AppData/Local/Datameer/6.1.14/data/temp
INFO [2017-05-04 10:29:10.317] [main] (RunlevelManager.java:59) - Setting runlevel to RUNNING
INFO [2017-05-04 10:29:10.317] [HousekeepingService thread-1] (SingleThreadedController.java:106) - Starting controller HousekeepingService
INFO [2017-05-04 10:29:10.317] [pool-2-thread-1] (DataVolumeProvider.java:115) - Starting DataVolumeProvider with a delay of 1 mins, 0 sec and period of 1 hrs, 0 sec
WARN [2017-05-04 10:29:10.317] [main] (ContextListener.java:210) - your db.mode [hsql-file] is not suitable for production
INFO [2017-05-04 10:29:10.317] [main] (ContextListener.java:212) - initializing project done
INFO [2017-05-04 10:29:10.317] [main] (ContextListener.java:213) - The application is started, please open your browser on: http://127.0.0.1:32826
INFO [2017-05-04 10:29:10.317] [ClusterCapacityUpdater thread-1] (SingleThreadedController.java:106) - Starting controller ClusterCapacityUpdater
INFO [2017-05-04 10:29:10.317] [DataTrackingService thread-1] (SingleThreadedController.java:106) - Starting controller DataTrackingService
INFO [2017-05-04 10:29:10.317] [JamonStatisticsService thread-1] (SingleThreadedController.java:106) - Starting controller JamonStatisticsService
INFO [2017-05-04 10:29:10.317] [JobScheduler thread-1] (SingleThreadedController.java:106) - Starting controller JobScheduler
INFO [2017-05-04 10:29:10.317] [pool-2-thread-2] (JobSchedulerDaemon.java:182) - Registering scheduled job configurations...
INFO [2017-05-04 10:29:10.364] [pool-2-thread-2] (JobSchedulerDaemon.java:198) - Registered 0 scheduled job configurations in 32.12 ms
INFO [2017-05-04 10:29:10.364] [pool-2-thread-2] (JobSchedulerDaemon.java:120) - Starting job scheduler daemon
INFO [2017-05-04 10:29:10.411] [HousekeepingService thread-1] (HousekeepingService.java:169) - Starting housekeeping
INFO [2017-05-04 10:29:10.428] [DataTrackingService thread-1] (DataTrackingService.java:129) - Found initial license volume information: InitialDataVolumeConfiguration{2017-04-06 15:45, 8520}
INFO [2017-05-04 10:29:10.583] [JobScheduler thread-1] (JobScheduler.java:1071) - Searching for obsolete datas.
INFO [2017-05-04 10:29:10.806] [JobScheduler thread-1] (JobScheduler.java:1087) - Searching for obsolete datas took 223 ms.
INFO [2017-05-04 10:29:11.098] [HousekeepingService thread-1] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 10:29:11.110] [HousekeepingService thread-1] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 10:29:11.113] [HousekeepingService thread-1] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 10:29:11.121] [HousekeepingService thread-1] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 10:29:11.124] [HousekeepingService thread-1] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 10:29:11.126] [HousekeepingService thread-1] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 10:29:11.131] [HousekeepingService thread-1] (HousekeepingService.java:236) - Housekeep physically deleted data entities: 68.55% (558ms)
INFO [2017-05-04 10:29:11.132] [HousekeepingService thread-1] (HousekeepingService.java:236) - Housekeep outdated job executions : 16.34% (133ms)
INFO [2017-05-04 10:29:11.132] [HousekeepingService thread-1] (HousekeepingService.java:236) - Housekeep obsolete artifacts from cluster : 1.97% (16ms)
INFO [2017-05-04 10:29:11.133] [HousekeepingService thread-1] (HousekeepingService.java:236) - Housekeep outdated temporary datameer files: 0.12% (1ms)
INFO [2017-05-04 10:29:11.133] [HousekeepingService thread-1] (HousekeepingService.java:236) - Housekeep outdated temporary HDFS folder and files: 0.74% (6ms)
INFO [2017-05-04 10:29:11.133] [HousekeepingService thread-1] (HousekeepingService.java:236) - Housekeep physical data : 0.74% (6ms)
INFO [2017-05-04 10:29:11.133] [HousekeepingService thread-1] (HousekeepingService.java:239) - Business: 100.0%
INFO [2017-05-04 10:29:11.133] [HousekeepingService thread-1] (HousekeepingService.java:216) - Housekeeping done. took 0 sec
INFO [2017-05-04 10:29:14.591] [main] (DesktopLauncher.java:276) - Launching browser at 'http://127.0.0.1:32826'.
INFO [2017-05-04 10:29:36.675] [qtp1679033854-25] (CountSessionProcessor.java:62) - Registered new session. Current number of sessions: 1
INFO [2017-05-04 10:30:10.321] [DataVolumeCalculator] (DataVolumeProvider.java:171) - Calculating consumed total license volume...
INFO [2017-05-04 10:30:10.327] [DataVolumeCalculator] (DataVolumeProvider.java:179) - Calculated consumed total license volume in 6 ms
INFO [2017-05-04 10:30:10.336] [DataVolumeCalculator] (DataVolumeProvider.java:192) - Updating cached license volumes for interval 2017-04-04T00:00:00.000-05:00/2017-10-01T17:00:00.000-05:00
INFO [2017-05-04 10:30:10.460] [DataVolumeCalculator] (DataVolumeProvider.java:202) - Updated cached license volumes completed in 128 ms
INFO [2017-05-04 11:31:15.587] [JobScheduler thread-1] (JobScheduler.java:1071) - Searching for obsolete datas.
INFO [2017-05-04 11:31:15.720] [JobScheduler thread-1] (JobScheduler.java:1087) - Searching for obsolete datas took 133 ms.
INFO [2017-05-04 11:31:24.186] [org.eclipse.jetty.server.session.HashSessionManager@2255775aTimer] (CountSessionProcessor.java:80) - Deregistered session. Current number of sessions: 0
INFO [2017-05-04 11:33:08.060] [qtp1679033854-20] (CountSessionProcessor.java:62) - Registered new session. Current number of sessions: 1
INFO [2017-05-04 12:05:48.421] [qtp1679033854-20] (CountSessionProcessor.java:80) - Deregistered session. Current number of sessions: 0
INFO [2017-05-04 12:29:07.355] [qtp1679033854-23] (CountSessionProcessor.java:62) - Registered new session. Current number of sessions: 1
INFO [2017-05-04 12:29:34.043] [HousekeepingService thread-1] (HousekeepingService.java:169) - Starting housekeeping
INFO [2017-05-04 12:29:34.063] [HousekeepingService thread-1] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 12:29:34.066] [HousekeepingService thread-1] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 12:29:34.075] [HousekeepingService thread-1] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 12:29:34.084] [HousekeepingService thread-1] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 12:29:34.088] [HousekeepingService thread-1] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 12:29:34.090] [HousekeepingService thread-1] (HadoopUtil.java:465) - Setting fs.file.impl to:datameer.dap.sdk.hadoop.filesystem.windows.WindowsLocalFileSystem
INFO [2017-05-04 12:29:34.093] [HousekeepingService thread-1] (HousekeepingService.java:236) - Housekeep physically deleted data entities: 32.73% (18ms)
INFO [2017-05-04 12:29:34.093] [HousekeepingService thread-1] (HousekeepingService.java:236) - Housekeep outdated job executions : 5.45% (3ms)
INFO [2017-05-04 12:29:34.094] [HousekeepingService thread-1] (HousekeepingService.java:236) - Housekeep obsolete artifacts from cluster : 21.82% (12ms)
INFO [2017-05-04 12:29:34.094] [HousekeepingService thread-1] (HousekeepingService.java:236) - Housekeep outdated temporary datameer files: 1.82% (1ms)
INFO [2017-05-04 12:29:34.094] [HousekeepingService thread-1] (HousekeepingService.java:236) - Housekeep outdated temporary HDFS folder and files: 21.82% (12ms)
INFO [2017-05-04 12:29:34.094] [HousekeepingService thread-1] (HousekeepingService.java:236) - Housekeep physical data : 7.27% (4ms)
INFO [2017-05-04 12:29:34.094] [HousekeepingService thread-1] (HousekeepingService.java:239) - Business: 0.0%
INFO [2017-05-04 12:29:34.095] [HousekeepingService thread-1] (HousekeepingService.java:216) - Housekeeping done. took 0 sec
INFO [2017-05-04 12:30:19.370] [DataVolumeCalculator] (DataVolumeProvider.java:171) - Calculating consumed total license volume...
INFO [2017-05-04 12:30:19.370] [DataVolumeCalculator] (DataVolumeProvider.java:179) - Calculated consumed total license volume in 0 ms
INFO [2017-05-04 12:31:16.084] [JobScheduler thread-1] (JobScheduler.java:1071) - Searching for obsolete datas.
INFO [2017-05-04 12:31:16.157] [JobScheduler thread-1] (JobScheduler.java:1087) - Searching for obsolete datas took 73 ms.
INFO [2017-05-04 12:40:53.987] [qtp1679033854-22] (CountSessionProcessor.java:80) - Deregistered session. Current number of sessions: 0 -
Thank you Jesus, unfortunately no further details are logged in the conductor.log file. I appreciate you sharing it to double check though.
Let's continue to focus on using smtp.office365.com:587 at this point since you have demonstrated that you encounter the same issue with Hotmail as well (one that we could freely verify works in our lab environment). The last exception you noted in that environment was "Client was not authorized to send anonymous mail during MAIL FROM". Is that still the current exception?
If so, what are the detailed settings that you are inputing for the Mail Server itself? Is the "from address" that you're using the same as the "user name" that you are providing with a password to login to the SMTP server?
-
Hi Jesus, according to the documentation from Microsoft (https://support.office.com/en-us/article/POP-and-IMAP-settings-for-Outlook-Office-365-for-business-7fc677eb-2491-4cbc-8153-8e7113525f6c) the correct server should be smtp.office365.com on port 587 with SSL/TLS enabled.
Previously, I mentioned outlook.office365.com by mistake. Please use the one from Microsoft's documentation.
Besides this, are there any firewall rules on this server? Perhaps there are restrictions for which applications can submit outbound internet traffic.
-
Hi Joel,
I tried with smtp.office365.com as well, with AntiVirus ON it sends the same error as before, with AntiVirus OFF sends this:
This environment is in a Virtual Windows 7 machine with personal Datameer 6.1.14 license, i have tried in a CentOS server at our lab as well getting exact same results. However, I will try again tonight in our lab with Datameer 5.11.14 to double check it.
Best Regards.
-
Thank you for the attempt Jesus. Are there other applications that you are able to configure successfully with this same SMTP server from the same general network?
The telnet connection detail is a good validation in general from both the Windows and CentOS systems. It does not appear to be a network issue at this time.
-
Hi Joel,
I did the same test with thunderbird days ago with a Hotmail account, and from thunderbird email went smoothly but datameer sends same error message. One thing i noticed is that STARTTLLS is on, instead of SSL/TLS, ¿Can that be part of the problem? Since i noticed it's the same STARTTLS on our office365 accounts.
Thanks, best regards.
-
Hello Jesus, after following up with our Engineering team about this implementation and issue. It appears that the Office365 SMTP server is using a STARTTLS protocol (according to Microsoft documentation). At this time, STARTTLS is not a supported protocol for Datameer's SMTP implementation at this time. The STARTTLS connection type that Office365 offers starts as plaintext and then converts to an encrypted channel -- this type of connection is not supported in Datameer.
Datameer supports a SSL/TLS connection or a plaintext connection only.
I would recommend seeking clarification with Microsoft on the encryption options available for SMTP with your connection. From the available documentation, it appears that only STARTTLS is available which is not a protocol that Datameer supports. If it is possible to enable the fully encrypted SSL/TLS connection for your Office365 account, that would be a valid configuration.
Please sign in to leave a comment.
Comments
25 comments