Problem
When a user is creating a new Data Link or Import Job using a Hive connection, the user selects the desired Hive Table from the Data Details tab and clicks Next. After doing so, an error is generated in the GUI indicating the following:
Can not parse input: java.lang.ClassNotFoundException Class com.bizo.hive.serde.csv.CSVSerde not found
The customized SerDe Jar file was already added to the Hive Plugin per the documented steps here.
Additionally, if a user queries this same table manually in a Hive Client, the same ClassNotFoundException error is logged in the native Hive client:
hive> SELECT * FROM <HiveTableName>;
FAILED: RuntimeException MetaException(message:java.lang.ClassNotFoundException Class com.bizo.hive.serde.csv.CSVSerde not found)
Cause
The cause is a configuration issue with the Hive Server.
Specifically, the custom SerDe jar file is required to be loaded by the Hive Client using the "add jar" command. The Hive Server should already have the custom SerDe driver included in the native path for all Hive Clients.
Solution
To resolve this issue, ensure that the Hive Server is configured to include the custom SerDe driver natively.
In most environments, this can be accomplished by adding the customer SerDe Jar file into the Hive Server's /usr/lib/hive/lib directory. Once this is added, restart the Hive Server to ensure that the newly added Jar file is loaded.
Once this issue is resolved, the same user query in a native Hive Client that previously failed should succeed:
hive> SELECT * FROM <HiveTableName>;
OK
Time taken: 2.362 seconds
Comments
0 comments
Please sign in to leave a comment.