Problem
Users using MapR 5.0 Hadoop distribution who are importing from S3 or Azure (possibly other sources), the import jobs fail with a ClassNotFountException.
Cause
The required libraries are separated from the correct class path of YARN.
Solution
Copy over the needed libraries to the Hadoop common folder so they would be available for YARN.
- Open the Hadoop tools library folder <mapr-home>/share/hadoop/tools/lib
-
Copy the following jar files:
S3 Users:
aws-java-sdk-1.7.4.jar
hadoop-aws-2.7.0-mapr-1506.jar
Azure Users:
hadoop-azure-2.7.0-mapr-1506.jar
- Add the files to the Hadoop common library folder <mapr-home>/share/hadoop/common/lib
Note: This action must be completed on each node.
Comments
0 comments
Please sign in to leave a comment.