How to Test Kerberos Authentication and Job Execution

Goal

Test Kerberos authentication and job execution from your current Datameer installation directory.

[datameer@datameer current]$ pwd
/opt/datameer/current

Learn

1. Check your keytab file:

klist -k /home/datameer/datameer.keytab -Kte

2. And your Kerberos tickets:

klist -f

3. Create a ticket, if necessary:

kinit datameer@<domain>.<tld> -k -t /home/datameer/datameer.keytab

4. Check if you have access to HDFS: 

hadoop fs -ls /user/datameer 

5. Search for sample job on your cluster: 

sudo find / -name 'hadoop-mapreduce-examples*'

6. Send a test job into the cluster in the configured queue. 

Example 1

[datameer@datameer current]$ hadoop jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-*.jar pi -Dmapreduce.job.queuename=root.default 3 10

Example 2

[datameer@datameer current]$ hadoop jar /opt/cloudera/parcels/CDH/jars/hadoop-mapreduce-examples-*.jar pi -Dmapreduce.job.queuename=root.datameer 3 10

Example 3

A map/reduce program that counts the words in the input files.

[datameer@datameer current]$ hadoop jar /opt/cloudera/parcels/CDH/jars/hadoop-mapreduce-examples-*.jar wordcount /<hdfs folder>/<input file> /<hdfs folder>/<output folder to create>