Pentaho

 View Only

 Issue with Setting up hadoop cluster in spoon

  • Pentaho
  • Kettle
  • Pentaho
  • Pentaho Data Integration PDI
  • Spoon
Data Conversion's profile image
Data Conversion posted 07-16-2018 06:19

Hi,

I am using PDI 8.0 and facing issue while setting up the hadoop cluster. I am getting the below errors.

pastedimage_0


#Spoon
#Kettle
#PentahoDataIntegrationPDI
#Pentaho
John Eicher's profile image
John Eicher

Rajat,

When you connect to Hadoop from Spoon, it will attempt to connect to the cluster using the user profile of whoever started Spoon. So for example, in my case if I start Spoon in Windows using my 'ceicher' profile, I must have a /user/ceicher directory in the Hadoop cluster, or else I will get similar errors to what you're seeing now.

Further, you'll need to make sure you've configured your Spoon's shim with all the correct *-site.xml files.

Finally, if you have any kerberos security enabled, you'll need to configure that in the shim as well.

-Chris