Jouri Semenov

Pentaho 8.0 Connection to Hadoop on Cloudera

Discussion created by Jouri Semenov on Mar 28, 2018
Latest reply on Sep 21, 2018 by Steffen Dahnke

Hi all,

 

I use currently Pentaho 8.0 and try to connect to Hadoop from PDI (Hadoop distribution is Cloudera CDH 5.12). When I try to test my connection, I got User Home Directory Access denied and Root Directory Access denied. I just got back the next inmformation: We couldn't run test User Home Directory Access/ Root Directory Access (The rest is ok, I succesfully executed Hadoop File System Connection, Ping Job Tracker/Resource Manager, Oozie Host Connection, Zookeeper Ensemble Connection and Active Shim Load ).

Consequently I get next error message, when I start to run this application:

2018/03/28 09:08:17 - Spoon - Starting job...

2018/03/28 09:08:17 - testHadoopConnection - Start of job execution

2018/03/28 09:08:17 - testHadoopConnection - Starting entry [Hadoop Copy Files]

2018/03/28 09:08:17 - Hadoop Copy Files - Starting ...

2018/03/28 09:08:17 - Hadoop Copy Files - Processing row source File/folder source : [file:///C:/some path to the file] ... destination file/folder : [hdfs://10.64.0.60:8020/user/root]... wildcard : [*.txt]

2018/03/28 09:08:17 - Hadoop Copy Files - ERROR (version 8.0.0.0-28, build 8.0.0.0-28 from 2017-11-05 07.27.50 by buildguy) : Folder  hdfs://10.64.0.60:8020/user/root does not exist !

2018/03/28 09:08:17 - Hadoop Copy Files - ERROR (version 8.0.0.0-28, build 8.0.0.0-28 from 2017-11-05 07.27.50 by buildguy) : Destination folder does not exist!

2018/03/28 09:08:17 - testHadoopConnection - Finished job entry [Hadoop Copy Files] (result=[false])

2018/03/28 09:08:17 - testHadoopConnection - Job execution finished

2018/03/28 09:08:17 - Spoon - Job has ended.

 

Anyway, I'm pretty sure that this destination folder should be exist in my directory...

I also tried with various combinations of logins (such as username, admin and root), Nothing is worked!

Outcomes