AnsweredAssumed Answered

Run a transform with HIVE2 in AEL

Question asked by HUY VU on Jul 26, 2018
Latest reply on Aug 1, 2018 by Chris Eicher

I used Table input with Hive2 connection, the transform can run local mode but it is fail when I run in Spark Engine (AEL).

Anybody has same issue with me?

 

2018-07-27 09:24:06.628  INFO 20750 --- [launcher-proc-1] o.a.s.launcher.app.SparkWebSocketMain    : Caused by: org.pentaho.di.core.exception.KettleXMLException:
2018-07-27 09:24:06.628  INFO 20750 --- [launcher-proc-1] o.a.s.launcher.app.SparkWebSocketMain    : Unable to create new database interface
2018-07-27 09:24:06.629  INFO 20750 --- [launcher-proc-1] o.a.s.launcher.app.SparkWebSocketMain    :
2018-07-27 09:24:06.629  INFO 20750 --- [launcher-proc-1] o.a.s.launcher.app.SparkWebSocketMain    : database type with plugin id [HIVE2] couldn't be found!
2018-07-27 09:24:06.629  INFO 20750 --- [launcher-proc-1] o.a.s.launcher.app.SparkWebSocketMain    :
2018-07-27 09:24:06.629  INFO 20750 --- [launcher-proc-1] o.a.s.launcher.app.SparkWebSocketMain    :
2018-07-27 09:24:06.630  INFO 20750 --- [launcher-proc-1] o.a.s.launcher.app.SparkWebSocketMain    :    at org.pentaho.di.core.database.DatabaseMeta.<init>(DatabaseMeta.java:977)
2018-07-27 09:24:06.630  INFO 20750 --- [launcher-proc-1] o.a.s.launcher.app.SparkWebSocketMain    :    ... 38 more
2018-07-27 09:24:06.630  INFO 20750 --- [launcher-proc-1] o.a.s.launcher.app.SparkWebSocketMain    : Caused by: org.pentaho.di.core.exception.KettleDatabaseException:
2018-07-27 09:24:06.630  INFO 20750 --- [launcher-proc-1] o.a.s.launcher.app.SparkWebSocketMain    : database type with plugin id [HIVE2] couldn't be found!
2018-07-27 09:24:06.631  INFO 20750 --- [launcher-proc-1] o.a.s.launcher.app.SparkWebSocketMain    :
2018-07-27 09:24:06.631  INFO 20750 --- [launcher-proc-1] o.a.s.launcher.app.SparkWebSocketMain    :    at org.pentaho.di.core.database.DatabaseMeta.findDatabaseInterface(DatabaseMeta.java:584)
2018-07-27 09:24:06.631  INFO 20750 --- [launcher-proc-1] o.a.s.launcher.app.SparkWebSocketMain    :    at org.pentaho.di.core.database.DatabaseMeta.getDatabaseInterface(DatabaseMeta.java:558)
2018-07-27 09:24:06.631  INFO 20750 --- [launcher-proc-1] o.a.s.launcher.app.SparkWebSocketMain    :    at org.pentaho.di.core.database.DatabaseMeta.<init>(DatabaseMeta.java:974)
2018-07-27 09:24:06.632  INFO 20750 --- [launcher-proc-1] o.a.s.launcher.app.SparkWebSocketMain    :    ... 38 more
2018-07-27 09:24:06.804  INFO 20750 --- [nio-9060-exec-5] o.p.a.d.spark.RequestServerEndpoint      : Received Stop Message from driver
2018-07-27 09:24:06.810  INFO 20750 --- [nio-9060-exec-5] o.p.a.d.spark.RequestServerEndpoint      : Session 1 closed because of CloseReason[1000,Error executing transformation]
2018-07-27 09:24:06.830  INFO 20750 --- [nio-9060-exec-6] o.p.a.d.spark.RequestServerEndpoint      : Session 0 closed because of CloseReason[1000,Error executing transformation]

Outcomes