Pentaho

 View Only

 Pentaho Data Integration 8.2 problem connection Google Big Query

  • Pentaho
  • Kettle
  • Pentaho
  • Pentaho Data Integration PDI
Fabrizio Agosti's profile image
Fabrizio Agosti posted 02-14-2019 13:49

This content was either too long or contained formatting that did not work with our migration. A PDF document is attached that contains the original representation

 

Hi,I've installed PDI version 8.2 and try to create connection to Google Big Query, but I don't understand how to set the filed parameters.I've configured the field "project id" but don't understand how to set others field and how to pass Json authentication file.This is error message.Errore di connessione al database [Groupm - BigQuery] : org.pentaho.di.core.exception.KettleDatabaseException:Error occurred while trying to connect to the databaseError connecting to database: (using class com.simba.googlebigquery.jdbc42.Driver)[Simba][BigQueryJDBCDriver](100009) Service account email or private key file path not specified.org.pentaho.di.core.exception.KettleDatabaseException: Error occurred while trying to connect to the databaseError connecting to database: (using class com.simba.googlebigquery.jdbc42.Driver)[Simba][BigQueryJDBCDriver](100009) Service account email or private key file path not specified.  at org.pentaho.di.core.database.Database.normalConnect(Database.java:472)  at org.pentaho.di.core.database.Database.connect(Database.java:370)  at org.pentaho.di.core.database.Database.connect(Database.java:341)  at org.pentaho.di.core.database.Database.connect(Database.java:331)  at org.pentaho.di.core.database.DatabaseFactory.getConnectionTestReport(DatabaseFactory.java:83)  at org.pentaho.di.core.database.DatabaseFactory.getConnectionTestResults(DatabaseFactory.java:112)  at org.pentaho.di.core.database.DatabaseMeta.testConnectionSuccess(DatabaseMeta.java:2811)  at org.pentaho.ui.database.event.DataHandler.testDatabaseConnection(DataHandler.java:621)  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  at java.lang.reflect.Method.invoke(Method.java:498)  at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:313)  at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:157)  at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:141)  at org.pentaho.ui.xul.swt.tags.SwtButton.access$500(SwtButton.java:43)  at org.pentaho.ui.xul.swt.tags.SwtButton$4.widgetSelected(SwtButton.java:137)  at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source)  at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)  at org.eclipse.swt.widgets.Display.sendEvent(Unknown Source)  at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)  at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)  at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)  at org.eclipse.swt.widgets.Widget.notifyListeners(Unknown Source)  at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)  at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)  at org.eclipse.jface.window.Window.runEventLoop(Window.java:820)  at org.eclipse.jface.window.Window.open(Window.java:796)  at org.pentaho.di.ui.xul.KettleDialog.show(KettleDialog.java:80)  at org.pentaho.di.ui.xul.KettleDialog.show(KettleDialog.java:47)  at org.pentaho.di.ui.core.database.dialog.XulDatabaseDialog.open(XulDatabaseDialog.java:116)  at org.pentaho.di.ui.core.database.dialog.DatabaseDialog.open(DatabaseDialog.java:61)  at org.pentaho.di.ui.spoon.delegates.SpoonDBDelegate.dupeConnection(SpoonDBDelegate.java:144)  at org.pentaho.di.ui.spoon.Spoon.dupeConnection(Spoon.java:2720)  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  at java.lang.reflect.Method.invoke(Method.java:498)  at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:313)  at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:157)  at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:141)  at org.pentaho.ui.xul.jface.tags.JfaceMenuitem.access$100(JfaceMenuitem.java:43)  at org.pentaho.ui.xul.jface.tags.JfaceMenuitem$1.run(JfaceMenuitem.java:106)  at org.eclipse.jface.action.Action.runWithEvent(Action.java:498)  at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545)  at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490)  at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:402)  at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)  at org.eclipse.swt.widgets.Display.sendEvent(Unknown Source)  at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)  at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)  at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)  at org.eclipse.swt.widgets.Widget.notifyListeners(Unknown Source)  at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)  at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)  at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1381)  at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7817)  at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:9179)  at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:707)  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  at java.lang.reflect.Method.invoke(Method.java:498)  at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92)Caused by: org.pentaho.di.core.exception.KettleDatabaseException: Error connecting to database: (using class com.simba.googlebigquery.jdbc42.Driver)[Simba][BigQueryJDBCDriver](100009) Service account email or private key file path not specified.  at org.pentaho.di.core.database.Database.connectUsingClass(Database.java:583)  at org.pentaho.di.core.database.Database.normalConnect(Database.java:456)  ... 63 moreCaused by: java.sql.SQLException: [Simba][BigQueryJDBCDriver](100009) Service account email or private key file path not specified.  at com.simba.googlebigquery.googlebigquery.client.BQClient.serviceAccountOAuth(Unknown Source)  at com.simba.googlebigquery.googlebigquery.core.BQConnection.connect(Unknown Source)  at com.simba.googlebigquery.jdbc.common.BaseConnectionFactory.doConnect(Unknown Source)  at com.simba.googlebigquery.jdbc.common.AbstractDriver.connect(Unknown Source)  at java.sql.DriverManager.getConnection(DriverManager.java:664)  at java.sql.DriverManager.getConnection(DriverManager.java:208)  at org.pentaho.di.core.database.Database.connectUsingClass(Database.java:570)  at org.pentaho.di.core.database.Database.normalConnect(Database.java:456)  at org.pentaho.di.core.database.Database.connect(Database.java:370)  at org.pentaho.di.core.database.Database.connect(Database.java:341)  at org.pentaho.di.core.database.Database.connect(Database.java:331)  at org.pentaho.di.core.database.DatabaseFactory.getConnectionTestReport(DatabaseFactory.java:83)  at org.pentaho.di.core.database.DatabaseFactory.getConnectionTestResults(DatabaseFactory.java:112)  at org.pentaho.di.core.database.DatabaseMeta.testConnectionSuccess(DatabaseMeta.java:2811)  at org.pentaho.ui.database.event.DataHandler.testDatabaseConnection(DataHandler.java:621)  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  at java.lang.reflect.Method.invoke(Method.java:498)  at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:313)  at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:157)  at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:141)  at org.pentaho.ui.xul.swt.tags.SwtButton.access$500(SwtButton.java:43)  at org.pentaho.ui.xul.swt.tags.SwtButton$4.widgetSelected(SwtButton.java:137)  at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source)  at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source)  at org.eclipse.swt.widgets.Display.sendEvent(Unknown Source)  at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)  at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)  at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source)  at org.eclipse.swt.widgets.Widget.notifyListeners(Unknown Source)  at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source)  at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source)  at org.eclipse.jface.window.Window.runEventLoop(Window.java:820)  at org.eclipse.jface.window.Window.open(Window.java:796)  at org.pentaho.di.ui.xul.KettleDialog.show(KettleDialog.java:80)  at org.pentaho.di.ui.xul.KettleDialog.show(KettleDialog.java:47)  at org.pentaho.di.ui.core.database.dialog.XulDatabaseDialog.open(XulDatabaseDialog.java:116)  at org.pentaho.di.ui.core.database.dialog.DatabaseDialog.open(DatabaseDialog.java:61)  at org.pentaho.di.ui.spoon.delegates.SpoonDBDelegate.dupeConnection(SpoonDBDelegate.java:144)  at org.pentaho.di.ui.spoon.Spoon.dupeConnection(Spoon.java:2720)  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)  at sun....
#PentahoDataIntegrationPDI
#Pentaho
#Kettle
Attachment  View in library
Pentaho Da...2 problem connection Google Big Query 56 KB
Roguen Keller's profile image
Roguen Keller posted 02-14-2019 16:06

Hello Fabrizio Agosti

Have you come across this documentation: Google BigQuery - Pentaho Documentation

Data Conversion's profile image
Data Conversion posted 08-14-2019 23:44
Attachment  View in library
68357.pdf 56 KB
R L Magidson's profile image
R L Magidson posted 10-02-2019 15:02

I got this going with PDI 8.3 and thought I'd share a bit of clarification... That doc was not clear since it didn't really match what we see in the PDI data connection dialog (for example, there's no "options" to enter).

 

Create a new Database Connection (not the wizard)

  • Select General
  • Give it a Connection Name
  • Connection Type is Google BigQuery
  • Access is Native (JDBC)

In the Settings,

 

Replace things in <brackets> with your own info. Obviously you'll have to generate the json file in BQ first.

 

I hope this helps

- rlm

 

Related Content