Pentaho

Hi,

we have tried to use BigQuery as source and target. Reading is fine with step 'table input'. Writing into BigQuery with step 'table output' fails.

Also tested this with steps 'Beam BigQuery Input' and 'Beam BigQuery Output'.. No luck :/

Has anyone got this to work?

Br, Mika

Did you follow these steps?
https://help.hitachivantara.com/Documentation/Pentaho/9.4/Setup/Google_BigQuery

Can you include the error for "it fails"?

Hi,

we have tried to use BigQuery as source and target. Reading is fine with step 'table input'. Writing into BigQuery with step 'table output' fails.

Also tested this with steps 'Beam BigQuery Input' and 'Beam BigQuery Output'.. No luck :/

Has anyone got this to work?

Br, Mika

Did you follow these steps?
https://help.hitachivantara.com/Documentation/Pentaho/9.4/Setup/Google_BigQuery

Can you include the error for "it fails"?

Hi,

we have tried to use BigQuery as source and target. Reading is fine with step 'table input'. Writing into BigQuery with step 'table output' fails.

Also tested this with steps 'Beam BigQuery Input' and 'Beam BigQuery Output'.. No luck :/

Has anyone got this to work?

Br, Mika

Hi Stephen,

And thank you for quick reply. Error we are getting ->

BigQuery table output ->"The Simba driver for a Google Big Query database connection does not support regular DDL statements.
Please use the GBQ Bulk Loader step to create your table"

Beam BigQuery Output. Logging says  -> 
2023/06/12 14:49:58 - BigQuery_input.0 - Finished reading query, closing connection
2023/06/12 14:49:58 - BigQuery_input.0 - Finished processing (I=3, O=0, R=0, W=3, U=0, E=0)
2023/06/12 14:49:58 - Beam BigQuery Output.0 - Finished processing (I=0, O=0, R=3, W=3, U=0, E=0)
2023/06/12 14:49:58 - Spoon - The transformation has finished!!

But there is 0 rows in target table :/

And yes, we followed documentation. We can read from BigQuery so connection etc is ok.

-Mika

Did you follow these steps?
https://help.hitachivantara.com/Documentation/Pentaho/9.4/Setup/Google_BigQuery

Can you include the error for "it fails"?

Hi,

we have tried to use BigQuery as source and target. Reading is fine with step 'table input'. Writing into BigQuery with step 'table output' fails.

Also tested this with steps 'Beam BigQuery Input' and 'Beam BigQuery Output'.. No luck :/

Has anyone got this to work?

Br, Mika

 i got the same issue.  i read the documents in hitachivantara. it tell me use the bigquery  bulk loader . but i can not find this controls.

Have you solved the problem ？

2024/04/11 14:47:09 table output - .0 - ERROR (version 9.3.0.0-428, build 9.3.0.0-428 from 2022-04-12 04.56.25 by buildguy) : An error occurred intialising this step:
2024/04/11 14:47:09 - table output.0 - The Simba driver for a Google Big Query database connection does not support regular DDL statements. Please use the GBQ Bulk Loader step to create your table.

Hi Stephen,

And thank you for quick reply. Error we are getting ->

BigQuery table output ->"The Simba driver for a Google Big Query database connection does not support regular DDL statements.
Please use the GBQ Bulk Loader step to create your table"

Beam BigQuery Output. Logging says  -> 
2023/06/12 14:49:58 - BigQuery_input.0 - Finished reading query, closing connection
2023/06/12 14:49:58 - BigQuery_input.0 - Finished processing (I=3, O=0, R=0, W=3, U=0, E=0)
2023/06/12 14:49:58 - Beam BigQuery Output.0 - Finished processing (I=0, O=0, R=3, W=3, U=0, E=0)
2023/06/12 14:49:58 - Spoon - The transformation has finished!!

But there is 0 rows in target table :/

And yes, we followed documentation. We can read from BigQuery so connection etc is ok.

-Mika

Did you follow these steps?
https://help.hitachivantara.com/Documentation/Pentaho/9.4/Setup/Google_BigQuery

Can you include the error for "it fails"?

Hi,

we have tried to use BigQuery as source and target. Reading is fine with step 'table input'. Writing into BigQuery with step 'table output' fails.

Also tested this with steps 'Beam BigQuery Input' and 'Beam BigQuery Output'.. No luck :/

Has anyone got this to work?

Br, Mika

the following link

 https://docs.hitachivantara.com/r/en-us/pentaho-data-integration-and-analytics/9.3.x/mk-95pdia003/pdi-job-entries/google-bigquery-loader/options/setup-tab .

but  i can not find this PDI job entries .what should i do ?

 i got the same issue.  i read the documents in hitachivantara. it tell me use the bigquery  bulk loader . but i can not find this controls.

Have you solved the problem ？

2024/04/11 14:47:09 table output - .0 - ERROR (version 9.3.0.0-428, build 9.3.0.0-428 from 2022-04-12 04.56.25 by buildguy) : An error occurred intialising this step:
2024/04/11 14:47:09 - table output.0 - The Simba driver for a Google Big Query database connection does not support regular DDL statements. Please use the GBQ Bulk Loader step to create your table.

Hi Stephen,

And thank you for quick reply. Error we are getting ->

BigQuery table output ->"The Simba driver for a Google Big Query database connection does not support regular DDL statements.
Please use the GBQ Bulk Loader step to create your table"

Beam BigQuery Output. Logging says  -> 
2023/06/12 14:49:58 - BigQuery_input.0 - Finished reading query, closing connection
2023/06/12 14:49:58 - BigQuery_input.0 - Finished processing (I=3, O=0, R=0, W=3, U=0, E=0)
2023/06/12 14:49:58 - Beam BigQuery Output.0 - Finished processing (I=0, O=0, R=3, W=3, U=0, E=0)
2023/06/12 14:49:58 - Spoon - The transformation has finished!!

But there is 0 rows in target table :/

And yes, we followed documentation. We can read from BigQuery so connection etc is ok.

-Mika

Did you follow these steps?
https://help.hitachivantara.com/Documentation/Pentaho/9.4/Setup/Google_BigQuery

Can you include the error for "it fails"?

Hi,

we have tried to use BigQuery as source and target. Reading is fine with step 'table input'. Writing into BigQuery with step 'table output' fails.

Also tested this with steps 'Beam BigQuery Input' and 'Beam BigQuery Output'.. No luck :/

Has anyone got this to work?

Br, Mika