Profile

Stephen Donovan

Hitachi Vantara

Contact Details

Hitachi Vantara

My Content

1 to 20 of 50+ total

RE: Build error of pentaho-kettle maste

Posted By Stephen Donovan 09-14-2023 10:38
Found In Egroup: Pentaho \ view thread
Is there a reason you are trying to build from Master and not the last release?  10.1 is currently in development and the master would be less stable as all that code is marged into master.  As Petr noted, you can wait until all the assets are aligned, or you can go back to a prior released branch. ...

RE: ETL execution stops

Posted By Stephen Donovan 09-07-2023 10:22
Found In Community: Pentaho \ view thread
Marko, You were quite clear prior.  It is interesting that it does not seem to be repeatable even at failure.  As you stated rerunning the same dataset may or may not result in error.  Since you are doing inserts and updates, the reprocessing of the same data intot he pipeline would change the flow (unless ...

RE: ETL execution stops

Posted By Stephen Donovan 09-05-2023 13:15
Found In Community: Pentaho \ view thread
Good suggestions Antonio.  It does look to be a simple update.  You could alternatively add Error Handling to that step, which the Update step also supports. A simple Write to log step for just one row can often be enlightening.  Better than showing all rows in the logs. You can leave it as Basic or ...

RE: Keep SourceForge as mirror and archive

Posted By Stephen Donovan 09-01-2023 13:28
Found In Egroup: Pentaho \ view thread
On the JIRA.  Thank you for calling it out.  If you run spoon Debug you will see these errors in the log. 12:45:06,355 ERROR [BSHExpression] Scripts are prevented from running by default in order to avoid potential remote code execution.  The system administrator must enable this capability. http ...

RE: Login prompt on kettle status page

Posted By Stephen Donovan 08-22-2023 11:42
Found In Community: Pentaho \ view thread
CAUTION: is of course warranted.  We are assuming this server is protected behind your firewall and walled off to only allow those API requests from potected server to server. The Jetty server for Carte is configured for basic auth by default.  The user and password configured in the carte-config.xml ...

RE: Using S3 REST API to upload file using Pentaho REST Client

Posted By Stephen Donovan 08-08-2023 09:45
Found In Egroup: Pentaho \ view thread
You can use the virutal filesystem and an S3 VFS Connection.  Then just use the file output step to create the files directly.  If you already have the files and are simply trying to move them to S3 you can do the same with the copy files job entry. ------------------------------ Stephen Donovan ...

RE: Is is possible to create a callable end-point on Pentaho Server?

Posted By Stephen Donovan 08-01-2023 14:25
Found In Community: Pentaho \ view thread
Depends on how you define "callable".   There are API end points to run KTRs and KJBs within the server.  Same as the carte APIs.  From an external web page, including the Ctools UI, you could submit and API call with parameters to execute a transform to insert data.  GET and POST are supported, I would ...

RE: Data Explorer not available in Spoon?

Posted By Stephen Donovan 06-14-2023 16:31
Found In Community: Pentaho \ view thread
Data Explorer (DET) is an integration between Spoon and the BA Server's plugins.  It is only available in the EE version of the product.

RE: pentaho-server 9.1 shedule can not run

Posted By Stephen Donovan 06-12-2023 10:33
Found In Community: Pentaho \ view thread
The scheduler kicks off the jobs, but where they run is subject to architecture.  If only running on a single server the /pentaho/kettle/status page will show all the logging for the jobs and transforms executed locally.

RE: Pentaho 9.4 BigQuery input/output?

Posted By Stephen Donovan 06-09-2023 12:02
Found In Egroup: Pentaho \ view thread
More details: We use a Simba BigQuery driver for TableInput from BIgQuery.  The Simba driver will not work well with TableOutput because there are quotas on Insert statements. It is why we have a  job entry plugin in the Enterprise Endition to bulk load BIgQuery. https://help.hitachivantara.com/ ...

RE: Pentaho 9.4 BigQuery input/output?

Posted By Stephen Donovan 06-09-2023 10:49
Found In Egroup: Pentaho \ view thread
Did you follow these steps? https://help.hitachivantara.com/Documentation/Pentaho/9.4/Setup/Google_BigQuery Can you include the error for "it fails"? ------------------------------ Stephen Donovan General IT Consulting & Implementation Pre-eminent Professional Hitachi Vantara ------------------- ...

RE: Pentaho metadata editor tool standalone - exported XMI files hold connection password in plain text

Posted By Stephen Donovan 06-06-2023 11:17
Found In Community: Pentaho \ view thread
The majority of Penthao connections can handle Penthao encrypted passwords.  https://help.hitachivantara.com/Documentation/Pentaho/9.4/Setup/Use_password_encryption_with_Pentaho Just take the output that command and use that full string (including the 'Encrpypted') as your password.  Docs don't mention ...

RE: Table Input takes too long

Posted By Stephen Donovan 06-06-2023 11:15
Found In Egroup: Pentaho \ view thread
Need a lot more detail as asked above.  What are the "Get Variables"?  Base on youyr question it seems like actually the row data from the prior transform.  Then you replace variables in the stream.  Why are you blocking and what are those settings? Are you blocking for all input rows 100k+?  That will ...

RE: Is there a way for Pentaho job to run to only get new records and not rerun the old records?

Posted By Stephen Donovan 05-04-2023 15:42
Found In Community: Pentaho \ view thread
The simple answer is, "But of course".  There are a few options.  As John stated "None of the following will work if you do not a unique key column or columns that is in common  to source and target. " Insert/Update step versus Table Output is the easiest.  However, this step does single row requests ...

RE: Access to Pentaho JIRA instance

Posted By Stephen Donovan 03-17-2023 11:01
Found In Egroup: Pentaho \ view thread
I was unaware that this site is not fully opened up yet.  After the move between technologies, the process and the site are undergoing an internal privacy review.  Sorry these things take time.  Hopefully, it will be "public" as it states very soon. ------------------------------ Stephen Donovan ...

RE: Access to Pentaho JIRA instance

Posted By Stephen Donovan 03-08-2023 10:09
Found In Egroup: Pentaho \ view thread
You are correct that you will have to reregsiter with the new JIRA.  Tickets were migrated but we did not bring over all of the users. Are you saying you cannot see anything here? https://pentaho-public.atlassian.net/jira/software/c/projects/PDI/issues ------------------------------ Stephen Donovan ...

RE: Pentaho 9.3: Truncate option in Table Output doesn't reset the Auto Increment Field

Posted By Stephen Donovan 03-01-2023 16:07
Found In Community: Pentaho \ view thread
Note the change being reverted was here. https://github.com/pentaho/pentaho-kettle/blob/9.4.0.0/core/src/main/java/org/pentaho/di/core/database/Database.java#L3303 I am not CE user or able to help you compile a fix that that code in 9.4.  But there may be members that can get you down that road if d ...

RE: Pentaho 9.3: Truncate option in Table Output doesn't reset the Auto Increment Field

Posted By Stephen Donovan 03-01-2023 16:06
Found In Community: Pentaho \ view thread
I am not seeing that.  I am on MySQL 8.0.30 with the same driver.  Make sure you don't have a driver mismatch. If you are using shared DB connections and consitent naming, the toggle of the driver and even the Type from MySQL to Generic and back should be transparent.

RE: Pentaho 9.3: Truncate option in Table Output doesn't reset the Auto Increment Field

Posted By Stephen Donovan 02-23-2023 17:41
Found In Community: Pentaho \ view thread
My initial tests were invalid.  I had the select in the same Transform as the TableOutput.  This creates a potential shared connection group which forced the DELETE due to parallel thread use. https://github.com/pentaho/pentaho-kettle/blob/8.3/core/src/main/java/org/pentaho/di/core/database/Database.java#L3325-L3336 ...

RE: Pentaho 9.3: Truncate option in Table Output doesn't reset the Auto Increment Field

Posted By Stephen Donovan 02-23-2023 14:45
Found In Community: Pentaho \ view thread
I don't have an answer, but I think I have a workaround.  In your connection, change from the MySQL dialect to the Generic Database dialect.  Specifiy the URL and driver class (likely com.mysql.cj.jdbc.Driver).  Then select MySQL in the dialect drop down at the top.  If you forget this last step, you ...