Profile

Antonio Petrella

UNOG

Contact Details

UNOG

My Content

1 to 20 of 36 total

RE: PDI CE 9.4: updating MongoDB java driver to more recent versions

Posted By Antonio Petrella 03-15-2024 08:43
Found In Egroup: Pentaho \ view thread
Hello Giovanni,   I'm currently connecting to MongoDB through the provided driver (version 3.12) with the PDI 9.4 version. I'd like to recompile the mongodb plugin with a more recent java driver but unfortunately I don't have the time to learn how to develop a pentaho plugin from scratch. Kind ...

RE: PDI CE 9.4: updating MongoDB java driver to more recent versions

Posted By Antonio Petrella 11-22-2023 03:03
Found In Egroup: Pentaho \ view thread
Hello,     thank you for your reply. The problem is not the compatibility of PDI 9.4 CE with MongoDB server itself.  The question is related to the upgrade of the mongodb java driver that is wrapped in the pentaho mongodb plugin. Currently this plugin wraps mongodb java driver version 3.12 that implements ...

RE: PDI CE 9.4: updating MongoDB java driver to more recent versions

Posted By Antonio Petrella 11-08-2023 09:28
Found In Egroup: Pentaho \ view thread
Hello, any help? ------------------------------ Antonio Petrella Data Service Manager UNOG ------------------------------

RE: ETL execution stops

Posted By Antonio Petrella 09-04-2023 11:27
Found In Community: Pentaho \ view thread
Hi Marko,   Just a wild guess here: from the log sent, it seems that the STG83....step2.ktr starts, but it does not read any data from the 00A and 00B and it continues to STG83...step1.ktr after initializing 05B deactivate existing rows. I see that such step is Execute SQL script. In its documentation ...

RE: ETL execution stops

Posted By Antonio Petrella 09-04-2023 05:45
Found In Community: Pentaho \ view thread
Hi Marko,   difficult to analyse this by looking at the logs only. Which steps are you using in the transformation that fails?  Do they correctly handle exceptions?

RE: ETL execution stops

Posted By Antonio Petrella 09-04-2023 02:54
Found In Community: Pentaho \ view thread
Hello,   can it be en error from the database? Try to rerun with the Log Level set to Debug or even Row Level, you might get more info in the log.

PDI CE 9.4: updating MongoDB java driver to more recent versions

Posted By Antonio Petrella 05-04-2023 04:41
Found In Egroup: Pentaho \ view thread
Hello everyone,    I have seen that the MongoDB Input/Output steps in PDI CE 9.4 use the mongodb plugin pentaho-mongodb-plugin-9.4.0.0-343 which in its turns it's using the mongo-java-driver-3.12.10. This driver is quite old and is based on the legacy API. Simply replacing the mongo-dava-driver-3.12.10.jar ...

RE: Authentication to Carte

Posted By Antonio Petrella 04-17-2023 03:15
Found In Egroup: Pentaho \ view thread
Hello Keren,   you can read this page: https://help.hitachivantara.com/Documentation/Pentaho/9.4/Products/Set_Up_a_Carte_Cluster, specifically the paragraph "Configuring Carte Server SSL" has the documentation on how to achieve that. In a nutshell, you need to configure the pwd/carte-config-master.xml ...

RE: Authentication to Carte

Posted By Antonio Petrella 04-04-2023 09:28
Found In Egroup: Pentaho \ view thread
Hello Keren,    for one of our projects we are starting jobs/transformations through Carte via REST API with Basic Auth over HTTPS. (Community Edition) Some useful documentation is here: https://help.hitachivantara.com/Documentation/Pentaho/9.4/Developer_center/REST_API_Reference/Carte Kind regards ...

RE: ETL Metadata Injection broken in PDI CE 9.4?

Posted By Antonio Petrella 03-08-2023 08:28
Found In Community: Pentaho \ view thread
Thanks Petr, removing the metastore.jar indeed helped with the this specific pipeline but it could reoccur with other classes.  Hopefully the plugin concept problems will be fixed in the next release.

ETL Metadata Injection broken in PDI CE 9.4?

Posted By Antonio Petrella 03-07-2023 09:16
Found In Community: Pentaho \ view thread
Hello everyone,   I have a pipeline working fine in PDI CD 9.3 that injects data through the ETL metadata injection step into a simple transformation that has only two steps: a Data Grid and a Pentaho Reporting Output (see example below): After changing PDI engine to version 9.4 the above pipeline doesn't ...

RE: sending email with embedded images in Mail component does not work

Posted By Antonio Petrella 03-03-2023 08:54
Found In Egroup: Pentaho \ view thread
Hi Chris,   the cid value in the img src tag of the HTML email body should match the cid generated by pdi. Per your above screenshots you should have: Best regards ------------------------------ Antonio Petrella Data Service Manager UNOG ------------------------------

RE: Rest Client – How to setup an Authorization Bearer in the REST Client?

Posted By Antonio Petrella 02-15-2023 09:06
Found In Egroup: Pentaho \ view thread
Hello Igor,   I did this with two REST client steps. In the first REST client step I authenticate via the login endpoint and retrieve the Authentication token by parsing the JSON output. Then form the login API response I isolate the authentication token and configure the subsequent REST client ...

RE: Looking for design assistance

Posted By Antonio Petrella 01-12-2023 10:56
Found In Egroup: Pentaho \ view thread
Hi Cory,   one way would be to connect all the inputs to a Join Rows (cartesian product) step and code conditions to not have the same value across the inputs. To achieve that, each input must have a different stream name. For example, for 4 input streams, if the values are stored in the stream variable ...

RE: Pentaho Data Integration carte - custom API read JSON body

Posted By Antonio Petrella 11-03-2022 05:43
Found In Community: Pentaho \ view thread
@Alan Hope Excellent, spot on! By adding the forward slash before the question mark I don't get the redirection and I can read the post data from the target transformation. Many thanks!​

RE: Pentaho Data Integration carte - custom API read JSON body

Posted By Antonio Petrella 09-30-2022 04:43
Found In Library: Pentaho

RE: Pentaho Data Integration carte - custom API read JSON body

Posted By Antonio Petrella 09-30-2022 03:26
Found In Community: Pentaho \ view thread
Hi Andrew,   These are the steps taken in my test bench: Start the carte webservice by running carte.sh localhost 8097 Create a very simple test.ktr transformation, with P_JSON in the transformation parameters, a Get Variable step to fetch $(P_JSON) and a Write to log step to print the value of such ...

RE: Pentaho Data Integration carte - custom API read JSON body

Posted By Antonio Petrella 09-29-2022 07:43
Found In Community: Pentaho \ view thread
Hello, P_JSON is named in the transformation's parameter list however it still fails in receiving the JSON body. By inspecting the browser's Network tab after having sent the call, I've also noticed that the original POST request gets converted to a GET and therefore I lose the json body. I'm using plain ...

RE: Pentaho Data Integration carte - custom API read JSON body

Posted By Antonio Petrella 09-28-2022 05:53
Found In Community: Pentaho \ view thread
Hello,   I have a follow up question to this topic. Is the p_json sent as a body of the POST request or rather as another query parameter of the POST request (just like trans, or rep or level)? In other words, if you had to use curl to send the Carte call, would it be something like: curl --request POST ...

RE: Pentaho Data Integration carte - custom API read JSON body

Posted By Antonio Petrella 08-29-2022 03:15
Found In Community: Pentaho \ view thread
Hello,    I investigated some time ago the possibility of sending POST requests through Carte without success and eventually I turned to using a long list of GET parameters. If you find a way to use Carte with POST requests please let us know. As for the JSON return data, you might want to try the JSON ...