Profile

Ana Gonzalez

UDIMA

Contact Details

UDIMA

My Content

1 to 20 of 50+ total

RE: Mongo db for Pentaho 8.0 community version

Posted By Ana Gonzalez 07-01-2022 08:06
Found In Egroup: Pentaho \ view thread
What version of Pentaho Data Integration are you running? I'm using the Community Edition of version 8.2 and in the Big Data steps are the MongoDB input and output steps. I don't have documented adding this steps from an external source, so I think they are available with the Community Edition. ...

RE: AWS Linux 2 AMI, Pentaho Data Integration installation

Posted By Ana Gonzalez 05-30-2022 07:03
Found In Egroup: Pentaho \ view thread
You could try if this solution for RHEL 7 works for you: https://unix.stackexchange.com/questions/182603/how-to-install-webkitgtk1-on-rhel7 Good luck! ------------------------------ Ana Gonzalez Data Service Manager UDIMA ------------------------------

RE: Specifying Python version in CPython Executor

Posted By Ana Gonzalez 04-26-2022 05:49
Found In Egroup: Pentaho \ view thread
According to the issue opened in Cpython github page, it's a parameter in the kettle.properties file, pdi.cpython.command. Cpython github page ------------------------------ Ana Gonzalez Data Service Manager UDIMA ------------------------------

RE: I need to develop dynamic transformation where my source file keep change the columns counts

Posted By Ana Gonzalez 03-24-2022 09:10
Found In Community: Pentaho \ view thread
So you'll need two transformations, the first transformation reads the file using the line end as the row delimiter, so you get the whole line as a column, and you keep only the first line: Column1 id,name,loc,pin Then you use the split field to rows operator, using the comma as the character to split ...

RE: I wanted to load only header to the output file. Is there any option without java code

Posted By Ana Gonzalez 03-22-2022 08:52
Found In Community: Pentaho \ view thread
If you use the Text file input step to read the file, you can uncheck the option to indicate there is no header row, and check the option to add a rownum field to add a column with the number of line of your file. You'll have to give column names manually to the file, and after the Text file input step ...

RE: On the Pentaho Google Sheets Output plugin, I get cryptic error saying Read Timeout, which I later figured out was the result of google quota. Is there a way to do exception handling?

Posted By Ana Gonzalez 10-26-2021 10:07
Found In Community: Pentaho \ view thread
Youll probably have better luck getting an answer opening an issue in the github page of the plugin, although it seems someone else has a similar issue and has already opened one.

RE: Select current datetime from Database instead of PDI server time using Table Input step

Posted By Ana Gonzalez 10-13-2021 09:58
Found In Community: Pentaho \ view thread
This is probably more a Postgres question than a PDI question, and it probably has to do with how Postgres handle connections. I dont know about Postgres, but in Oracle you have DB locale settings and Connection locale settings, and this seems like in Postgres is similar. Probably theres some kind of ...

RE: How to build a report that take data from spoon transformation?

Posted By Ana Gonzalez 10-08-2021 09:05
Found In Community: Pentaho \ view thread
It should be possible, I played with it some years ago and I could make it work, I havent used it actively in production, so I cant help you. Have you tried the opposite? I mean, using a PDI transformation as datasource in a report, someone here some days ago found a thread in the old forum that helped ...

RE: How to schedule the execution of a PDI job on Pentaho Server?

Posted By Ana Gonzalez 10-08-2021 08:57
Found In Community: Pentaho \ view thread
I cant help you there, I dont use the server to schedule the execution of PDI jobs and transformations, maybe you can find something in the old forum (https://forums.pentaho.com/) or in old blog posts, Diethards blog has a lot of useful information in PDI: https://diethardsteiner.github.io/list.html

RE: How to schedule the execution of a PDI job on Pentaho Server?

Posted By Ana Gonzalez 10-01-2021 09:35
Found In Community: Pentaho \ view thread
If you install PDI in the server, you just call the kitchen.sh with the job file and parameters if needed. To run a transformation you use the pan.sh script. Look in Pentaho documentation the parameters you can pass to kitchen and pan scripts.

RE: Is the LDAP authentication available on Pentaho Server 9.2 CE ?

Posted By Ana Gonzalez 09-17-2021 10:01
Found In Community: Pentaho \ view thread
With Pentaho CE you dont have the Authentication menu option shown in the official Pentaho Documentation, you have to scroll down to set it up manually, go to the Manual Configuration section: https://help.hitachivantara.com/Documentation/Pentaho/9.2/Setup/LDAP_security Also, this refers to an old version ...

RE: How to setup PDI ce on production environment on linux machine ?

Posted By Ana Gonzalez 07-26-2021 09:00
Found In Community: Pentaho \ view thread
Yes, the server zip is for another setup (mainly to create dashboards, although it contains some things pertaining to Data Integration, but its not necessary if you are only interested in the data integration part), if you only want to execute jobs and transformations you have created in your desktop, ...

RE: How to setup PDI ce on production environment on linux machine ?

Posted By Ana Gonzalez 07-23-2021 09:26
Found In Community: Pentaho \ view thread
The installation is the same as with your desktop, you ensure you have Java 8 JDK, unzip and youre ready to roll. If you have added libraries (probably to connect to database), modified config files or added plugins in your PC youll have to do the same in the server. To program the execution of jobs ...

RE: PDI Kitchen/ Spoon logging of metrics to monitor if job/ transformation ran successfully

Posted By Ana Gonzalez 07-13-2021 08:40
Found In Community: Pentaho \ view thread
Its going to depend on the logic of your workflow, but in most cases, yes. I have some workflows where I dont mind if certain steps fail, or I force an error to stop the flow of data due to the internal logic, so in those workflows the ERRORS column is not going to help, but in most cases that column ...

RE: PDI Kitchen/ Spoon logging of metrics to monitor if job/ transformation ran successfully

Posted By Ana Gonzalez 07-12-2021 09:39
Found In Community: Pentaho \ view thread
Looking to the ERRORS column in Job Log table you should be able to see if the Job has completed successfully or if it has failed. Something that also works for me, is having a Send Mail step in the job and all the steps have a failed step transition that send the email, something like this:

RE: Pentaho Data Integration does not support MongoDB database connection?

Posted By Ana Gonzalez 06-07-2021 16:32
Found In Community: Pentaho \ view thread
Im connecting to MongoDB using Pentaho 8.2, its under the Big Data steps

RE: How to use string cut to get the starting positions to length of position on the value .

Posted By Ana Gonzalez 06-07-2021 16:28
Found In Community: Pentaho \ view thread
You would need previous steps to calculate string length and search for the position of the whitespace, its probably easier using the Regex Evaluation step to get it done in one step. For example, with this expression: (.*)(\s.*) you get two strings as output, one with everything until the whitespace ...

RE: Excel file transformation: columns to rows

Posted By Ana Gonzalez 06-01-2021 10:57
Found In Community: Pentaho \ view thread
You have a samples folder in your installation. Inside the transformations folder, you have the meta-inject folder with an example of how metadata injection works, precisely to read a csv file. Read the documentation about metadata injection also. When creating a new transformation with metadata injection, ...

RE: How join data from excel and oracle table?

Posted By Ana Gonzalez 05-31-2021 12:06
Found In Community: Pentaho \ view thread
You read the csv, you read the oracle table, sort the rows by the keys you want to use to join and merge the data of those inputs.

RE: Excel file transformation: columns to rows

Posted By Ana Gonzalez 05-31-2021 11:59
Found In Community: Pentaho \ view thread
Youll have to work with Metadata Injection, first to read the excel file and pass to the excel input step all the date columns to read and then to the row normaliser step the names of the columns to normalise as date (and the values, that would be the same as the column name)