Profile

RE: How to get Previous month date using Pentaho Data Integration

Posted By Brandon Jackson 07-13-2021 18:05
Found In Community: Pentaho \ view thread

If you are taking in a date as an input field, you can use the calculator step to perform date math on it. If you are trying to grab the date from another row, then you can use the Analysis Step to get 1 row ahead to pull that date forward. I usually end up using a Javascript Step and copy paste a ...

RE: Access parquet files via SQL

Posted By Brandon Jackson 07-13-2021 17:58
Found In Community: Pentaho \ view thread

PDI itself does not have the kind of SQL capability you are asking about. If you read them in, you can join the streams; but that could mean a lot of data in memory. You are looking for a different tool to carry out the task. For example, you might look at Dremio, or Google BigQuery. They both support ...

RE: Pentaho Kettle and Magento V1.9 API

Posted By Brandon Jackson 09-06-2020 22:26
Found In Community: Pentaho \ view thread

There are really only two ways to do it on a repeated basis. Either you use REST APIs or you find a JDBC driver that will do the heavy lifting for you and let you use SQL against Magento. Where Kettle is missing some data sources, I use the Generic driver setting and use a driver from elsewhere. CData ...

RE: Jdk-13.0.1 and Jdk-13.0.2 not working for PDI 9

Posted By Brandon Jackson 07-17-2020 15:30
Found In Community: Pentaho \ view thread

If you need Java 8 on windows, the installer is at https://adoptopenjdk.net This way you are not under the commercial Oracle license.

RE: Parse JSON through JSON Input Step dynamically

Posted By Brandon Jackson 07-09-2020 17:53
Found In Community: Pentaho \ view thread

You are presenting a lot of different kinds of issues. V7.1, Meta Injection, JSON Input. We would need to know more about where you are having problems and how you approached this. Clearly, you will have to have something handling the dynamic side of the environment, and then injecting field names and ...

RE: How to consume API in Pentaho report designer?

Posted By Brandon Jackson 07-06-2020 22:36
Found In Community: Pentaho \ view thread

I think the easiest approach for doing this inside Pentaho Report Designer is to use a Pentaho Data Integration transformation as a datasource. You simply create a KTR that calls the REST endpoint you want; JSON Input Step to extract the answers, and shape up the results so they are in a table like format ...

RE: PDI Table Input, how to define SSH Tunneling for it when querying MySQL? Is this possible?

Posted By Brandon Jackson 07-06-2020 22:33
Found In Community: Pentaho \ view thread

If you are on linux there are a lot of options. If you want to do all of this through Spoon itself, you could create a KJB (Job) to execute a script which would hand off the tunnel creation to the OS layer you are using. Then your KTRs when they initialize will simply find the database connection waiting ...

RE: Hello everyone, I have a question about the Pentaho BI Suite Product.What are the advantages and disadvantages of the Pentaho BI Suite Product?Beforehand thank you very much.I wait for the answer :)

Posted By Brandon Jackson 07-06-2020 18:17
Found In Community: Pentaho \ view thread

The advantages are many if you have a good pool of technical knowledge to draw from including skills like Javascript, SQL, Java based application support, HTML and CSS with knowledge of require.js, protovis, D3, etc. The biggest advantage is that the platform is largely opensource and you can customize ...

RE: How to handle number format from US to EU? ( #,###.00 to #.###,00 )

Posted By Brandon Jackson 07-05-2020 17:18
Found In Community: Pentaho \ view thread

I would try using a formula for the formatting. The conversions are done during rendering. If your formula can use clever logic to detect currency formatting desired, then you just submit the formatting code given the one you want.

RE: Is it possible to "Concatenate" / "integrate" other pentaho report/sub report into pentaho ? example: There are 2 pentaho reports A an B, Can I integrate/ concatenate report A into report B or in new pentaho report ? If Yes Can I get details/ref

Posted By Brandon Jackson 07-05-2020 17:17
Found In Community: Pentaho \ view thread

Yes. What you have to do is add report B to report B, in say a footer. Then you have to make sure all the parameters pass from report A into report B. That will allow report A to render and then report B will render when the footer is hit and the subreport is activated.

RE: Why Salesforce input SOQL query is not connecting

Posted By Brandon Jackson 07-05-2020 17:13
Found In Community: Pentaho \ view thread

That indicates a bug in the plugin providing that step. I would recommend you download the cdata.com JDBC driver for the same. The $1k that youll spend, is a better trade for dealing with all the frustrating parsing and curl tricks you may end up with if that step cannot be fixed.

RE: Table Output on MySQL writing at 4 r/s even after parameter tuning on Windows machine

Posted By Brandon Jackson 07-05-2020 17:11
Found In Community: Pentaho \ view thread

Bulk loading on MySQL using the Bulk Load Step is better under Linux because it supports piping data across to Mysql as text streams. Your best performance option in Windows would be to drop indexes on the destination tablet and use batch inserts.

RE: Help regarding the compare and input data!

Posted By Brandon Jackson 07-05-2020 17:09
Found In Community: Pentaho \ view thread

One trick I have used is creating a SHA checksum on each row in the database that I wanted to compare against. Then do the same on your input files. If you precalculate the database field, you can even store the SHA and primary key of the destination field elsewhere. Comparing two SHA keys is very quick ...

RE: Capture Groups from Regex Evaluation

Posted By Brandon Jackson 07-05-2020 16:18
Found In Community: Pentaho \ view thread

You had an extra character after the $ in your statement. It was an invisible character.

RE: Optimal way to join multiple files and output without creating multiple transformations

Posted By Brandon Jackson 07-24-2019 19:28
Found In Community: Pentaho \ view thread

The metadata injection step is pretty unusual. If you are injecting a step, like Text Output, that would like output field columns and other metadata sent in, you send multiple rows (one for each field in the output). The other inputs streaming in will be singular values into the destination step. ...

RE: Carte server 8.2 lacks some images at the kettle status page

Posted By Brandon Jackson 07-23-2019 18:17
Found In Community: Pentaho \ view thread

I put the static images attached to this case, if you like the manual way. https://jira.pentaho.com/browse/PDI-17948 I suggest downloading a patched copy here at http://kettle.be/

RE: Multiple BI servers install share the same DBs?

Posted By Brandon Jackson 07-23-2019 18:10
Found In Community: Pentaho \ view thread

Basically, the answer is yes. Your question falls under clustering the Pentaho server. I would not suggest different versions sharing repositories or content. Newer versions of the server upgrade content making it incompatible with prior versions in some cases. https://help.pentaho.com/Documentat ...

RE: pentho8.2 ce

Posted By Brandon Jackson 05-06-2019 16:59
Found In Community: Pentaho \ view thread

This kind of problem requires more detail. Are you able to post catalina.out file from your tomcat/logs folder for the server when you tried to run the report? Could you post the prpt file with static data? That is a very odd problem that I have never seen before. Make sure that your Pentaho 8.2 ...

RE: why is it so difficult to get an official price for pentaho enterprise??

Posted By Brandon Jackson 05-06-2019 16:14
Found In Community: Pentaho \ view thread

Capterra and other vendor comparison sites will publish pricing of the base deals. There are basically 3 deals that I know of. Everything (without big data or column store databases): 65,000 US (was 2018, but 2019 was quoted at 75k) Everything (with column store databases) 120,000 US (was 90k in 2018) ...

RE: Pentaho service down

Posted By Brandon Jackson 04-09-2019 18:57
Found In Community: Pentaho \ view thread

Resources can be tracked by looking at the JVM as the whole thing runs with Java. jvisualvm is great for that. Logs usually exist for the server parts in ../server/tomcat/logs or ../data-integration/logs/spoon.log

Brandon Jackson

Contact Details