Pentaho

 View Only

 Streaming data from 2 diff data structures

  • Pentaho
  • Kettle
  • Pentaho
  • Pentaho Data Integration PDI
Rene Desaulniers's profile image
Rene Desaulniers posted 05-08-2019 12:52

Marketplace has an add-in called 'PDI Stream Schema Merge' which "Merges the schema among multiple streams. Leaves fields blank where they don't exist in the source schema."

I have tested this with a simple 2 data grid example. Datagrid 1 has 1 column of numbers. Datagrid 2 has 1 column of letters.  I connect both grids to the Schema merge step and "Get Steps to Merge", which is both Datagrids. I added a Dummy step to view the results of my test. I have not been able to make this work.

Has anyone used/tried this add-in with success? What am I missing?

Is there another way to achieve this?


#PentahoDataIntegrationPDI
#Kettle
#Pentaho
Johan Hammink's profile image
Johan Hammink posted 05-08-2019 13:17

Yes I use that step without any problem. See screenprint

streammerge

Rene Desaulniers's profile image
Rene Desaulniers posted 05-09-2019 13:26

Well thank-you for taking the time to test and confirm that it works!  Great Relief.

However, I must be doing something wrong or not have my enviro properly setup.  I have been running Pentaho for 3 years, problem. Just cant' seem to get this new add-in to work.

My enviro is as follows:

- Pentaho  8.0.0.0-28 using HSQL repository

- Windows 7

- MySQL DB for data tables

Any thoughts?

Thank-you again!

Rene

Johan Hammink's profile image
Johan Hammink posted 05-10-2019 05:07

Can you share your transformation? And can you see anything in the log file?

Rene Desaulniers's profile image
Rene Desaulniers posted 05-14-2019 07:40

I finally got it to work!  Thanks for your assistance!

Related Content