Pentaho

 View Only
  • 1.  How can i filter null values in an certain column so only the data that is null shows-up

    Posted 02-02-2023 09:38
    Hi!

    I've been trying to get null values from the database trough PDI, but with filter rows, the wrong data is showing

    I need a column with onnly the rows that are empty

    i want to make something similar to "select...from...where is null", but that could works for any column without code, we need to schedule this transformation

    how can i do that?

    ------------------------------
    Thiago Melo
    Data Service Manager
    VLM
    ------------------------------


  • 2.  RE: How can i filter null values in an certain column so only the data that is null shows-up

    Posted 02-02-2023 10:29
    Hi,
    "that could works for any column without code"  >>>
    avez-vous essayé "DATA VALIDATOR" ? ( Did you try the "Data validator step "?
    Best regards

    ------------------------------
    R. ETROF
    HelpDesk Support
    SSA
    ------------------------------



  • 3.  RE: How can i filter null values in an certain column so only the data that is null shows-up

    Posted 02-03-2023 11:10
    Can you explain why/how the Filter step does not work?  Are you trying to inject the column name(s) dynamically?


    ------------------------------
    Stephen Donovan
    Digital Solutions Architect
    Hitachi Vantara
    ------------------------------



  • 4.  RE: How can i filter null values in an certain column so only the data that is null shows-up

    Posted 02-03-2023 12:05
      |   view attached

    Column Name reflection with Javascript.
    https://help.hitachivantara.com/Documentation/Pentaho/8.2/Products/Data_Integration/Transformation_Step_Reference/Modified_Java_Script_Value#:~:text=Examples-,Check%20for%20the%20Existence%20of%20Fields%20in%20a%20Row,-The%20following%20code

    One similarly easy solution would be to add ", ${WHICH_COLUMN} as lookupValue" to your query and filter on that now dynamic column.  But this is more portable to other source types.



    ------------------------------
    Stephen Donovan
    Digital Solutions Architect
    Hitachi Vantara
    ------------------------------

    Attachment(s)

    ktr
    NullColumns.ktr   29 KB 1 version