Pentaho

 View Only
  • 1.  Table Input takes too long

    Posted 06-01-2023 12:28

    I have a transformation that receive input rows from previous transformation, this inputs rows are used to replace variable in query. Sometimes my table input runs for too long, it takes til 1h to get rows from query, but I don't know where's to find some solution.

    Please, anyone could help me?



    ------------------------------
    Daniel Batista
    Systems Engineer
    Embracon
    ------------------------------


  • 2.  RE: Table Input takes too long

    Posted 06-01-2023 15:33

    Hi Daniel,

    this is problem of DB server. Perform execution query plan for more details. Or may be problem with network for receive data from server.



    ------------------------------
    Petr Prochazka
    Systems Engineer
    P.V.A. systems s.r.o.
    ------------------------------



  • 3.  RE: Table Input takes too long

    Posted 06-01-2023 16:20

    Hi Petr,

    Thanks for you reply :)

    Do you think it could be a Pentaho issue too or not?



    ------------------------------
    Daniel Batista
    Systems Engineer
    Embracon
    ------------------------------



  • 4.  RE: Table Input takes too long

    Posted 06-01-2023 15:34

    And strange is that table input step has hop from previous step but doesn't load any row.



    ------------------------------
    Petr Prochazka
    Systems Engineer
    P.V.A. systems s.r.o.
    ------------------------------



  • 5.  RE: Table Input takes too long

    Posted 06-05-2023 15:21

    What are you meaning Pentaho issue too? I don't understand it.



    ------------------------------
    Petr Prochazka
    Systems Engineer
    P.V.A. systems s.r.o.
    ------------------------------



  • 6.  RE: Table Input takes too long

    Posted 06-06-2023 11:16

    Need a lot more detail as asked above.  What are the "Get Variables"?  Base on youyr question it seems like actually the row data from the prior transform.  Then you replace variables in the stream.  Why are you blocking and what are those settings? Are you blocking for all input rows 100k+?  That will cause memory issues and could create thrashing on the input stream because you cannot output the rows.



    ------------------------------
    Stephen Donovan
    General IT Consulting & Implementation Pre-eminent Professional
    Hitachi Vantara
    ------------------------------