Pentaho

 View Only
Back to discussions
Expand all | Collapse all

How maintain persistence connection using connection pooling in pentaho community edition

This thread has been viewed 7 times

  • 1.  How maintain persistence connection using connection pooling in pentaho community edition

    Posted 11-08-2022 11:33
    Team,

    I am migrating data to MySQL and frequently getting connection reset errors. It's around 16GB table. I tried to enable connection pooling but job hangs.  Can you shad some light on it.

    Error:


    Thanks,
    Priyesh K Patel
    JPMorganChase

    ------------------------------
    Priyesh Patel
    Systems Engineer
    JPMorgan Chase
    ------------------------------


  • 2.  RE: How maintain persistence connection using connection pooling in pentaho community edition

    Posted 11-09-2022 11:36
    Hi Priyesh,
    this looks like a server side problem and connection pooling does not work. If any step fails, then fails all transformation.
    I see that input read 450k rows, so problem is on server or network. You can check logs on server for more details why server closed connection.

    Otherwise you can use in SQL LIMIT ... OFFSET ... clause for smaller block of data and iterate over transformation in job.

    ------------------------------
    Petr Prochazka
    Systems Engineer
    P.V.A. systems s.r.o.
    ------------------------------

    Original Message


Related Content