Hello,
What Pentaho version? What database are you connecting to? What JDBC driver are you using?
I've never encountered this issue with SQL Server and the MS SQL JDBC driver. I'll be testing with the PostgreSQL DB and JDBC driver shortly--I certainly hope it doesn't have this issue. It seems odd that the Table Output step could not determine the metadata of a table w/o reading all the rows. This sounds like a bug, to me.
John
------------------------------
John Craig
Systems Engineer
Henry Schein One
------------------------------
Original Message:
Sent: 01-28-2024 02:36
From: Szymon Zycinski
Subject: PDI reads complete table when Table Output step is opened
Hello
Is there any configuration parameter that influences number of rows read by PDI when table output step is opened? At the moment on large tables PDI get stuck until it reads complete content of table to determine sizing of the fields and prepare possible sql statements.
It is real pain sometimes when working remotely and connect to huge table. Any idea how to affect this behaviour.
------------------------------
Szymon Zycinski
Systems Engineer
ZF Automotive Poland
------------------------------