Pentaho

Hello everyone:

We're facing an issue when inserting a significant volume of data into an Oracle database.

Using the Output Table and Insert/Update steps, the process moves forward but generates an excessive amount of log files on the database server (50 GB in 20 minutes).

We've found that the solution involves marking the tables with the NOLOGGING modifier in Oracle. When performing the insertions, we should use the hint: INSERT /* +APPEND */ .....

The problem is that we don't see a way to perform the bulk load while customizing the INSERT statement. The only idea that comes to mind is using the SQL script step, but we understand that it would commit for each line, and we believe it won't be very efficient.

Do you have any ideas on how we can proceed?

Best regards and thank you very much.