AnsweredAssumed Answered

Logging Status of Files Read by Pentaho Text File Input Step

Question asked by nathan steele on Aug 21, 2018

I'm trying to use a Text File Input step with wildcards(regexpressions) to read a bunch of files(say 100) from a directory. This is working fine. But what I'd like to know is whether there is a way to log which all files got processed successfully and which all failed in the step?

 

Say for example, In directory /home/usr/ I have 10 .txt files like A.txt,B.txt,C.txt,D.txt,E.txt,F.txt,G.txt,H.txt,I.txt,J.txt.

 

What I would like to know is whether there is way I can log something like,

 

file A.txt processed successfully file B.txt processed successfully file C.txt processed successfully file D.txt failed (due to some reason) file E.txt processed successfully file F.txt processed successfully file G.txt processed successfully file H.txt failed file I.txt processed successfully file J.txt processed successfully  

 

Simply put, I would just like to log the status of the individual files that the Text File Input step is reading.

Is this possible?

I already tried running the transformation with Detailed, Debug and Row Level log level but to no avail.

Please help !!!

 

P.S. I'm using Petaho 8.1

Outcomes