AnsweredAssumed Answered

Avro Output step to Google Cloud Storage with kitchen/pan

Question asked by jouni.kari@nosto.com on Jun 10, 2019
Latest reply on Jun 11, 2019 by jouni.kari@nosto.com

I cannot figure out what I am missing here. I have a simple transformation which generates .avro file and passes it to Google Cloud Storage using VFS configuration within Avro Output step. I am using PDI 8.2.

 

Everything works fine in spoon.

 

But when trying to run it on command line using kitchen or pan, error below is thrown. I cannot figure out the cause.

 

org.pentaho.di.core.exception.KettleException:

java.lang.NullPointerException

at java.lang.Thread.run (Thread.java:748)

at org.pentaho.di.trans.step.RunThread.run (RunThread.java:62)

at org.pentaho.big.data.kettle.plugins.formats.impl.avro.output.AvroOutput.processRow (AvroOutput.java:66)

at org.pentaho.big.data.kettle.plugins.formats.impl.avro.output.AvroOutput.init (AvroOutput.java:112)

 

at org.pentaho.big.data.kettle.plugins.formats.impl.avro.output.AvroOutput.processRow(AvroOutput.java:100)

at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)

at java.lang.Thread.run(Thread.java:748)

Caused by: java.lang.NullPointerException

at org.pentaho.big.data.kettle.plugins.formats.impl.avro.output.AvroOutput.init(AvroOutput.java:112)

at org.pentaho.big.data.kettle.plugins.formats.impl.avro.output.AvroOutput.processRow(AvroOutput.java:66)

... 2 more

2019/06/10 15:36:30 - Avro Output.0 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Unexpected error

2019/06/10 15:36:30 - Avro Output.0 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : org.pentaho.di.core.exception.KettleException:

2019/06/10 15:36:30 - Avro Output.0 - java.lang.NullPointerException

2019/06/10 15:36:30 - Avro Output.0 -  at java.lang.Thread.run (Thread.java:748)

2019/06/10 15:36:30 - Avro Output.0 -  at org.pentaho.di.trans.step.RunThread.run (RunThread.java:62)

2019/06/10 15:36:30 - Avro Output.0 -  at org.pentaho.big.data.kettle.plugins.formats.impl.avro.output.AvroOutput.processRow (AvroOutput.java:66)

2019/06/10 15:36:30 - Avro Output.0 -  at org.pentaho.big.data.kettle.plugins.formats.impl.avro.output.AvroOutput.init (AvroOutput.java:112)

2019/06/10 15:36:30 - Avro Output.0 -

2019/06/10 15:36:30 - Avro Output.0 - at org.pentaho.big.data.kettle.plugins.formats.impl.avro.output.AvroOutput.processRow(AvroOutput.java:100)

2019/06/10 15:36:30 - Avro Output.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)

2019/06/10 15:36:30 - Avro Output.0 - at java.lang.Thread.run(Thread.java:748)

2019/06/10 15:36:30 - Avro Output.0 - Caused by: java.lang.NullPointerException

2019/06/10 15:36:30 - Avro Output.0 - at org.pentaho.big.data.kettle.plugins.formats.impl.avro.output.AvroOutput.init(AvroOutput.java:112)

2019/06/10 15:36:30 - Avro Output.0 - at org.pentaho.big.data.kettle.plugins.formats.impl.avro.output.AvroOutput.processRow(AvroOutput.java:66)

2019/06/10 15:36:30 - Avro Output.0 - ... 2 more

Outcomes