AnsweredAssumed Answered

Fields not found in MongoDB output from Kafka consumer

Question asked by RAKOTONDRASOA Andry on Feb 18, 2019
Latest reply on Feb 19, 2019 by RAKOTONDRASOA Andry

Hi everyone, I'm new to mongodb and @data @streaming

I have a transformation that must insert a data streaming from Kafka to MongoDB but in the 3 versions of PDI (8.0, 8.1 and 8.2), the MongoDb return the same error :

 

2019/02/18 13:49:32 - mdbo-centreon-alert.0 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Unexpected error

2019/02/18 13:49:32 - mdbo-centreon-alert.0 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : org.pentaho.di.core.exception.KettleException:

2019/02/18 13:49:32 - mdbo-centreon-alert.0 - Some expected Mongo fields not found in step input fields. Check step configuration. Mongo fields not found: 'message', 'topic', 

2019/02/18 13:49:32 - mdbo-centreon-alert.0 -

2019/02/18 13:49:32 - mdbo-centreon-alert.0 - at org.pentaho.di.trans.steps.mongodboutput.MongoDbOutput.checkInputFieldsMatch(MongoDbOutput.java:514)

2019/02/18 13:49:32 - mdbo-centreon-alert.0 - at org.pentaho.di.trans.steps.mongodboutput.MongoDbOutput.processRow(MongoDbOutput.java:148)

2019/02/18 13:49:32 - mdbo-centreon-alert.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62)

2019/02/18 13:49:32 - mdbo-centreon-alert.0 - at java.lang.Thread.run(Unknown Source)

 

I checked that the two columns (message and topic) exist in the steps that precede the mongodb output.

I made the same insertion in databases (table output) and file but the error does not occur.

Please, can someone help me to solve this error because I'm stuck on this step ? (in attached the transformations files)

 

Thanks in advance.

Outcomes