Profile

Hi, Finally I was able to make the other party set Pentaho producer to retry connection as you recommended. The settings helped indeed, but we are still not quite satisfied. As far the pentaho producer is concerned, they sent 3603416 messages to a single topic (tszpayments) as shown in the output below.  ...

Hi Sandeep,  Did you have a chance to take a look at the logs? Regards, Imre

Hi, Sorry, I couldn't get back earlier. I attach the relevant log fragments.  There were two attempts to push messages. During the transfer we killed the lead broker for the topic. The kafka cluster quickly changed the lead broker to a different broker and cruisecontrol soon (within a couple of seconds) ...

Hi, We have a pentaho integration in place to stream data to a data warehouse system through Kafka. We have the connection set up by providing bootstrap servers and kafka topic. As bootstrap servers we specify all kafka brokers as broker1:9091,broker2:9092,broker3:9092 Pentaho connects to the kafka cluster ...