Handling bad messages via DLQ by configuring JDBC Kafka Sink Connector
Any trustworthy data streaming pipeline needs to be able to identify and handle faults. Exceptionally while IoT devices ingest endlessly critical data/events into permanent persistence storage like RDBMS for future […]
Streaming Data to RDBMS via Kafka JDBC Sink Connector without leveraging Schema Registry
In today’s M2M (Machine to machine) communications landscape, there is a huge requirement for streaming the digital data from heterogeneous IoT devices to the various RDBMS for further analysis via […]
Resolve Apache Kafka starting issue installed on Single/Multi-node cluster
This short article explains how to resolve the error “ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)kafka.common.InconsistentClusterIdException:” when we start the Apache Kafka installed and configured on a […]
Few intrinsic of Apache Zookeeper and their importance
As a bird’s eye view, Apache Zookeeper has been leveraged to get coordination services for managing distributed applications. Holds responsibility for providing configuration information, naming, synchronization, and group services over […]
Why Kappa Architecture for processing of streaming data. Have competence to superseding Lambda Architecture?
Data is quickly becoming the new currency of the digital economy, but it is useless if it can’t be processed. The processing of data is essential for subsequent decision-making or […]
