Understanding of Supervisor and it’s specification in Apache Druid for real-time data ingestion from Apache KafkaUnderstanding of Supervisor and it’s specification in Apache Druid for real-time data ingestion from Apache Kafka

Understanding of Supervisor and it’s specification in Apache Druid for real-time data ingestion from Apache Kafka

1 year ago

Although both Apache Druid and Apache Kafka are potent open-source data processing tools, they have diverse uses. While Druid is… Read More

Causes and remedies of poison pill in Apache KafkaCauses and remedies of poison pill in Apache Kafka

Causes and remedies of poison pill in Apache Kafka

2 years ago

A poison pill is a message deliberately sent to a Kafka topic, designed to consistently fail when consumed, regardless of… Read More

Apache Kafka’s built-in command line tools – A hidden gem to scan internals.Apache Kafka’s built-in command line tools – A hidden gem to scan internals.

Apache Kafka’s built-in command line tools – A hidden gem to scan internals.

2 years ago

Several tools/scripts are included in the bin directory of the Apache Kafka binary installation. Even if that directory has a… Read More

The significance of deep storage in Apache DruidThe significance of deep storage in Apache Druid

The significance of deep storage in Apache Druid

2 years ago

The phrase "deep storage" refers to the long-term storage system used by Apache Druid, where past data segments are preserved… Read More

Forging Apache Druid with Apache Kafka for real-time streaming analyticsForging Apache Druid with Apache Kafka for real-time streaming analytics

Forging Apache Druid with Apache Kafka for real-time streaming analytics

2 years ago

A real-time analytics database called Apache Druid is developed for quick slice-and-dice analysis on massive data volumes. The best data… Read More

Knowing and valuing Apache Kafka’s ISR (In-Sync Replicas)Knowing and valuing Apache Kafka’s ISR (In-Sync Replicas)

Knowing and valuing Apache Kafka’s ISR (In-Sync Replicas)

2 years ago

To get more clarity about ISR in Apache Kafka, We should first carefully examine the replication process in the Kafka… Read More

Handling bad messages via DLQ by configuring JDBC Kafka Sink ConnectorHandling bad messages via DLQ by configuring JDBC Kafka Sink Connector

Handling bad messages via DLQ by configuring JDBC Kafka Sink Connector

2 years ago

Any trustworthy data streaming pipeline needs to be able to identify and handle faults. Exceptionally while IoT devices ingest endlessly… Read More

Streaming Data to RDBMS via Kafka JDBC Sink Connector without leveraging Schema RegistryStreaming Data to RDBMS via Kafka JDBC Sink Connector without leveraging Schema Registry

Streaming Data to RDBMS via Kafka JDBC Sink Connector without leveraging Schema Registry

2 years ago

In today's M2M (Machine to machine) communications landscape, there is a huge requirement for streaming the digital data from heterogeneous… Read More

Resolve Apache  Kafka  starting issue installed on Single/Multi-node clusterResolve Apache  Kafka  starting issue installed on Single/Multi-node cluster

Resolve Apache Kafka starting issue installed on Single/Multi-node cluster

2 years ago

This short article explains how to resolve the error "ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)kafka.common.InconsistentClusterIdException:" when… Read More

Few intrinsic of Apache Zookeeper and their importanceFew intrinsic of Apache Zookeeper and their importance

Few intrinsic of Apache Zookeeper and their importance

2 years ago

As a bird's eye view, Apache Zookeeper has been leveraged to get coordination services for managing distributed applications. Holds responsibility… Read More