Streaming real-time data from Kafka 3.7.0 to Flink 1.18.1 for processing

10 months ago

Over the past few years, Apache Kafka has emerged as the leading standard for streaming data. Fast-forward to the present… Read More

Why Apache Kafka and Apache Flink work incredibly well together to boost real-time data analytics

11 months ago

When data is analyzed and processed in real-time, it can yield insights and actionable information either instantly or with very… Read More

Integrating rate-limiting and backpressure strategies synergistically to handle and alleviate consumer lag in Apache Kafka

11 months ago

Apache Kafka stands as a robust distributed streaming platform. However, like any system, it is imperative to proficiently oversee and… Read More

Leveraging Apache Kafka for the Distribution of Large Messages (in gigabyte size range)

1 year ago

In today's data-driven world, the capability to transport and circulate large amounts of data, especially video files, in real-time is… Read More

The Zero Copy principle subtly encourages Apache Kafka to be more efficient.

1 year ago

The Apache Kafka, a distributed event streaming technology, can process trillions of events each day and eventually demonstrate its tremendous… Read More

Understanding of Supervisor and it’s specification in Apache Druid for real-time data ingestion from Apache Kafka

1 year ago

Although both Apache Druid and Apache Kafka are potent open-source data processing tools, they have diverse uses. While Druid is… Read More

Causes and remedies of poison pill in Apache Kafka

1 year ago

A poison pill is a message deliberately sent to a Kafka topic, designed to consistently fail when consumed, regardless of… Read More

Apache Kafka’s built-in command line tools – A hidden gem to scan internals.

1 year ago

Several tools/scripts are included in the bin directory of the Apache Kafka binary installation. Even if that directory has a… Read More

The significance of deep storage in Apache Druid

1 year ago

The phrase "deep storage" refers to the long-term storage system used by Apache Druid, where past data segments are preserved… Read More

Forging Apache Druid with Apache Kafka for real-time streaming analytics

2 years ago

A real-time analytics database called Apache Druid is developed for quick slice-and-dice analysis on massive data volumes. The best data… Read More