Tech Threads

Importance of unstructured data

In today’s world,  Internet plays a major factor to generate and propagate information from various sources. Social media, Email, What’sApp, E-News Paper  etc  are playing a crucial role on circulation followed by creation of information.  These type of information often include text and multimedia contents.  These information or data methodically can’t be persisted in database and it is referred as unstructured data.


Due to advancement in  technology,  70-80 % growing data is unstructured and increasing significantly over structured/semi structured data.   Typically we store structured data and semi-structured data (after process) in traditional database but unstructured data can’t. Most of the organizations in today’s tough business environment have started analyzing unstructured data to take better business decision. Hadoop distributed file systems (HDFS) is an excellent framework to store unstructured data.

Here in (HDFS)we do not have to design schema in row  column  structure  to accumulate data. Data can be ingested directly in HDFS and process eventually in a distributed manner to get desire result.  The unstructured data is closely associate with term call “BIG DATA” which is tuning the entire world of information towards a new direction and Hadoop is enabling  us to process thousand of petabyte of unstructured data.

Written by
Gautam Goswami

Page: 1 2

Recent Posts

Best Practices for Handling Bad Data in Stream Processing Platforms

Introduction Today, stream processing platforms facilitate the real-time analysis of data flowing continuously from Internet… Read More

2 weeks ago

The Real-Time Revolution: Why Blockchain Needs Data Stream Processing

Blockchain is an extremely data-driven technology because the primary function of a blockchain is to… Read More

3 months ago

Event-Driven AI Acceleration via TOON on Apache Kafka

AI agents now increasingly require real-time stream data processing as the environment involving the decision making… Read More

6 months ago

Hot Data: Where Real-Time Insight Begins

Hot data means the data currently being created, accessed, and queried at real-time or near… Read More

8 months ago

Is TOON the Next Lightweight Hero in Event Stream Processing with Apache Kafka?

 The data serialization format is a key factor when dealing with stream processing, as it… Read More

10 months ago

Using Schema Registry to Manage Real-Time Data Streams in AI Pipelines

In today's AI-powered systems, real-time data is essential rather than optional. Real-time data streaming has… Read More

11 months ago