Ingesting data into HDFS
we are always talking about data processing using Hadoop starting from structured to unstructured . And know the basic definition of Big Data which is huge volume of data those can not be stored in existing traditional database or data repository.
Interestingly, how can we import such a huge volume of data to the cluster of computers where Hadoop is installed? Yes, using Flume we can continuously collect the stream of data. For example Twitter data can be collected for analysis of comments. Sqoop is applied to transfer data from various existing Data warehouse systems, Databases as well as from document repositories.
Written by
Gautam Goswami
Can be reached for real-time POC development and hands-on technical training at [email protected]. Besides, to design, develop just as help in any Hadoop/Big Data handling related task. Gautam is a advisor and furthermore an Educator as well. Before that, he filled in as Sr. Technical Architect in different technologies and business space across numerous nations.
He is energetic about sharing information through blogs, preparing workshops on different Big Data related innovations, systems and related technologies.
