Introduction to BigData

History of data storage:

During early days when computer was introduced commercially to be used in business, data used to be saved in flat file system which was unsafe and also insecure and redundant in many cases.

Then DBMS was introduced and its one variant RDBMS ruled the IT world for many decades, also ObjectRDBMS was also used with advantages of Object request and service benefit to existing RDBMS.The only drawback was and is also presently that the data has to be structured and we need SQL for querying data.

With the popularity and advancement of social media huge unstructured data started generating and there was a need of some mechanism by which we can keep voluminous unstructured data comprising of text ,audio,video,image etc.

Apache HADOOP:

somewhere in 2005 BigData idea was coined and HADOOP architecture came into picture which was capable of giving a framework to store large amount of unstructured data.

Advantage of HADOOP is that we can implement it with a group of simple legacy system without high-end servers too.

Map-Reduce can then be applied for data analytics or for streaming data we can use Spark.

In the next writeup we will discuss in detail HADOOP Map-Reduce and Spark , so happy reading.

35 views2 comments

Recent Posts

See All

We know IOT is a buzzword nowadays , when we think of implementing IOT , we require a small handy microprocessor which can process all kind of data coming from different kinds of data coming from sens

With the advancement of different social networking sites, lots of unstructured and variety of data is posted every second, and with the advent of BigData technology people started saving this data as