History of data storage:
During early days when computer was introduced commercially to be used in business, data used to be saved in flat file system which was unsafe and also insecure and redundant in many cases.
Then DBMS was introduced and its one variant RDBMS ruled the IT world for many decades, also ObjectRDBMS was also used with advantages of Object request and service benefit to existing RDBMS.The only drawback was and is also presently that the data has to be structured and we need SQL for querying data.
With the popularity and advancement of social media huge unstructured data started generating and there was a need of some mechanism by which we can keep voluminous unstructured data comprising of text ,audio,video,image etc.
somewhere in 2005 BigData idea was coined and HADOOP architecture came into picture which was capable of giving a framework to store large amount of unstructured data.
Advantage of HADOOP is that we can implement it with a group of simple legacy system without high-end servers too.
Map-Reduce can then be applied for data analytics or for streaming data we can use Spark.
In the next writeup we will discuss in detail HADOOP Map-Reduce and Spark , so happy reading.