What To Expect In This Data Era

Data Clusters

Data Generated By Some Companies :-

Data Growth

Hadoop As A Tool/Software :-

Why is Hadoop important?

  • Ability to store and process huge amounts of any kind of data, quickly. With data volumes and varieties constantly increasing, especially from social media and the Internet of Things (IoT), that's a key consideration.
  • Computing power. Hadoop's distributed computing model processes big data fast. The more computing nodes you use, the more processing power you have.
  • Fault tolerance. Data and application processing are protected against hardware failure. If a node goes down, jobs are automatically redirected to other nodes to make sure the distributed computing does not fail. Multiple copies of all data are stored automatically.
  • Flexibility. Unlike traditional relational databases, you don’t have to preprocess data before storing it. You can store as much data as you want and decide how to use it later. That includes unstructured data like text, images and videos.
  • Low cost
  • Scalability. You can easily grow your system to handle more data simply by adding nodes. Little administration is required.

The 3 Important V’s of Big Data :-

3 V’s of Big Data
  • 100 GB data when stored in a computer takes 10 minutes .
  • Same 100 GB data when divided into 10 parts of each 10 GB and stored in 10 Different Computers simultaneously can take only 1 minute .
Master Slave Topology/Model

--

--

--

A tech enthusiast pursuing B.Tech from BMSIT, Bangalore. A keen learner of new technologies and exploring use cases to create an impact in the society.

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Creating my own ‘Year in Monzo’ using Python & Pandas

Predicting Cost of Tender with 99.24% Accuracy : Miracle!

Bootstrapping at scale in Snowflake

PictureText: Interactive Visuals of Text

Qualitative Data Can Provide Context and Meaning to Your Quantitative Data

Data may be the New Oil, but Most of it is ‘Heavy Crude’ and Not Worth Refining

In Search of Property listings in Nairobi.

The People Behind the People Science: Intern Edition

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Suryansh Shrivastava

Suryansh Shrivastava

A tech enthusiast pursuing B.Tech from BMSIT, Bangalore. A keen learner of new technologies and exploring use cases to create an impact in the society.

More from Medium

4 ways to be more disciplined for your goals — A romanians fitness and self-development blog

How To Make My Grandmother’s Migas | Recipe

Investing Basics

How We Built LYST Website Clone in just 7 days?