Big Data : Problem and It’s Solution

Big Data

What is Data?

Some Facts about Data

  • 1.7MB of data is created every second by every person during 2020.
  • In the last two years alone, the astonishing 90% of the world’s data has
  • 463 exabytes of data will be generated each day by humans as of 2025.
  • 95 million photos and videos are shared every day on Instagram.
  • By the end of 2020, 44 zettabytes will make up the entire digital universe.
  • Every day, 306.4 billion emails are sent, and 5 million Tweets are made.
  • Google gets over 3.5 billion searches daily
  • Whats App users exchange up to 65 billion messages daily.
  • Internet users generate about 2.5 Quintilian bytes of data each day
  • In 2019, there are 2.3 billion active Facebook users, and they generate a lot of data.

What is Big Data?

Big Data Problems

  1. Volume: The amount of data matters. With big data, you’ll have to process high volumes of low-density, unstructured data. This can be data of unknown value, such as Twitter data feeds, clickstreams on a webpage or a mobile app, or sensor-enabled equipment. For some organizations, this might be tens of terabytes of data. For others, it may be hundreds of petabytes.
  2. Velocity: Velocity is the fast rate at which data is received and (perhaps) acted on. Normally, the highest velocity of data streams directly into memory versus being written to disk. Some internet-enabled smart products operate in real time or near real time and will require real-time evaluation and action.
  3. Variety: Variety refers to the many types of data that are available. Traditional data types were structured and fit neatly in a relational database. With the rise of big data, data comes in new unstructured data types. Unstructured and semistructured data types, such as text, audio, and video, require additional preprocessing to derive meaning and support metadata.

How Big Data Problems are Resolved?

Conclusion

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store