Big Data is one of THE biggest buzzwords around at the moment and I believe big data will change the world. Some say it will be even bigger than the Internet. What's certain, big data will impact everyone's life. Having said that, I also think that the term 'big data' is not very well defined and is, in fact, not well chosen. Let me use this article to explain what's behind the massive 'big data' buzz and demystify some of the hype.
Basically, big data refers to our ability to collect and analyse the vast amounts of data we are now generating in the world. The ability to harness the ever-expanding volumes of data is completely transforming our ability to understand the world and everything within it. The advances in analysing big data allow us to e.g. decode human DNA in minutes, find cures for cancer, accurately predict human behaviour, foil terrorist attacks, pinpoint marketing efforts and prevent diseases.
Take this business example: Wal-Mart is able to take data from your past buying patterns, their internal stock information, your mobile phone location data, social media as well as external weather information and analyse all of this in seconds so it can send you a voucher for a BBQ cleaner to your phone - but only if you own a barbeque, the weather is nice and you currently are within a 3 miles radius of a Wal-Mart store that has the BBQ cleaner in stock. That's scary stuff, but one step at a time, let's first look at why we have so much more data than ever before.
In my talks and training sessions on big data I talk about the 'datafication of the world'. This datafication is caused by a number of things including the adoption of social media, the digitalisation of books, music and videos, the increasing use of internet-connected devices as well as cheaper and better sensors that allow us to measure and track everything. Just think about it for a minute:
I am sure you are getting the point. The volume of data is growing at a frightening rate. Google's executive chairman Eric Schmidt brings it to a point: "From the dawn of civilisation until 2003, humankind generated five exabytes of data. Now we produce five exabytes every two days…and the pace is accelerating."
Not only do we have a lot of data, we also have a lot of different and new types of data: text, video, web search logs, sensor data, financial transactions and credit card payments etc. In the world of 'Big Data' we talk about the 4 Vs that characterize big data:
So, we have a lot of data, in different formats, that is often fast moving and of varying quality - why would that change the world? The reason the world will change is that we now have the technology to bring all of this data together and analyse it.
In the past we had traditional database and analytics tools that couldn't deal with extremely large, messy, unstructured and fast moving data. Without going into too much detail, we now have software like Hadoop and others which enable us to analyse large, messy and fast moving volumes of structured and unstructured data. It does it by breaking the task up between many different computers (which is a bit like how Google breaks up the computation of its search function). As a consequence of this, companies can now bring together these different and previously inaccessible data sources to generate impressive results. Let's look at some real examples of how big data is used today to make a difference:
And these examples are just the beginning. Companies are barely starting to get to grips with the new world of big data. In conclusion then, big data will change the world. Even though I don’t particularly like the term ‘big data’, it is clear that every company, in every industry, will need to consider strategically how the data revolution will change their business .
Bernard Marr is a bestselling author, keynote speaker, and advisor to companies and governments. He has worked with and advised many of the world's best-known organisations. LinkedIn has recently ranked Bernard as one of the top 10 Business Influencers in the world (in fact, No 5 - just behind Bill Gates and Richard Branson). He writes on the topics of intelligent business performance for various publications including Forbes, HuffPost, and LinkedIn Pulse. His blogs and SlideShare presentation have millions of readers.