Big Data – Too Many Answers Not Enough Questions
2 July 2021
One of my favourite examples of why so many big data projects fail comes from a book that was written decades before “big data” was even conceived.
In Douglas Adams’ The Hitchhiker’s Guide to the Galaxy, a race of creatures built a supercomputer to calculate the meaning of “life, the universe, and everything.” After hundreds of years of processing, the computer announces that the answer is “42.”
When the beings protest, the computer calmly suggests that now they have the answer, they need to know what the actual question is – a task that requires a much bigger and more sophisticated computer.
This is a wonderful parable for big data because it illustrates one quintessential fact: data on its own is meaningless.
Remember the value of data is not the data itself – it’s what you do with the data. For data to be useful you first need to know what data you need, otherwise you just get tempted to know everything and that’s not a strategy, it’s an act of desperation that is doomed to end in failure.
Why go to all the time and trouble collecting data that you won’t or can’t use to deliver business insights? You must focus on the things that matter the most otherwise you’ll drown in data. Data is a strategic asset but it’s only valuable if it’s used constructively and appropriately to deliver results.
Good questions yield better answers
This is why it’s so important to start with the right questions. If you are clear about what you are trying to achieve then you can think about the questions to which you need answers. For example, if your strategy is to increase your customer base, questions that you will need answers to might include, ‘Who are currently our customers?’, ‘What are the demographics of our most valuable customers?’ and ‘What is the lifetime value of our customers?’.
When you know the questions you need answered then it’s much easier to identify the data you need to access in order to answer those key questions.
For example, I worked with a small fashion retail company that had no data other than their traditional sales data. They wanted to increase sales but had no smart data to draw on to help them achieve that goal. Together we worked out that the questions they needed answers to included:
- How many people actually pass our shops?
- How many stop to look in the window and for how long? How many of them then come into the shop, and
- How many then buy?
What we did was install a small, discreet device into the shop windows that tracked mobile phone signals as people walked past the shop. Everyone, at least everyone passing these particular stores with a mobile phone on them (which nowadays is almost everyone), would be picked up by the sensor in the device and counted, thereby answering the first question. The sensors would also measure how many people stopped to look at the window and for how long, how many people then walked into the store, and sales data would record who actually bought something.
By combining the data from the sensors placed in the window with transaction data we were able to measure conversion ratio and test window displays and various offers to see which ones increased conversion rate. Not only did this fashion retailer massively increase sales by getting smart about the way they were combining small traditional data with untraditional Big Data but also they used the insights to make a significant saving by closing one of their stores. The sensors were able to finally tell them that the footfall reported by the market research company prior to opening in that location was wrong and the passing traffic was insufficient to justify keeping the store open.
Too much data obscures the truth
Really successful companies today are making decisions based on facts and data-driven insights, not opinion, gut feeling or even experience. Whether you have access to tons of data or not, if you start with strategy and identify the questions you need answers to in order to deliver your outcomes then you will be on track to improve performance and harness the primary power of data.
Every manager now has the opportunity to use data to support their decision-making with actual facts. But without the right questions, all those “facts” can conceal the truth.
A lot of data can generate lots of answers to things that don’t really matter; instead companies should be focusing on the big unanswered questions in their business and tackling them with big data. When I work with my clients we develop the key questions as part of their data strategy , so they don’t ever fall into the trap of all answers and no questions.
Related Articles
Will AI Solve The World’s Inequality Problem – Or Make It Worse?
We are standing on the cusp of a new technological revolution. AI is increasingly permeating every aspect of our lives, with intelligent machines transforming the way we live and work.[...]
How You Become Irreplaceable In The Age Of AI
In a world where artificial intelligence is rapidly advancing, many of us are left wondering: Will AI take our jobs?[...]
Why Apple Intelligence Sets A New Gold Standard For AI Privacy
In the rapidly evolving world of artificial intelligence, privacy concerns have become a hot-button issue.[...]
Can Your Device Run Apple Intelligence? What You Need To Know
Apple's announcement of Apple Intelligence has sent waves of excitement through the tech world.[...]
10 Amazing Things You Can Do With Apple Intelligence On Your IPhone
Apple Intelligence is poised to revolutionize the iPhone experience, offering a suite of AI-powered tools that promise to make your digital life easier, more productive, and more creative.[...]
Agentic AI: The Next Big Breakthrough That’s Transforming Business And Technology
The world of artificial intelligence is evolving at a breakneck pace, and just when you thought you'd wrapped your head around generative AI, along comes another game-changing concept: agentic AI.[...]
Sign up to Stay in Touch!
Bernard Marr is a world-renowned futurist, influencer and thought leader in the fields of business and technology, with a passion for using technology for the good of humanity.
He is a best-selling author of over 20 books, writes a regular column for Forbes and advises and coaches many of the world’s best-known organisations.
He has a combined following of 4 million people across his social media channels and newsletters and was ranked by LinkedIn as one of the top 5 business influencers in the world.
Bernard’s latest book is ‘Generative AI in Practice’.
Social Media