Walmart: Big Data analytics at the world’s biggest retailer
23 July 2021
With over 20,000 stores in 28 countries, Walmart is the largest retailer in the world. So it’s fitting then that the company is in the process of building the world’s largest private cloud, big enough to cope with 2.5 petabytes of data every hour. To make sense of all this information, Walmart has created what it calls its Data Café – a state-of-the-art analytics hub located within its Bentonville, Arkansas headquarters.

Walmart uses Big Data in practice
The Data Café allows huge volumes of internal and external data, including 40 petabytes of recent transactional data, to be rapidly modelled, manipulated and visualised. Speaking to me about the project, senior statistical analyst Naveen Peddamail said, “If you can’t get insights until you’ve analysed your sales for a week or a month, then you’ve lost sales within that time.”
Quick access to insights is therefore vital. For example, Peddamail told me about a grocery team who could not understand why sales had suddenly declined in a particular product category. By drilling into the data, they were quickly able to see that pricing miscalculations had led to the products being listed at a higher price than they should have been.
The system also provides automated alerts, so, when particular metrics fall below a set threshold in any department, the relevant team is alerted so that they can find a fast solution. In one example of this, during Halloween, sales analysts were able to see in real time that, although a particular novelty cookie was very popular in most stores, it wasn’t selling at all in two stores. The alert prompted a quick investigation, which showed that, due to a simple stocking oversight, the cookies hadn’t been put on the shelves. The store was then able to rectify the situation immediately.
The technical details
As well as 200 billion rows of transactional data (representing only the past few weeks!), the Café pulls in information from 200 sources, including meteorological data, economic data, Nielsen data, telecom data, social media data, gas prices, and local events databases. Anything within these vast and varied datasets could hold the key to the solution to a particular problem, and Walmart’s algorithms are designed to blaze through them in microseconds to come up with real-time solutions.
Ideas and insights you can steal
Clearly, Walmart has huge amounts of data at its fingertips – and the resources to tackle all that data. But what any company can borrow from Walmart’s example is their ability to react to data quickly. After all, there’s little point investing in data capabilities if your internal setup doesn’t allow you to quickly make decisions and changes based on what the data is telling you.
You can read more about how Walmart is using Big Data to drive success in Big Data in Practice: How 45 Successful Companies Used Big Data Analytics to Deliver Extraordinary Results.
Related Articles
What Tech Trends Should Companies Focus on in 2023? Here Are Three to Consider (And One to Ignore)
It’s common to hear it said that today, in order to thrive, every business needs to become a tech business.[...]
The Top 10 In-Demand Skills For 2030
What will the world be like in 2030? Well, obviously, no one knows for sure, but we have some interesting predictions:[...]
Beyond Dashboards: The Future Of Analytics And Business Intelligence?
Analytics and business intelligence (BI) have long been understood to be fundamental to business success.[...]
The Top 5 Data Science And Analytics Trends In 2023
Today, information can be captured from many different sources, and technology to extract insights is becoming increasingly accessible.[...]
The 5 Biggest Business Trends In 2023 Everyone Must Get Ready For Now
Businesses have faced huge challenges and have undergone an incredible amount of change over the past few years, and this won’t slow down in 2023.[...]
8 Simple Ways To Enhance Your Data Literacy Skills
We’re living through the fourth industrial revolution (or “Industry 4.0”), a revolution that’s defined by wave upon wave of new technologies that combine the physical and digital worlds.[...]
Stay up-to-date
- Get updates straight to your inbox
- Join my 1 million newsletter subscribers
- Never miss any new content
Social Media