Written by

Bernard Marr

Bernard Marr is a world-renowned futurist, influencer and thought leader in the fields of business and technology, with a passion for using technology for the good of humanity. He is a best-selling author of 20 books, writes a regular column for Forbes and advises and coaches many of the world’s best-known organisations. He has over 2 million social media followers, 1 million newsletter subscribers and was ranked by LinkedIn as one of the top 5 business influencers in the world and the No 1 influencer in the UK.

Bernard’s latest book is ‘Business Trends in Practice: The 25+ Trends That Are Redefining Organisations’

View Latest Book

Follow Me

Bernard Marr ist ein weltbekannter Futurist, Influencer und Vordenker in den Bereichen Wirtschaft und Technologie mit einer Leidenschaft für den Einsatz von Technologie zum Wohle der Menschheit. Er ist Bestsellerautor von 20 Büchern, schreibt eine regelmäßige Kolumne für Forbes und berät und coacht viele der weltweit bekanntesten Organisationen. Er hat über 2 Millionen Social-Media-Follower, 1 Million Newsletter-Abonnenten und wurde von LinkedIn als einer der Top-5-Business-Influencer der Welt und von Xing als Top Mind 2021 ausgezeichnet.

Bernards neueste Bücher sind ‘Künstliche Intelligenz im Unternehmen: Innovative Anwendungen in 50 Erfolgreichen Unternehmen’

View Latest Book

Follow Me

The Problem With Biased AIs (and How To Make AI Better)

10 October 2022

AI has the potential to deliver enormous business value for organizations, and its adoption has been sped up by the data-related challenges of the pandemic. Forrester estimates that almost 100% of organizations will be using AI by 2025, and the artificial intelligence software market will reach $37 billion by the same year.

The Problem With Biased AIs (and How To Make AI Better) | Bernard Marr

But there is growing concern around AI bias — situations where AI makes decisions that are systematically unfair to particular groups of people. Researchers have found that AI bias has the potential to cause real harm.

I recently had the chance to speak with Ted Kwartler, VP of Trusted AI at DataRobot, to get his thoughts on how AI bias occurs and what companies can do to make sure their models are fair.

Why AI Bias Happens

AI bias occurs because human beings choose the data that algorithms use, and also decide how the results of those algorithms will be applied. Without extensive testing and diverse teams, it is easy for unconscious biases to enter machine learning models. Then AI systems automate and perpetuate those biased models.

For example, a US Department of Commerce study found that facial recognition AI often misidentifies people of color. If law enforcement uses facial recognition tools, this bias could lead to wrongful arrests of people of color.

Several mortgage algorithms in financial services companies have also consistently charged Latino and Black borrowers higher interest rates, according to a study by UC Berkeley.

Kwartler says the business impact of biased AI can be substantial, particularly in regulated industries. Any missteps can result in fines, or could risk a company’s reputation. Companies that need to attract customers must find ways to put AI models into production in a thoughtful way, as well as test their programs to identify potential bias.

What Better AI Looks Like

Kwartler says “good AI” is a multidimensional effort across four distinct personas:

  • AI Innovators: Leaders or executives who understand the business and realize that machine learning can help solve problems for their organization
  • AI Creators: The machine learning engineers and data scientists who build the models
  • AI Implementers: Team members who fit AI into existing tech stacks and put it into production
  • AI Consumers: The people who use and monitor AI, including legal and compliance teams who handle risk management

“When we work with clients,” Kwartler says, “we try to identify those personas at the company and articulate risks to each one of those personas a little bit differently, so they can earn trust.”

Kwartler also talks about why "humble AI" is critical. AI models must demonstrate humility when making predictions, so they don't drift into the biased territory.

Kwartler told VentureBeat, "If I'm classifying an ad banner at 50% probability or 99% probability, that's kind of that middle range. You have one single cutoff threshold above this line, and you have one outcome. Below this line, you have another outcome. In reality, we're saying there's a space in between where you can apply some caveats, so a human has to go review it. We call that humble AI in the sense that the algorithm is demonstrating humility when it's making that prediction."

Why It’s Critical to Regulate AI

According to DataRobot’s State of AI Bias report, 81% of business leaders want government regulation to define and prevent AI bias.

Kwartler believes that thoughtful regulation could clear up a lot of ambiguity and allow companies to move forward and step into the enormous potential of AI. Regulations are particularly critical around high-risk use cases like education recommendations, credit, employment, and surveillance.

Regulation is essential for protecting consumers as more companies embed AI into their products, services, decision-making, and processes.

How to Create Unbiased AI

When I asked Kwartler for his top tips for organizations that want to create unbiased AI, he had several suggestions.

The first recommendation is to educate your data scientists about what responsible AI looks like, and how your organizational values should be embedded into the model itself, or the guardrails of the model.

Additionally, he recommends transparency with consumers, to help people understand how algorithms create predictions and make decisions. One of the ongoing challenges of AI is that it is seen as a “black box,” where consumers can see inputs and outputs, but have no knowledge of the AI’s internal workings. Companies need to strive for explainability, so people can understand how AI works and how it might have an impact.

Lastly, he recommends companies establish a grievance process for individuals, to give people a way to have discussions with companies if they feel they have been treated unjustly.

How AI Can Help Save the Planet

I asked Kwartler for his hopes and predictions for the future of AI, and he said that he believes AI can help us solve some of the biggest problems human beings are currently facing, including climate change.

He shared a story of one of DataRobot’s clients, a cement manufacturer, who used a complex AI model to make one of their plants 1% more efficient, helping the plant save approximately 70,000 tons of carbon emissions every year.

But to reach the full potential of AI, we need to ensure that we work toward reducing bias and the possible risks AI can bring.

Business Trends In Practice | Bernard Marr
Business Trends In Practice | Bernard Marr

Related Articles

The Top 10 Tech Trends In 2023 Everyone Must Be Ready For

As a futurist, it’s my job to look ahead — so every year, I cover the emerging tech trends that will be shaping our digital world in the next 12 months.[...]

The Top Five Cybersecurity Trends In 2023

Here, we look at the most important trends to watch out for in 2023, including the increased threats from connected IoT devices, hybrid working, and state-sponsored attacks.[...]

The Disruptive Economic Impact Of Artificial Intelligence

I firmly believe that artificial intelligence (AI) has the potential to be among the most disruptive technologies we will ever develop.[...]

Artificial Intelligence | Bernard Marr

The 5 Biggest Artificial Intelligence (AI) Trends In 2023

Over the last decade, Artificial intelligence (AI) has become embedded in every aspect of our society and lives.[...]

Is AI Really A Job Killer? These Experts Say No

If you believe all the doom and gloom in the news today, you might think automation and the deployment of AI-enabled systems at work will replace scores of jobs worldwide.[...]

How AI And Machine Learning Will Impact The Future Of Healthcare

Our modern healthcare system is currently facing huge challenges exacerbated by the pandemic, a rise in lifestyle-related diseases, and an exploding world population.[...]

Stay up-to-date

  • Get updates straight to your inbox
  • Join my 1 million newsletter subscribers
  • Never miss any new content

Social Media

0
Followers
0
Followers
0
Followers
0
Subscribers
0
Followers
0
Subscribers
0
Yearly Views
0
Readers

Podcasts

View Podcasts