Written by

Bernard Marr

Bernard Marr is a world-renowned futurist, influencer and thought leader in the fields of business and technology, with a passion for using technology for the good of humanity. He is a best-selling author of over 20 books, writes a regular column for Forbes and advises and coaches many of the world’s best-known organisations. He has a combined following of 4 million people across his social media channels and newsletters and was ranked by LinkedIn as one of the top 5 business influencers in the world.

Bernard’s latest books are ‘Future Skills’, ‘The Future Internet’, ‘Business Trends in Practice’ and ‘Generative AI in Practice’.

Generative AI Book Launch
View My Latest Books

Follow Me

Bernard Marr ist ein weltbekannter Futurist, Influencer und Vordenker in den Bereichen Wirtschaft und Technologie mit einer Leidenschaft für den Einsatz von Technologie zum Wohle der Menschheit. Er ist Bestsellerautor von 20 Büchern, schreibt eine regelmäßige Kolumne für Forbes und berät und coacht viele der weltweit bekanntesten Organisationen. Er hat über 2 Millionen Social-Media-Follower, 1 Million Newsletter-Abonnenten und wurde von LinkedIn als einer der Top-5-Business-Influencer der Welt und von Xing als Top Mind 2021 ausgezeichnet.

Bernards neueste Bücher sind ‘Künstliche Intelligenz im Unternehmen: Innovative Anwendungen in 50 Erfolgreichen Unternehmen’

View Latest Book

Follow Me

The Problem With Biased AIs (and How To Make AI Better)

10 October 2022

AI has the potential to deliver enormous business value for organizations, and its adoption has been sped up by the data-related challenges of the pandemic. Forrester estimates that almost 100% of organizations will be using AI by 2025, and the artificial intelligence software market will reach $37 billion by the same year.

The Problem With Biased AIs (and How To Make AI Better) | Bernard Marr

But there is growing concern around AI bias — situations where AI makes decisions that are systematically unfair to particular groups of people. Researchers have found that AI bias has the potential to cause real harm.

I recently had the chance to speak with Ted Kwartler, VP of Trusted AI at DataRobot, to get his thoughts on how AI bias occurs and what companies can do to make sure their models are fair.

Why AI Bias Happens

AI bias occurs because human beings choose the data that algorithms use, and also decide how the results of those algorithms will be applied. Without extensive testing and diverse teams, it is easy for unconscious biases to enter machine learning models. Then AI systems automate and perpetuate those biased models.

For example, a US Department of Commerce study found that facial recognition AI often misidentifies people of color. If law enforcement uses facial recognition tools, this bias could lead to wrongful arrests of people of color.

Several mortgage algorithms in financial services companies have also consistently charged Latino and Black borrowers higher interest rates, according to a study by UC Berkeley.

Kwartler says the business impact of biased AI can be substantial, particularly in regulated industries. Any missteps can result in fines, or could risk a company’s reputation. Companies that need to attract customers must find ways to put AI models into production in a thoughtful way, as well as test their programs to identify potential bias.

What Better AI Looks Like

Kwartler says “good AI” is a multidimensional effort across four distinct personas:

  • AI Innovators: Leaders or executives who understand the business and realize that machine learning can help solve problems for their organization
  • AI Creators: The machine learning engineers and data scientists who build the models
  • AI Implementers: Team members who fit AI into existing tech stacks and put it into production
  • AI Consumers: The people who use and monitor AI, including legal and compliance teams who handle risk management

“When we work with clients,” Kwartler says, “we try to identify those personas at the company and articulate risks to each one of those personas a little bit differently, so they can earn trust.”

Kwartler also talks about why "humble AI" is critical. AI models must demonstrate humility when making predictions, so they don't drift into the biased territory.

Kwartler told VentureBeat, "If I'm classifying an ad banner at 50% probability or 99% probability, that's kind of that middle range. You have one single cutoff threshold above this line, and you have one outcome. Below this line, you have another outcome. In reality, we're saying there's a space in between where you can apply some caveats, so a human has to go review it. We call that humble AI in the sense that the algorithm is demonstrating humility when it's making that prediction."

Why It’s Critical to Regulate AI

According to DataRobot’s State of AI Bias report, 81% of business leaders want government regulation to define and prevent AI bias.

Kwartler believes that thoughtful regulation could clear up a lot of ambiguity and allow companies to move forward and step into the enormous potential of AI. Regulations are particularly critical around high-risk use cases like education recommendations, credit, employment, and surveillance.

Regulation is essential for protecting consumers as more companies embed AI into their products, services, decision-making, and processes.

How to Create Unbiased AI

When I asked Kwartler for his top tips for organizations that want to create unbiased AI, he had several suggestions.

The first recommendation is to educate your data scientists about what responsible AI looks like, and how your organizational values should be embedded into the model itself, or the guardrails of the model.

Additionally, he recommends transparency with consumers, to help people understand how algorithms create predictions and make decisions. One of the ongoing challenges of AI is that it is seen as a “black box,” where consumers can see inputs and outputs, but have no knowledge of the AI’s internal workings. Companies need to strive for explainability, so people can understand how AI works and how it might have an impact.

Lastly, he recommends companies establish a grievance process for individuals, to give people a way to have discussions with companies if they feel they have been treated unjustly.

How AI Can Help Save the Planet

I asked Kwartler for his hopes and predictions for the future of AI, and he said that he believes AI can help us solve some of the biggest problems human beings are currently facing, including climate change.

He shared a story of one of DataRobot’s clients, a cement manufacturer, who used a complex AI model to make one of their plants 1% more efficient, helping the plant save approximately 70,000 tons of carbon emissions every year.

But to reach the full potential of AI, we need to ensure that we work toward reducing bias and the possible risks AI can bring.

Business Trends In Practice | Bernard Marr
Business Trends In Practice | Bernard Marr

Related Articles

The 5 Biggest Business Trends For 2025 Everyone Must Be Ready For Now

2025 marks the halfway point of a decade that’s already brought profound upheaval and transformation across technology, politics, and society.[...]

How To Embrace The Enterprise AI Era

In the rapidly evolving world of technology, artificial intelligence (AI) has emerged as a transformative force, reshaping industries and redefining how businesses operate.[...]

18 Generative AI Tools Transforming Customer Service

Without a doubt, one of the standout use cases for generative AI in business is in customer service and support.[...]

How To Write Amazing Generative AI Prompts

Generative artificial intelligence has become a powerful tool for enhancing productivity and tackling everyday tasks.[...]

The 10 Biggest AI Trends Of 2025 Everyone Must Be Ready For Today

There is little doubt that artificial intelligence will continue to be the most talked-about technology of 2025.[...]

The 5 Biggest Technology Trends For 2025 Everyone Must Be Ready For Now

Unbelievable as it seems, we’re rapidly approaching 2025. This means it’s time for me to once again pick the trends that I believe will be most important over the coming year.[...]

Sign up to Stay in Touch!

Bernard Marr is a world-renowned futurist, influencer and thought leader in the fields of business and technology, with a passion for using technology for the good of humanity.

He is a best-selling author of over 20 books, writes a regular column for Forbes and advises and coaches many of the world’s best-known organisations.

He has a combined following of 4 million people across his social media channels and newsletters and was ranked by LinkedIn as one of the top 5 business influencers in the world.

Bernard’s latest book is ‘Generative AI in Practice’.

Sign Up Today

Social Media

0
Followers
0
Followers
0
Followers
0
Subscribers
0
Followers
0
Subscribers
0
Yearly Views
0
Readers

Podcasts

View Podcasts