Written by

Bernard Marr

Bernard Marr is a world-renowned futurist, influencer and thought leader in the fields of business and technology, with a passion for using technology for the good of humanity. He is a best-selling author of over 20 books, writes a regular column for Forbes and advises and coaches many of the world’s best-known organisations. He has a combined following of 4 million people across his social media channels and newsletters and was ranked by LinkedIn as one of the top 5 business influencers in the world.

Bernard’s latest books are ‘Future Skills’, ‘The Future Internet’, ‘Business Trends in Practice’ and ‘Generative AI in Practice’.

Generative AI Book Launch
View My Latest Books

Follow Me

Bernard Marr ist ein weltbekannter Futurist, Influencer und Vordenker in den Bereichen Wirtschaft und Technologie mit einer Leidenschaft für den Einsatz von Technologie zum Wohle der Menschheit. Er ist Bestsellerautor von 20 Büchern, schreibt eine regelmäßige Kolumne für Forbes und berät und coacht viele der weltweit bekanntesten Organisationen. Er hat über 2 Millionen Social-Media-Follower, 1 Million Newsletter-Abonnenten und wurde von LinkedIn als einer der Top-5-Business-Influencer der Welt und von Xing als Top Mind 2021 ausgezeichnet.

Bernards neueste Bücher sind ‘Künstliche Intelligenz im Unternehmen: Innovative Anwendungen in 50 Erfolgreichen Unternehmen’

View Latest Book

Follow Me

The AI-Powered Robot That Learnt Curling Using Adaptive Deep Reinforcement Learning

2 July 2021

In curling, a sport that’s been referred to as “chess on ice” because of the strategy and precision involved, a robot named Curly beat Korean national teams in three out of four official matches. Robots have certainly come a long way, but they are still fairly clumsy, and most lack the dexterity of the human body. So Curly, the robot that mastered curling, is quite impressive.

What is Curling?

To fully appreciate this feat of technology, it’s important to understand the sport of curling. Curling requires the physicality of bowling as players push a 40-pound stone down a sheet of ice from a boundary called a hogline toward a target that’s 100 feet away. The target for the stone is called the house that has concentric circles—the closer you get to the target, the more points you get.

In curling, you compete against a team whose players also attempt to hurl their granite puck closer to the target or knock out yours to earn the most points. Curling strategy is about figuring out how to keep your opponent’s stone away from the house by bumping it out of position while doing so with enough finesse that your stone aligns in the house in an optimal position. The trick is that the friction of the stone and ice makes the elements faced by the competitors always shifting throughout the match. Curling is no easy feat for man and an incredible accomplishment for a machine.

Curly and Its Creators

Klaus-Robert Müller at the Berlin Institute of Technology in Germany and his colleagues are behind Curly’s creation. Curly is powered by artificial intelligence, specifically an adaptive deep reinforcement learning framework. The robot has two wheels in the front and a caster wheel in the back. It has a telescoping camera that reaches 7 feet in the air to help the robot see the house and another one right above the front wheels for it to spot the hogline. Along with four smaller wheels shaped in a U and powered by a conveyor belt, the robot grasps the stone with its front wheel. It’s the U-shaped wheels that enable the robot to spin the stone, the curl that makes the stone spin right or left, a critical technique in the sport.

To help Curly learn the strategy of curling, the development team created a simulation of a curling game that Curly could compete with and learn from. The challenging thing to simulate was the ever-changing conditions that happen in each match—the ice conditions and the stone’s polish and other physics of the sport. Human competitors must continually adapt to changing conditions. As a result, there was a gap between the simulation and reality.

Before a match begins, competitors are allowed test throws to learn more about the current conditions. Curly also did the test throws and then needed to align real-world experience with the mathematical models it learned from. It was programmed to compare the current conditions experienced in the test throws against the training model and adjust as necessary.

Additionally, during the match, Curly had to learn the best moves for the next throw, depending on the position of the competitor’s stones. In the simulation, Curly was given various scenarios and considered different throws, ultimately gauging the risk of each type. Using the knowledge it gained in training and then adjusting to the real-world conditions and progression of the match, the robot adapted its plan accordingly to achieve success. 

It’s important to note that these matches between Curly and the Koreans weren’t an exact replica of the sport since there was no sweeping—the process where teammates sweep a broom in front of the stone to scrub the ice to reduce friction and make the stone travel a straighter course—done by Curly or the Korean competitors in these matches.

Ultimately, Curly’s training and development resulted in success showing that artificial intelligence can adapt to real-world conditions. Olympic-level curling competitors learn the nuances of their sport over 15 to 20 years. It was truly remarkable that a robot powered by AI achieved so much in such a short amount of time and successfully adapted to the many variables that are part of a curling competition. Curly showed that even if there is a gap between physics-based simulators and real-world conditions, artificial intelligence can overcome it. This will be important as other artificial intelligence systems are developed.

Where to go from here

If you would like to know more about , check out my articles on:

Or browse the Artificial Intelligence & Machine Learning to find the metrics that matter most to you.


Business Trends In Practice | Bernard Marr
Business Trends In Practice | Bernard Marr

Related Articles

The Simple ChatGPT Trick That Will Transform Your Business AI Interactions

I believe ChatGPT and other generative AI tools can help pretty much any business.[...]

The Third Wave Of AI Is Here: Why Agentic AI Will Transform The Way We Work

The chess pieces of artificial intelligence are being dramatically rearranged. While previous iterations of AI focused on making predictions or generating content, we're now witnessing the emergence of something far more sophisticated: AI agents that can independently perform complex tasks and make decisions.[...]

How Generative AI Will Change Jobs In Cybersecurity

Ensuring robust cybersecurity measures are in place is more important than ever when it comes to protecting organizations and even governments and nations from digital threats.[...]

The 10 Most Important Banking And Financial Technology Trends That Will Shape 2025

As technological disruption and economic uncertainty continue to reshape the financial landscape, alongside dramatic shifts in consumer behavior and regulatory requirements, 2025 promises to be both challenging and opportunistic for banking and financial services.[...]

The 6 Most Powerful AI Marketing Trends That Will Transform Your Business In 2025

The quiet hum of AI servers is rapidly drowning out the traditional drumbeat of marketing departments worldwide.[...]

AI Everywhere – Scaling AI In The Cloud With Intel® Xeon®6

Today, the omnipresent AI that we’re starting to take for granted has become a critical tool for business.[...]

Sign up to Stay in Touch!

Bernard Marr is a world-renowned futurist, influencer and thought leader in the fields of business and technology, with a passion for using technology for the good of humanity.

He is a best-selling author of over 20 books, writes a regular column for Forbes and advises and coaches many of the world’s best-known organisations.

He has a combined following of 4 million people across his social media channels and newsletters and was ranked by LinkedIn as one of the top 5 business influencers in the world.

Bernard’s latest book is ‘Generative AI in Practice’.

Sign Up Today

Social Media

0
Followers
0
Followers
0
Followers
0
Subscribers
0
Followers
0
Subscribers
0
Yearly Views
0
Readers

Podcasts

View Podcasts