Written by

Bernard Marr

Bernard Marr is a world-renowned futurist, influencer and thought leader in the fields of business and technology, with a passion for using technology for the good of humanity. He is a best-selling author of over 20 books, writes a regular column for Forbes and advises and coaches many of the world’s best-known organisations. He has a combined following of 4 million people across his social media channels and newsletters and was ranked by LinkedIn as one of the top 5 business influencers in the world.

Bernard’s latest books are ‘Future Skills’, ‘The Future Internet’, ‘Business Trends in Practice’ and ‘Generative AI in Practice’.

Generative AI Book Launch
View My Latest Books

Follow Me

Bernard Marr ist ein weltbekannter Futurist, Influencer und Vordenker in den Bereichen Wirtschaft und Technologie mit einer Leidenschaft für den Einsatz von Technologie zum Wohle der Menschheit. Er ist Bestsellerautor von 20 Büchern, schreibt eine regelmäßige Kolumne für Forbes und berät und coacht viele der weltweit bekanntesten Organisationen. Er hat über 2 Millionen Social-Media-Follower, 1 Million Newsletter-Abonnenten und wurde von LinkedIn als einer der Top-5-Business-Influencer der Welt und von Xing als Top Mind 2021 ausgezeichnet.

Bernards neueste Bücher sind ‘Künstliche Intelligenz im Unternehmen: Innovative Anwendungen in 50 Erfolgreichen Unternehmen’

View Latest Book

Follow Me

ChatGPT Gets A Memory – Here’s All You Need To Know About This Groundbreaking Innovation

26 February 2024

One of the frustrations with ChatGPT (and other generative AI chatbots) is that they don’t remember what we’ve said to them in previous sessions. This means starting from scratch with each new chat, teaching it about yourself, your business or anything you want it to know that it won’t find in its training data or through web browsing.

Well, it looks like all that is about to change. In what could prove to be its most significant update so far, OpenAI – the creators of ChatGPT – has just announced that it is to be given a memory.

But while I think this will prove to be hugely helpful for the millions of us who use it every day, it also raises some important concerns. How reliable will this memory be? What does it mean for data privacy? And are we ready for AI that can develop long-term memories, bringing them yet another step closer to human intelligence?

ChatGPT Gets A Memory – Here’s All You Need To Know About This Groundbreaking Innovation | Bernard Marr

Why Does ChatGPT Need Memory?

Just as with the addition of web browsing to ChatGPT’s capabilities last year, the addition of memory is more than just a regular incremental update. It could potentially change its behavior and capabilities in many ways.

So far, when ChatGPT generates a response, all of the information it has to consider comes from three data sources: It’s training data, the user’s input during the current session, and (if using web browsing mode) the internet.

Effectively, this update adds a fourth source – a long-term memory store that’s persistent between sessions and holds information that could make its replies in future chats more valuable. This could include, for example, the user’s name, their occupation, or their personal likes and dislikes.

Having this long-term memory as an additional source of information means users won’t have to repeatedly input this data every time they start a new session.

This should mean there will be less need for lengthy, detailed prompts that have to be re-entered every session in order to ensure it gives consistent output.

The Context Window

The context window is the technical term for all of the information that ChatGPT can “see” when it creates its responses.

If you’ve ever had a long chat with it and noticed that eventually it starts to forget things you’ve already said, that’s because you’ve run out of space in the context window. GPT-4 – ChatGPT’s most powerful model – has a context window of 8,192 tokens.

OpenAI hasn’t yet said whether this new long-term memory will be loaded into the existing context window, or if the context window will be expanded, making it effectively “free” information.

Expanding the amount of information that ChatGPT can address in a conversation means it will be able to carry out longer, more complex and more detailed tasks.

How Will This Improve Generative AI?

There are a ton of ways in which giving generative AI long-term memory could improve it as a tool:

· It means it could improve its ability to learn over time, as it stores information from past interactions and uses it to inform future conversations.

· It can make its responses more personal, as it learns about the user and understands specifics about how they like to work and solve problems.

· Conversations will have improved continuity, as it remembers facts and information from previous chats without having to be reminded.

· It comes closer to being able to provide responses that display emotional intelligence, as it can build up a long-term understanding of users’ emotional responses.

· It can become better at making decisions, as it remembers how previous actions and interactions affected results and outcomes.

All of this could also help us to foster a deeper sense of connection with AIs, ultimately letting us make better decisions on matters of trust.

But What Do We Have To Worry About?

With all of the benefits, there are also a number of important concerns that have to be addressed.

The most pressing is probably around data privacy and security. Due to the nature of the information that we will want it to store, most of this new data will be personal information – things that are specific to us as users and human beings. For example, OpenAI’s press release says that the tool will avoid actively recalling sensitive data, such as your health information, unless users specifically request it to do so.

It also says it will give users granular control over what information can be retained and what information can be fed back to it in order to better train its systems. This sounds good, but we have yet to see how it will work in practice. We can only hope that other AI tools that are now rushing to add memory will be so conscientious, too.

There are also ethical concerns around deciding what an AI should remember or forget. Even if the user is in control, the tool itself may still have to make decisions when it comes to personal information that relates to other people.

Another concern, perhaps more long-term, is how it will affect the way we use technology in general. Does this bring us a step closer to AGI? Memory is a critical feature of natural human intelligence, and although ChatGPT has always had a memory of sorts – its training data could be considered as such – this takes things a whole step further by allowing it to remember things about people as individuals. Coming to terms with the full ethical and cultural implications of this will be a complex task.

In whatever way we end up addressing these issues, one certainty is that we’ll remember this as an important development in the history of AI, and now it looks like AI will remember it, too.

Business Trends In Practice | Bernard Marr
Business Trends In Practice | Bernard Marr

Related Articles

How Generative AI Will Accelerate Other Cutting-Edge Technologies

Generative AI doesn’t exist in a vacuum. The rapid advancements we’ve seen in generative AI over the past year or so have been made possible by other tech breakthroughs.[...]

The Future Of Banking: Morgan Stanley And The Rise Of AI-Driven Financial Advice

Generative AI, the technology made famous by ChatGPT, will profoundly change the landscape of banking operations.[...]

Sex And Intimacy In The Generative AI Era

Sex and technology have long been intertwined – millions of us use dating apps to find partners, and some of the earliest commercial online activity revolved around pornography.[...]

Generative AI Sucks: Meta’s Chief AI Scientist Calls For A Shift To Objective-Driven AI

In a landscape where generative AI is hailed as the frontier of technological innovation, Yann LeCun, Chief AI Scientist at Meta, presents a contrarian viewpoint that challenges the status quo.[...]

Instacart Harnesses Generative AI To Revolutionize Grocery Delivery Experience

Grocery delivery and pickup service Instacart is not shy about adopting new technologies. So, it makes sense that the company has embraced generative AI across the business.[...]

Responsible AI: Why Privacy Is An Essential Element

Today, people often talk about “responsible” AI use, but what do they really mean?[...]

Sign up to Stay in Touch!

Bernard Marr is a world-renowned futurist, influencer and thought leader in the fields of business and technology, with a passion for using technology for the good of humanity.

He is a best-selling author of over 20 books, writes a regular column for Forbes and advises and coaches many of the world’s best-known organisations.

He has a combined following of 4 million people across his social media channels and newsletters and was ranked by LinkedIn as one of the top 5 business influencers in the world.

Bernard’s latest book is ‘Generative AI in Practice’.

Sign Up Today

Social Media

0
Followers
0
Followers
0
Followers
0
Subscribers
0
Followers
0
Subscribers
0
Yearly Views
0
Readers

Podcasts

View Podcasts