Jack Rae and Timothy Lillicrap
A New Model and Dataset for Long-Range Memory
A good and useful memory is all about knowing what to forget.
One of the challenges for AI systems is that, as they become more sophisticated and swallow up larger and larger databases, they need ever more processing power to achieve marginally better results. Even the biggest server farms have their limits. Yet people don’t want to wait for more than a few microseconds, so a major task in AI science is to determine how to reduce mountains of crude data to hills of important data. Google’s DeepMind project’s latest proposal is to use sleep as an inspiration for data processing. Your Eureka moment might have come one afternoon during a power nap.
About the Authors
Jack Rae and Timothy Lillicrap are staff researchers at Google’s DeepMind project in London.
In our Journal
4 months ago
The Four Horsepersons of the AI Apocalypse: Part One
Why is success with Artificial Intelligence (AI) so elusive, and what can you do about it? In my three decades of working with data, mathematics, computers, and the digital Bermuda Triangle that exists between them, I have come to appreciate many of the difficulties we humans face in putting technology to work. This is particularly […]
Comment on this summary