Artificial intelligence developed by the likes of Google's DeepMind and Elon Musk's OpenAI is taught within the confines of game worlds – including navigating around mazes, dodging deadly cliffs, playing laser tag and flying through space.
In a mission to build a general AI capable of solving any problem put in front of it, DeepMind is open-sourcing its game code to everyone. The software and 14 levels from DeepMind Labs will be put on GitHub later this week.
And, not to be outdone, Elon Musk's own OpenAI is also releasing its own 'computer training ground' called Universe. Universe is open-source software that supports Gym; OpenAI's toolkit for testing its algorithms which help software play games, for example, using a reward scheme.
Videos of the gaming world released alongside the source code show AI agents (which are represented by large orbs) collecting pieces of fruit, walking through corridors, climbing stairs, exploring space, and navigating their way around a complex digital maze. Open-sourcing the software will allow AIresearchers to develop their own levels, test their own AI on the platforms and verify what the Google-owned firm has used it for. ("You could make huge mazes with keys and doors and all sorts of challenges")."The [AI] agents are wandering around in this world and there are all sorts of different objects they can see: walls, doorways, pieces of fruit and other objects they can pick up," Shane Legg, one of DeepMind's co-founders, told WIRED. "It's up to them to learn how to behave in this environment and solve the problems we can give to them."
"It's much closer to the real-world," Legg continued. "We live in a 3D environment, if we want artificial intelligence systems that can perceive the real-world; to move around in that environment; interact with it; and solve problems, this is a virtual proxy to that."
For gamers, the first-person game views may look familiar. This is because the game engine used to create it is from Quake III Arena – released 17 years ago. "The world," which has been further developed by Deepmind, "is rendered with rich science fiction-style visuals": a paper published alongside the source code says.
Within DeepMind, the Lab, which has been used for a "couple of years" and is still being developed, has been used to advance its own machine learning. The game world has helped teach AI to have a short-term memory (like navigating the London Underground), episodic memory (similar to how dogs and humans remember), image detection and navigation skills.The aged-game engine was purposefully picked. "There are advantages to using relatively old software," Legg explained. "They were designed to run on relatively low-powered computers and get quite good performance". The old engine is resource efficient and doesn't need to be run on a GPU.
Legg concluded: "Navigation brings together a number of different challenges: you may want to remember the structure of a maze and then use what you have remembered and learnt about the structure to plan your way through the maze and solve a problem."
Back in April, Elon Musk's artificial intelligence firm similarly created a 'gym' to let developers train their AI systems on games and challenges.
The open source code provides "environments" in which developers can test their AIs. These environments include 59 Atari games, with Alien, Pong, Asteroids and Pac-Man all making an appearance.
OpenAI also compiles a leaderboard of the most successful systems. Unlike traditional leaderboards, however, these won't be a list of high scores – instead, success will be based on how versatile the systems are.
No comments:
Post a Comment