Milestone is proud to introduce A.N.N.A., an acronym for Artificial Neural Network Agent, a revolutionary Artificial Intelligence based on neural networks that will enable an incredible level of challenge for players, with cleverer and faster opponents that will take advantages of each mistake. MotoGP™19 will be the first Milestone game where A.N.N.A. will debut, on June 6th on PlayStation®4, Xbox One, Windows PC®/STEAM on June 27th on Nintendo Switch™
A.N.N.A is the result of more than 2 years of joint development with Orobix’s engineers and data scientists, a company specializing in engineering Artificial Intelligence solutions, and it’s a new paradigm rather than traditional AI, where every action is planned by a developer in advance.
With neural network-based AI the approach is completely different; developers don’t dictate preset behaviors, they provide AI a goal and tools available to reach it. Then, through a complex rewarding system, they “teach” AI which behaviors are useful to reach the goal and which are counter-productive; it will be the AI itself that learns which are the best actions to take to reach its goal.
This machine learning approach is called reinforcement learning and it allows one to obtain an AI that is extremely aware of the surrounding environment and consequences of its actions, differently from other approaches focused on observation and imitation of the human behavior without a real awareness of what the AI is doing. In the first case the game strategy results from the interaction between AI and the environment, in the second one it’s imposed.
The training phase based on reinforcement learning lasts several months, during which developers can simulate more than 200.000 races in a single day, more than a professional rider can run in his entire life. In the training phase, the main activities of the Neural AI can be divided into 2 moments: the exploration phase, where AI understands if consequences of its actions are useful or not to reach its goal, and the exploitation phase, where AI take advantage of its experience and knowledge to get the best reward available.
The result is an extremely realistic and natural driving behavior, with driving systems, manoeuvres and techniques very similar to those made by a professional rider. On the performance side, Neural AI lap times are very close to professional rider’s lap times in real life, and much faster than a traditional AI system. Behavior in group is aggressive but fair, with AI always ready to take advantages of any mistakes. However, to match all payers’ needs, the difficulty level will be customizable. While for our MotoGP™ hardcore fans, the challenge has never been harder!
“We’re facing one of the biggest innovations in Milestone’s history” said Luisa Bixio, CEO, Milestone. “The amazing work done by our engineers, in collaboration with Orobix, it’s a great example of two independent companies innovating in an industry that is often controlled by big corporations. It’s a demonstration of creativity, passion and capacity to innovate”.
Michele Caletti, MotoGP™19 Producer, said “we developed the game following feedback we received from our passionate community. One of the most recurring requests were a harder challenge in single player and a more natural behavior of the AI. With neural networks we reached both these goals, with results above our best expectations. I do think this is just the first step on an innovation path where neural networks will become crucial in our games development”.
Luca Antiga, Chief Technical Officer in Orobix, said “it was exciting to work closely with Milestone engineers and designers and to see a new generation of AI evolving. It’s really motivating to know that the technology we developed for many months will be on PCs and consoles all over the world. Here in Orobix we’re already working on other applications of this technology in different industries, such as medical and manufacturer”.
MotoGP™19 will be available on June 6th on PlayStation®4, Xbox One, Windows PC®/STEAM and on June 27th on Nintendo Switch™
