AI Case Study

Ubisoft detects 60% of video game coding errors and recommends solutions in real-time using machine learning

The gaming company Ubisoft has introduced an AI tool to prevent coding errors made by game developers which result in bugs. The tool identifies where in the code the problems are as well, along with the outcomes of the coding errors and suggestions on how to fix them.

Industry

Consumer Goods And Services

Entertainment And Sports

Project Overview

From Wired: "Dubbed Commit Assistant, the goal of the AI system is to catch bugs before they're ever committed into code, saving developers time and reducing the number of flaws that make it into a game before release. Commit Assistant with roughly ten years' worth of code from across Ubisoft's software library, allowing it to learn where mistakes have historically been made, reference any corrections that were applied, and predict when a coder may be about to write a similar bug." Games Industry Biz reports: "When a programmer adds new code to a game, Commit Assistant is intended to flag parts of the code that are introducing bugs... it also tells devs what the apparent issue would be, and suggests a fix for it."

Reported Results

Technical results from Games Industry Biz: "Ubisoft claims it catches 6 out of 10 bugs accurately, and has a 30% false alarm rate, and as developers use it more and it re-trains itself, the expectation is that the system will flag bugs with higher confidence and reduce the false alarm rate". However, in terms of implementation Ubisoft is "only starting to pollinate Commit Assistant to its development teams and, so far, there's no usage data on how much it's impacting game creation".

Technology

"It analyzes bugs and regressions that were added to code previously and creates a "signature," checking what parts of the program the new code is touching and estimating how likely that is to produce problems." (Games Industry Biz)

Function

Information Technology

Quality Assurance

Background

In the creation of video games "eliminating bugs during the development phase requires massive teams and can absorb as much as 70 per cent of costs". (Wired)

Benefits

Data

Code from across the Ubisoft software library spanning 10 years