Using Reinforcement Learning for Load Testing of Video Games

Abstract

Different from what happens for most types of software systems, testing video games has largely remained a manual activity performed by human testers. This is mostly due to the continuous and intelligent user interaction video games require. Recently, reinforcement learning (RL) has been exploited to partially automate functional testing. RL enables training smart agents that can even achieve super-human performance in playing games, thus being suitable to explore them looking for bugs. We investigate the possibility of using RL for load testing video games. Indeed, the goal of game testing is not only to identify functional bugs, but also to examine the game's performance, such as its ability to avoid lags and keep a minimum number of frames per second (FPS) when highdemanding 3D scenes are shown on screen. We define a methodology employing RL to train an agent able to play the game as a human while also trying to identify areas of the game resulting in a drop of FPS. We demonstrate the feasibility of our approach on three games. Two of them are used as proof-of-concept, by injecting artificial performance bugs. The third one is an open-source 3D game that we load test using the trained agent showing its potential to identify areas of the game resulting in lower FPS.

Towards Agent-Based Testing of 3D Games using Reinforcement Learning

“…The Wuji framework [32] employs an RL policy together with evolutionary multi-objective optimization to encourage exploration and high game state coverage in two commercial combat games. [29] investigates the possibility of using RL for load testing video games, i.e., to examine the game's performance. [5] has used Deep RL to increase test coverage,in particular, to find exploits, test map difficulty, and to detect common problems that arise in the testing of first-person shooter (FPS) games.…”