Modeling user selection in quality diversity

Abstract

The initial phase in real world engineering optimization and design is a process of discovery in which not all requirements can be made in advance, or are hard to formalize. Quality diversity algorithms, which produce a variety of high performing solutions, provide a unique chance to support engineers and designers in the search for what is possible and high performing. In this work we begin to answer the question how a user can interact with quality diversity and turn it into an interactive innovation aid. By modeling a user's selection it can be determined whether the optimization is drifting away from the user's preferences. The optimization is then constrained by adding a penalty to the objective function. We present an interactive quality diversity algorithm that can take into account the user's selection. The approach is evaluated in a new multimodal optimization benchmark that allows various optimization tasks to be performed. The user selection drift of the approach is compared to a state of the art alternative on both a planning and a neuroevolution control task, thereby showing its limits and possibilities.

Artificial Intelligence in Elite Sports—A Narrative Review of Success Stories and Challenges

“…It also provides an intuition of what options are available. QD has previously been used in motion planning in robotics, aerodynamic shape optimization, and urban planning, among others (Cully et al, 2015 ; Gaier et al, 2017a , b ; Hagg et al, 2018 , 2019 ; Urquhart and Hart, 2018 ).…”

Automatic Generation of Adversarial Metamorphic Malware Using MAP-Elites

“…Following the approach described in previous literature, as the theoretical optimum is unknown, we take the value for the best solution possible to be the single best solution obtained from any run of either algorithm. This is given 8…”

“…MAP-Elites algorithm traverses a high-dimensional search space in search of the best solution at every point of a feature space with low dimension defined by the user and is one of a new raft of quality-diversity optimisation algorithms [14] that aim to return an archive of diverse, high-quality behaviors in a single run. The algorithm has multiple documented successes in evolutionary robotics [13], but also in design applications, car wing-mirror design [8].…”