A Genetic Algorithm for HMI Test Infrastructure Fine Tuning

Abstract

Human machine interfaces (HMI) have become a part of our daily lives. They are an essential part of a variety of products ranging from computers over smart phones to home appliances. Customer's requirements for HMIs are rising and so does the complexity of the devices. Several years ago, many products had a rather simple HMI such as mere buttons. Nowadays lots of devices have screens that display complex text messages and a variety of objects such as icons. This leads to new challenges in testing, the goal of which it is to ensure quality and to find errors. We combine a genetic algorithm with computer vision techniques in order to solve two testing use cases located in the automated verification of displays. Our method has a low runtime and can be used on low budget equipment such as Raspberry Pi which reduces the operational cost in practice.