Model-Based Testing of Infotainment Systems on the Basis of a Graphical Human-Machine Interface

Abstract

Abstract. Automotive infotainment systems were getting more and more features in recent years. The complexity of HMI (human-machine interface) softwares is growing with the increasing requirements for stability, interactions, usabilities and internationalization of the automotive markets. Testing the HMI became a very time consuming and costly task. Because of multiplicity of HMI variants, a better test coverage is a goal for the development process of most manufacturers. Model-based testing is one way to achieve a better test coverage and keep the costs and complexity acceptable. However, the existing research approaches in the area of model-based HMI testing can not satisfy the needs for our testing purposes. In this doctoral thesis a model-based testing approach will be proposed for testing both the logical behavior and the graphical interface of automotive infotainment HMIs. As an important part of the testing approach a test-oriented HMI specification model will be proposed. It is a model, which describes the theoretical behavior of the HMI and contains the necessary information for automated HMI testing. Test generation methods and the design of the tests to be generated will also be proposed. These results can be generally used for testing advanced GUI-driven applications. In the work, some infotainment specific coverage criteria will be defined. Methods will be introduced, how the generated tests can be executed automatically and how the HMI behavior of the system under test can be observed and verified.

Automatically Generating Specification Properties From Task Models for the Formal Verification of Human–Automation Interaction

“…Several researchers [65], [66] have developed different coverage criteria for human-computer and human-automation interfaces. These could be used to generate specification properties for formal interface models for use in formal verification analyses.…”

A Genetic Algorithm for HMI Test Infrastructure Fine Tuning

“…Mateo Navarro et al (2010) examine HMI testing from a software engineering point of view and propose an architecture for graphical user interface (GUI) testing. Duan et al (2010) developed a model-based approach to achieve a high code coverage and to keep the development cost in bounds. Howe et al (1997) exploit planning techniques in order to generate test cases for GUIs using evolutionary methods.…”

Generating phenotypical erroneous human behavior to evaluate human–automation interaction using model checking

“…These models can then be used in a variety of formal analyses to evaluate the HAI. For example: researchers have formulated a number of generic temporal logic properties for evaluating interface usability with a model checker (Abowd et al, 1995; Berstel et al, 2005; Campos and Harrison, 1997, 2009; Paternò, 1997); a variety of techniques have been developed for detecting potential mode confusion 1 in automated systems (Bredereke and Lankenau, 2005; Buth, 2004; Campos and Harrison, 2001, 2011; Degani and Heymann, 2002; Javaux, 2002; Joshi et al, 2003; Leveson et al, 1997; Rushby, 2002; Wheeler, 2007); graph theory can be used to evaluate usability (Thimbleby and Gow, 2007b); methods have been developed for generating test cases that will guarantee coverage of the devices features and displays (Duan et al, 2010; Giannakopoulou et al, 2011); code for implementing a modeled human-computer interfaces can be automatically generated (Berstel et al, 2005); and human-device interfaces can be automatically generated to ensure certain usability properties are maintained (Combéfis et al, 2011; Gimblett and Thimbleby, 2010; Heymann and Degani, 2007). …”