A systematic literature review on the usage of eye-tracking in understanding process models

Abstract

PurposeBusiness process modeling can involve multiple stakeholders, so it is natural that problems may occur during the designing and understanding processes. One way to perceive these problems is to evaluate the comprehension of business process models through the collection of data related to the readers' eye movement via an eye-tracking device. The purpose of this paper is to provide a comprehensive overview of the use of eye-trackers in understanding process models and to offer a research roadmap to challenge the community to address the identified limitations and open issues that require further investigation.Design/methodology/approachTo achieve this goal, Systematic Literature Review (SLR) was performed following good practices from the Evidence-Based Software Engineering's (EBSE) field.FindingsThis study resulted in 10 primary studies selected for analysis and data extraction, from the 1,482 initially retrieved. The major findings indicate that the business process community still benefits little from the use of eye-tracking, e.g. not offering sufficient support for inexperienced designers and not having an explicit standardization in its use. These and other findings are synthesized in a research roadmap which results would benefit researchers and practitioners.Originality/valueIn the studies found, the methods used to explore eyes' movement in process models' comprehension analysis were presented as an advantage of the current study. Additionally, another aspect presented in this SRL as an originality is presenting a set of open questions, suggesting valuable topics for future research through a research script (research roadmap).

Don’t overthink it: The paradoxical nature of expertise for the detection of errors in conceptual business process models

“…Past studies using eye-tracking in process models comprehension tasks found that visual attention and scan paths are influenced by the past work experience and personal knowledge (Petrusel et al, 2017;Zimoch et al, 2018b). However, these results are inconsistent as other research found that expertise had no immediate effect on model comprehension (Zimoch et al, 2018a;Batista Duarte et al, 2021). As the eye tracking literature is not mature enough in the field of process model comprehension, we have extended our literature review to include studies identifying the differences in visual attention between experts and novices in different types of search tasks.…”

“…Recent studies have used the eye-tracking methodology to investigate the understanding of process models in 10.3389/fnins.2022.982764 different comprehension tasks (Batista Duarte et al, 2021). As comprehension of process models cannot be directly observed and measured; eyetracking studies use the visual attention measures paired with comprehension correctness to identify patterns linking the scan path or cognitive load to model understanding (Petrusel and Mendling, 2013;Batista Duarte et al, 2021).…”

“…Recent studies have used the eye-tracking methodology to investigate the understanding of process models in 10.3389/fnins.2022.982764 different comprehension tasks (Batista Duarte et al, 2021). As comprehension of process models cannot be directly observed and measured; eyetracking studies use the visual attention measures paired with comprehension correctness to identify patterns linking the scan path or cognitive load to model understanding (Petrusel and Mendling, 2013;Batista Duarte et al, 2021). As the complexity of the tasks increases (by increasing the model complexity, modeling language complexity, or reducing the participant's knowledge of the process), the fixation duration and the total number of fixations generally increase (Petrusel et al, 2017;Zimoch et al, 2018b;Tallon et al, 2019).…”

“…Using ‘think-aloud’ research methods, challenges were identified in the areas of lack of domain knowledge, lack of BPMN knowledge, unclear inspection criteria, and many false positives found. However, we found no in-depth studies that use eye tracking technologies to analyze human cognition in the inspection of BPMN models ( Batista Duarte et al, 2021 ).…”

Kontestasi Jamaah Masjid Al-Amin Babakan Sari Kiaracondong Kota Bandung

“…Adapun teknik Studi Literatur, peneliti lakukan dengan cara mencari bahan-bahan bacaan yang relevan dengan objek penelitian ini (Duarte et al, 2020). Bahan-bahan bacaan itu dapat berupa buku, artikel jurnal dalam bentuk tercetak yang dapat peneliti dapati di Perpustakaan UIN Sunan Gunung Djati Bandung.…”