Uncovering expertise‐related differences in troubleshooting performance: combining eye movement and concurrent verbal protocol data

Abstract

This study explored the value of eye movement data for uncovering relatively small expertise‐related differences in electrical circuit‐troubleshooting performance, and describes that value in relation to concurrent verbal protocols. Results show that in the ‘problem orientation’ phase, higher expertise participants spent relatively more time, had a shorter mean fixation duration, and fixated more on a major fault‐related component than lower expertise participants. In the ‘problem formulation’ part of the ‘problem formulation and action decision’ phase, the mean fixation duration of the higher expertise participants was longer. In the ‘action evaluation and next action decision’ phase, higher expertise participants spent relatively more time than the lower expertise participants. Over the different phases, only the mean fixation duration of the higher expertise participants differed significantly. The relation between the eye movement and concurrent verbal protocol data is qualitatively described. The results are discussed in perspective of the combined value of eye tracking and concurrent reports for expertise research and instructional design. Copyright © 2005 John Wiley & Sons, Ltd.

How Signaling Principle Affects Learning: An Eye Tracking Study

“…Higher fixation duration on relevant information may result in higher test scores or better performances. Thus, the results of the current study were consistent with the studies arguing that there was a relationship between total fixation duration on relevant information and performances of test scores (Amadieu et al, 2011(Amadieu et al, , 2009Boucheix et al, 2013;Hannus & Hyönä, 1999;Jamet, 2014;Ozcelik et al, 2010;van Gog et al, 2005). In addition to these, results showed that time to first fixation of experimental group were lower than control group.…”

On the Use of Gaze as a Measure for Performance in a Visual Exploration Task

“…The higher the verbalisation score the more similar the gaze pattern. This finding is in line with previous research indicating that there are also differences in gaze patterns where the expertise level is small between novices and experts [18]. For future work, it might be interesting to compare apprentices' gaze patterns not to the average teacher but to the teacher who achieves the highest verbalisation score.…”

Different Perspectives on Retest Effects in the Context of Spatial Thinking: Interplay of Behavioral Performance, Cognitive Processing, and Cognitive Workload

“…For example, participants may learn from test to test (or from item to item) to focus on the relevant parts of the item figures of this particular test, as was demonstrated for Raven's matrices (e.g., Hayes et al 2015;Verguts and Boeck 2002). This is also in accordance with results from studies comparing experts and novices; experts outperform novices in visuospatial tasks by focusing on relevant parts and ignoring irrelevant parts (e.g., Charness et al 2001;Jarodzka et al 2010;van Gog et al 2005). Such results can also be obtained if participants were trained (to "experts") during the experiment (e.g., Canham and Hegarty 2010;Hegarty et al 2010).…”