Prospects and Pitfalls in Combining Eye Tracking Data and Verbal Reports

Helle, Laura

doi:10.14786/flr.v5i3.254

Cited by 11 publications

(11 citation statements)

References 34 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This method enabled the researchers to compare the knowledge used in visual diagnosis between different expertise groups and across ECG traces varying in difficulty, as well as between the think-aloud protocols and explanation protocols that were collected a week later. In this special issue, Helle (2017) discusses the relationship between eye tracking data and verbal data. …”

Section: Think-aloud Protocolsmentioning

confidence: 99%

Examining Expertise Using Interviews and Verbal Protocols

Wiel

2017

FLR

View full text Add to dashboard Cite

To understand expertise and expertise development, interactions between knowledge, cognitive processing and task characteristics must be examined in people at different levels of training, experience, and performance. Interviewing is widely used in the initial exploration of domain expertise. Work and cognitive task analysis chart the knowledge, skills, and strategies experts employ to perform effectively in representative tasks. Interviewing may also shed light on the learning processes involved in acquiring and maintaining expertise and the way experts deal with critical incidents. Interviews may focus on specific tasks, events, scenarios, and examples, but they do not directly tap the representations involved in task performance. Methods that collect verbal protocols during and immediately after task performance better probe the ongoing processes in representing problems and accomplishing tasks. This article provides practical guidelines and examples to help researchers to prepare, conduct, analyse, and report expertise studies using interviews and verbal protocols that are derived from thinking aloud, dialogues or group discussions, free recall, explanation, and retrospective reports. In a multi-method approach, these methods and other techniques need to be combined to fully grasp the nature of expertise. This article shows how the cognitive processes in data collection constrain data quality and highlights how research questions guide the development of coding schemes that enable meaningful interpretation of the rich data obtained. It focuses on professional expertise and provides examples from medicine including visual tasks. This comprehensive review of qualitative research methods aims to contribute to the advancement of expertise.Keywords: expertise, interviews, verbal protocols, cognitive processing, analysis IntroductionFor this special issue on "Methodologies for studying visual expertise", the present article will discuss the qualitative research methods of interviews and verbal protocols to examine expertise and expertise development. This article aims to guide students, practitioners, and researchers new to the field of expertise research, or these types of qualitative research, when and how to use these methods to answer their research questions. Starting from a theoretical framework of expertise and cognitive processing in task performance, this article provides practical guidelines so that researchers can prepare, conduct, analyse, and report expertise studies using interviews and verbal protocols. The rationale behind the methods, as well as their strengths and weaknesses, are explained to understand how procedures should be designed to maximise the quality of the data. Although these guidelines for research are applicable to all expertise domains, the focus here is on professional expertise. Most examples will be drawn from medical expertise research, as it has a long-standing tradition of using diverse methods of verbal protocols, and includes various areas of visual expertise. Thi...

show abstract

Section: Think-aloud Protocolsmentioning

confidence: 99%

Examining Expertise Using Interviews and Verbal Protocols

Wiel

2017

FLR

View full text Add to dashboard Cite

show abstract

“…Van de Wiel's article (2017) does a great job in showing how verbal methods can be used in showing reasoning lines and knowledge application by medical experts, intermediates, and novices. It also shows that the validity of verbal methods depends a lot on the vocabulary mastered by the participants, the skill of the researcher to identify references to visual qualities (Helle (2017) refers to Ericsson's (2006) "non-verbal thoughts", captured by briefs labels and referents), and on the successfulness of separating perception of features of the image (if necessary by means of additional methods such as pointing or drawing) from the interpretation of patterns of features in the protocols. The usefulness of verbal methods, stand-alone or in combination with eye-tracking, also depends on a couple of other things: the kind of visual information involved, and -not surprisingly -the research question.…”

Section: Verbalisations -The Working Memory Outputmentioning

confidence: 99%

“…Images of local conditions may show isolated, discernible lesions that can be pointed at, but other disease processes only show themselves in the qualities of the image (e.g., 'cloudy' or 'milky'; see Kok et al, 2012). These differences in visual qualities of the domain under investigation have implications for vocabulary building, and thus for the usefulness of verbal reports generated by participants of different expertise levels (see Van de Wiel, 2017), and for foveal detection, and thus for the usefulness of eye-tracking (see Helle, 2017).…”

Section: Verbalisations -The Working Memory Outputmentioning

confidence: 99%

Unboxing the Black Box of Visual Expertise in Medicine

Jarodzka

Boshuizen

2017

FLR

View full text Add to dashboard Cite

show abstract

“…From a methodological point of view, it would be tempting to criticize the neglect to use eye movement recordings; this would have allowed highly specific, quantifiable measures of perceptual activity. Yet, verbal protocols can also be used as indicators for visual expertise (Helle, 2017;Van de Wiel, 2017). Usually, as prototypically shown in this example, protocols are collected for a duration of up to few hours and then are analyzed with a focus on cognitive mechanisms.…”

Section: 3mentioning

confidence: 99%

“…Each article is devoted to one approach (or to a combination of approaches) and discusses its affordances and constraints for empirically analyzing visual expertise. These approaches are: cognitive-neurosciences (Gegenfurtner et al, 2017b), receiver operating characteristics analysis (Krupsinki, 2017), eye tracking (Fox & Faulkner-Jones, 2017), pupillometry (Szulewski, Kelton, & Howes, 2017), the flash-preview moving window paradigm (Litchfield & Donovan, 2017), the combination of eye tracking data and verbal report data (Helle, 2017), the use of interviews and verbal protocols (Van de Wiel, 2017), ethnomethodology (Ivarsson, 2017), and the expert performance approach (Williams, Fawyer, & Hodges, 2017). The special issue closes with two commentaries (Boucheix, 2017;Jarodzka & Boshuizen, 2017).…”

Section: Introductionmentioning

confidence: 99%