Effects of concurrent verbalization on design problem solving

Davies, Simon P.

doi:10.1016/0142-694x(95)90649-z

Cited by 17 publications

(7 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Research, however, has indicated mixed results on this accuracy issue, which remains far from settled. For example, concurrent verbalisations of design activity have been shown to map poorly onto the behaviour that the descriptions were intended to characterise [12], whilst little effect on veridicality was evident in children's concurrent reports of subtraction processes [27].…”

Section: Inaccuracymentioning

confidence: 99%

Cueing Retrospective Verbal Reports in Usability Testing Through Eye-Movement Replay

Eger

Ball

Stevens

et al. 2007

Electronic Workshops in Computing

View full text Add to dashboard Cite

An experimental validation is presented of a novel method for usability testing that entails the playback of dynamic eyetracking data to cue the elicitation of retrospective verbal reports. Participants in our study produced: (1) think-aloud reports during an online search task, and (2) retrospective reports during another online search task, with reports being cued by the playback of either the screen capture of events or the participant's own eye-movements. Task-completion times and response rates were recorded for all reporting methods. Fewer participants completed the search task whilst thinking aloud, indicating the reactivity of this technique. Verbal transcripts were coded for instances of usability problems. The eye-cued method identified more usability problems than the think-aloud or screen-cued methods. A significant interaction between search engine type and retrospective cue type suggests that the value of the eye-cue method for eliciting usability problems may be greatest with more complex search environments. Our results demonstrate that when cued appropriately, retrospective reports may be less reactive and more informative than other verbalisation techniques.

show abstract

Section: Inaccuracymentioning

confidence: 99%

Cueing Retrospective Verbal Reports in Usability Testing Through Eye-Movement Replay

Eger

Ball

Stevens

et al. 2007

Electronic Workshops in Computing

View full text Add to dashboard Cite

show abstract

“…The activities that are degraded by verbalization include insight problem solving, but not noninsight problem solving (Schooler & Melcher, 1994;Schooler, Ohlsson, & Brooks, 1993). Davies (1995), discussing an experiment on software design, and Lloyd, Lawson, and Scott (1995), discussing an experiment designing a bicycle rack, present evidence that verbal protocol experiments distort normal design behavior. Visser (1992), in her discussion of the applicability of protocol analysis methodology to design, notes that Ericsson and Simon (1980) remark that "producing verbal reports of information directly available in propositional [i.e.…”

Section: Using Verbal Protocols To Study Design Thinkingmentioning

confidence: 99%

Adaptation of Sources of Inspiration in Knitwear Design

Eckert¹,

Stacey²

2003

Creativity Research Journal

View full text Add to dashboard Cite

In an experimental study of designing by adaptation, professional and student knitwear designers were videotaped designing sweaters based on a Persian rug or a 19th century tapestry. The designers used a range of source-triggered and goal-directed adaptation strategies to create adaptations ranging from the closest possible translations into the medium to radical transformations of abstract characteristics. While each strategy sometimes led to each type of adaptation, the source-triggered strategies were predominant for the easy-to-adapt source (the rug) and typically led to close adaptations; while the goal-directed strategies were more common for the more difficult source (the tapestry), and more often led to more radical transformations of the source. The professional designers made more use of goal-directed strategies than the student designers. The study supports the view that creative behavior can usefully be described in terms of consistent patterns resulting from both task demands and from cognitive capacities and learned skills.

show abstract

“…Van Someren et al [6] show that thinking aloud stresses all parts of the cognitive system and thus, slows down not only the eye movements but also the exploration and learning process. Davies [7] states that concurrent think-aloud even influences the course of action and the subject changes the order of performing the task. However, in complex tasks concurrent think-aloud can be essential because it provides the momentous perspective.…”

Section: Think-aloud Methods In Researchmentioning

confidence: 99%

Combination of Eye Tracking and Think-Aloud Methods in Engineering Design Research

Ruckpaul

Fürstenhöfer

Matthiesen

2015

Design Computing and Cognition '14

View full text Add to dashboard Cite

In order to understand the engineers' behavior while designing it needs to be revealed how the designer perceives function-shape-relations of a technical system. Eye tracking is a adequate method to observe the proceedings of the human analyzing technical systems. However, further information for concluding on the designer's perception is needed. Well-established methods in order to elicit further implicit and tacit knowledge are think aloud approaches. The combination thinkaloud and eye tracking is not yet observed in detail; especially how think-aloud influences the eye movements and which additional data is gained in the context of engineering design research. This paper presents an eye tracking study, which compares two think-aloud methods, concurrent and retrospective think-aloud, in combination with eye tracking. The results show no significant influence on the eye movements. However, the two think-aloud approaches generate differing contents of verbalizations and complement the recorded gaze data with different scopes.

show abstract

Effects of concurrent verbalization on design problem solving

Cited by 17 publications

References 15 publications

Cueing Retrospective Verbal Reports in Usability Testing Through Eye-Movement Replay

Cueing Retrospective Verbal Reports in Usability Testing Through Eye-Movement Replay

Adaptation of Sources of Inspiration in Knitwear Design

Combination of Eye Tracking and Think-Aloud Methods in Engineering Design Research

Contact Info

Product

Resources

About