A constraint satisfaction approach to predicting skilled interactive cognition

Vera, Alonso; Howes, Andrew; McCurdy, Michael; Lewis, Richard L.

doi:10.1145/985692.985708

Cited by 21 publications

(31 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Consistent with theories and approaches to predictive modeling [8,13,14], participants exhibit evidence of perceptual and motor processing that is overlapped and interleaved to maintain very good parallel performance on two demanding tasks. The high-speed coordination of eye movements and perceptual processing between the two visual displays, both to classify blips but also to maintain situational awareness, demonstrates a complex interleaving of processing between the two tasks.…”

Section: Overlapped Performancesupporting

confidence: 55%

“…It is encouraging, given the goal of predicting human performance in time-critical dual task situations, to see that the timing of many of the eye movements, such as the eyesto-target times in Figure 9, could likely be predicted based on straightforward task analysis and an understanding of fundamental human perceptual-motor constraints (such as built into [14]). …”

Section: Examining Blips Prior To Classificationmentioning

confidence: 99%

“…Computational cognitive models for predicting human performance in HCI tasks (such as [8,13,14]) need to accurately account for multitasking performance. Cognitive models often focus on cognitive strategies, the deliberate though often subconscious plans for coordinating and overlapping perceptual, decision, memory, and motor processing to do a task.…”

Section: Introductionmentioning

confidence: 99%

“…One approach to modeling skilled human-computer interaction uses constraint satisfaction to build strategies based on individual information processing steps (such as single eye movements) or substrategies (assemblies of several steps) [14]. More data is needed to explore how well a constraint-based approach such as this can predict dual task performance.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Knowing where and when to look in a time-critical multimodal dual task

Hornof

Zhang

Halverson

2010

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

Human-computer systems intended for time-critical multitasking need to be designed with an understanding of how humans can coordinate and interleave perceptual, memory, and motor processes. This paper presents human performance data for a highly-practiced time-critical dual task. In the first of the two interleaved tasks, participants tracked a target with a joystick. In the second, participants keyed-in responses to objects moving across a radar display.Task manipulations include the peripheral visibility of the secondary display (visible or not) and the presence or absence of auditory cues to assist with the radar task. Eye movement analyses reveal extensive coordination and overlapping of human information processes and the extent to which task manipulations helped or hindered dual task performance. For example, auditory cues helped only a little when the secondary display was peripherally visible, but they helped a lot when it was not peripherally visible.

show abstract

Section: Overlapped Performancesupporting

confidence: 55%

Section: Examining Blips Prior To Classificationmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Knowing where and when to look in a time-critical multimodal dual task

Hornof

Zhang

Halverson

2010

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…(Computing this intersection can be profitably viewed as a constraint satisfaction problem; Howes et al, 2004;Vera et al, 2004. ) Step 3, inferring utility, computes the payoff for behaviors in this space with respect to an explicit utility function.…”

Section: Overview Of Each Step In the Methodsmentioning

confidence: 99%

Rational adaptation under task and processing constraints: Implications for testing theories of cognition and action.

Howes

Lewis

Vera

2009

Psychological Review

Self Cite

152

214

View full text Add to dashboard Cite

The authors assume that individuals adapt rationally to a utility function given constraints imposed by their cognitive architecture and the local task environment. This assumption underlies a new approach to modeling and understanding cognition-cognitively bounded rational analysis-that sharpens the predictive acuity of general, integrated theories of cognition and action. Such theories provide the necessary computational means to explain the flexible nature of human behavior but in doing so introduce extreme degrees of freedom in accounting for data. The new approach narrows the space of predicted behaviors through analysis of the payoff achieved by alternative strategies, rather than through fitting strategies and theoretical parameters to data. It extends and complements established approaches, including computational cognitive architectures, rational analysis, optimal motor control, bounded rationality, and signal detection theory. The authors illustrate the approach with a reanalysis of an existing account of psychological refractory period (PRP) dual-task performance and the development and analysis of a new theory of ordered dual-task responses. These analyses yield several novel results, including a new understanding of the role of strategic variation in existing accounts of PRP and the first predictive, quantitative account showing how the details of ordered dual-task phenomena emerge from the rational control of a cognitive system subject to the combined constraints of internal variance, motor interference, and a response selection bottleneck.Keywords: rational adaptation, bounded optimality, cognitive architecture, theory comparison, response ordering, dual taskThe extraordinarily flexible and adaptive nature of human behavior presents both unique opportunities and unique challenges for developing a science of the mind and brain. On the one hand, treating the mind as an adaptive system opens up possibilities for deep explanations of behavior that are grounded primarily in the observable structure and contingencies of the task environment, along with an assumption of rationality or optimal adaptation. This insight is the point of departure for a range of approaches to understanding cognition and perception, including rational analysis and related Bayesian approaches (Anderson, 1990;Berthier, Rosenstein, & Barto, 2005;Bogacz, Brown, Moehlis, Holmes, & Cohen, 2006;Chater & Oaksford, 1999;Geisler, 2003;Tenenbaum, Griffiths, & Kemp, 2006), optimal motor control approaches (Maloney, Trommershäuser, & Landy, 2007;Meyer, Abrams, Kornblum, Wright, & Smith, 1988;Trommershäuser, Maloney, & Landy, 2003a, 2003bReichle & Laurent, 2006), as well as signal detection theory and ideal observer analysis (Green & Swets, 1966;Swets, Tanner, & Birdsall, 1961;Tanner & Swets, 1954). For example, in the arena of perception, ideal observer models demonstrate that human performance on some very simple discrimination tasks is limited only by external photon noise (Geisler, 2003). In the arena of memory, the decay over time of i...

show abstract

Foundations of CSP

Ghédira¹,

Dubuisson²

2013

Constraint Satisfaction Problems

View full text Add to dashboard Cite

A constraint satisfaction approach to predicting skilled interactive cognition

Cited by 21 publications

References 9 publications

Knowing where and when to look in a time-critical multimodal dual task

Knowing where and when to look in a time-critical multimodal dual task

Rational adaptation under task and processing constraints: Implications for testing theories of cognition and action.

Foundations of CSP

Contact Info

Product

Resources

About