Design of a Cooperative Problem-Solving System for En-Route Flight Planning: An Empirical Evaluation

Layton, Charles; Smith, Philip J.; McCoy, Candace

doi:10.1177/001872089403600106

Cited by 127 publications

(76 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…It has been described as an unjustified assumption of satisfaction in the situation faced, although some improvements could apply (Layton et al, 1994;Parasuraman et al, 1993;Smith et al, 1997). This phenomenon is related to a low level of suspicion and is often correlated with overtrust in automation.…”

Section: Definition Of Complacencymentioning

confidence: 99%

The role of algorithm and result comprehensibility of automated scheduling on complacency

Cegarra¹,

Hoc²

2008

Hum Ftrs & Erg Mfg Svc

View full text Add to dashboard Cite

Several studies have stressed that even expert operators who are aware of a machine's limits could adopt its proposals without questioning them (i.e., the complacency phenomenon). In production scheduling for manufacturing, this is a significant problem, as it is often suggested that the machine be allowed to build the production schedule, confining the human role to that of rescheduling. This article evaluates the characteristics of scheduling algorithms on human rescheduling performance, the quality of which was related to complacency. It is suggested that scheduling algorithms be characterized as having result comprehensibility (the result respects the scheduler's expectations in terms of the discourse rules of the information display) or algorithm comprehensibility (the complexity of the algorithm hides some important constraints). The findings stress, on the one hand, that result comprehensibility is necessary to achieve good production performance and to limit complacency. On the other hand, algorithm comprehensibility leads to poor performance due to the very high cost of understanding the algorithm. C 2008 Wiley Periodicals, Inc.

show abstract

Section: Definition Of Complacencymentioning

confidence: 99%

The role of algorithm and result comprehensibility of automated scheduling on complacency

Cegarra¹,

Hoc²

2008

Hum Ftrs & Erg Mfg Svc

View full text Add to dashboard Cite

show abstract

“…Disuse can decrease automation benefits and lead to accidents if, for instance, safety systems and alarms are not consulted when needed. Another maladaptive attitude is automation bias [33,55,77,88,112], a user tendency to ascribe greater power and authority to automated decision aids than to other sources of advice (e.g. humans).…”

Section: Introductionmentioning

confidence: 99%

The Role of Trust in Human-Robot Interaction

Lewis

Sycara

Walker

2018

Foundations of Trusted Autonomy

153

140

View full text Add to dashboard Cite

“…However, they also found that half of the participants overused the IA support by not recognizing that the IA provided a poor judgment on one trial. Similar acceptance of an incorrect automated judgment was also observed by Layton et al [91].…”

supporting

confidence: 84%

“…There may also be benefits from IA that provides an automated assessment [7], [8], [91]. Bass and Pritchett [7] found that judgment performance improved for an air traffic conflict prediction task when humans were provided with an automated assessment compared to when they were not provided with an automation assessment.…”

mentioning

confidence: 99%

A conceptual framework to guide the design and evaluation of human interaction with information automation to support judgment

Baumgart

View full text Add to dashboard Cite

In critical domains from air traffic control to health care, humans make judgments by using informational cues to assess the true state of the environment. How humans judge environmental conditions is now ubiquitously supported by automation. While prior modeling and analysis has defined levels of automated decision support and methods to evaluate independent human and automated judges, we have yet to develop ways to both support and evaluate human judgment.To address this gap, this research develops a conceptual design and evaluation framework, titled the Expanded Lens Model with Automation (ELMA). To provide design support, ELMA accounts for discrepancies between how cues in the environment are transformed into operator displays via automated processes. The transformation is based upon the desired, hierarchical level of cognitive judgment support, from cue perception, to cue comprehension, to an automated assessment, to explanation of the automated assessment. In addition to design support, ELMA includes quantitative evaluation measures, using multiple linear regression and correlation analysis to characterize the achievement, consistency, and task knowledge of the human judge; potential and accuracy of automation; and predictability of the environment.ELMA's utility is demonstrated through the investigation of two tasks: 1) judging the probability of an air traffic conflict using heading and speed cues and 2) judging the quality of population-based hypertension care using cues on patient outcomes (e.g., blood pressure) and processes (e.g., medications prescribed). Across both tasks, ELMA revealed that when participants were supported at the cognitive level of cue comprehension they achieved significantly higher judgment achievement compared to those supported at the lower level of cue perception. Decomposition of achievement indicated that these differences were predominantly due to the consistency of individuals in executing judgments rather than task knowledge. Additionally, reliability across participants was significantly iv higher for participants with cue perception and cue comprehension support compared to participants with automated assessment support in the quality of hypertension care task.ELMA is a useful tool for systems engineers as it provides both a systematic framework to inform automation design choices and a quantitative method to evaluate human-automation judgment systems.v

show abstract

Design of a Cooperative Problem-Solving System for En-Route Flight Planning: An Empirical Evaluation

Cited by 127 publications

References 11 publications

The role of algorithm and result comprehensibility of automated scheduling on complacency

The role of algorithm and result comprehensibility of automated scheduling on complacency

The Role of Trust in Human-Robot Interaction

A conceptual framework to guide the design and evaluation of human interaction with information automation to support judgment

Contact Info

Product

Resources

About