Models of Automation Surprise: Results of a Field Survey in Aviation

Boer, Robert J. de; Dekker, Sidney

doi:10.3390/safety3030020

Cited by 14 publications

(10 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Moreover, while there were areas where the interface countermeasure drove behavior -evidenced by increased coherent activity, overall, there was no statistically significant hemodynamic response. This effect appears to conform to earlier work concerning the vigilance decrement and signal detection errors (e.g., Parasuraman et al, 1996; Miller and Parasuraman, 2003; De Boer and Dekker, 2017). Such that, even with the interface countermeasure(s) in place, participants were still required to maintain a sufficient level of sustained attention in between events in order to detect the signal.…”

Section: Discussionsupporting

confidence: 89%

“…While automation has increased productivity through a reduction in information-processing and cognitive load, it has also lead to decreased on-task safety and increased incidents during safety-critical operations due to monitoring error. Incidents triggered by on-task monitoring surprise, are often the result of a decrease in operator vigilance and sustained attention (Parasuraman et al, 1996; Miller and Parasuraman, 2003; De Boer and Dekker, 2017). In the new automated workplace, the ability to maintain a vigilant state, characterized as a process of sustained attention or tonic alertness, may become a valuable asset.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Toward a Hybrid Passive BCI for the Modulation of Sustained Attention Using EEG and fNIRS

Karran

Demazure

Léger

et al. 2019

Front. Hum. Neurosci.

View full text Add to dashboard Cite

We report results of a study that utilizes a BCI to drive an interactive interface countermeasure that allows users to self-regulate sustained attention while performing an ecologically valid, long-duration business logistics task. An engagement index derived from EEG signals was used to drive the BCI while fNIRS measured hemodynamic activity for the duration of the task. Participants (n = 30) were split into three groups (1) no countermeasures (NOCM), (2) continuous countermeasures (CCM), and (3) event synchronized, level-dependent countermeasures (ECM). We hypothesized that the ability to self-regulate sustained attention through a neurofeedback mechanism would result in greater task engagement, decreased error rate and improved task performance. Data were analyzed by wavelet coherence analysis, statistical analysis, performance metrics and self-assessed cognitive workload via RAW-TLX. We found that when the BCI was used to deliver continuous interface countermeasures (CCM), task performance was moderately enhanced in terms of total 14,785 (σ = 423) and estimated missed sales 7.46% (σ = 1.76) when compared to the NOCM 14,529 (σ = 510), 9.79% (σ = 2.75), and the ECM 14,180 (σ = 875), 9.62% (σ = 4.91) groups. An “actions per minute” (APM) metric was used to determine interface interaction activity which showed that overall the CCM and ECM groups had a higher APM of 3.460 (SE = 0.140) and 3.317 (SE = 0.139) respectively when compared with the NOCM group 2.65 (SE = 0.097). Statistical analysis showed a significant difference between ECM - NOCM and CCM - NOCM (p < 0.001) groups, but no significant difference between the ECM – CCM groups. Analysis of the RAW-TLX scores showed that the CCM group had lowest total score 7.27 (σ = 3.1) when compared with the ECM 9.7 (σ = 3.3) and NOCM 9.2 (σ = 3.4) groups. No statistical difference was found between the RAW-TLX or the subscales, except for self-perceived performance (p < 0.028) comparing the CCM and ECM groups. The results suggest that providing a means to self-regulate sustained attention has the potential to keep operators engaged over long periods, and moderately increase on-task performance while decreasing on-task error.

show abstract

Section: Discussionsupporting

confidence: 89%

Section: Introductionmentioning

confidence: 99%

Toward a Hybrid Passive BCI for the Modulation of Sustained Attention Using EEG and fNIRS

Karran

Demazure

Léger

et al. 2019

Front. Hum. Neurosci.

View full text Add to dashboard Cite

show abstract

“…In addition, much research has been conducted regarding how to increase situation awareness (Mica R. Endsley & Kaber, 1999;Jipp & Ackerman, 2016) how to avoid the out-of-the-loop problem (David B. Kaber & Endsley, 1997;Mica R. Endsley, 2018), and how to decrease automation surprise (N. Sarter et al, 1997;De Boer & Dekker, 2017).…”

Section: Automationmentioning

confidence: 99%

“…Having different levels of automation in operation together with a human operator can cause automation surprise (N. Sarter et al, 1997;De Boer & Dekker, 2017), meaning that the automation fails in executing or performing its actions which are unexpected for the human operator. This can leave the human operator in confusion and risks.…”

Section: Ironies Of Automationmentioning

confidence: 99%

“…Moreover, operators can misunderstand information provided by automation and technology (Bonini et al, 2001). Aviation has suffered from several incidents due to automation surprises such as undetected behaviour of the autopilot or faulty mental models of the autopilot by the pilots (De Boer & Dekker, 2017;Trippe & Mauro, 2017). More recently, the Lion Air and Ethiopian Airlines crashes of the Boeing 737-Max8 aircraft might be blamed on the lack of the human factors research area in the development of the aircraft, and thus, resulting in automation surprise and loss of situation awareness (Mica R. Endsley, 2019).…”

Section: Ironies Of Automationmentioning

confidence: 99%

See 1 more Smart Citation

Human-automation teamwork : Current practices and future directions in air traffic control

Svensson

2020

Linköping Studies in Science and Technology. Dissertations

View full text Add to dashboard Cite

This dissertation explores the topic of human-automation teamwork in Air Traffic Control (ATC). ATC is a high stakes environment where complex automation is being introduced while the human operator has the legal responsibility. With increasing demands on productivity in various industries (as also in ATC), automation is introduced for efficiency, maintaining safety, and to keep the workload of the human operator within acceptable limits. However, previous research has shown that automation may cause negative effects on the human operator and performance, such as forcing the operator out of the control loop, which might lead to problems or confusion. Previous research suggests a need for strengthening human-automation collaboration where automation is seen as a team member to keep the operator in the loop. In order to achieve such teamwork, the design of the automation needs to be human-centred, i.e. that the automation is designed for the underlying need of the operator.The aim of this dissertation is to explore teamwork in ATC from several angles to understand how the air traffic controllers are working in current ATC environments and how automation could be designed to support humanautomation teamwork. The included studies rely on interviews, simulations, and questionnaires, all with operational air traffic controllers as participants.The results indicate that for both human-human teamwork and humanautomation teamwork, teamwork factors such as adaptability and mutual performance monitoring (knowing what the other team members are doing) are important for the work performance in current ATC environments, where mutual performance monitoring is especially important during stressful situations.When designing automation, lessons learned from human-human teamwork should be considered. The work within the scope of this dissertation identifies and concerns two human-automation teamwork aspects: boundary awareness and implicit communication. These are proposed to support the operator's knowledge about the automation and the communication flow between the iv operator and the automation. Boundary awareness is the operator's knowledge of the automation's abilities, its boundaries (what it can or cannot manage), and about consequences if it would go outside of these boundaries. Implicit communication is the unspoken or implied small cues that the operator and the automation can use to communicate with each other. It is proposed that implicit communication can be based on the work patterns of the operator. The knowledge gained through the work in this dissertation can be used as a foundation for further research and design of automation regarding operator knowledge about the automation boundaries and the communication within the team. v vii INCLUDED PUBLICATIONS

show abstract

Sustained Attention in a Monitoring Task: Towards a Neuroadaptative Enterprise System Interface

Demazure

Karran

Labonté-LeMoyne

et al. 2018

Information Systems and Neuroscience

View full text Add to dashboard Cite

Models of Automation Surprise: Results of a Field Survey in Aviation

Cited by 14 publications

References 27 publications

Toward a Hybrid Passive BCI for the Modulation of Sustained Attention Using EEG and fNIRS

Toward a Hybrid Passive BCI for the Modulation of Sustained Attention Using EEG and fNIRS

Human-automation teamwork : Current practices and future directions in air traffic control

Sustained Attention in a Monitoring Task: Towards a Neuroadaptative Enterprise System Interface

Contact Info

Product

Resources

About