Automation Reliability in Unmanned Aerial Vehicle Control: A Reliance-Compliance Model of Automation Dependence in High Workload

Dixon, Stephen; Wickens, Christopher D.

doi:10.1518/001872006778606822

Cited by 237 publications

(206 citation statements)

References 21 publications

Supporting

Mentioning

177

Contrasting

Order By: Relevance

“…For example, studies have shown that if the perceived reliability of the aid is low-especially if lower than 70 % [28]-operators could become under-dependent on the aid in a way that they ignore it, even when it may be correct [42]. However, the failure rate in this study was 18 %, which does not necessarily lead to a decrease in trust.…”

Section: Summary and Interpretation Of The Resultsmentioning

confidence: 54%

A human factors perspective on the use of automated aids in the evaluation of NDT data

Bertovic

2016

AIP Conference Proceedings

View full text Add to dashboard Cite

Abstract. In comparison to manual NDT methods, mechanized NDT is considered to be more reliable for a number of reasons, one of which being that the role of the inspectors and, therewith, the potential for human error, have been reduced. However, human-automation interaction research suggests that in spite of its numerous benefits, automation can lead to new yet unknown risks. One of those risks is inappropriate reliance on automation, which can result in automation misuse and disuse. The aim of this study was to investigate the potential inappropriate use of automation (specificallythe automated aids) in NDT addressing therewith the prevalent belief in the high reliability of automation held by the NDT community. To address this issue, 70 NDT trainees were asked to control the results of an eddy current data evaluation, allegedly provided by an automated aid, i.e. indication detection and sizing software. Seven errors were implemented into the task and it was measured to what extent the participants agreed with the aid. The results revealed signs of both misuse (agreeing with the aid even though it is incorrect) and disuse (disagreeing with the aid even though it is correct) of the aid that can affect the reliability with which inspections are carried out. Whereas misuse could be explained by a lower propensity to take risks and by a decreased verification behavior-possibly due to bias towards automation and complacent behavior-, disuse was assigned to problems in establishing the sizing criterion or to general difficulties in sizing. The implications of these results for the NDT praxis including suggestions for the decrease of automation bias are discussed.

show abstract

Section: Summary and Interpretation Of The Resultsmentioning

confidence: 54%

A human factors perspective on the use of automated aids in the evaluation of NDT data

Bertovic

2016

AIP Conference Proceedings

View full text Add to dashboard Cite

show abstract

“…On the other hand, when the miss rate was high, the concurrent task performance was affected more than the automated task because the operator had to allocate more visual attention to monitor the automated task. Similarly, Dixon and Wickens (2006) showed that FAs and misses affected compliance and reliance, respectively, and their effects appeared to be relatively independent of each other. In contrast to Meyer's model and the aforementioned findings, Dixon et al (2007) showed that FAP automation impaired "performance more on the automated task than did miss-…”

mentioning

confidence: 90%

Effectiveness of Concurrent Performance of Military and Robotics Tasks and Effects of Cueing and Individual Differences in a Simulated Reconnaissance Environment

Chen¹

2009

Advances in Human-Robot Interaction

View full text Add to dashboard Cite

Introduction BackgroundThe goal of this research is to examine if and how aided target recognition (AiTR) cueing capabilities facilitates multitasking (including operating a robot) by gunners in a military tank crewstation environment. Specifically, we examine if gunners are able to effectively perform their primary task -maintaining local security -while performing a pair of secondary tasks: (1) managing a robot and (2) communications with fellow crew members. According to Mitchell (2005), who used the Improved Performance Research Integration Tool (IMPRINT) to examine the workload of the crew of a future tank system, the gunner is the most viable option for performing the robotics control tasks compared to the other two positions (i.e. vehicle commander and driver). She found that the gunner had the fewest instances of overload and, therefore, may be able to assume control of the robot. However, she also discovered that there were instances in the model when the gunner dropped his/her primary tasks of detecting and engaging targets to perform robotics tasks, which could be catastrophic for the team and mission during a real operation. If the gunner is the individual who will most likely be assigned the responsibility of robotics control, then it is important to consider what design changes will be necessary to allow successful multitasking without a critical performance decrement in maintaining local security. Based on Mitchell's modeling work, Chen and Joyner (2009) conducted a simulation experiment and the results showed that, when the robotics operator had to perform robot targeting and local security (i.e. gunner's tasks) at the same time, both workload and performance degraded, compared with a baseline single-task condition. More specifically, as the robotics task became more difficult, the participants' gunnery task performance became worse and their workload assessment also increased. Indeed, past research in dual task performance has shown that operators may encounter difficulties when both tasks involve focal vision. For example, Horrey and Wickens (2004) demonstrated that participants could not effectively detect road hazards while operating in-vehicle-devices. Additionally, Murray (1994) found that as the number of monitored displays increased, the operators' reaction time for their target search tasks also increased linearly. In fact, response times almost www.intechopen.com Advances in Human-Robot Interaction 234 doubled when the number of displays increased from 1 to 2 and from 2 to 3 (a slope of 1.94 was obtained). Since both the gunnery and the robotics tasks in Chen and Joyner were heavily visual, we considered tapping into another modality -touch. Our hypothesis was that parsing additional information by using relatively untapped modalities might alleviate the resource demands and could help the operator effectively transition between displays (Wickens, 2002). Tactile cueingIn the current study, we examined if and how tactile cueing, which delivered simulated AiTR capabilities (i.e. cues to t...

show abstract

“…Automation may also lead to peaks and troughs in workload if it reduces workload during periods when workload was already low but becomes a burden during higher workload phases, a situation known as 'clumsy automation' (Wiener, 1989;Woods, 1996). Automation which assists the operator during high workload conditions is most likely to be successful (Dixon & Wickens, 2006), because this is when the largest benefits can be achieved. The ability of automation to reduce workload during normal operations is well documented in experimental studies (e.g.…”

Section: Effects Of Automationmentioning

confidence: 99%

Impact of automation: Measurement of performance, workload and behaviour in a complex control environment

2015

View full text Add to dashboard Cite

This paper describes an experiment that was undertaken to compare three levels of automation in rail signalling; a high level in which an automated agent set routes for trains using timetable information, a medium level in which trains were routed along pre-defined paths, and a low level where the operator (signaller) was responsible for the movement of all trains. These levels are described in terms of a rail automation model based on previous automation theory (Parasuraman, Sheridan, & Wickens, 2000). Performance, subjective workload, and signaller activity were measured for each level of automation running under both normal operating conditions and abnormal, or disrupted, conditions. The results indicate that perceived workload, during both normal and disrupted phases of the experiment, decreased as the level of automation increased and performance was most consistent (i.e. showed the least variation between participants) with the highest level of automation. The results give a strong case in favour of automation, particularly in terms of demonstrating the potential for automation to reduce workload, but also suggest much benefit can achieved from a mid-level of automation potentially at a lower cost and complexity. Impact StatementResearch in the area of automation, and in particular in the examination of human interaction with different levels of automation, has normally been undertaken in Balfe et al, Impact of Automation: Measurement of Performance, Workload and Behaviour in a Complex Control Environment 2 laboratory settings using simple tasks and naïve participants where the level of automation can be easily manipulated. This research was undertaken with expert participants using complex simulation of three ecologically valid levels of automation and provides empirical field validation of some of the results found in laboratory studies.

show abstract

Automation Reliability in Unmanned Aerial Vehicle Control: A Reliance-Compliance Model of Automation Dependence in High Workload

Cited by 237 publications

References 21 publications

A human factors perspective on the use of automated aids in the evaluation of NDT data

A human factors perspective on the use of automated aids in the evaluation of NDT data

Effectiveness of Concurrent Performance of Military and Robotics Tasks and Effects of Cueing and Individual Differences in a Simulated Reconnaissance Environment

Impact of automation: Measurement of performance, workload and behaviour in a complex control environment

Contact Info

Product

Resources

About