Beyond Identity: Incorporating System Reliability Information Into an Automated Combat Identification System

Abstract

Objective: The aim of this study was to evaluate display formats for an automated combat identification (CID) aid.Background: Verbally informing users of automation reliability improves reliance on automated CID systems. A display can provide reliability information in real time.Method: We developed and tested four visual displays that showed both target identity and system reliability information. Display type (pie, random mesh) and display proximity (integrated, separated) of identity and reliability information were manipulated. In Experiment 1, participants used the displays while engaging targets in a simulated combat environment. In Experiment 2, participants briefly viewed still scenes from the simulation.Results: Participants relied on the automation more appropriately with the integrated display than with the separated display. Participants using the random mesh display showed greater sensitivity than those using a pie chart. However, in Experiment 2, the sensitivity effects were limited to lower reliability levels.Conclusion: The integrated display format and the random mesh display were the most effective displays tested.Application: We recommend the use of the integrated format and a random mesh display to indicate identity and reliability information with an automated CID system.

Situation Awareness-Based Agent Transparency

“…Lee (2012) proposed that to increase system transparency to the operator, the system's 3Ps (purpose, process, and performance), as well as the history of the 3Ps, should be visible to the operator. However, the presentation should be in a simplified form (e.g., integrated graphical displays) so the operator is not overwhelmed by the additional information he/she needs to process (Cook and Smallman, 2008;Neyedli et al, 2011;Tufte, 2001). …”

Enhancing Driving Safety and User Experience Through Unobtrusive and Function-Specific Feedback

“…While no related studies have been identified in a driving context, knowledge can be transferred from other domains. In a military context, Neyedli et al [23] showed that integrating uncertainty information with the affected data resulted in improvements in reliance compared to a display that presented data and its uncertainty separately. Further, previous studies indicated that graphically displaying uncertainty is (at least) equally effective as numerical or verbal communication [8,31].…”

Ecological Interface Design for a Water Monitoring Decision Aid

“…To measure users' reliance on decision aids, several studies have used signal detection theory and its measure of response bias (Meyer, 2001;Maltz & Meyer, 2001;Maltz & Shinar, 2003;Neyedli, Hollands, & Jamieson, 2011;Wang, Jamieson, & Hollands, 2009). If the aid indicates that there is a signal in a given trial, then users relying on the aid should be more liberal in responding that a signal exists than if they performed the task manually.…”

“…The sample size was selected based on reported effect sizes of display format on task performance (Carswell & Wickens, 1996;Neyedli et al, 2011), as well as trust and reliance (Neyedli et al, 2011). Participants received $20 for their participation in the single session.…”