DARPA Augmented Cognition Technical Integration Experiment (TIE)

John, Mark St.; Kobus, David A.; Morrison, Jeffrey G.

doi:10.1037/e461042006-001

Cited by 15 publications

(8 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Real-Time Eye Tracking: Pupil Size, Contingent, Gaze-Control, and Gaze-Aware Gaze location can be used to modify a display or physical device in real-time, depending on either pupil size or on the location of gaze itself, with both summarized in the following five parts: (1) Augmented cognition, (2) Contingency, (3) Gaze-control, (4) Gaze-aware systems, and (5) The DARPA augmented cognition initiative has considered the use of gaze tracking as a potentially important for assisting users in military scenarios (Crosby et al, 2003;Marshall and Raley, 2004;Nicholson et al, 2005;Fuchs et al, 2007a;Stanney et al, 2009). The majority of these studies used pupil dilation as a measure of cognitive load (Marshall, 2002;Marshall et al, 2003;St John et al, 2003;Taylor et al, 2003;Raley et al, 2004;St. John et al, 2004;Johnson et al, 2005;Mathan et al, 2005;Russo et al, 2005;Ververs et al, 2005;De Greef et al, 2007;Coyne et al, 2009), while only few attempted to actually develop the technical infrastructure for real-time assistance via gaze location (Barber et al, 2008), though none produced results using gaze location.…”

Section: Augmented Cognition Human-agent Human-robot Human-swarm Imentioning

confidence: 99%

Human Strategies for Multitasking, Search, and Control Improved via Real-Time Memory Aid for Gaze Location

Taylor

Bilgrien

et al. 2015

Front. ICT

View full text Add to dashboard Cite

Objective: We aimed to elucidate how our domain-general cuing algorithm improved multitasking performance and changed behavioral strategies in human operators.Background: Though many gaze-control systems have been designed, previous realtime gaze-aware assistance systems were not both successful and domain-general. It is largely unknown what constitutes optimal search efficiency using the eyes, or ideal control using the mouse. It is unclear what the best coordinating strategies are between these two modalities. Our previously developed closed-loop multitasking aid drastically improved multitasking performance, though the behavioral mechanisms through which it acted were unknown. Methods:We performed in-depth analyses and generated novel eye tracking and mouse movement measures, to explore the complex effects of our helpful system on gaze and motor behavior.Results: Our overlay cuing algorithm improved control efficiency and reduced wellknown biases in search patterns. This system also reduced micromanaging behavior, with humans rationally relying more on imperfect automation in experimental assistance cue conditions. We showed that mouse and gaze were more independently specialized in the helpful cuing condition than in control conditions. Specifically, with our aid, the gaze performed more global movement, and the mouse performed more local clustered movement. Further, the gaze shifted toward search over processing with the helpful cuing system. We also illustrated a relationship between the mouse and the gaze, such that in these studies, "the hand was quicker than the eye." Conclusion:Overall, results suggested that our cuing system improved performance and reduced short-term working memory load on humans by delegating it to the computer in real time. Further, it reduced the number of required repeated decisions by an estimate of about one per second. It also enabled the gaze to specialize for improved visual search behavior, and the mouse to specialize for improved control.

show abstract

Section: Augmented Cognition Human-agent Human-robot Human-swarm Imentioning

confidence: 99%

Human Strategies for Multitasking, Search, and Control Improved via Real-Time Memory Aid for Gaze Location

Taylor

Bilgrien

et al. 2015

Front. ICT

View full text Add to dashboard Cite

show abstract

“…Such novel and emerging applications that are not related to communication and control may include detection of covert behavior (Zander and Jatzev 2009, Bahramisharif et al 2010, Baernreuther et al 2010, biofeedback, sleep control, treatment of learning disorders, functional and stroke rehabilitation, and the use of brain signals as biomarkers for diagnosis of diseases or their progression (Georgopoulos et al 2007). Some of these opportunities have begun to be exploited commercially, e.g., neuromarketing (Neurofocus, http://www.neurofocus.com, Pradeep 2010) and defense applications (Honeywell, AugCog helmet, Dorneich et al 2009, St. John et al 2005. The ability of BCI feedback to induce cortical plasticity (Fetz 1969, Taylor et al 2002, Carmena et al 2003, Leuthardt et al 2004, Miller et al 2010 may provide the basis for therapeutic tools that restore the brain function.…”

Section: Emerging Applications Not Related To Communication and Controlmentioning

confidence: 99%

“…Using these research-grade systems, groups around the world are now beginning to demonstrate clinical efficacy of BCIs in patients with severe motor disabilities , Vaughan et al 2006, Nijboer et al 2008, Cincotti et al 2008, Stavisky et al 2009, Guger et al 2009 (Zander and Jatzev 2009, Bahramisharif et al 2010, Baernreuther et al 2010. This approach provides the basis for emerging applications such as neuromarketing (e.g., Neurofocus, http://www.neurofocus.com, Pradeep 2010) or defense applications (e.g., Honeywell, AugCog helmet, St. John et al 2005, Dorneich et al 2009, Kotchetkov et al 2010.…”

Section: Introductionmentioning

confidence: 99%

Current trends in hardware and software for brain–computer interfaces (BCIs)

et al. 2011

View full text Add to dashboard Cite

A brain-computer interface (BCI) provides a non-muscular communication channel to people with and without disabilities. BCI devices consist of hardware and software. BCI hardware records signals from the brain, either invasively or non-invasively, using a series of device components. BCI software then translates these signals into device output commands and provides feedback. One may categorize different types of BCI applications into the following four categories: basic research, clinical/translational research, consumer products, and emerging applications. These four categories use BCI hardware and software, but have different sets of requirements. For example, while basic research needs to explore a wide range of system configurations, and thus requires a wide range of hardware and software capabilities, applications in the other three categories may be designed for relatively narrow purposes and thus may only need a very limited subset of capabilities. This paper summarizes technical aspects for each of these four categories of BCI applications. The results indicate that BCI technology is in transition from isolated demonstrations to systematic research and commercial development. This process requires several multidisciplinary efforts, including the development of better integrated and more robust BCI hardware and software, the definition of standardized interfaces, and the development of certification, dissemination and reimbursement procedures.

show abstract

“…Laboratory vigilance tasks require correctly identifying rare target stimuli in an array for a prolonged period (Daly et al, 2017). Vigilance decrement typically onsets within 15 min of sustained attention, however it has been reported in as little as 8 min under particularly demanding situations (Helton et al, 1999;St John et al, 2006).…”

Section: Introductionmentioning

confidence: 99%

A review of cyber vigilance tasks for network defense

Guidetti

Speelman

Bouhlas³

2023

Front. Neuroergonomics

View full text Add to dashboard Cite

The capacity to sustain attention to virtual threat landscapes has led cyber security to emerge as a new and novel domain for vigilance research. However, unlike classic domains, such as driving and air traffic control and baggage security, very few vigilance tasks exist for the cyber security domain. Four essential challenges that must be overcome in the development of a modern, validated cyber vigilance task are extracted from this review of existent platforms that can be found in the literature. Firstly, it can be difficult for researchers to access confidential cyber security systems and personnel. Secondly, network defense is vastly more complex and difficult to emulate than classic vigilance domains such as driving. Thirdly, there exists no single, common software console in cyber security that a cyber vigilance task could be based on. Finally, the rapid pace of technological evolution in network defense correspondingly means that cyber vigilance tasks can become obsolete just as quickly. Understanding these challenges is imperative in advancing human factors research in cyber security.CCS categoriesHuman-centered computing~Human computer interaction (HCI)~HCI design and evaluation methods.

show abstract

DARPA Augmented Cognition Technical Integration Experiment (TIE)

Cited by 15 publications

References 17 publications

Human Strategies for Multitasking, Search, and Control Improved via Real-Time Memory Aid for Gaze Location

Human Strategies for Multitasking, Search, and Control Improved via Real-Time Memory Aid for Gaze Location

Current trends in hardware and software for brain–computer interfaces (BCIs)

A review of cyber vigilance tasks for network defense

Contact Info

Product

Resources

About