UAV Operators Workload Assessment by Optical Brain Imaging Technology (fNIR)

İzzetoǧlu, Kurtuluş; Ayaz, Hasan; Hing, James T.; Shewokis, Patricia A.; Bunce, Scott C.; Oh, Paul; Onaral, Banu

doi:10.1007/978-90-481-9707-1_22

Cited by 26 publications

(13 citation statements)

References 48 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The results from this study showed that all the four brain regions of interest were sensitive to workload changes. These findings are in parallel with previous studies with functional brain imaging techniques confirming that different brain regions within the PFC area are sensitive to task manipulations during various cognitive tasks [1,[6][7][8]27,33]. In particular, our study results indicated that for both the Ambulance and School Bus scenarios, bilateral activation was observed both in the left (LDLPFC, LANTPFC) and in the right (RDLPFC, RANTPFC).…”

Section: Discussionsupporting

confidence: 91%

“…Mean (average) statistics for OXY were calculated across the right channels (right dorsolateral (RDLPFC); right anterior (RANTPFC)), left channels (left dorsolateral (LDLPFC); left anterior (LANTPFC)). Previous studies that used average OXY as a dependent measure in complex cognitive tasks demonstrated its sensitivity to task difficulty levels and established validity of average OXY for measuring cortical changes associated with cognitive workload, e.g., [ 32 , 33 ]. Additionally, in an fNIRS study conducted by Liang and colleagues [ 1 ], medium effect sizes for OXY and oxy-Hb [d = 0.44–0.76] and small effect sizes [d = 0.26–0.28] for deoxy-Hb and total hemoglobin (HbT) were reported, suggesting that OXY and oxy-Hb were more sensitive to workload changes compared to the other two biomarkers.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Examining Mental Workload in a Spatial Navigation Transfer Game via Functional near Infrared Spectroscopy

et al. 2021

Self Cite

View full text Add to dashboard Cite

The goal of this study was to examine the effects of task-related variables, such as the difficulty level, problem scenario, and experiment week, on performance and mental workload of 27 healthy adult subjects during problem solving within the spatial navigation transfer (SNT) game. The study reports task performance measures such as total time spent on a task (TT) and reaction time (RT); neurophysiological measures involving the use of functional near-infrared spectroscopy (fNIRS); and a subjective rating scale for self-assessment of mental workload (NASA TLX) to test the related hypothesis. Several within-subject repeated-measures factorial ANOVA models were developed to test the main hypothesis. The results revealed a number of interaction effects for the dependent measures of TT, RT, fNIRS, and NASA TLX. The results showed (1) a decrease in TT and RT across the three levels of difficulty from Week 1 to Week 2; (2) an increase in TT and RT for high and medium cognitive load tasks as compared to low cognitive load tasks in both Week 1 and Week 2; (3) an overall increase in oxygenation from Week 1 to Week 2. These findings confirmed that both the behavioral performance and mental workload were sensitive to task manipulations.

show abstract

Section: Discussionsupporting

confidence: 91%

Section: Methodsmentioning

confidence: 99%

Examining Mental Workload in a Spatial Navigation Transfer Game via Functional near Infrared Spectroscopy

et al. 2021

Self Cite

View full text Add to dashboard Cite

show abstract

“…To date, there have been few studies in which procedural/real world learning tasks have been tested with a tDCS intervention (Izzetoglu et al, 2014 ; Nelson et al, 2014 ), and even fewer with a significant motor component as the focus of performance/training enhancement (Zhu et al, 2015 ). However, tDCS enhancement of real-world skills has been reported for complex motor control tasks.…”

Section: Discussionmentioning

confidence: 99%

Transcranial Direct Current Stimulation Modulates Neuronal Activity and Learning in Pilot Training

Choe

Coffman

Bergstedt

et al. 2016

Front. Hum. Neurosci.

View full text Add to dashboard Cite

Skill acquisition requires distributed learning both within (online) and across (offline) days to consolidate experiences into newly learned abilities. In particular, piloting an aircraft requires skills developed from extensive training and practice. Here, we tested the hypothesis that transcranial direct current stimulation (tDCS) can modulate neuronal function to improve skill learning and performance during flight simulator training of aircraft landing procedures. Thirty-two right-handed participants consented to participate in four consecutive daily sessions of flight simulation training and received sham or anodal high-definition-tDCS to the right dorsolateral prefrontal cortex (DLPFC) or left motor cortex (M1) in a randomized, double-blind experiment. Continuous electroencephalography (EEG) and functional near infrared spectroscopy (fNIRS) were collected during flight simulation, n-back working memory, and resting-state assessments. tDCS of the right DLPFC increased midline-frontal theta-band activity in flight and n-back working memory training, confirming tDCS-related modulation of brain processes involved in executive function. This modulation corresponded to a significantly different online and offline learning rates for working memory accuracy and decreased inter-subject behavioral variability in flight and n-back tasks in the DLPFC stimulation group. Additionally, tDCS of left M1 increased parietal alpha power during flight tasks and tDCS to the right DLPFC increased midline frontal theta-band power during n-back and flight tasks. These results demonstrate a modulation of group variance in skill acquisition through an increasing in learned skill consistency in cognitive and real-world tasks with tDCS. Further, tDCS performance improvements corresponded to changes in electrophysiological and blood-oxygenation activity of the DLPFC and motor cortices, providing a stronger link between modulated neuronal function and behavior.

show abstract

“…In particular, in this study, we explored two main aspects in which greater consumption of eSports can affect the gamers- mainly (i) the neuroplasticity of the brain in response to 460 gaining expertise in playing a game, and (ii) the emotional state of a gamer. Previous studies have demonstrated that the expertise level of participants can lead to a change in brain activity in response to experience, also known as neuroplasticity [ 32 ], and continuous consumption of such eSports may effect on the cognition and emotional states of gamers [ 49 ]. Hence, to gain an insight into the link between an emotional state of a gamer, and their expertise, classification analysis with only fNIRS data (DS1) and classification analysis with fNIRS data in tandem with derived emotions from facial expressions (DS2) is performed separately.…”

Section: Discussionmentioning

confidence: 99%

“…Another study that investigated the relation between changes in mental workload, level of expertise, and task performance for aerospace application on brain activity recorded using fNIRS is by Ayaz et al [ 32 ]. They concluded that fNIRS signal measurements are correlated to task performance, and subjective self-reported measures.…”

Section: Related Workmentioning

confidence: 99%

Single-Trial Recognition of Video Gamer’s Expertise from Brain Haemodynamic and Facial Emotion Responses

et al. 2021

Self Cite

View full text Add to dashboard Cite

With an increase in consumer demand of video gaming entertainment, the game industry is exploring novel ways of game interaction such as providing direct interfaces between the game and the gamers’ cognitive or affective responses. In this work, gamer’s brain activity has been imaged using functional near infrared spectroscopy (fNIRS) whilst they watch video of a video game (League of Legends) they play. A video of the face of the participants is also recorded for each of a total of 15 trials where a trial is defined as watching a gameplay video. From the data collected, i.e., gamer’s fNIRS data in combination with emotional state estimation from gamer’s facial expressions, the expertise level of the gamers has been decoded per trial in a multi-modal framework comprising of unsupervised deep feature learning and classification by state-of-the-art models. The best tri-class classification accuracy is obtained using a cascade of random convolutional kernel transform (ROCKET) feature extraction method and deep classifier at 91.44%. This is the first work that aims at decoding expertise level of gamers using non-restrictive and portable technologies for brain imaging, and emotional state recognition derived from gamers’ facial expressions. This work has profound implications for novel designs of future human interactions with video games and brain-controlled games.

show abstract

UAV Operators Workload Assessment by Optical Brain Imaging Technology (fNIR)

Cited by 26 publications

References 48 publications

Examining Mental Workload in a Spatial Navigation Transfer Game via Functional near Infrared Spectroscopy

Examining Mental Workload in a Spatial Navigation Transfer Game via Functional near Infrared Spectroscopy

Transcranial Direct Current Stimulation Modulates Neuronal Activity and Learning in Pilot Training

Single-Trial Recognition of Video Gamer’s Expertise from Brain Haemodynamic and Facial Emotion Responses

Contact Info

Product

Resources

About