Classifying visuomotor workload in a driving simulator using subject specific spatial brain patterns

Abstract

A passive Brain Computer Interface (BCI) is a system that responds to the spontaneously produced brain activity of its user and could be used to develop interactive task support. A human-machine system that could benefit from brain-based task support is the driver-car interaction system. To investigate the feasibility of such a system to detect changes in visuomotor workload, 34 drivers were exposed to several levels of driving demand in a driving simulator. Driving demand was manipulated by varying driving speed and by asking the drivers to comply to individually set lane keeping performance targets. Differences in the individual driver's workload levels were classified by applying the Common Spatial Pattern (CSP) and Fisher's linear discriminant analysis to frequency filtered electroencephalogram (EEG) data during an off line classification study. Several frequency ranges, EEG cap configurations, and condition pairs were explored. It was found that classifications were most accurate when based on high frequencies, larger electrode sets, and the frontal electrodes. Depending on these factors, classification accuracies across participants reached about 95% on average. The association between high accuracies and high frequencies suggests that part of the underlying information did not originate directly from neuronal activity. Nonetheless, average classification accuracies up to 75–80% were obtained from the lower EEG ranges that are likely to reflect neuronal activity. For a system designer, this implies that a passive BCI system may use several frequency ranges for workload classifications.

EEG-Based Affect and Workload Recognition in a Virtual Driving Environment for ASD Intervention

“…Wang et al proposed an online closed-loop lapse detection and mitigation system that continuously monitored a driver’s EEG signature of fatigue based on EEG spectra, and delivered warnings accordingly during an event-related lane-keeping task using a VR-based driving simulator [18]. Dijksterhuis et al classified the mental workload of drivers with varying speed- and lane-keeping demand by applying common spatial pattern and a linear discriminant analysis algorithm, again with a driving simulator [19]. Compared with mental workload, affective states are less studied in driving because affective states are not directly related to the safety-critical aspect of driving.…”

Prediction of Difficulty Levels in Video Games from Ongoing EEG

“…In typical BCI studies that aim for workload assessment, the experimental paradigm introduces two conditions which induce two levels of workload, e.g. low and high [6,7]. This represents a classical classification setting where common practice is to train a linear classifier on EEG features using the binary labels.…”

EEG-based decoding of error-related brain activity in a real-world driving task

“…These BCI systems would decode driver's brain activity to estimate his/her cognitive states or action intentions. For instance, the system can verify whether the driver is paying attention to the driving behavior (Simon et al, 2011), estimate mental workload (Dijksterhuis et al, 2013), or predict driver's intention of action (e.g., braking, traffic lights, and lane changes) (Haufe et al, 2011;Gheorghe et al, 2013;Haufe et al, 2014;Sonnleitner et al, 2014;Kim et al, 2015;Khaliliardali et al, 2015).…”