A Review of Psychophysiological Measures to Assess Cognitive States in Real-World Driving

Abstract

As driving functions become increasingly automated, motorists run the risk of becoming cognitively removed from the driving process. Psychophysiological measures may provide added value not captured through behavioral or self-report measures alone. This paper provides a selective review of the psychophysiological measures that can be utilized to assess cognitive states in real-world driving environments. First, the importance of psychophysiological measures within the context of traffic safety is discussed. Next, the most commonly used physiology-based indices of cognitive states are considered as potential candidates relevant for driving research. These include: electroencephalography and event-related potentials, optical imaging, heart rate and heart rate variability, blood pressure, skin conductance, electromyography, thermal imaging, and pupillometry. For each of these measures, an overview is provided, followed by a discussion of the methods for measuring it in a driving context. Drawing from recent empirical driving and psychophysiology research, the relative strengths and limitations of each measure are discussed to highlight each measures' unique value. Challenges and recommendations for valid and reliable quantification from lab to (less predictable) real-world driving settings are considered. Finally, we discuss measures that may be better candidates for a near real-time assessment of motorists' cognitive states that can be utilized in applied settings outside the lab. This review synthesizes the literature on in-vehicle psychophysiological measures to advance the development of effective human-machine driving interfaces and driver support systems.

EEG Theta Power Activity Reflects Workload among Army Combat Drivers: An Experimental Study

“…Overall, these results strengthen previous findings on the positive correlation between the operator's mental workload and θ-activity [2,51,72]. In particular, θ-activity in frontal areas has been associated with brain engagement in cognitive processes such as judgment, problem solving, working memory, decision making, and mathematical problem solving [73]. Here, we found that an increase in the θ-activity occurred predominantly in the right frontal electrodes (i.e., frontal θ-asymmetry).…”

Thermal Infrared Imaging-Based Affective Computing and Its Application to Facilitate Human Robot Interaction: A Review

“…Thermal IR imaging was demonstrated to be a valid technique for assessing variation in cognitive load [52,107,108]. Most of all, it could enable sensing the real-time state of motorists non-invasively i.e., without disrupting driving-related tasks and, unlike RGB cameras, independently from external light conditions [109]. Studies of thermal IR imaging in driving contexts stated that a rise in mental workload leads to an increase in the difference between nose and forehead temperature [108,110].…”

Neural signatures of vigilance decrements predict behavioural errors before they occur

“…Previous studies have used physiological measures such as pupil size (Yoss, et al, 1970), body temperature (Molina et al, 2019), skin conductance, blood pressure, etc. (Lohani et al, 2019) to indicate the level of human arousal or alertness, but these lack the fine-grained information necessary to distinguish transient dips from problematic levels of inattention in which task-related information is lost. In particular, we lack detail on how information processing changes in the brain during vigilance decrements.…”