Understanding the Multidimensional and Dynamic Nature of Facial Expressions Based on Indicators for Appraisal Components as Basis for Measuring Drivers' Fear

Abstract

Facial expressions are one of the commonly used implicit measurements for the in-vehicle affective computing. However, the time courses and the underlying mechanism of facial expressions so far have been barely focused on. According to the Component Process Model of emotions, facial expressions are the result of an individual's appraisals, which are supposed to happen in sequence. Therefore, a multidimensional and dynamic analysis of drivers' fear by using facial expression data could profit from a consideration of these appraisals. A driving simulator experiment with 37 participants was conducted, in which fear and relaxation were induced. It was found that the facial expression indicators of high novelty and low power appraisals were significantly activated after a fear event (high novelty: Z = 2.80, p < 0.01, rcontrast = 0.46; low power: Z = 2.43, p < 0.05, rcontrast = 0.50). Furthermore, after the fear event, the activation of high novelty occurred earlier than low power. These results suggest that multidimensional analysis of facial expression is suitable as an approach for the in-vehicle measurement of the drivers' emotions. Furthermore, a dynamic analysis of drivers' facial expressions considering of effects of appraisal components can add valuable information for the in-vehicle assessment of emotions.

The Novelty Appraisal of the Feeling of Risk in Vehicles

“…More recently, in addition to valence and arousal, more dimensions (e.g., novelty) were suggested to describe the full space of emotional experience [ 30 , 31 ]. In this vein, a recent study suggested understanding facial expressions with regard to the time courses of and the mechanisms underlying the generation of emotional appraisals [ 32 ].…”

“…This result is consistent with the result from a questionnaire study [ 41 ]. In a driving simulator study [ 32 ], facial expressions based on the FACS were used to successfully indicate the appraisal of high novelty and low power in fearful traffic situations. However, reliable multimodal measurements of the feeling of risk in vehicles with consideration of the individual appraisal of the situation still need more empirical validation.…”