We describe a multimodal dataset acquired in a controlled experiment on a driving simulator. The set includes data for n=68 volunteers that drove the same highway under four different conditions: No distraction, cognitive distraction, emotional distraction, and sensorimotor distraction. The experiment closed with a special driving session, where all subjects experienced a startle stimulus in the form of unintended acceleration—half of them under a mixed distraction, and the other half in the absence of a distraction. During the experimental drives key response variables and several explanatory variables were continuously recorded. The response variables included speed, acceleration, brake force, steering, and lane position signals, while the explanatory variables included perinasal electrodermal activity (EDA), palm EDA, heart rate, breathing rate, and facial expression signals; biographical and psychometric covariates as well as eye tracking data were also obtained. This dataset enables research into driving behaviors under neatly abstracted distracting stressors, which account for many car crashes. The set can also be used in physiological channel benchmarking and multispectral face recognition.

In a simulation experiment we studied the effects of cognitive, emotional, sensorimotor, and mixed stressors on driver arousal and performance with respect to (wrt) baseline. In a sample of n = 59 drivers, balanced in terms of age and gender, we found that all stressors incurred significant increases in mean sympathetic arousal accompanied by significant increases in mean absolute steering. The latter, translated to significantly larger range of lane departures only in the case of sensorimotor and mixed stressors, indicating more dangerous driving wrt baseline. In the case of cognitive or emotional stressors, often a smaller range of lane departures was observed, indicating safer driving wrt baseline. This paradox suggests an effective coping mechanism at work, which compensates erroneous reactions precipitated by cognitive or emotional conflict. This mechanisms’ grip slips, however, when the feedback loop is intermittently severed by sensorimotor distractions. Interestingly, mixed stressors did not affect crash rates in startling events, suggesting that the coping mechanism’s compensation time scale is above the range of neurophysiological latency.

No abstract

Electrodermal activity (EDA) is an important affective indicator, measured conventionally on the fingers with desktop sensing instruments. Recently, a new generation of wearable, battery-powered EDA devices came into being, encouraging the migration of EDA sensing to other body locations. To investigate the implications of such sensor/location shifts in psychophysiological studies we performed a validation experiment. In this experiment we used startle stimuli to instantaneously arouse the sympathetic system of n = 23 subjects while sitting. Startle stimuli are standard but minimal stressors, and thus ideal for determining the sensor and location resolution limit. The experiment revealed that precise measurement of small EDA responses on the fingers and palm is feasible either with conventional or mobile EDA sensors. By contrast, precise measurement of small EDA responses on the sole is challenging, while on the wrist even detection of such responses is problematic for both EDA modalities. Given that affective wristbands have emerged as the dominant form of EDA sensing, researchers should beware of these limitations.

No abstract

No abstract

Several decades of research into detecting lies has resulted in a large number of available of techniques among both behavioral and physiological channels. However only in the recent past, have researchers started to focus more on ways to detect ill-intent. Persons lying under high stakes situations show detectable changes in behavior. Similarly while lying to conceal ones true intent, one exhibits similar characteristics. This work presents a fast, convenient and discrete way of monitoring facial physiology using thermal imaging to detect when a person is lying about their intentions. Its application is suitable for screening in airports, border crossing and other venues with large transit volumes.

This article documents thermophysiological patterns associated with migraine episodes, where the inner canthi and supraorbital temperatures drop significantly compared to normal conditions. These drops are likely due to vasoconstriction of the ophthalmic arteries under the inner canthi and sympathetic activation of the eccrine glands in the supraorbital region, respectively. The patterns were observed on eight migraine patients and meticulously quantified using advance computational methods, capable of delineating small anatomical structures in thermal imagery and tracking them automatically over time. These methods open the way for monitoring migraine episodes in non-clinical environments, where the patient maintains directional attention, such as his/her computer at home or at work. This is a development with the potential to significantly expand the operational envelope of migraine studies.