Continuous electronic data capture of physiology, behavior and experience in real life: towards ecological momentary assessment of emotion

Abstract

Emotions powerfully influence our physiology, behavior, and experience. A comprehensive assessment of affective states in health and disease would include responses from each of these domains in real life. Since no single physiologic parameter can index emotional states unambiguously, a broad assessment of physiologic responses is desirable. We present a recently developed system, the LifeShirt, which allows reliable ambulatory monitoring of a wide variety of cardiovascular, respiratory, metabolic, motor-behavioral, and experiential responses. The system consists of a garment with embedded inductive plethysmography and other sensors for physiologic data recording and a handheld computer for input of experiential data via touch screen. Parameters are extracted offline using sophisticated analysis and display software. The device is currently used in clinical studies and to monitor effects of physical and emotional stress in naturalistic settings. Further development of signal processing and pattern recognition algorithms will enhance computerized identification of type and extent of physical and emotional activation. q

Engineering Issues in Physiological Computing

“…Others can be built into the user interface or the surrounding environment. Lin (2011), for example, built their sensors into the steering wheel of a car while Wilhelm et al (2006) built them into clothing. These sensors have great potential, but need to be validated to ensure that factors such as intermittent contact with the skin do not invalidate the measurements.…”

Classification of Emotional Stress Using Brain Activity

“…One kind of this data is respiration. Emotional stress processes influence respiration (Ritz et al, 2002;Wilhelm et al, 2006). Slow respiration, for example is linked to relaxation while irregular rhythm, quick variations, and cessation of respiration correspond to more aroused emotions like anger or fear.…”

Computer-Assisted Regulation of Emotional and Social Processes

“…In this sense, behavioural and physiological components of emotion are somewhat more convenient to measure. It is feasible to acquire these measures continuously and in real-time without distracting the person (Öhman et al, 2000;Teller, 2004;Wilhelm et al, 2006;Mandryk & Atkins, 2007). This also creates potential for more accurate timing of emotional responses.…”

“…The measurement of bioelectric signals can be criticized based on the complex arrangements (e.g., electrodes, amplifiers, and skin cleaning) that are required for measuring them. Recently, several wireless and non-invasive technologies have been developed for measuring physiological signals, including facial EMG (e.g., Anttonen & Surakka, 2005;Teller, 2004;Wilhelm et al, 2006). For example, the electrical activity of forehead muscles (e.g., corrugator supercilii) can be measured with an easy-to-wear wireless headband that contains embroidered silver thread electrodes (Vehkaoja & Lekkala, 2004;Nöjd et al, 2005).…”

“…In other types of setups, the clinician can monitor these signals, estimate the progress of therapy, and adjust its intensity accordingly. Previous research has established a number of physiology-based measures of emotional states that can be used as a basis for adapting the therapy (Vanhala & Surakka, 2007a;Vanhala & Surakka, 2007b;Partala et al, 2006;Anttonen & Surakka, 2005;Wilhelm et al, 2006;Surakka & Vanhala, accepted). These measures include electrical brain and facial muscle activity, heart rate, respiration, and skin conductivity.…”