Biosensing and Actuation—Platforms Coupling Body Input-Output Modalities for Affective Technologies

Abstract

Research in the use of ubiquitous technologies, tracking systems and wearables within mental health domains is on the rise. In recent years, affective technologies have gained traction and garnered the interest of interdisciplinary fields as the research on such technologies matured. However, while the role of movement and bodily experience to affective experience is well-established, how to best address movement and engagement beyond measuring cues and signals in technology-driven interactions has been unclear. In a joint industry-academia effort, we aim to remodel how affective technologies can help address body and emotional self-awareness. We present an overview of biosignals that have become standard in low-cost physiological monitoring and show how these can be matched with methods and engagements used by interaction designers skilled in designing for bodily engagement and aesthetic experiences. Taking both strands of work together offers unprecedented design opportunities that inspire further research. Through first-person soma design, an approach that draws upon the designer’s felt experience and puts the sentient body at the forefront, we outline a comprehensive work for the creation of novel interactions in the form of couplings that combine biosensing and body feedback modalities of relevance to affective health. These couplings lie within the creation of design toolkits that have the potential to render rich embodied interactions to the designer/user. As a result we introduce the concept of “orchestration”. By orchestration, we refer to the design of the overall interaction: coupling sensors to actuation of relevance to the affective experience; initiating and closing the interaction; habituating; helping improve on the users’ body awareness and engagement with emotional experiences; soothing, calming, or energising, depending on the affective health condition and the intentions of the designer. Through the creation of a range of prototypes and couplings we elicited requirements on broader orchestration mechanisms. First-person soma design lets researchers look afresh at biosignals that, when experienced through the body, are called to reshape affective technologies with novel ways to interpret biodata, feel it, understand it and reflect upon our bodies.

Lessons learned from psychosocial support and mental health surveys during the 10 years since the Great East Japan Earthquake: Establishing evidence‐based disaster psychiatry

“…In the present COVID-19 pandemic, remote support using online tools has been implemented [75][76][77] ; several attempts have begun to use monitoring by biosensing, capturing mental and physical conditions that are difficult to grasp both subjectively and objectively, such as the amount of activity, sleep, and autonomic nervous function. 78,79 New intervention approaches, such as AI technology processing a huge amount of information using state-of-the-art technologies, as well as brain science, robotics, and virtual reality (VR) technology, should be employed. Japanese and U.S. venture companies are actively engaged in clinical trials of the remote use of cognitive-behavioral therapy using smartphones, monitoring the pre-disease status of psychiatric conditions.…”

HRV and Stress: A Mixed-Methods Approach for Comparison of Wearable Heart Rate Sensors for Biofeedback

“…Affective health and wellbeing is a growing area of research. Many have developed affective technologies targeting stress-related disorders for adults, children, caregivers, clinical staff, and researchers [36], [37]. Such technologies aim to provide prevention, diagnosis, triage, intervention, self-management, and maintenance of affective disorders in both clinical and non-clinical settings.…”

In the hands of users with Learning Disabilities: Co-Designing Tangible Users Interfaces for Mental Wellbeing

“…During the session a range of non-invasive, easy to use sensors that could be used in realworld environments [2] were explored through interactive demonstrations, ensuring participants understood their functionality by allowing them to test each of the sensors. A HR sensor was first explored where participants were able to place their finger on the sensor and lights would flash at the same rate as their pulse.…”