‘This time with feeling?’ Assessing EU data governance implications of out of home appraisal based emotional AI

Abstract

The boundaries of personal space and borders of bodily integrity are being tested by deployments of emotional artificial intelligence (EAI) in private and public spaces. By means of sensing, seeing and machine learning of facial expressions, voice, gaze, gestures and range of physiological signals (heart rate, skin conductivity and temperature, muscle activity, body temperature, respiration and other bio-signals), the goal is to make interior emotional life machine-readable for personal, commercial and security objectives.In this paper, we focus on computer vision and face-based analytics to consider the nature, method and development of facial coding, the potential demise of existing approaches, and the rise of even more invasive methods. Criticisms of facial coding have long existed, but recent scholarship and industrial development signals a lack of confidence in ‘basic emotions’ and a turn to appraisal-based accounts of emotion. This inevitably entails use of data about internal physiological and experiential contexts, but also factors external to an individual. To explore this, this paper asks and answers the following question: With regard to deployment in out-of-home situations, what are the legal and privacy implications of appraisal-based emotion capture?

Emotional artificial intelligence in children’s toys and devices: Ethics, governance and practical remedies

“…As to achieving high confidence in automated emotion detection, Minhas adds, ‘I think it will be multimodal’ – necessitating extra signals and data sources to triangulate and identify a child’s state. Although this may improve accuracy, it perforce increases surveillance breadth (McStay and Urquhart, 2019). As a consequence, Minhas adds, ‘And certainly as a business, our ethos would probably steer us away from … building our technology into objects where the main recipients of which would be children’.…”

Nothing to Be Happy about: Consumer Emotions and AI

“…The potential for computing to relate to, arise from, or influence emotions is not a new phenomenon. Already in 1995, the term 'affecting computing' was coined for such applications [1] Today, the term 'Emotion AI' (or 'emotional AI') is used to describe the use of affective computing together with AI-via predetermined rules or Big Data analytics [2]-in order to 'autonomously sense expressions and behaviour, profile, learn, simulate understanding and react' [3]. Such capabilities allow for new levels of personalisation and understanding of consumer behaviour, impacting on the interaction between humans and technology as well as interpersonal relationships [3].…”

Emotional AI, soft biometrics and the surveillance of emotional life: An unusual consensus on privacy

“…This is problematic because 'similar configurations of facial movements variably express instances of more than one emotion category' (Barrett et al, 2019), which indicates that more detail on the context of the situation is required to understand the emotion. This requires more data and potentially more invasive practices (McStay and Urquhart, 2019).…”

“…Wachter's focus is on assumed interests as a proxy for personal traits, but the principle of indirect inference is interesting because data collected about emotional conditions may be collected by group aggregate, but will impact them personally, albeit not through strictly speaking personal data. The interest in online advertising has parallel with urban smart advertising that makes use of emotional AI (McStay, 2016;McStay and Urquhart, 2019). For example, groups of people that move daily through urban spaces (such as a commuter-line train stations) will by default become identifiable groups clustered by psycho-physiological emotional reactivity.…”