Using an Online Narrative Approach to Explore Diverse Participants’ Understanding of Emerging Technology: Citizen’s Perspectives on Living With Emotional AI

Laffer, Alexander

doi:10.4135/9781529604122

Cited by 1 publication

(1 citation statement)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Participants in each focus group are talked through the interactive narrative by a moderator, where they are presented with a series of different settings involving emotion profiling based on current and likely near-future lived contexts. As well as emotion profiling from social media algorithms and in an emotoy (discussed in this paper), the narrative introduced emotion profiling within a home-hub smart assistant, a digital music service, a bus station surveillance sensor, a sales call evaluation and prompt tool, and a hire-car automated system (the complete design fiction narrative is available at [DATASET] Laffer, 2023 ; also see Laffer, 2022 ). Each of these settings introduces the technology and its emotion profiling in terms that are simple (for comprehensibility) and neutral (to minimize social desirability bias).…”

Section: Stage 1: Focus Groups Using Design Fiction and Contravisionmentioning

confidence: 99%

On manipulation by emotional AI: UK adults’ views and governance implications

Bakir,

Laffer,

McStay

et al. 2024

Front. Sociol.

Self Cite

View full text Add to dashboard Cite

With growing commercial, regulatory and scholarly interest in use of Artificial Intelligence (AI) to profile and interact with human emotion (“emotional AI”), attention is turning to its capacity for manipulating people, relating to factors impacting on a person’s decisions and behavior. Given prior social disquiet about AI and profiling technologies, surprisingly little is known on people’s views on the benefits and harms of emotional AI technologies, especially their capacity for manipulation. This matters because regulators of AI (such as in the European Union and the UK) wish to stimulate AI innovation, minimize harms and build public trust in these systems, but to do so they should understand the public’s expectations. Addressing this, we ascertain UK adults’ perspectives on the potential of emotional AI technologies for manipulating people through a two-stage study. Stage One (the qualitative phase) uses design fiction principles to generate adequate understanding and informed discussion in 10 focus groups with diverse participants (n = 46) on how emotional AI technologies may be used in a range of mundane, everyday settings. The focus groups primarily flagged concerns about manipulation in two settings: emotion profiling in social media (involving deepfakes, false information and conspiracy theories), and emotion profiling in child oriented “emotoys” (where the toy responds to the child’s facial and verbal expressions). In both these settings, participants express concerns that emotion profiling covertly exploits users’ cognitive or affective weaknesses and vulnerabilities; additionally, in the social media setting, participants express concerns that emotion profiling damages people’s capacity for rational thought and action. To explore these insights at a larger scale, Stage Two (the quantitative phase), conducts a UK-wide, demographically representative national survey (n = 2,068) on attitudes toward emotional AI. Taking care to avoid leading and dystopian framings of emotional AI, we find that large majorities express concern about the potential for being manipulated through social media and emotoys. In addition to signaling need for civic protections and practical means of ensuring trust in emerging technologies, the research also leads us to provide a policy-friendly subdivision of what is meant by manipulation through emotional AI and related technologies.

show abstract

Section: Stage 1: Focus Groups Using Design Fiction and Contravisionmentioning

confidence: 99%