The shallow of your smile: the ethics of expressive vocal deep-fakes

Guerouaou, Nadia; Vaïva, Guillaume; Aucouturier, Jean‐Julien

doi:10.1098/rstb.2021.0083

Cited by 5 publications

(2 citation statements)

References 65 publications

(107 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Closing this theme issue with a look towards the exciting but risky future of digital voice resynthesis, Guerouaou et al [21] (critical topics (iv) and (v)) address the ethics of expressive vocal 'deep-fakes'. In an experimental ethics study, participants showed a high and broad acceptability of possible applications of expressive voice transformation technologies that alter the real vocal parameters of vocalizers, with only one general exception: when consent is lacking on the part of the vocalizer.…”

Section: (B) Partmentioning

confidence: 99%

Voice modulation: from origin and mechanism to social impact

Leongoméz

Pisanski

Reby

et al. 2021

Phil. Trans. R. Soc. B

View full text Add to dashboard Cite

Research on within-individual modulation of vocal cues is surprisingly scarce outside of human speech. Yet, voice modulation serves diverse functions in human and nonhuman nonverbal communication, from dynamically signalling motivation and emotion, to exaggerating physical traits such as body size and masculinity, to enabling song and musicality. The diversity of anatomical, neural, cognitive and behavioural adaptations necessary for the production and perception of voice modulation make it a critical target for research on the origins and functions of acoustic communication. This diversity also implicates voice modulation in numerous disciplines and technological applications. In this two-part theme issue comprising 21 articles from leading and emerging international researchers, we highlight the multidisciplinary nature of the voice sciences. Every article addresses at least two, if not several, critical topics: (i) development and mechanisms driving vocal control and modulation; (ii) cultural and other environmental factors affecting voice modulation; (iii) evolutionary origins and adaptive functions of vocal control including cross-species comparisons; (iv) social functions and real-world consequences of voice modulation; and (v) state-of-the-art in multidisciplinary methodologies and technologies in voice modulation research. With this collection of works, we aim to facilitate cross-talk across disciplines to further stimulate the burgeoning field of voice modulation. This article is part of the theme issue ‘Voice modulation: from origin and mechanism to social impact (Part I)’.

show abstract

Section: (B) Partmentioning

confidence: 99%

Voice modulation: from origin and mechanism to social impact

Leongoméz

Pisanski

Reby

et al. 2021

Phil. Trans. R. Soc. B

View full text Add to dashboard Cite

show abstract

“…To address more critical domains, such as psychotherapy or the service industry, AI applications should describe, understand or detect more emotions in real life. For instance, one can imagine training to express self-confidence before a job interview or dealing with anxiety in a therapeutic context [ 14 ]. Thus the FEM-based process needs to adapt to more various and fine-grained requirements.…”

Section: Introductionmentioning

confidence: 99%

Combining GAN with reverse correlation to construct personalized facial expressions

Yan,

Soladié,

Aucouturier

et al. 2023

PLoS ONE

Self Cite

View full text Add to dashboard Cite

Recent deep-learning techniques have made it possible to manipulate facial expressions in digital photographs or videos, however, these techniques still lack fine and personalized ways to control their creation. Moreover, current technologies are highly dependent on large labeled databases, which limits the range and complexity of expressions that can be modeled. Thus, these technologies cannot deal with non-basic emotions. In this paper, we propose a novel interdisciplinary approach combining the Generative Adversarial Network (GAN) with a technique inspired by cognitive sciences, psychophysical reverse correlation. Reverse correlation is a data-driven method able to extract an observer’s ‘mental representation’ of what a given facial expression should look like. Our approach can generate 1) personalized facial expression prototypes, 2) of basic emotions, and non-basic emotions that are not available in existing databases, and 3) without the need for expertise. Personalized prototypes obtained with reverse correlation can then be applied to manipulate facial expressions. In addition, our system challenges the universality of facial expression prototypes by proposing the concepts of dominant and complementary action units to describe facial expression prototypes. The evaluations we conducted on a limited number of emotions validate the effectiveness of our proposed method. The code is available at https://github.com/yansen0508/Mental-Deep-Reverse-Engineering.

show abstract

Publics’ views on ethical challenges of artificial intelligence: a scoping review

Machado,

Silva,

Neiva

2023

AI Ethics

View full text Add to dashboard Cite

This scoping review examines the research landscape about publics’ views on the ethical challenges of AI. To elucidate how the concerns voiced by the publics are translated within the research domain, this study scrutinizes 64 publications sourced from PubMed® and Web of Science™. The central inquiry revolves around discerning the motivations, stakeholders, and ethical quandaries that emerge in research on this topic. The analysis reveals that innovation and legitimation stand out as the primary impetuses for engaging the public in deliberations concerning the ethical dilemmas associated with AI technologies. Supplementary motives are rooted in educational endeavors, democratization initiatives, and inspirational pursuits, whereas politicization emerges as a comparatively infrequent incentive. The study participants predominantly comprise the general public and professional groups, followed by AI system developers, industry and business managers, students, scholars, consumers, and policymakers. The ethical dimensions most commonly explored in the literature encompass human agency and oversight, followed by issues centered on privacy and data governance. Conversely, topics related to diversity, nondiscrimination, fairness, societal and environmental well-being, technical robustness, safety, transparency, and accountability receive comparatively less attention. This paper delineates the concrete operationalization of calls for public involvement in AI governance within the research sphere. It underscores the intricate interplay between ethical concerns, public involvement, and societal structures, including political and economic agendas, which serve to bolster technical proficiency and affirm the legitimacy of AI development in accordance with the institutional norms that underlie responsible research practices.

show abstract

The shallow of your smile: the ethics of expressive vocal deep-fakes

Cited by 5 publications

References 65 publications

Voice modulation: from origin and mechanism to social impact

Voice modulation: from origin and mechanism to social impact

Combining GAN with reverse correlation to construct personalized facial expressions

Publics’ views on ethical challenges of artificial intelligence: a scoping review

Contact Info

Product

Resources

About