Towards an AI-driven talking avatar in virtual reality for investigative interviews of children

Hassan, Syed Zohaib; Salehi, Pegah; Røed, Ragnhild Klingenberg; Halvorsen, Pål; Baugerud, Gunn Astrid; Johnson, Miriam S.; Lison, Pierre; Riegler, Michael; Lamb, Michael E.; Griwodz, Carsten; Sabet, Saeed Shafiee

doi:10.1145/3534085.3534340

Cited by 18 publications

(10 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Were great effort has been invested to design more effective interview training programs (e.g., Powell et al, 2014;Pompedda et al, 2015;Haginoya et al, 2020;Hassan et al, 2022) where continuing practice and ongoing feedback have been used to sustain the training effects (for a recent review, see Powell et al, 2022). Beyond the established efficacy of these training programs, serious gaming (Wouters et al, 2013) involving simulated avatar interviews (Pompedda et al, 2015) can be used as a tool to study the fundamental psychological processes, such as emotional impact on decision making during interviews (Zhang et al, 2022;Segal et al, 2023).…”

Section: Not Recommended Questionsmentioning

confidence: 99%

“…In fact, even trained interviewers sometimes fail to follow best practice guidelines without continuous feedback and involvement in multiple training modules ( Powell et al, 2008 ; Lamb, 2016 ) and tend to ask close-ended, leading, and repeated questions, thus increasing the likelihood of gathering only partial or even misleading information ( Santtila et al, 2004 ; Bruck et al, 2006 ; Thoresen et al, 2009 ; Leach et al, 2022 ). To address these issues, great effort has been invested to design more effective interview training programs (e.g., Powell et al, 2014 ; Pompedda et al, 2015 ; Haginoya et al, 2020 ; Hassan et al, 2022 ) where continuing practice and ongoing feedback have been used to sustain the training effects (for a recent review, see Powell et al, 2022 ). Beyond the established efficacy of these training programs, serious gaming ( Wouters et al, 2013 ) involving simulated avatar interviews ( Pompedda et al, 2015 ) can be used as a tool to study the fundamental psychological processes, such as emotional impact on decision making during interviews ( Zhang et al, 2022 ; Segal et al, 2023 ).…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Associations between emotions and psychophysiological states and confirmation bias in question formulation in ongoing simulated investigative interviews of child sexual abuse

et al. 2023

View full text Add to dashboard Cite

IntroductionIn forensic settings interviewers are advised to ask as many open-ended questions as possible. However, even experts may have difficulty following this advice potentially negatively impacting an investigation. Here, we sought to investigate how emotions and psychophysiological parameters are associated with question formulation in real time in an ongoing (simulated) child sexual abuse (CSA) interview.MethodIn a experimental study, psychology students (N = 60, Mage = 22.75) conducted two interviews with child avatars, while their emotions (anger, sadness, disgust, surprise and relief), GSR and heart rate (HR) were registered.ResultsFirst, we found that general emotionality related to CSA and perceived realness of the avatars was associated with stronger overall emotional reactions. Second, we found that closed (vs. open) questions were preceded by more facially observable anger, but not disgust, sadness, surprise or relief. Third, closed (vs. open) questions were preceded by higher GSR resistance and lower heart rate.DiscussionResults suggest for the first time that emotions and psychophysiological states can drive confirmation bias in question formulation in real time in CSA.

show abstract

Section: Not Recommended Questionsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Associations between emotions and psychophysiological states and confirmation bias in question formulation in ongoing simulated investigative interviews of child sexual abuse

et al. 2023

View full text Add to dashboard Cite

show abstract

“…2) Epistemic Calibration: Once an initial awareness would have been achieved, it may become expedient to facilitate an explorative educational VR deepfake setting. By way of example, one could implement a VR platform where individuals can experience state-of-the-art deepfake text capabilities by interacting with a set of virtual avatars some of which are driven by present-day language AI [39], [40] and some of which are embodiments of human users. In this way, people could actively improve and test their knowledge on when one must avoid to overestimate present-day language AI and in which contexts on must conversely not underestimate its abilities.…”

Section: A Vr Deepfakes For Epistemic Security Training 1) Awareness ...mentioning

confidence: 99%

VR, Deepfakes and Epistemic Security

Aliman

Kester

2022

2022 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)

View full text Add to dashboard Cite

In recent years, technological advancements in the AI and VR fields have increasingly often been paired with considerations on ethics and safety aimed at mitigating unintentional design failures. However, cybersecurity-oriented AI and VR safety research has emphasized the need to additionally appraise instantiations of intentional malice exhibited by unethical actors at pre-and post-deployment stages. On top of that, in view of ongoing malicious deepfake developments that can represent a threat to the epistemic security of a society, security-aware AI and VR design strategies require an epistemically-sensitive stance. In this vein, this paper provides a theoretical basis for two novel AIVR safety research directions: 1) VR as immersive testbed for a VR-deepfake-aided epistemic security training and 2) AI as catalyst within a deepfake-aided so-called cyborgnetic creativity augmentation facilitating an epistemically-sensitive threat modelling. For illustration, we focus our use case on deepfake text -an underestimated deepfake modality. In the main, the two proposed transdisciplinary lines of research exemplify how AIVR safety to defend against unethical actors could naturally converge toward AIVR ethics whilst counteracting epistemic security threats.

show abstract

“…Through this method, trainees can confront and comprehend their biases in a manageable environment, cultivating a more conscious and contemplative interviewing stance. This practice may translate into more balanced evaluations of interviewees in actual scenarios, encouraging impartiality and inclusivity [7][8][9][10][11][12][13][14][15][16][17][18][19][20][21][22][23].…”

Section: Introductionmentioning

confidence: 99%

Enhancing Inclusivity in Interviewing: Harnessing Intelligent Digital Avatars for Bias Mitigation

Salvetti,

Bertagni

2024

Advances in Digital Transformation - Rise of Ultra-Smart Fully Automated Cyberspace

View full text Add to dashboard Cite

Interviewing is a critical process in various fields such as human resource management, psychology, and social sciences, serving as a fundamental tool for evaluation, selection, and research. However, this process is inherently susceptible to human bias, which can adversely affect the fairness and validity of outcomes, leading to discrimination and a lack of diversity. Addressing these biases is imperative to ensure fair and equitable practices. In this chapter, we introduce an innovative application designed to address this vulnerability allowing interviewers to practice with digital humans, powered by generative artificial intelligence, and learn how to mitigate such biases. These avatars embody a substantial representation of diversity and are designed with advanced social intelligence capabilities, enabling them to engage in realistic and dynamic interactions, present a range of topics engagingly, and simulate human-like emotional and mood responses. The avatars challenge interviewers to navigate complex, multifaceted interactions, thus honing their abilities to identify and overcome personal biases. Practicing conversations with digital humans accelerates learning from experience without the risks associated with learning in the field. After each interaction, the system provides immediate feedback, fostering self-awareness and performance improvement. The integration of intelligent digital avatars into the interviewing process holds great promise for enhancing inclusivity and reducing bias. By leveraging the power of artificial intelligence and extended reality, it is possible to create a more equitable and effective interview process beneficial for both interviewers and candidates. As this technology continues to develop, it has the potential to significantly transform the landscape of interviewing across a wide range of fields.

show abstract

Towards an AI-driven talking avatar in virtual reality for investigative interviews of children

Cited by 18 publications

References 15 publications

Associations between emotions and psychophysiological states and confirmation bias in question formulation in ongoing simulated investigative interviews of child sexual abuse

Associations between emotions and psychophysiological states and confirmation bias in question formulation in ongoing simulated investigative interviews of child sexual abuse

VR, Deepfakes and Epistemic Security

Enhancing Inclusivity in Interviewing: Harnessing Intelligent Digital Avatars for Bias Mitigation

Contact Info

Product

Resources

About