Pragmatic Multimodality: Effects of Nonverbal Cues of Focus and Certainty in a Virtual Human

Freigang, Farina; Klett, Sören; Kopp, Stefan

doi:10.1007/978-3-319-67401-8_16

Cited by 2 publications

(1 citation statement)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These cues include gestures, facial expressions, posture, eye contact, and prosody. According to Freigang et al, users tend to perceive the utterances of VHs as more competent and significant when they utilize gestures, facial expressions, head nods, and prosody [20]. Similarly, several advantages of non-verbal cues have been reported.…”

Section: Nonverbal Cuesmentioning

confidence: 99%

The Effect of Eye Contact in Multi-Party Conversations with Virtual Humans and Mitigating the Mona Lisa Effect

Kum,

Jung,

Lee

2024

Electronics

View full text Add to dashboard Cite

The demand for kiosk systems with embodied conversational agents has increased with the development of artificial intelligence. There have been attempts to utilize non-verbal cues, particularly virtual human (VH) eye contact, to enable human-like interaction. Eye contact with VHs can affect satisfaction with the system and the perception of VHs. However, when rendered in 2D kiosks, the gaze direction of a VH can be incorrectly perceived, due to a lack of stereo cues. A user study was conducted to examine the effects of the gaze behavior of VHs in multi-party conversations in a 2D display setting. The results showed that looking at actual speakers affects the perceived interpersonal skills, social presence, attention, co-presence, and competence in conversations with VHs. In a second study, the gaze perception was further examined with consideration of the Mona Lisa effect, which can lead users to believe that a VH rendered on a 2D display is gazing at them, regardless of the actual direction, within a narrow range. We also proposed the camera rotation angle fine tuning (CRAFT) method to enhance the users’ perceptual accuracy regarding the direction of the VH’s gaze.The results showed that the perceptual accuracy for the VH gaze decreased in a narrow range and that CRAFT could increase the perceptual accuracy.

show abstract

Section: Nonverbal Cuesmentioning

confidence: 99%