Challenges for the Animation of Expressive Virtual Characters: The Standpoint of Sign Language and Theatrical Gestures

Abstract

Designing and controlling virtual characters endowed with expressive gestures requires the modeling of multiple processes, involving high-level abstract representations to lowlevel sensorimotor models. An expressive gesture is here defined as a meaningful bodily motion which intrinsically associates sense, style, and expressiveness. The main challenges rely both on the capability to produce a large spectrum of parametrized actions executed with some variability in various situations, and on the biological plausibility of the motion of the virtual characters. The goals of the paper are twofold. First we review the different formalisms used to describe expressive gestures, from notations to computational languages. Secondly we identify and discuss remaining challenges in the generation of expressive virtual characters. The different models and formalisms are illustrated more particularly for theatrical and sign language gestures.

Advanced Content and Interface Personalization through Conversational Behavior and Affective Embodied Conversational Agents

“…ECAs are those CAs that can facilitate full virtual body and the available embodiment in order to incorporate humanlike responses. The ECA technology ranges from chatbots and 2D/3D realizations in a form of talking heads [22][23][24] to fully articulated embodied conversational agents engaged in various concepts of HMI, including sign language [25], storytelling [26], companions [27], and virtual hosts within user interfaces, and even used as moderators of various concepts in ambient-assisted living environments [28][29][30][31][32].…”

A survey on the animation of signing avatars: From sign representation to utterance synthesis

“…Consequently, ECA's gestures, like those of SL, must be precise, realistic, and expressive. Different challenges have been identified in the ECA community for deictic [125] or metaphoric gestures (use of the form and motion of a gesture to convey abstract concepts [126]), or more broadly for expressive virtual agent gestures guided by semantics [127]. Such challenges are very similar to those of the SL animation community.…”