Endowing Spoken Language Dialogue Systems with Emotional Intelligence

Abstract. A key goal in agent research is to be able to generate multimodal characters that can reflect a particular personality. The Big Five model of personality provides a framework for codifying personality variation. This paper reviews findings in the psychology literature to understand how the Big Five trait of emotional stability correlates with changes in verbal and nonverbal behavior. Agent behavior was modified based on these findings and a perceptual study was completed to determine if these changes lead to the controllable perception of emotional stability in virtual agents. The results reveal how language variation and the use of self-adaptors can be used to increase or decrease the perceived emotional stability of an agent. Self-adaptors are movements that often involve self-touch, such as scratching or bending one's fingers backwards in an unnatural brace. These results provide guidance on how agent designers can create particular characters, including indicating that for particular personality types, it is important to also produce typically non-communicative gestural behavior, such as the self-adaptors studied.

show abstract

“…This represents one aspect of a very significant effort to design emotion and personality models for agents (e.g. [2,17,10,38,32,1,15,31]). …”

Section: Discussionmentioning

confidence: 99%

Don’t Scratch! Self-adaptors Reflect Emotional Stability

Neff

Toothman

Bowmani

et al. 2011

Intelligent Virtual Agents

View full text Add to dashboard Cite

show abstract

“…For each condition, a video showing a dialogue between a human and a virtual agent was recorded 1,2,3,4 . In the videos, a caregiver, called Louisa, interacts with the dialogue system by a virtual avatar called Christian.…”

Section: Methodsmentioning

confidence: 99%

“…Being more polite does not become repetitive if the propositional content of the system actions changes. André et al [1] have proposed the adjustment of the politeness level for adaptation. While the robotic tutor of Saerbeck et al [8] uses hard adaptation in the form of fixed motivational sentences, it also employs soft adaptation, e.g.…”

Section: Introductionmentioning

confidence: 99%

Exploring the Applicability of Elaborateness and Indirectness in Dialogue Management

Pragst

Minker

Ultes

2018

Lecture Notes in Electrical Engineering

Self Cite

View full text Add to dashboard Cite

In this paper, we investigate the applicability of soft changes to the system behaviour, namely changing the amount of elaborateness and indirectness displayed. To this end, we examine the impact of elaborateness and indirectness on the perception of human-computer communication in a user study. Here, we show that elaborateness and indirectness influence the user's impression of a dialogue and discuss the implications of our results for adaptive dialogue management. We conclude that elaborateness and indirectness offer valuable possibilities for adaptation and should be incorporated in adaptive dialogue management.

show abstract

“…Finally, the emphasis on low-level processes in dialogue behaviour leads to models that are more concerned with the central place of emotion and feelings in dialogue behaviour (See Damasio, 1999 regarding the revival of emotions in psychology and André et al, 2004 for work on affective dialogue systems).…”

Section: Trends and Outlookmentioning

confidence: 99%

“…In this respect, it is in the spirit of the annual workshops on the Semantics and Pragmatics of Dialogue (semdial) and the sigdial workshops on Discourse and Dialogue, which bring together researchers from a variety of backgrounds to discuss recent development in dialogue research. 1 …”

Section: Introductionmentioning

confidence: 99%