2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology 2008
DOI: 10.1109/wiiat.2008.192
|View full text |Cite
|
Sign up to set email alerts
|

Affect as Information about Users' Attitudes to Conversational Agents

Abstract: This paper presents a novel method for automatic evaluation of conversational agents. In the method, information about users' attitudes and sentiments to conversational agents and their performance are achieved by analyzing their general emotional engagement in the conversation and specific affective states, and interpreting them using psychological reasoning of Affect-as-Information. In the evaluation experiment the users' attitudes to two Japanesespeaking conversational agents were checked simultaneously in … Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1

Citation Types

0
4
0

Year Published

2009
2009
2010
2010

Publication Types

Select...
3

Relationship

3
0

Authors

Journals

citations
Cited by 3 publications
(4 citation statements)
references
References 11 publications
(11 reference statements)
0
4
0
Order By: Relevance
“…As part of our research on an emotion recognition agent, we have also developed an automatic emotiveness-analysis-based method for dialogue systems evaluation. The chat logs from an experiment with our humor-equipped agents were analyzed using ML-Ask Emotive Elements/Emotive Expressions Analysis Agent, developed by Ptaszynski et al [25,26]. ML-Ask analyzed users' emotive reactions towards both (humor-and non-humor-equipped) agents, searching for positive and negative emotions.…”
Section: Our Research So Farmentioning
confidence: 99%
See 1 more Smart Citation
“…As part of our research on an emotion recognition agent, we have also developed an automatic emotiveness-analysis-based method for dialogue systems evaluation. The chat logs from an experiment with our humor-equipped agents were analyzed using ML-Ask Emotive Elements/Emotive Expressions Analysis Agent, developed by Ptaszynski et al [25,26]. ML-Ask analyzed users' emotive reactions towards both (humor-and non-humor-equipped) agents, searching for positive and negative emotions.…”
Section: Our Research So Farmentioning
confidence: 99%
“…Another agent used in this research is Ptaszynski et al's ML-Ask Emotive Elements/Emotive Expressions Analysis System [25,26]. As mentioned above, in this system the emotiveness analysis agent performs two functions:…”
Section: Emotiveness Analysis Agent (Ml-ask)mentioning
confidence: 99%
“…As shown in Figure 7, most of the users showed more emotions towards Pundalin than towards Modalin, which means that they were generally more emotively involved in the conversation with the system which used humor [20]). …”
Section: General Emotivenessmentioning
confidence: 96%
“…If emotions detected by ML-Ask were positive or changing from negative through neutral (non-emotive) to positive during the whole conversation, the general sentiment towards the system was considered to be positive. If the emotions detected by ML-Ask were negative or changing from positive through neutral to negative during the whole conversation, the general sentiment towards the system was considered to be negative [20].…”
Section: Determining General Emotiveness (Emotive/non-emotive) and 2mentioning
confidence: 99%