Modelling and Evaluating Verbal and Non-Verbal Communication in Talking Animated Interface Agents

Granström, Björn; House, David

doi:10.1007/978-1-4020-5817-2_3

Cited by 6 publications

(3 citation statements)

References 35 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Various methods have been used to evaluate the effectiveness of an agent's verbal or non-verbal communication towards achieving the goal of communication. These methods can be classified as methods that investigate psychological aspects to estimate the personality and internal state of the agent [33] and those that use specific criteria to measure how the agent expresses its intention and internal states [34]. Among the methods that investigate psychological aspects, Allwood [35] discussed the features of successful verbal and non-verbal communication.…”

Section: Methodologies To Evaluate Agent Communicationmentioning

confidence: 99%

“…The authors used Eysenck's theoretical [36] basis to explain aspects of the characterization of four different agents. To evaluate the effectiveness of their agent's speech, the study by Granström and House [34] used intelligibility and information presentation, visual cues for prominence, prosody and interaction, visual cues to sentence mode, and agent expressiveness and attitude.…”

Section: Methodologies To Evaluate Agent Communicationmentioning

confidence: 99%

See 1 more Smart Citation

Speech Act Theory as an Evaluation Tool for Human–Agent Communication

Hanna

Richards

2019

Algorithms

View full text Add to dashboard Cite

Effective communication in task-oriented situations requires high-level interactions. For human–agent collaboration, tasks need to be coordinated in a way that ensures mutual understanding. Speech Act Theory (SAT) aims to understand how utterances can be used to achieve actions. SAT consists of three components: locutionary act, illocutionary act, and perlocutionary act. This paper evaluates the agent’s verbal communication while collaborating with humans. SAT was used to anatomize the structure of the agent’s speech acts (locutionary acts), the agent’s intention behind the speech acts (illocutionary acts), and the effects on the human’s mental state (perlocutionary acts). Moreover, this paper studies the impact of human perceptions of the agent’s speech acts on the perception of collaborative performance with the agent.

show abstract

Section: Methodologies To Evaluate Agent Communicationmentioning

confidence: 99%

Section: Methodologies To Evaluate Agent Communicationmentioning

confidence: 99%

Speech Act Theory as an Evaluation Tool for Human–Agent Communication

Hanna

Richards

2019

Algorithms

View full text Add to dashboard Cite

show abstract

“…Researchers have been developing human-like talking heads that can have human-like interaction with humans [1], realize realistic facial expressions [2], and express emotions [3] and communicate behaviors [4].…”

Section: Introductionmentioning

confidence: 99%

Animated Faces for Robotic Heads: Gaze and Beyond

Moubayed

Beskow

Edlund

et al. 2011

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

Abstract. We introduce an approach to using animated faces for robotics where a static physical object is used as a projection surface for an animation. The talking head is projected onto a 3D physical head model. In this chapter we discuss the different benefits this approach adds over mechanical heads. After that, we investigate a phenomenon commonly referred to as the Mona Lisa gaze effect. This effect results from the use of 2D surfaces to display 3D images and causes the gaze of a portrait to seemingly follow the observer no matter where it is viewed from. The experiment investigates the perception of gaze direction by observers. The analysis shows that the 3D model eliminates the effect, and provides an accurate perception of gaze direction. We discuss at the end the different requirements of gaze in interactive systems, and explore the different settings these findings give access to.

show abstract

Lip-Reading: Furhat Audio Visual Intelligibility of a Back Projected Animated Face

Moubayed

Skantze

Beskow

2012

Intelligent Virtual Agents

View full text Add to dashboard Cite

Abstract. Back projecting a computer animated face, onto a three dimensional static physical model of a face, is a promising technology that is gaining ground as a solution to building situated, flexible and human-like robot heads. In this paper, we first briefly describe Furhat, a back projected robot head built for the purpose of multimodal multiparty human-machine interaction, and its benefits over virtual characters and robotic heads; and then motivate the need to investigating the contribution to speech intelligibility Furhat's face offers. We present an audio-visual speech intelligibility experiment, in which 10 subjects listened to short sentences with degraded speech signal. The experiment compares the gain in intelligibility between lip reading a face visualized on a 2D screen compared to a 3D back-projected face and from different viewing angles. The results show that the audio-visual speech intelligibility holds when the avatar is projected onto a static face model (in the case of Furhat), and even, rather surprisingly, exceeds it. This means that despite the movement limitations back projected animated face models bring about; their audio visual speech intelligibility is equal, or even higher, compared to the same models shown on flat displays. At the end of the paper we discuss several hypotheses on how to interpret the results, and motivate future investigations to better explore the characteristics of visual speech perception 3D projected faces.

show abstract

Modelling and Evaluating Verbal and Non-Verbal Communication in Talking Animated Interface Agents

Cited by 6 publications

References 35 publications

Speech Act Theory as an Evaluation Tool for Human–Agent Communication

Speech Act Theory as an Evaluation Tool for Human–Agent Communication

Animated Faces for Robotic Heads: Gaze and Beyond

Lip-Reading: Furhat Audio Visual Intelligibility of a Back Projected Animated Face

Contact Info

Product

Resources

About