Furhat: A Back-Projected Human-Like Robot Head for Multiparty Human-Machine Interaction

Moubayed, Samer Al; Beskow, Jonas; Skantze, Gabriel; Granström, Björn

doi:10.1007/978-3-642-34584-5_9

Cited by 198 publications

(129 citation statements)

References 12 publications

Supporting

Mentioning

123

Contrasting

Order By: Relevance

“…Furhat, shown in Figure 1, can be regarded as a middleground between a mechanical robot head and animated agents [10]. Using a micro projector, the facial animation is projected on a three-dimensional mask that is a three dimensional printout of the same head model used in the animation software.…”

Section: Methodology 21 Furhat: a Back-projected Robot Headmentioning

confidence: 99%

Perception of gaze direction for situated interaction

Moubayed¹,

Skantze²

2012

Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction

Self Cite

View full text Add to dashboard Cite

Accurate human perception of robots' gaze direction is crucial for the design of a natural and fluent situated multimodal face-to-face interaction between humans and machines. In this paper, we present an experiment targeted at quantifying the effects of different gaze cues synthesized using the Furhat back-projected robot head, on the accuracy of perceived spatial direction of gaze by humans using 18 test subjects. The study first quantifies the accuracy of the perceived gaze direction in a human-human setup, and compares that to the use of synthesized gaze movements in different conditions: viewing the robot eyes frontal or at a 45 degrees angle side view. We also study the effect of 3D gaze by controlling both eyes to indicate the depth of the focal point (vergence), the use of gaze or head pose, and the use of static or dynamic eyelids. The findings of the study are highly relevant to the design and control of robots and animated agents in situated face-to-face interaction.

show abstract

Section: Methodology 21 Furhat: a Back-projected Robot Headmentioning

confidence: 99%

Perception of gaze direction for situated interaction

Moubayed¹,

Skantze²

2012

Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction

Self Cite

View full text Add to dashboard Cite

show abstract

“…As noted, VOILA has been deployed onto Furhat: a human-like Robot Head (Moubayed et al, 2011), which provides an interaction framework for the management of multi-party, multi-modal interactions, and which employs a Microsoft Kinect for skeletal tracking. In the demonstration, the VOILA agent will randomly choose 20 visual objects, and then learn to describe them using their low-level visual attributes (e.g.…”

Section: Demonstrationmentioning

confidence: 99%

VOILA: An Optimised Dialogue System for Interactively Learning Visually-Grounded Word Meanings (Demonstration System)

Eshghi

Lemon

2017

Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue

View full text Add to dashboard Cite

We present VOILA: an optimised, multimodal dialogue agent for interactive learning of visually grounded word meanings from a human user. VOILA is: (1) able to learn new visual categories interactively from users from scratch; (2) trained on real human-human dialogues in the same domain, and so is able to conduct natural spontaneous dialogue; (3) optimised to find the most effective trade-off between the accuracy of the visual categories it learns and the cost it incurs to users. VOILA is deployed on Furhat 1 , a humanlike, multi-modal robot head with backprojection of the face, and a graphical virtual character.

show abstract

“…Furhat [13] is a robot head that consists of an animated face that is projected using a micro projector on a three dimensional physical mask that matches in design the animated face that is projected on it. The state of the art animation models used in Furhat produce synchronized articulatory movements in correspondence to output speech [14], and allow for highly accurate and realistic control of different facial movements.…”

Section: The Furhat Embodied Agentmentioning

confidence: 99%