Getting in Touch with a Cognitive Character

Bierz, Torsten; Dannenmann, Peter; Hergenröther, Kai; Bertram, Matthias; Barthel, Henning; Scheuermann, Gerik; Hagen, Hans

doi:10.1109/whc.2005.63

Cited by 3 publications

(2 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In applying our concept more broadly, we foresee applications of our framework across the entire reality-virtuality continuum. Using full immersive Virtual Reality, in which the physical intermediary is not seen, we anticipate the use of haptics systems and virtual characters for getting in touch with the receiver's physical space, Bierz et al ( 2005 ). In a robotic telepresence scenario, in which the intermediary is a robot with spatial audio systems and physical animated facial expressions, we envision the robot to be driven by our system using synchronized audio and captured facial data.…”

Section: Limitations and Future Workmentioning

confidence: 99%

Intermediated Reality: A Framework for Communication Through Tele-Puppetry

Casas

Mitchell

2019

Front. Robot. AI

View full text Add to dashboard Cite

We introduce Intermediated Reality (IR), a framework for intermediated communication enabling collaboration through remote possession of entities (e.g., toys) that come to life in mobile Mediated Reality (MR). As part of a two-way conversation, each person communicates through a toy figurine that is remotely located in front of the other participant. Each person's face is tracked through the front camera of their mobile devices and the tracking pose information is transmitted to the remote participant's device along with the synchronized captured voice audio, allowing a turn-based interactive avatar chat session, which we have called ToyMeet. By altering the camera video feed with a reconstructed appearance of the object in a deformed pose, we perform the illusion of movement in real-world objects to realize collaborative tele-present augmented reality (AR). In this turn based interaction, each participant first sees their own captured puppetry message locally with their device's front facing camera. Next, they receive a view of their counterpart's captured response locally (in AR) with seamless visual deformation of their local 3D toy seen through their device's rear facing camera. We detail optimization of the animation transmission and switching between devices with minimized latency for coherent smooth chat interaction. An evaluation of rendering performance and system latency is included. As an additional demonstration of our framework, we generate facial animation frames for 3D printed stop motion in collaborative mixed reality. This allows a reduction in printing costs since the in-between frames of key poses can be generated digitally with shared remote review.

show abstract

Section: Limitations and Future Workmentioning

confidence: 99%

Intermediated Reality: A Framework for Communication Through Tele-Puppetry

Casas

Mitchell

2019

Front. Robot. AI

View full text Add to dashboard Cite

show abstract

“…Both approaches are very interesting but lack force feedback to limit the user's actions, causing several interaction issues. Bierz et al, 14 describe haptic interaction with cognitive avatars in their CONTACT project. More specifically, the user can interactively influence an actor's planned path by blocking the avatar's path with his virtual hand representation, forcing the actor to calculate a new path.…”

Section: Related Workmentioning

confidence: 99%

Bringing haptics and physical simulation together: haptic travel through physical worlds

Jorissen

Boeck²,

Lamotte³

2006

Computer Animation & Virtual

View full text Add to dashboard Cite

This paper describes our efforts in bringing haptics closer to current dynamic virtual environments (VE). These interactive 3D worlds make more and more use of physical simulations in order to increase realism. As a first step in closing the gap, we propose haptic travel that allows users to feel how their virtual representation navigates through the simulated world. In this work, we show how we coupled stable haptic rendering to physical simulation in order to achieve this. By generating a force feedback field, based on the user's input in combination with collision information provided by a rigid body simulator, we managed to provide the user with useful information on what is happening to its virtual representation. A humanoid animated character, which represents the user, is coupled to the rigid body object that represents the user in physical space. This character is animated according to the travel motions that the physical object makes, depending on user input from the haptic device. Our approach is suitable for a whole set of applications and input devices and can reduce the number of devices necessary to interact in VEs.

show abstract

The Haptik Library

Pascale¹,

Prattichizzo²

2007

IEEE Robot. Automat. Mag.

View full text Add to dashboard Cite

The Haptik Library is a newly developed method to access haptic devices. In addition to its device independency, it has a driver version transparency and both backward and future binary compatibility with new devices, drivers and APIs. This Haptik Library has a plugin-based architecture that allows the addition of support for latest devices and drivers without the need for a recompilation of the library. This library can easily be used in existing complex applications with different architectures and has been designed to develop research applications that requires custom graphic engines. However, Haptik lack the support for non-mainstream devices and minor differences. This library is currently being used both for high-end visio-haptic development and as a teaching tool

show abstract

Getting in Touch with a Cognitive Character

Cited by 3 publications

References 13 publications

Intermediated Reality: A Framework for Communication Through Tele-Puppetry

Intermediated Reality: A Framework for Communication Through Tele-Puppetry

Bringing haptics and physical simulation together: haptic travel through physical worlds

The Haptik Library

Contact Info

Product

Resources

About