Towards Environment-to-Environment (E2E) multimedia communication systems

Abstract

We present an approach to connect multiple remote environments for natural interaction among people and objects. Focus of current communication and telepresence systems severely restrict user affordances in terms of movement, interaction, peripheral vision, spatio-semantic integrity and even information flow. These systems allow information transfer rather than experiential interaction. We propose Environment-to-Environment (E2E) as a new paradigm for communication which allows users to interact in natural manner using text, audio, and video by connecting environments. Each Environment is instrumented using as many different types of sensors as may be required to detect presence and activity of objects and this object position and activity information is used to direct multimedia information to be sent to other Environments as well as present incoming multimedia information on right displays and speakers. The mediation for the appropriate data capture and presentation is done by a scalable event-based multimodal information system. This paper describes the design principles for E2E communication, discusses system architecture, and gives our experience in implementing prototypes of such systems in telemedicine and office collaboration applications. We also discuss the research challenges and a road-map for creating more sophisticated E2E applications in near future.

Creating Spatio-Temporal Contiguities Between Real and Virtual Rooms in an Assistive Living Environment

“…In a business environment, conference rooms have used similar set-ups to create telepresence (Singh et al 2008).…”

Situation based control for cyber-physical environments

“…A typical problem in such a system is that of choosing the best (audio/ video output) data feed to be sent to other users, and identifying the most appropriate settings for actuators and rendering devices to present the incoming audio video information. Readers are pointed to [15] for more details on this paradigm and implementation.…”