Advanced Mixed Reality Technologies for Surveillance and Risk Prevention Applications

Figure 1: An example of trans-modal rendering application selected by our engine to render 3D digital content to visually impaired people. AbstractNowadays, several techniques exist to render digital content such as graphics, audio, haptic, etc. Unfortunately, they require different faculties that cannot always be applied, e.g. providing a picture to a blind person would be useless.In this paper, we present a new multimodal rendering engine with a server web-connected to other devices to perform ubiquitous computing. In order to take advantage of user capabilities, we defined an ontology populated with the following elements: user, device, and information. Our system, with the help of this ontology, aims to select and launch automatically a rendering application.Several test case applications were implemented to render shape, text, and video information via audio, haptic, and sight channels. Validations demonstrate that our system is flexible, easily extensible, and shows promise.

show abstract

“…A situation could be a surveillance walking team helped with a video flow provided by a camera carried on a soft blimp [Thalmann et al 2006].…”

Section: Video-surveillancementioning

confidence: 99%

Context aware, multimodal, and semantic rendering engine

Salamin

Thalmann

Vexo

2009

Proceedings of the 8th International Conference on Virtual Reality Continuum and Its Applications in Industry

Self Cite

View full text Add to dashboard Cite

show abstract

“…An ARS application to flood disasters management (Thalmann et al, 2006) is another initiative. Data acquired with airborne cameras is superimposed on additional information, which forms MR. A Cave Automatic Virtual Environment (CAVE) system visualizes MR in a control room.…”

Section: Virtual Environment In Emergency Management Support: Integramentioning

confidence: 99%

Resilience of Cities to Terrorist and other Threats

Pasman¹,

Kirillov

2008

NATO Science for Peace and Security Series C Environmental Security

View full text Add to dashboard Cite

This Series presents the results of scientific meetings supported under the NATO Advanced Research Workshops (ARW) are expert meetings where an intense but informal exchange of views at the frontiers of a subject aims at identifying directions for future action re-organised. Recent volumes on topics not related to security, which result from meetings supported under the programme earlier, may be found in the NATO Science Series. Sub-Series D. Information and Communication Security IOS Press IOS Press

show abstract

“…[10] tackles the issues that rise from the integration of an intelligent agent software robot into a crisis communication portal for sending news alerts on mobile devices. The work of [13] adopts novel techniques in mixed and virtual reality technologies to enhance systems aiming at the surveillance, security and emergency, prevention plans in crowded environments. The interactive control room processes video data from airborne and fixed cameras and along with GPS driven maps generates real-time augmented 3D videos with the crowd for risk and prevention planning.…”

Section: Related Workmentioning

confidence: 99%

A System for Adaptive Multimodal Interaction in Crisis Environments

Datcu

Yang

Rothkrantz

2007

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Abstract. In the recent years multimodal interfaces have acquired an important role in human computer interaction applications. Subsequently these interfaces become more and more human-oriented. Humans use multimodality to reduce ambiguity and incompleteness of information. Seemingly they are able to switch easily from one modality to the other and fuse the information from different multimodal sources. The goal of our research was to develop a crisis based human like multimodal system. In particular, we bring into focus the multimodal interaction between human users and the automatic crisis system and its correlation with the adaptability to the human behavior in crisis situations. Our system is capable of conceding for an optimal interaction process by taking into account the major informational human channels while gathering the user inputs and producing the system feedback. In this paper we describe the design of our system which is implemented as a running prototype. We have conducted a simulation of a crisis event to measure the degree of user satisfaction. At last we discuss the drawbacks as well as the premises of our solution in the context of the high level of performance achieved by our approach.

show abstract

Advanced Mixed Reality Technologies for Surveillance and Risk Prevention Applications

Cited by 6 publications

References 10 publications

Context aware, multimodal, and semantic rendering engine

Context aware, multimodal, and semantic rendering engine

Resilience of Cities to Terrorist and other Threats

A System for Adaptive Multimodal Interaction in Crisis Environments

Contact Info

Product

Resources

About