Multimedia surveillance systems

Abstract

The integration of video technology and sensor networks constitutes the fundamental infrastructure for new generations of multimedia surveillance systems, where many different media streams (audio, video, images, textual data, sensor signals) will concur to provide an automatic analysis of the controlled environment and a real-time interpretation of the scene. New solutions can be devised to enlarge the view of traditional surveillance systems by means of distributed architectures with fixed and active cameras, to enhance their view with other sensed data, to explore multi-resolution views with zooming and omnidirectional cameras. Applications regard surveillance of wide indoor and outdoor area and particularly people surveillance: in this case, multimedia surveillance systems can be enriched with biometric technology; the best views of detected persons and their extracted visual features (e.g. faces, voices, trajectories) can be exploited for people identification.VSSN05 is the third edition of the workshop, co-located at ACM Multimedia Conference, that embraces research reports on video surveillance and, since the edition of 2004, sensor networks. This paper gives a short overview of the hot topics in multimedia surveillance systems and introduces some research activities currently engaged in the world and presented at VSSN05.

Alert-response for distributed surveillance: DODAF-based services and systems

“…Surveillance systems [1], [2], [3] are one of the wellknown multimedia-based applications which have provided a great impact on the human life in different environments and uses; starting from the simple home security monitoring system located into a single location up to a complicated system of systems (SoS) distributed over wide-area and isolated places to serve in emergency and battlefield situations. Such evolution has extended the capabilities of the surveillance systems and consequently increased its complexity.…”

Joint Effect of Multiple Correlated Cameras in Wireless Multimedia Sensor Networks

“…In WMSNs, multiple cameras work together to provide multiple views, multiple resolutions and enhanced observations of the environment [3]. Cameras are directional sensors with limited field of views [6], and the image observed by a camera is directly related to its field of view.…”

Towards Computational Modelling of Neural Multimodal Integration Based on the Superior Colliculus Concept

“…The types of saccades can be classified in different ways [39] as shown in Figure 1. Most saccades are reflexive and try to identify the point of interest in the visual field which has moved due to the previous visual frame changing to the current one [20].…”

“…According to J. Pavon [19], this multimodal integration concept is used to achieve efficiency in agents when co-operating and co-ordinating with various sensor data modalities. Similarly Rita Cucchiara [39] has established a biometric multimedia surveillance system that uses multimodal integration techniques for an effective surveillance system, but the multimodal usage is not able to overcome problems like the influence of noise.…”