Neural Moving Object Detection by Pan-Tilt-Zoom Cameras

Abstract

Automated video surveillance using video analysis and understanding technology has become an important research topic in the area of computer vision. Most cameras used in surveillance are fixed, allowing to only look at one specific view of the surveilled area. Recently, the progress in sensor technologies is leading to a growing dissemination of Pan-Tilt-Zoom (PTZ) cameras, that can dynamically modify their field of view. Since PTZ cameras are mainly used for object detection and tracking, it is important to extract moving object regions from images taken with this type of camera. However, this is a challenging task because of the dynamic background caused by camera motion.\ud \ud After reviewing background subtraction-based approaches to moving object detection in image sequences taken from PTZ cameras, we present a neural-based background subtraction approach where the background model automatically adapts in a self-organizing way to changes in the scene background. Experiments conducted on real image sequences demonstrate the effectiveness of the presented approach

Background subtraction using Gaussian–Bernoulli restricted Boltzmann machine

“…Biologically-inspired techniques have also been adopted by using a feed-forward neural network (NN) [27] to achieve background subtraction. A recent effort based on the NN [28] extends [29] the idea of self-organisation to automatically compensate for the egomotion of a device. Convolutional NNs are used recently for background subtraction where the background modelling is learned using the hand segmented foreground objects in the training images [30].…”