Deep Crowd Anomaly Detection by Fusing Reconstruction and Prediction Networks

Abstract

Abnormal event detection is one of the most challenging tasks in computer vision. Many existing deep anomaly detection models are based on reconstruction errors, where the training phase is performed using only videos of normal events and the model is then capable to estimate frame-level scores for an unknown input. It is assumed that the reconstruction error gap between frames of normal and abnormal scores is high for abnormal events during the testing phase. Yet, this assumption may not always hold due to superior capacity and generalization of deep neural networks. In this paper, we design a generalized framework (rpNet) for proposing a series of deep models by fusing several options of a reconstruction network (rNet) and a prediction network (pNet) to detect anomaly in videos efficiently. In the rNet, either a convolutional autoencoder (ConvAE) or a skip connected ConvAE (AEc) can be used, whereas in the pNet, either a traditional U-Net, a non-local block U-Net, or an attention block U-Net (aUnet) can be applied. The fusion of both rNet and pNet increases the error gap. Our deep models have distinct degree of feature extraction capabilities. One of our models (AEcaUnet) consists of an AEc with our proposed aUnet has capability to confirm better error gap and to extract high quality of features needed for video anomaly detection. Experimental results on UCSD-Ped1, UCSD-Ped2, CUHK-Avenue, ShanghaiTech-Campus, and UMN datasets with rigorous statistical analysis show the effectiveness of our models.

Enhancement of Video Anomaly Detection Performance Using Transfer Learning and Fine-Tuning

“…In predictive techniques, the probability of the desired outcome is predicted in line with the significance in the dataset of input variables utilizing known outcomes while training the model. Several other techniques such as fuzzy theory estimation [58], adaptive sparsity model [59], sparsity-based background subtraction method [60], use of high-frequency correlation sensors [61], particle filtering [62], redundancy removal [63] are utilized in the literature to spot irregularities in the flow of traffic such as accidents, dangerous driving behavior, street crimes, traffic violations, etc.…”