Janus - Multi Source Event Detection and Collection System for Effective Surveillance of Criminal Activity

Abstract

Recent technological advances provide the opportunity to use large amounts of multimedia data from a multitude of sensors with different modalities (e.g., video, text) for the detection and characterization of criminal activity. Their integration can compensate for sensor and modality deficiencies by using data from other available sensors and modalities. However, building such an integrated system at the scale of neighborhood and cities is challenging due to the large amount of data to be considered and the need to ensure a short response time to potential criminal activity. In this paper, we present a system that enables multi-modal data collection at scale and automates the detection of events of interest for the surveillance and reconnaissance of criminal activity. The proposed system showcases novel analytical tools that fuse multimedia data streams to automatically detect and identify specific criminal events and activities. More specifically, the system detects and analyzes series of incidents (an incident is an occurrence or artifact relevant to a criminal activity extracted from a single media stream) in the spatiotemporal domain to extract events (actual instances of criminal events) while cross-referencing multimodal media streams and incidents in time and space to provide a comprehensive view to a human operator while avoiding information overload. We present several case studies that demonstrate how the proposed system can provide law enforcement personnel with forensic and real time tools to identify and track potential criminal activity.

Detection and Modeling of Cyber Attacks with Petri Nets

“…[11,12]. Moreover, the evolution towards cloud computing, increasing use of social networks, mobile and peer-to-peer networking technologies, which are an intrinsic part of our daily routine, bring many conveniences to our personal life, business and government, gives the possibility of using them as tools for cyber criminals [13] and a potential path of malware propagation [14,15].…”

Achieving Fair Spectrum Allocation and Reduced Spectrum Handoff in Wireless Sensor Networks: Modeling via Biobjective Optimization

“…One of the primary objectives of WSNs is to transmit monitored results timely and concurrently, without using large amount of network resources. The dynamic spectrum access becomes very vital to achieve such timely and concurrent transmissions in WSNs; for instance, in a WSN for real time surveillance system [5,6] or real time machine-to-machine communications [7], the transmissions of video or image data captured by the sensors require high bandwidth and multiple spectra [8]. Subsequently, the following major principles can be made.…”

Trajectory based database management for intelligent surveillance system with heterogeneous sensors

“…Also, visual sensors with PTZ functionality zoom in objects to obtain the high resolution information [5]. One of the key functionalities in an intelligent surveillance system is to search the information related to a surveillance event from the database [12,16]. Information management and searching process have also been considered important approach for other research area, for example, data recommendation field [9,11,15].…”