A calibration free hybrid RF and video surveillance system for reliable tracking and identification

Abstract

We introduce a calibration free hybrid RF and video surveillance system for reliable tracking, identification in Mass Casualty Incidents (MCI). The system fuses RF measurements along with information harvested from the video such as target temporal, kinematic, and appearance information. Our hybrid RF and video surveillance system can be deployed rapidly without manual calibration of either the camera or the RF devices, and can work in complex RF environments. This is made possible by the simultaneous identification and mapping algorithm that iteratively refines the mapping of the radio beacon signal strength signature to target positions in video frames. The system is the basis of identity aware video surveillance, i.e. enabling unique identification of targets in the video and applying identity specific analytics roles to individual targets.

Tracking by Identification Using Computer Vision and Radio

“…Yu and Ganz [37] aim to prevent identity switches in longer video sequences by associating identities from a signal-strength-based active RFID system with tracklets that are obtained from a calibrated video camera. Later, they extended their approach to use raw (uncalibrated) radio measurements, and perform tracking and identity association in image plane instead on the ground plane [38]. …”