MUSAK: A Multi-Scale Space Kinematic Method for Drone Detection

Abstract

Accurate and robust drone detection is an important and challenging task. However, on this issue, previous research, whether based on appearance or motion features, has not yet provided a satisfactory solution, especially under a complex background. To this end, the present work proposes a motion-based method termed the Multi-Scale Space Kinematic detection method (MUSAK). It fully leverages the motion patterns by extracting 3D, pseudo 3D and 2D kinematic parameters at three scale spaces according to the keypoints quality and builds three Gated Recurrent Unit (GRU)-based detection branches for drone recognition. The MUSAK method is evaluated on a hybrid dataset named multiscale UAV dataset (MUD), consisting of public datasets and self-collected data with motion labels. The experimental results show that MUSAK improves the performance by a large margin, a 95% increase in average precision (AP), compared with the previous state-of-the-art (SOTA) motion-based methods, and the hybrid MUSAK method, which integrates with the appearance-based method Faster Region-based Convolutional Neural Network (Faster R-CNN), achieves a new SOTA performance on AP metrics (AP, APM, and APS).

Experimental Solution for Estimating Pedestrian Locations from UAV Imagery

“…Over the last few years, R-CNN has evolved and several improved versions of the algorithm were proposed. Perhaps one of the most used versions is faster R-CNN [16], which improves the computational speed of the algorithm (e.g., used by Liu et al [17] in their proposed drone detection method). Mask R-CNN [18] provides a way to outline a detected image instead of only providing a rectangular detection window.…”