Deep Learning for UAV-based Object Detection and Tracking: A Survey

Abstract

This is the pre-acceptance version, to read the final version please go to IEEE Geoscience and Remote Sensing Magazine on IEEE Xplore. Owing to effective and flexible data acquisition, unmanned aerial vehicle (UAV) has recently become a hotspot across the fields of computer vision (CV) and remote sensing (RS). Inspired by recent success of deep learning (DL), many advanced object detection and tracking approaches have been widely applied to various UAV-related tasks, such as environmental monitoring, precision agriculture, traffic management. This paper provides a comprehensive survey on the research progress and prospects of DL-based UAV object detection and tracking methods. More specifically, we first outline the challenges, statistics of existing methods, and provide solutions from the perspectives of DL-based models in three research topics: object detection from the image, object detection from the video, and object tracking from the video. Open datasets related to UAV-dominated object detection and tracking are exhausted, and four benchmark datasets are employed for performance evaluation using some state-of-the-art methods. Finally, prospects and considerations for the future work are discussed and summarized. It is expected that this survey can facilitate those researchers who come from remote sensing field with an overview of DL-based UAV object detection and tracking methods, along with some thoughts on their further developments.

POSEIDON: A Data Augmentation Tool for Small Object Detection Datasets in Maritime Environments

“…However, in the current study, we have opted for YOLOv5 [ 21 ], which is one of the popular object detection models. While the choice of object detector is not a critical aspect, YOLO [ 22 ] family detectors have demonstrated strong performance in datasets with similar characteristics [ 23 , 24 , 25 ]. Furthermore, we chose YOLOv5 because it has proven to be effective in this specific dataset, and it includes an option to balance datasets using weighted errors.…”

A Small Object Detection Method for Drone-Captured Images Based on Improved YOLOv7

“…Due to the fact that images obtained by drones are usually at higher positions and objects in the images are often small in size and captured from a limited range of angles, object detection for drones is different and more difficult compared to ordinary object detection. Exploring a high-precision object detection algorithm suitable for drone platforms is a popular research direction in the domain of object detection today [2][3][4].…”

An enhanced YOLOv5 based on Color Harmony Algorithm for object detection in Unmanned Aerial Vehicle captured Images

“…Early UAV and OD methods used context and feature extraction [9]. Despite its e ciency, these approaches depend heavily on descriptive features and image perspectives, which require a lot of effort and compute and decrease the model's transferability [10].…”