UAVSwarm Dataset: An Unmanned Aerial Vehicle Swarm Dataset for Multiple Object Tracking

Abstract

In recent years, with the rapid development of unmanned aerial vehicles (UAV) technology and swarm intelligence technology, hundreds of small-scale and low-cost UAV constitute swarms carry out complex combat tasks in the form of ad hoc networks, which brings great threats and challenges to low-altitude airspace defense. Security requirements for low-altitude airspace defense, using visual detection technology to detect and track incoming UAV swarms, is the premise of anti-UAV strategy. Therefore, this study first collected many UAV swarm videos and manually annotated a dataset named UAVSwarm dataset for UAV swarm detection and tracking; thirteen different scenes and more than nineteen types of UAV were recorded, including 12,598 annotated images—the number of UAV in each sequence is 3 to 23. Then, two advanced depth detection models are used as strong benchmarks, namely Faster R-CNN and YOLOX. Finally, two state-of-the-art multi-object tracking (MOT) models, GNMOT and ByteTrack, are used to conduct comprehensive tests and performance verification on the dataset and evaluation metrics. The experimental results show that the dataset has good availability, consistency, and universality. The UAVSwarm dataset can be widely used in training and testing of various UAV detection tasks and UAV swarm MOT tasks.

Object Tracking Based on Satellite Videos: A Literature Review

“…There are three major modules in general visual-based object tracking [19][20][21], which are: (1) target representation scheme, defining a target that is of interest for further analysis, such as vehicles or ships; (2) search mechanism, estimating the state of the target objects;…”

A Proposed System for Multi-UAVs in Remote Sensing Operations

“…The concept of unmanned aerial vehicles reflects the fact that it is a plane without a pilot on board, meaning that all the interaction with and control of this vehicle takes place remotely; in addition, the term has recently been changed to become Unmanned Aerial Systems (UAS) to reflect the complexity of the interactions between the UAV, the Ground Control Station (GCS), and the telecommunication system in operating a UAV. The field of UAVs covers many aspects, including military and civilian applications, where military applications can be used in reconnaissance, attack roles, rescue missions, and training of military troops, while civilian applications can be used in industrial support [ 1 ], fire extinguishing [ 2 ], logistics delivery, and autonomous transport.…”

One-Shot Multiple Object Tracking in UAV Videos Using Task-Specific Fine-Grained Features

“…With the development of computer vision, MOT is widely applied in many fields, such as intelligent video surveillance [1], human-computer interaction [2], and autonomous driving [3]. In addition, MOT is the foundation for advanced computer vision tasks such as video understanding [4], behavior recognition [5], and behavior analysis [6]. In recent years, due to the strong flexibility and high safety of unmanned aerial vehicles (UAVs), MOT from the UAV view has attracted the attention of many scholars.…”