Detection, Tracking, and Geolocation of Moving Vehicle From UAV Using Monocular Camera

Abstract

Unmanned aerial vehicles (UAVs) have been widely used in urban traffic supervision in recent years. However, the detection, tracking, and geolocation of moving vehicle based on the airborne platform suffer from small object sizes, complex scenes, and low-accuracy sensors. To address these problems, this paper develops a framework for moving vehicle detecting, tracking, and geolocating based on a monocular camera, a GPS receiver, and inertial measurement units (IMUs) sensors. First, the method based on YOLOv3 was employed for vehicle detection due to its effectiveness and efficiency for small object detection in complex scenes. Then, a visual tracking method based on correlation filters is introduced, and a passive geolocation method is presented to calculate the GPS coordinates of the moving vehicle. Finally, a flight control method in terms of the previous image processing results is introduced to lead the UAV that is following the interesting moving vehicle. The proposed scheme has been built on a DJI M100 platform on which a monocular camera and a microcomputer Jetson TX1 are added. The experimental results show that this scheme is capable of detecting, tracking, and geolocating the interesting moving vehicle with high precision. The framework demonstrates its capacity in automatic supervision on target vehicles in real-world experiments, which suggests its potential applications in urban traffic, logistics, and security. INDEX TERMS Unmanned aerial vehicle, YOLOv3, object geolocation, moving vehicle tracking.

MLSS-VO: A Multi-Level Scale Stabilizer with Self-Supervised Features for Monocular Visual Odometry in Target Tracking

“…Visual odometry (VO), as the core of solving the autonomous positioning problem of robots, has been of great interest to researchers in the visual field. Although binocular vision has advantages in accuracy, the monocular system still has certain advantages for automobiles [1], UAVs [2], and other industries due to the steady decline in the cost of consumer-level monocular cameras in recent years and the lower calibration workload. Therefore, the challenges of visual odometry are both fundamental and practical.…”

Real-Time Human-UAV Interaction: New Dataset and Two Novel Gesture-Based Interacting Systems

“…Nowadays, the camera became the default onboard UAV sensor, it's a cheap, passive, and weightless sensor which can provide great information about the UAV's surroundings. As a result, diverse researches have been built to investigate the benefits of using a camera sensor in different applications, for instance, UAV target tracking [8], [9], aerial surveillance [10], [11], UAV path planning [12], fire observation [13], [14], and HMI [15], [16]. These types of researches used image information for important and practical applications in our daily life.…”

Self-Navigating UAVs for Supervising Moving Objects over Large-Scale Wireless Sensor Networks

“…With respect to usage of on-board sensing electronics, in [20,21], the authors proposed image-based navigation algorithms. This strategy obviously eases the work of users/operators, given that UAVs provide visual data of targets.…”

“…The tracking machine uses a monocular camera and exchanges data with the target to assure the mission success. Differently, multiple means (monocular camera, GPS receiver, and IMU sensor) were exploited in [21] for a UAV to supervise moving vehicles in multiple levels. The proposed scheme first visually detects a vehicle, then tracks its movement, and eventually processes data to navigate the flying UAV from the ground.…”