Visual Drone Detection and Tracking for Autonomous Operation from Maritime Vessel

Abstract

To allow incorporation of autonomous Unmanned Aerial Vehicles (UAV's/drones) into maritime military operations, it is critical to be able to accurately localize the UAV with respect to the moving maritime vessel during the take-off and landing phases. This work addresses the study and implementation of a visual detection, tracking and threedimensional positioning method for a specific drone from a moving maritime vessel. The YOLOv5 detector and the OceanPlus tracker have been trained on a custom dataset with good performance in accuracy and processing time. The drone's position with respect to the vessel is estimated by applying stereo triangulation to the centres of the bounding boxes returned by the object detectors and trackers. The performance of the proposed positioning method was evaluated in a realistic simulated environment in the Unreal Game Engine. The proposed method allows detection, tracking, and positioning of a target drone at ranges exceeding 100m while achieving positioning errors below 10cm during landing phases.