Anchor‐adaptive railway track detection from unmanned aerial vehicle images

Abstract

Autonomous railway inspection with unmanned aerial vehicles (UAVs) has huge advantages over traditional inspection methods. As a prerequisite for UAV‐based autonomous following of railway lines, it is quite essential to develop intelligent railway track detection algorithms. However, there are no existing algorithms currently that can efficiently adapt to the demand for the various forms and changing inclination angles of railway tracks in the UAV aerial images. To address the challenge, this paper proposes a novel anchor‐adaptive railway track detection network (ARTNet), which constructs a dual‐branch architecture based on projection length discrimination to realize full‐angle railway track detection for the UAV aerial images taken from arbitrary viewing angles. Considering the potential capacity imbalance of the two branches that can be caused by the uneven distribution of railway tracks in the dataset, a balanced transpose co‐training strategy is proposed to train the two branches coordinately. Moreover, an extra customized transposed consistency loss is designed to guide the training of the network without increasing any computational complexity. A set of experiments have been conducted to verify the feasibility and superiority of the ARTNet. It is demonstrated that our approach can effectively realize full‐angle railway track detection and outperform other popular algorithms greatly in terms of both detection accuracy and reasoning efficiency. ARTNet can achieve a mean F1 of 76.12 and run at a speed of 50 more frames per second.

Autonomous flight strategy of an unmanned aerial vehicle with multimodal information for autonomous inspection of overhead transmission facilities

“…Especially unmanned aerial vehicles (UAVs) have gained attention because UAVs can easily access infrastructure at any location by deploying novel noncontact sensors (Pastor et al., 2007). Specifically, specialized UAVs have been proposed for a variety of applications, including a deflection estimation of bridges (Zhuge et al., 2022), railway tracks detection (Tong et al., 2023), inspection of large buildings (Mader et al., 2016), assessment of contaminant distribution and mobility (Martin et al., 2016), and monitoring defects in photovoltaic power plants (Libra et al., 2019). These trials mark the beginning of a new era in the O&M of infrastructure.…”

Sequential-Fault Diagnosis Strategy for High-Speed Train Traction Systems Based on Unreliable Tests

“…Due to the rapid increase in rail transit passenger flow, the requirements for train safety have become more stringent. Research on train safety issues [1,2] is also emerging in an endless stream. A train information control system is the core of a high-speed train, and a traction system is the "heart" of the high-speed train information control system.…”

Intelligent recognition of defects in high‐speed railway slab track with limited dataset

“…Tong et al. (2023) proposed a novel anchor‐adaptive railway track detection network realizing full‐angle railway track detection for the UAV aerial images taken from arbitrary viewing angles. W. Ye et al.…”

“…F. Guo et al (2021) proposed a realtime pixel-level rail components detection framework that realized fast object detection and highly accurate instance segmentation. Tong et al (2023) proposed a novel anchor-adaptive railway track detection network realizing full-angle railway track detection for the UAV aerial images taken from arbitrary viewing angles. W. Ye et al (2022Ye et al ( , 2023 realized rapid detection of apparent cracks in rail concrete based on deep learning and developed a systematic pixel-level crack segmentation-quantification method suited for nighttime detection of slab tracks.…”