Automatic Obstacle Detection Method for the Train Based on Deep Learning

Abstract

Automatic obstacle detection is of great significance for improving the safety of train operation. However, the existing autonomous operation of trains mainly depends on the signaling control system and lacks the extra equipment to perceive the environment. To further enhance the efficiency and safety of the widely deployed fully automatic operation (FAO) systems of the train, this study proposes an intelligent obstacle detection system based on deep learning. It collects perceptual information from industrial cameras and light detection and ranging (LiDAR), and mainly implements the functionality including rail region detection, obstacle detection, and visual–LiDAR fusion. Specifically, the first two parts adopt deep convolutional neural network (CNN) algorithms for semantic segmentation and object detection to pixel-wisely identify the rail track area ahead and detect the potential obstacles on the rail track, respectively. The visual–LiDAR fusion part integrates the visual data with the LiDAR data to achieve environmental perception for all weather conditions. It can also determine the geometric relationship between the rail track and obstacles to decide whether to trigger a warning alarm. Experimental results show that the system proposed in this study has strong performance and robustness. The system perception rate (precision) is 99.994% and the recall rate reaches 100%. The system, applied to the metro Hong Kong Tsuen Wan line, effectively improves the safety of urban rail train operation.

Toward the Enhancement of Rail Sustainability: Demonstration of a Holistic Approach to Obstacle Detection in Operational Railway Environments

“…Recent advancements in Artificial Intelligence (AI) and sensor technology have resulted in significant work on OD in railways [12,13]. Validating these autonomous obstacle detection (OD) systems in real-world scenarios is crucial for ensuring their reliability, safety, and practicality.…”

Intelligent Diagnosis of Urban Underground Drainage Network: From Detection to Evaluation

“…Notably, these single-stage algorithms have been observed to struggle with higher recall rates for smaller pipeline defects. Beyond the widely implemented attention mechanisms designed to adjust model weights, Shen [76] has explored integrating the RFB module into SSD's backbone network coupled with a skip-dense connection module (SDCM) for feature fusion. Te result is a signifcant enhancement in detection accuracy, with a recorded mAP of 92.20%.…”

Recent Advancements in Deep Learning Applications and Methods for Autonomous Navigation -- A Comprehensive Review

“…To enhance the safety of train operations it is crucial to detect the objects in rail region autonomously. Authors in [262], used LiDAR and camera to detect the obstacle within the rail region by utilizing CNNs for semantic segmentation and pixel-wise object detection. An encoder-decoder architecture based on CNNs was used to segment images for the purpose of identifying rail regions.…”