Real-Time Detection and Recognition of Railway Traffic Signals Using Deep Learning

Abstract

Automated detection and recognition of traffic signals are of great significance in railway systems. Autonomous driving solutions are well established for urban rail transportation systems. Many metro lines in service worldwide have reached the highest grade of automation where the train is automatically operated without any staff on board. However, autonomous driving is still an open challenge for mainline trains, due to the complexity of the mainline environment. In this context, automated recognition of wayside signals can help to minimise the risk of human error owing to low visibility and fatigue. It represents a key step towards the fully autonomous train. In this article we present a deep learning based approach for the above task. The You Only Look Once (YOLOv5) is used for detection and recognition of wayside signals. A heuristic is used to recognise blinking states. We consider FRSign dataset, a large collection of over 100,000 images of traffic signals from some of the trains in French Railways. A distilled and cleaned version of the dataset curated by us is used for training. The trained network has low computational overhead and can recognise traffic signals in real time and under diverse field conditions. It has robust performance even for complex scenes having multiple signals and light sources, and in adverse circumstances such as rain and night environments. The refined version of the dataset is published as open for validation and further research and development.

Challenges and Opportunities for Improving Management and Regulation of the Rail Transport Sector in Indonesia: Perspective From the Industry 4.0 Concept

“…The only ones using the GOA 1 are passenger trains in the Jabodebek area, which should eventually progress to GOA 3 and GOA 4. GOA 1 involves automatic train stops and protection, necessitating security installations on rail infrastructure facilities (Horcas et al, 2015;Staino et al, 2022). This proposal was once suggested but canceled due to the infrastructure being unprepared.…”

Automatic Switching of Electric Locomotive Power in Railway Neutral Sections Using Image Processing

“…It should be noted, however, that when examining related works about railway computer vision applications [ 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 , 28 ], there is still much room left for the field to mature. Furthermore, it is stressed that existing algorithms and approaches are not universal, since railway signage differs in various countries around the world.…”

“…More recently, Ref. [ 25 ] discusses the importance of automated detection and recognition of traffic signals in railway systems, especially for mainline locomotives, where autonomous driving is still challenging due to the complex nature of the environment. The authors introduce a deep learning method using the You Only Look Once (YOLOv5) architecture for detecting and recognizing wayside signals, including a heuristic for identifying blinking states.…”

Efficacy of Bluetooth-Based Data Collection for Road Traffic Analysis and Visualization Using Big Data Analytics

“…[25][26][27] are very important to present the findings of data analysis to the target audience. Big data are also being analysed and used in various ways like fuzzy-logic based machine learning algorithms and deep learning techniques for varied applications [25,28] .…”