Real-time lane detection model based on non bottleneck skip residual connections and attention pyramids

Abstract

The security of car driving is of interest due to the growing number of motor vehicles and frequent occurrence of road traffic accidents, and the combination of advanced driving assistance system (ADAS) and vehicle-road cooperation can prevent more than 90% of traffic accidents. Lane detection, as a vital part of ADAS, has poor real-time performance and accuracy in multiple scenarios, such as road damage, light changes, and traffic jams. Moreover, the sparse pixels of lane lines on the road pose a tremendous challenge to the task of lane line detection. In this study, we propose a model that fuses non bottleneck skip residual connections and an improved attention pyramid (IAP) to effectively obtain contextual information about real-time scenes and improve the robustness and real-time performance of current lane detection models. The proposed model modifies the efficient residual factorized pyramid scene parsing network (ERF-PSPNet) and utilizes skip residual connections in non bottleneck-1D modules. A decoder with an IAP provides high-level feature maps with pixel-level attention. We add an auxiliary segmenter and a lane predictor side-by-side after the encoder, the former for lane prediction and the latter to assist with semantic segmentation for classification purposes, as well as to solve the gradient disappearance problem. On the CULane dataset, the F1 metric reaches 92.20% in the normal scenario, and the F1 metric of the model is higher than the F1 metrics of other existing models, such as ERFNet-HESA, ENet_LGAD, and DSB+LDCDI, in normal, crowded, night, dazzling light and no line scenarios; in addition, the mean F1 of the nine scenarios reached 74.10%, the runtime (time taken to test 100 images) of the model was 5.88 ms, and the number of parameters was 2.31M, which means that the model achieves a good trade-off between real-time performance and accuracy compared to the current best results (i.e., a running time of 13.4 ms and 0.98M parameters).

Rail-STrans: A Rail Surface Defect Segmentation Method Based on Improved Swin Transformer

“…Dong et al [34] integrated multiscale contextual information by adding four global convolutional blocks to the pyramid feature extraction module and enhanced the network's focus on the target region by incorporating a guided attention mechanism. Chen et al [35] improved the attention pyramid module, reducing network complexity while effectively capturing contextual information from real-time scenes, thereby enhancing the model's accuracy and real-time performance. However, during the detection process, the conventional convolutional operation can only gather local information from the image and lacks a global perspective.…”

Automated Lane Centering: An Off-the-Shelf Computer Vision Product vs. Infrastructure-Based Chip-Enabled Raised Pavement Markers

“…Typical lane detection technology based on computer vision utilizes image processing algorithms. These algorithms extract features of lane lines by reducing image channels, processing acquired images, and fitting lane lines after extraction [7,8]. Computer vision systems, although useful, have limitations.…”

Are Warnings Suitable for Presentation in Head-Up Display? A Meta-Analysis for the Effect of Head-Up Display Warning on Driving Performance

“…An advanced driver assistance system (ADAS) can improve driving safety by sensing the surrounding environment, collecting information, analyzing this information through various devices installed in the vehicle, and ultimately enabling the driver to detect possible dangers in advance. Indeed, according to Chen et al ( 1 ), the combination of ADAS and vehicle–road cooperation could prevent more than 90% of traffic accidents. By providing drivers with information, warnings, and operational support, ADAS could significantly improve driving safety ( 2 – 4 ).…”