A Traffic-Sign Detection Algorithm Based on Improved Sparse R-cnn

Abstract

Automatic traffic-sign detection is a hot topic in computer vision and one of the critical technologies of intelligent transportation. The Transformer structure has recently become a research hotspot due to its excellent performance. We hope to apply this structure to the design of traffic sign detection algorithms. Therefore, we make some improvements to Sparse R-cnn, a neural network model inspired by Transformer. Sparse R-cnn is a novel model, and its core idea is to replace hundreds of thousands of candidate anchors in the RPN network with a small set of proposal boxes. The experiments in our paper proved that the performance of the Sparse R-cnn model is better than other existing general object detection models. Based on the original Sparse R-cnn inspiration, an improved Sparse R-cnn model is proposed. First, a novel backbone for the task of traffic-sign detection is proposed. Multi-scale fusion structure is the essential method of improving the algorithm for small target detection, so improving the multi-scale capability of the backbone is a required method for designing traffic sign detection. So, we made further improvements to the existing backbone ResNest. We enhanced the multi-scale representation ability of the backbone by constructing hierarchical residual-like connections within each single radix block in the original ResNest. We call the improved backbone Res2Nest. The novel backbone proposed by us shows better performance without introducing excessive computational costs to the model. In addition, the attention mechanism is also an effective method to improve the detection of traffic signs, so we set up a branch network for recalibrating the channel feature response adaptively through the Global Average Pooling (GAP) operation and a fully connected layer. It can also be seen as the implementation of the crosschannel self-attention mechanism. After experiments by TT100K dataset, our method would attain a better accuracy and robustness.

A Self-Attention Feature Fusion Model for Rice Pest Detection

“…The experimental results show that the convolution network with the self-attention mechanism is more accurate than the traditional methods. Additionally, Cao et al [26] combined the self-attention mechanism with SpareRCNN in traffic sign detection, they used the self-attention mechanism to establish a classification network, and adaptively recalibrated the channel feature response through the global average pool (GAP) operation and a full connection layer to improve the detection accuracy. The self-attention mechanism is a non local feature map processing method differs from other image processing methods.…”

An Automatic Conflict Detection Framework for Urban Intersections Based on an Improved Time Difference to Collision Indicator

“…Sparse R-CNN is a purely "sparse" object detection model, which abandons the region proposal network to produce dense anchors and avoids the complex post processing. At present, Sparse R-CNN has only been evaluated for detection accuracy on the public dataset COCO, and little research has been conducted on its application in the field of vehicle detection [23,24].…”

Cognition based Recognition of Partially Occluded Traffic Signs

“…In this work, we focus on European traffic signs only. Many computer vision based methods to automatically detect and recognize European traffic signs have been reported in literature [1,6,7,8,9,10]. Detection serves the purpose of segmenting a traffic sign in a real world scene whereas recognition deals with reading its contents.…”