TransCrack: revisiting fine-grained road crack detection with a transformer design

Abstract

Prior convolution-based road crack detectors typically learn more abstract visual representation with increasing receptive field via an encoder–decoder architecture. Despite the promising accuracy, progressive spatial resolution reduction causes semantic feature blurring, leading to coarse and incontiguous distress detection. To these ends, an alternative sequence-to-sequence perspective with a transformer network termed TransCrack is introduced for road crack detection. Specifically, an image is decomposed into a grid of fixed-size crack patches, which is flattened with position embedding into a sequence. We further propose a pure transformer-based encoder with multi-head reduced self-attention modules and feed-forward networks for explicitly modelling long-range dependencies from the sequential input in a global receptive field. More importantly, a simple decoder with cross-layer aggregation architecture is developed to incorporate global with local attentions across different regions for detailed feature recovery and pixel-wise crack mask prediction. Empirical studies are conducted on three publicly available damage detection benchmarks. The proposed TransCrack achieves a state-of-the-art performance over all counterparts by a substantialmargin, and qualitative results further demonstrate its superiority in contiguous crack recognition and fine-grained profile extraction. This article is part of the theme issue ‘Artificial intelligence in failure analysis of transportation infrastructure and materials’.

Introduction to ‘Artificial intelligence in failure analysis of transportation infrastructure and materials'

“…The results show that in the evaluation of the model's comprehensive recognition performance, the highest accuracy was 99%, and the lowest accuracy was 95% after the test and evaluation of the designed model in different datasets. Lin et al [2] also proposed an AI-based method to analyse road crack. In their study, an alternative to the sequence-to-sequence perspective with a transformer network termed TransCrack was introduced for road crack detection.…”

“…Lin et al . [ 2 ] also proposed an AI-based method to analyse road crack. In their study, an alternative to the sequence-to-sequence perspective with a transformer network termed TransCrack was introduced for road crack detection.…”