Comparing Different Deep Learning Architectures as Vision-Based Multi-Label Classifiers for Identification of Multiple Distresses on Asphalt Pavement

Abstract

Distress measurement is essential in pavement management. Image-based distress identification is increasingly becoming an integral part of traffic speed network-level road condition surveys. This allows an aggregated summary of road conditions over the whole network, so it does not require an exact distress location within the lane. In this context, multi-label classification (MLC), based on convolutional neural networks (CNN), is proposed as a potential solution for distress identification from a network-level right-of-way (ROW) video survey. MLC has the advantage of low computing resource consumption, as it is implemented from lightweight classification networks. In this work, the developed MLC models used three different CNN architectures (VGG16, ResNet-34, and ResNet-50) to detect potholes, cracks, patches, and bleeding. The best model obtained 97% average accuracy with an F1-score of 93% in distress identification despite the variability in imaging hardware. This makes it possible to generalize the classification algorithm, allowing versatile applications and incorporating it into network-level pavement management systems. This model has good potential for fast and accurate distress identification from a video survey, avoiding the need for various types of expensive sensors like laser scanners.

How to Make a State of the Art Report—Case Study—Image-Based Road Crack Detection: A Scientometric Literature Review

“…Espindola et al [58]. suggest using architectures such as VGG16, ResNet-34, and ResNet-50 to explore multi-label classification (MLC) and convolutional neural networks (CNNs) to find cracks in the road.…”

Efficient data dimensionality reduction method for improving road crack classification algorithms

“…In Espindola et al. (2022) a large review of different lightweight DL models for crack detection and classification was presented. It is stated that a DL network's computational load requirement is the number of floating‐point operations per second (FLOPS).…”