Attention-Based Multi-Scale Convolutional Neural Network (A+MCNN) for Multi-Class Classification in Road Images

Abstract

Automated pavement distress recognition is a key step in smart infrastructure assessment. Advances in deep learning and computer vision have improved the automated recognition of pavement distresses in road surface images. This task remains challenging due to the high variation of defects in shapes and sizes, demanding a better incorporation of contextual information into deep networks. In this paper, we show that an attention-based multi-scale convolutional neural network (A+MCNN) improves the automated classification of common distress and non-distress objects in pavement images by (i) encoding contextual information through multi-scale input tiles and (ii) employing a mid-fusion approach with an attention module for heterogeneous image contexts from different input scales. A+MCNN is trained and tested with four distress classes (crack, crack seal, patch, pothole), five non-distress classes (joint, marker, manhole cover, curbing, shoulder), and two pavement classes (asphalt, concrete). A+MCNN is compared with four deep classifiers that are widely used in transportation applications and a generic CNN classifier (as the control model). The results show that A+MCNN consistently outperforms the baselines by 1∼26% on average in terms of the F-score. A comprehensive discussion is also presented regarding how these classifiers perform differently on different road objects, which has been rarely addressed in the existing literature.

CT-ML: Diagnosis of Breast Cancer Based on Ultrasound Images and Time-Dependent Feature Extraction Methods Using Contourlet Transformation and Machine Learning

“…Liu et al [ 22 ] propose a novel perceptual consistency ultrasound image super-resolution (SR) method, which takes only the linear-resolved ultrasound data and guarantees that the generated SR image is consistent with the original LR image, and vice versa. Eslami et al [ 23 ] developed a multi-scale attention-based convolutional neural network for multi-class categorization of road pictures. Sadeghipour et al [ 24 ] developed a hybrid approach using both a firefly algorithm and an intelligent system to detect breast cancer.…”

PSOWNNs-CNN: A Computational Radiology for Breast Cancer Diagnosis Improvement Based on Image Processing Using Machine Learning Methods

“…Yang et al [ 37 ] presented a temporal model for page dissemination in order to reduce the disparity between prediction data from current models and actual code dissemination data. In a study by Eslami et al [ 38 ], attention-based multiscale convolutional neural networks (A+MCNN) were used to efficiently separate distress items from non-distress items in pavement photos. Liao et al [ 39 ] developed an enhanced faster regions with CNN features (R-CNN) technique for semi-supervised SAR target identification that includes a decoding module and a domain-adaptation module named FDDA.…”

WTD-PSD: Presentation of Novel Feature Extraction Method Based on Discrete Wavelet Transformation and Time-Dependent Power Spectrum Descriptors for Diagnosis of Alzheimer’s Disease

“…Yan et al [ 15 ] examined the structure and in vitro test results of waxy and regular maize starches after thermal processing using plasma-activated water. Eslami and Yun [ 16 ] have developed a novel approach called A + MCNN and have compared it to four commonly used deep classifiers in the transportation domain as well as the standard CNN classifier. Sadeghipour and Hatam [ 17 ] developed the XCSLA System to help in the diagnosis of diabetes.…”