Automatic segmentation, inpainting, and classification of defective patterns on ancient architecture using multiple deep learning algorithms

Abstract

Ancient architectures have a lot of distinctive patterns on their component surfaces. But due to the wind and the Sun, the patterns will present extensive deficiencies, which are not conducive to the routine inspections and the subsequent repair work. To overcome these limits, an automatic deep learning-based method of segmentation, inpainting, and classification for defective patterns on ancient architecture is proposed. First, You Only Look At CoefficienTs, which is a real-time instance segmentation network, is applied to obtain the mask of the defective parts. Then Generative Image Inpainting with Contextual Attention, which is an image inpainting algorithm, is used to reconstruct the defective parts. Finally, Residual Neural Network-50 is used to classify the reconstructed images. In this paper, three types of dragon motifs in the Forbidden City were studied. The results show that the classification accuracy of the reconstructed images is increased by an average of 13.1%, with the maximum increasing by 23.5%. The proposed methods can prepare for future routine inspections in advance.

Uncertainty‐aware convolutional neural network for explainable artificial intelligence‐assisted disaster damage assessment

“…Yan et al 13 leveraged CNN and lidar data from UAVs to automate detection and quantification of concrete cracks. Zou et al 28 explored deep neural network approaches for detecting pixel‐wise patterns of ancient buildings in China. Sajedi and Liang 29 proposed the use of deep generative Bayesian optimization for searching optimal sensor placement in the sensor‐based SHM.…”

Study on the historical landscape evolution of the core reserve of Guangfu Ancient City based on computer simulation

“…The ancient city of Guangfu has a history of more than 2,600 years. There are many historical relics and remains inside and outside the ancient city, including two national cultural relics protection units of Guangfu Ancient City and Hongji Bridge [1][2], of which Hongji Bridge is known as the "sister bridge" of Zhaozhou Bridge, which is one of the ancient large stone arch bridges preserved in China today [3][4]. There are also Yang Lu Chan's former residence, Wu Yuxiang's former residence, Wu Ru Qing's former residence, etc.…”