Abstract. The article describes an innovative procedure for the three-dimensional analysis of decay morphologies of ancient buildings, through the application of machine learning methods for the automatic segmentation of point clouds. In the field of Cultural Heritage conservation, photogrammetric data can be exploited, for diagnostic and monitoring support, to recognize different typologies of alterations visible on the masonry surface, starting from colour information. Actually, certain stone and plaster surface pathologies (biological patina, biological colonization, chromatic alterations, spots,…) are typically characterized by chromatic variations. To this purpose, colour-based segmentation with hierarchical clustering has been implemented on colour data of point clouds, considered in the HSV colour-space. In addition, geometry-based segmentation of 3D reconstructions has been performed, in order to identify the main architectural elements (walls, vaults), and to associate them to the detected defects. The proposed workflow has been applied to some ancient buildings’ environments, chosen because of their irregularity both in geometrical and colorimetric characteristics.
Nowadays, built heritage condition assessment is realized through on-site or photo-aided visual inspections, reporting pathologies manually on drawings, photographs, notes. The knowledge of the state of conservation goes through subjective and time or cost consuming procedures. This is even relevant for a historic building characterized by geometrical and morphological complexity and huge extension, or at risk of collapse. In this context, advancements in the field of Computer Vision and Artificial Intelligence provide an opportunity to address these criticalities. The proposed methodology is based on a Mask R-CNN model, for the detection of decay morphologies on built heritages, and, particularly on historic buildings. The experimentation has been carried out and validated on a highly heterogeneous dataset of images of historic buildings, representative of the regional Architectural Heritage, such as: castles, monasteries, noble buildings, rural buildings. The outcomes highlighted the significance of this remote, non-invasive inspection technique, in support of the technicians in the preliminary knowledge of the building state of conservation, and, most of all, in the decay mapping of some particular classes of alterations (moist area, biological colonization).
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.