Automatic concrete defect detection and reconstruction by aligning aerial images onto semantic‐rich building information model

Abstract

Concrete defect information is of vital importance to building maintenance. Increasingly, computer vision has been explored for automated concrete defect detection. However, existing studies suffer from the challenging issue of false positives. In addition, 3D reconstruction of the defects to pinpoint their positions and geometries has not been sufficiently explored. To address these limitations, this study proposes a novel computational approach for detecting and reconstructing concrete defects from geotagged aerial images. A bundle registration algorithm is devised to align a batch of aerial photographs with a building information model (BIM). The registration enables the retrieval of material semantics in BIM to determine the regions of interest for defect detection. It helps rectify the camera poses of the aerial images, enabling precise defect reconstruction.Experiments demonstrate the effectiveness of the approach, which significantly reduced the false discovery rate from 70.8% to 56.8%, resulting in an intersection over union 6.4% higher than that of the traditional method. The geometry of the defects was successfully reconstructed in 3D world space. This study opens a new avenue to advance the field of defect detection by exploiting the rich information from BIM. The approach can be deployed at scale, supporting urban renovation, numerical simulation, and other smart applications.

Major opportunities of digital twins for smart buildings: a scientometric and content analysis

“…The digital twin assists in real-time monitoring of building performance and generates data for facility and building managers to assess buildings and perform maintenance (Akanmu et al. , 2020; Lu et al ., 2020a; Chen et al. , 2022a).…”

“…The digital twins' concept facilitates building improvements by ensuring efficiency and adequacy in the building management system (Zhao et al, 2021). The digital twin assists in real-time monitoring of building performance and generates data for facility and building managers to assess buildings and perform maintenance (Akanmu et al, 2020;Lu et al, 2020a;Chen et al, 2022a). This could generate data easily and seamlessly from human-unreachable parts of buildings.…”

Crack identification using electrical impedance tomography and transfer learning

“…When early damage is detected, visual inspections are typically scheduled in usual practice (this is the typical case in which the SHM system triggers human intervention). In this phase, operators can use manual or automatic annotation tools (J. Chen et al., 2022; Liu et al., 2020), for example, by means of unmanned inspection devices, to generate damage labels associated with the input dataset used to predict the anomaly (central part of Figure 1).…”

Autonomous 3D vision‐based bolt loosening assessment using micro aerial vehicles

“…More recently, there is a trend of using 3D vision‐based reconstruction for structural damage evaluation (Isailović et al., 2020). For example, 3D vision‐based reconstruction has been employed to evaluate defects of concrete buildings (e.g., Chen et al., 2022; Meng et al., 2022), concrete bridge piers (e.g., Liu et al., 2020), and steel plate structures (Pan & Yang, 2023a). More recently, X. Wang et al.…”