Three-dimensional (3D) documentation of heritage buildings has long employed both image-based and range-based techniques. Unmanned aerial vehicles (UAVs) provide a particular advantage for image-based techniques in acquiring aerial views, which are difficult to attain using classical terrestrial-based methods. The technological development of optical sensors and dense matching algorithms also complement existing photogrammetric workflows for the documentation of heritage objects. In this paper, fundamental concepts in photogrammetry and 3D reconstruction based on structure from motion (SfM) will be briefly reviewed. Two case studies were performed using two types of UAVs, one being a state-of-the-art platform dedicated to obtaining close-range images. Comparisons with laser scanning data were performed and several issues regarding the aerial triangulation and dense matching results were assessed. The results show that although the dense matching of these UAV images may generate centimetre-level precision, a further increase in precision is often hampered by the quality of the onboard sensor.

No abstract

Built heritage has been documented by reality-based modeling for geometric description and by ontology for knowledge management. The current challenge still involves the extraction of geometric primitives and the establishment of their connection to heterogeneous knowledge. As a recently developed 3D information modeling environment, building information modeling (BIM) entails both graphical and non-graphical aspects of the entire building, which has been increasingly applied to heritage documentation and generates a new issue of heritage/historic BIM (HBIM). However, HBIM needs to additionally deal with the heterogeneity of geometric shape and semantic knowledge of the heritage object. This paper developed a new mesh-to-HBIM modeling workflow and an integrated BIM management system to connect HBIM elements and historical knowledge. Using the St-Pierre-le-Jeune Church, Strasbourg, France as a case study, this project employs Autodesk Revit as a BIM environment and Dynamo, a built-in visual programming tool of Revit, to extend the new HBIM functions. The mesh-to-HBIM process segments the surface mesh, thickens the triangle mesh to 3D volume, and transfers the primitives to BIM elements. The obtained HBIM is then converted to the ontology model to enrich the heterogeneous knowledge. Finally, HBIM geometric elements and ontology semantic knowledge is joined in a unified BIM environment. By extending the capability of the BIM platform, the HBIM modeling process can be conducted in a time-saving way, and the obtained HBIM is a semantic model with object-oriented knowledge.

The 3D documentation of heritage complexes or quarters often requires more than one scale due to its extended area. While the documentation of individual buildings requires a technique with finer resolution, that of the complex itself may not need the same degree of detail. This has led to the use of a multi-scale approach in such situations, which in itself implies the integration of multi-sensor techniques. The challenges and constraints of the multi-sensor approach are further added when working in urban areas, as some sensors may be suitable only for certain conditions. This paper describes the integration of heterogeneous sensors as a logical solution in addressing this problem. The royal palace complex of Kasepuhan Cirebon, Indonesia, was taken as a case study. The site dates to the 13th Century and has survived to this day as a cultural heritage site, preserving within itself a prime example of vernacular Cirebonese architecture. This type of architecture is influenced by the tropical climate, with distinct features designed to adapt to the hot and humid year-long weather. In terms of 3D documentation, this presents specific challenges that need to be addressed both during the acquisition and processing stages. Terrestrial laser scanners, DSLR cameras, as well as UAVs were utilized to record the site. The implemented workflow, some geometrical analysis of the results, as well as some derivative products will be discussed in this paper. Results have shown that although the proposed multi-scale and multi-sensor workflow has been successfully employed, it needs to be adapted and the related challenges addressed in a particular manner.

3D heritage documentation has seen a surge in the past decade due to developments in reality-based 3D recording techniques. Several methods such as photogrammetry and laser scanning are becoming ubiquitous amongst architects, archaeologists, surveyors, and conservators. The main result of these methods is a 3D representation of the object in the form of point clouds. However, a solely geometric point cloud is often insufficient for further analysis, monitoring, and model predicting of the heritage object. The semantic annotation of point clouds remains an interesting research topic since traditionally it requires manual labeling and therefore a lot of time and resources. This paper proposes an automated pipeline to segment and classify multi-scalar point clouds in the case of heritage object. This is done in order to perform multi-level segmentation from the scale of a historical neighborhood up until that of architectural elements, specifically pillars and beams. The proposed workflow involves an algorithmic approach in the form of a toolbox which includes various functions covering the semantic segmentation of large point clouds into smaller, more manageable and semantically labeled clusters. The first part of the workflow will explain the segmentation and semantic labeling of heritage complexes into individual buildings, while a second part will discuss the use of the same toolbox to segment the resulting buildings further into architectural elements. The toolbox was tested on several historical buildings and showed promising results. The ultimate intention of the project is to help the manual point cloud labeling, especially when confronted with the large training data requirements of machine learning-based algorithms.

Abstract. The lack of benchmarking data for the semantic segmentation of digital heritage scenarios is hampering the development of automatic classification solutions in this field. Heritage 3D data feature complex structures and uncommon classes that prevent the simple deployment of available methods developed in other fields and for other types of data. The semantic classification of heritage 3D data would support the community in better understanding and analysing digital twins, facilitate restoration and conservation work, etc. In this paper, we present the first benchmark with millions of manually labelled 3D points belonging to heritage scenarios, realised to facilitate the development, training, testing and evaluation of machine and deep learning methods and algorithms in the heritage field. The proposed benchmark, available at http://archdataset.polito.it/, comprises datasets and classification results for better comparisons and insights into the strengths and weaknesses of different machine and deep learning approaches for heritage point cloud semantic segmentation, in addition to promoting a form of crowdsourcing to enrich the already annotated database.

Close-range photogrammetry as a technique to acquire reality-based 3D data has, in recent times, seen a renewed interest due to developments in sensor technologies. Furthermore, the strong democratization of UAVs (Unmanned Aerial Vehicles) or drones means that close-range photogrammetry can now be used as a viable low-cost method for 3D mapping. In terms of software development, this led to the creation of many commercial black-box solutions (PhotoScan, Pix4D, etc.). This paper aims to demonstrate how the open source toolbox DBAT (Damped Bundle Adjustment Toolbox) can be used to generate detailed photogrammetric network diagnostics to help assess the quality of surveys processed by the commercial software, PhotoScan. In addition, the Apero module from the MicMac software suite was also used to provide an independent assessment of the results. The assessment is performed by the careful examination of some of the bundle adjustment metrics generated by both open source solutions. A UAV project was conducted on a historical church in the city center of Strasbourg, France, in order to provide a dataset with a millimetric level of precision. Results showed that DBAT can be used to reprocess PhotoScan projects under similar conditions and derive useful metrics from them, while Apero provides a completely independent verification of the results of commercial solutions. Overall, this paper shows that an objective assessment of photogrammetric results is important. In cases where problems are encountered in the project, this assessment method can be useful to detect errors that may not be explicitly presented by PhotoScan.

No abstract