Asserting the Precise Position of 3D and Multispectral Acquisition Systems for Multisensor Registration Applied to Cultural Heritage Analysis

Abstract

Abstract. We present a novel method to register multispectral acquisitions on a 3D model. The method is based on the external tracking of the acquisition systems using close-range photogrammetric techniques: multiple calibrated cameras simultaneously observe the successive acquisition systems in use. The views from these cameras are used to precisely determine the position of each acquisition system. All datasets can then be projected in the same coordinate system. The registration is thus independent from the quality and content of the data. This method is well suited to the study of cultural heritage or any other application where we do not wish to place targets on the object. We describe the method and the simulation pipeline used to find an adequate setup for two case studies.

Registration of 3D and Multispectral Data for the Study of Cultural Heritage Surfaces

“…When the acquisition systems are fixed to this target frame and survey an area of 400 mm × 700 mm, the simulations [30] show that we can achieve a spatial tracking accuracy of 0.020 mm and an angular accuracy of 0.100 mrad using four tracking cameras. Equivalent tracking accuracy can be obtained using six cameras when the acquisition systems digitize an area of 2,000 mm × 1,500 mm, such as a wall-painting.…”

“…Simulations have shown that it is possible to track our acquisition systems with an accuracy of 0.014 mm spatially and 0.100 mrad angularly [30]. This paper presents the experimental results performed in a laboratory environment to test the feasibility and the accuracy of the technique.…”

3d Interpretation and Fusion of Multidisciplinary Data for Heritage Science: A Review

“…The automatic implemented procedure included: automatic detection of a common region between overlapping textured 3D views, pairwise registration of 3D views, global registration, multi-spectral texture construction and surface fusion. Simon et al (2012) and Chane et al (2013) applied photogrammetric tracking on pre-calibrated multispectral cameras and fringe projection systems for 3D digitization used on the same scenes, to co-register and project the multi-spectral data on 3D models of heritage surfaces, with accuracy better than half an image pixel. Pelagotti et al (2009) and Remondino et al (2009) extracted depth maps from 3D heritage models, whose pixels maintained correspondence with the vertices of the respective 3D models, to register those maps with texture from multispectral images through Maximization of Mutual Information algorithms.…”