Combining Photogrammetry and Photometric Stereo to Achieve Precise and Complete 3D Reconstruction

Abstract

Image-based 3D reconstruction has been employed in industrial metrology for micro-measurements and quality control purposes. However, generating a highly-detailed and reliable 3D reconstruction of non-collaborative surfaces is still an open issue. In this paper, a method for generating an accurate 3D reconstruction of non-collaborative surfaces through a combination of photogrammetry and photometric stereo is presented. On one side, the geometric information derived with photogrammetry is used in areas where its 3D measurements are reliable. On the other hand, the high spatial resolution capability of photometric stereo is exploited to acquire a finely detailed topography of the surface. Finally, three different approaches are proposed to fuse both geometric information and high frequency details. The proposed method is tested on six different non-collaborative objects with different surface characteristics. To evaluate the accuracy of the proposed method, a comprehensive cloud-to-cloud comparison between reference data and 3D points derived from the proposed fusion methods is provided. The experiments demonstrated that, despite correcting global deformation up to an average RMSE of less than 0.1 mm, the proposed method recovers the surface topography at the same high resolution as the photometric stereo.

3d Digitization of Heritage: Photometric Stereo Can Help

“…More realistic models have been proposed. The methods for solving PS have been generalized to a point light source (Quéau et al, 2018a, Karami et al, 2022, which characterizes a LED illumination rather well.…”

“…This is mainly due to the illumination estimation, which is generally too coarse to describe accurately the incident flux at each point of the scene. One solution is to use a more sophisticated lighting estimation method (Karami et al, 2022). Another way, simpler to implement, consists in using the 3D points obtained by SfM as hard constraints during the integration of the normals, which is indeed possible with some integration methods (Quéau et al, 2018b).…”

“…The complementarity between photogrammetry and photometry has long been identified. Following a pioneer article by Nehab et al (Nehab et al, 2005), various solutions have been proposed to merge them (Karami et al, 2022, Ikeuchi et al, 2022. In this paper, we propose a new concrete solution of fusion between both these approaches which can answer the expectations of the heritage actors.…”

Analysis of the Influence of the Geometrical Parameters of the Body Scanner on the Accuracy of Reconstruction of the Human Figure Using the Photogrammetry Technique

“…There are also attempts to combine photogrammetry with other scanning techniques to take advantage of each of them. For example, in [ 25 ], the photogrammetry technique was combined with photometric stereo, achieving high-quality reconstruction. In publications [ 26 , 27 ], data from laser scanning and photogrammetry were integrated.…”

Orientation of Images With Low Contrast Textures and Transparent Objects

“…Due to refraction and mirror-like reflections, a part of the surface recorded textures of such objects is not invariant to the camera viewpoint being also dependent on the object's shape, surrounding environment, and illumination conditions. Therefore, standard procedures like those implemented in SfM applications become ineffective, leading to significant mistakes and, most frequently, failures in the image matching and orientation process (Hosseininaveh et al, 2015;Wu et al, 2018;Karami et al, 2022c).…”