3d Digitization of Transparent and Glass Surfaces: State of the Art and Analysis of Some Methods

Abstract

Abstract. In the field of industrial metrology, there is a rising need for 3D information at a very high resolution for micro-measurements and quality control of transparent objects such as glass bottles (beer, wine, cola, cosmetics, etc.). However, such objects are particularly challenging for optical-based 3D reconstruction methods and systems such as photogrammetry, photometric stereo, structured light scanning, laser scanning, typically resulting in poor metrological performances. Indeed, these methods require the surface of the object to diffusely reflect the incoming light, which is not the case with the glass material where refraction and absorption phenomena do not permit their use. Over the years, various methods have been investigated and developed to avoid the coating (or powdering) treatment often used to make transparent objects opaque and diffusely reflecting. Most of the approaches require either some a priori knowledge of the transparent object or assumptions about how light interacts with the surface. This paper provides a general overview of state-of-the-art 3D digitization methods for optically non-cooperative surfaces featuring absorption, scattering, and refraction. The paper reviews research works summarizing them into four categories including shape-from-X, direct ray measurements, hybrid, and learning-based approaches. Moreover, we provided some 3D results to better highlight the advantages and disadvantages of each method in practice when dealing with transparent objects.

Combining Photogrammetry and Photometric Stereo to Achieve Precise and Complete 3D Reconstruction

“…However, powdering the object surface might be impractical when the real topography of an object is needed at high-resolution since the layer added increases the total object volume and can smooth out minor information. In addition, surface treatment is impossible in the case of delicate cultural heritage assets or real-time 3D surface inspection [ 17 , 41 , 42 ].…”

“…These methods are commonly used in various applications [ 4 , 5 , 6 ]. In particular, in the field of industrial metrology, they can be used for quality control [ 7 , 8 , 9 , 10 ], inspection [ 11 , 12 , 13 , 14 ], reverse engineering [ 10 , 15 , 16 , 17 ] or 3D micro-measurement [ 18 , 19 , 20 ].…”

“…Photogrammetry can generate a geometrically accurate and dense model of a real-world object from a series of images of an object or a scene taken from various viewpoints under the assumption of known materials and lighting conditions [ 17 , 21 ]. However, it is still challenging to achieve high-accuracy 3D measurement of non-collaborative objects ( Figure 1 ) due to the sensitivity of photogrammetry to the textural properties of the surface [ 22 , 23 , 24 ].…”

An image fusion-based method for recovering the 3D shape of roll surface defects

“…For 3D reconstruction of small targets such as roll surface defects, traditional 3D reconstruction techniques such as laser scanning, structured light, and radar are generally used, and they have in common the projection of light from a specific light source onto the target object and the acquisition of reflected light information or shadow information for 3D reconstruction [9,10].…”

Orientation of Images With Low Contrast Textures and Transparent Objects

“…Estimating the position and orientation of 3D objects is one of the fundamental problems in photogrammetry and computer vision and requires repeatable, reliable, and well distributed tie points (Remondino et al, 2021;Bellavia et al, 2022). Among the different fields of application, photogrammetry is widely used for industrial measurements and inspections, although several challenges exist when dealing with non-collaborative surfaces (Figure 1), such as textureless (Ahmadabadian et al, 2017(Ahmadabadian et al, , 2019, reflective (Karami et al, 2021(Karami et al, , 2022b, and refractive objects (Wu et al, 2018;Liu et al, 2020;Karami et al, 2022a).…”