Three-dimensional shape measurement technique for large-scale objects based on line structured light combined with industrial robot

Yu, Haotian; Yu, Haoyong; Zheng, Dongliang; Bai, Lianfa; Han, Jing

doi:10.1016/j.ijleo.2019.163656

Cited by 24 publications

(13 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…1. The point 0 p is randomly selected in P and the spatial energy of the point in Q with respect to 0 p is calculated according to the formula (2). If the energy is less than the preset threshold 0.5…”

Section: Pose Solution Based On Energy Matchingmentioning

confidence: 99%

“…With the rapid development of the process manufacturing industry, the demand for the accuracy of 3D topography measurement of complex surfaces is also increasing [1][2] . However, most of these workpieces are large in size and difficult to move, it is difficult to use traditional measuring methods and equipment for efficient dimensional detection.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Combined line laser 3D measurement method based on binocular vision

Chen

Luo

et al. 2023

International Conference on Optical and Photonic Engineering (icOPEN 2022)

View full text Add to dashboard Cite

With the continuous development of domestic and foreign manufacturing industries, there are limitations in the omnidirectional three-dimensional measurement of large parts. In order to improve the 3D measurement range, speed, and accuracy of single-line lasers, a combined measurement method based on binocular vision positioning technology is proposed. First, the circular markers are pasted around the line laser sensor, and a virtual intermediate coordinate system is constructed based on the centers of the marked points. Secondly, a feature point energy matching algorithm is used to complete the corresponding points matching of the circular markers, and the position of the circular markers is solved based on the SVD method. Third, the relative pose relationship between the virtual intermediate coordinate system and the line laser sensor coordinate system is completed based on the hand-eye calibration model. Fourth, combined with the circular markers pose and relative pose, the local point cloud data of the line laser is unified into the global coordinate system to realize point cloud splicing. The experimental results show that the average measurement error of the measurement system is less than 0.23 mm, which basically meets the requirements of general shape measurement.

show abstract

Section: Pose Solution Based On Energy Matchingmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Combined line laser 3D measurement method based on binocular vision

Chen

Luo

et al. 2023

International Conference on Optical and Photonic Engineering (icOPEN 2022)

View full text Add to dashboard Cite

show abstract

“…In this method, the stitching of data depends on objects with special structure such as honeycomb cores. Yu et al [28] calibrated the light plane of the line structured light using binocular cameras which simplifies the calibration process and improves the 3D measurement accuracy. When the calibration is completed, the camera 2 is removed.…”

Section: Introductionmentioning

confidence: 99%

Flexible Scanning Method by Integrating Laser Line Sensors with Articulated Arm Coordinate Measuring Machines

Xie

Gong

et al. 2022

Chin. J. Mech. Eng.

View full text Add to dashboard Cite

Measuring and reconstructing the shape of workpieces have been considered as a fundamental step in both reverse engineering and product quality control. Owing to increasing structural complexity of recent products, measurements from multiple directions are typically required in current scanning techniques. Specifically, the plane structured light can be applied to measure one area of a part at a time, with an additional algorithm required to merge the collected data of each area. Alternatively, the line structured light sensor integrated on CNC machines or CMMs could also realize multi-view measurement. However, the system needs to be repeatedly calibrated at each new direction. This paper presents a flexible scanning method by integrating laser line sensors with articulated arm coordinate measuring machines (AACMM). Since the output of the laser line sensor is 2D raw data in the laser plane, our system model introduces an explicit transformation from the 2D sensor coordinate frame to the 3D base coordinate frame of the AACMM (i.e., the translation and rotation the of the 2D sensor coordinate in the sixth coordinate system of AACMM). To solve the model, the “conjugate pairs” are proposed and identified by measuring a fixed point (e.g., a sphere center). Moreover, a search algorithm is adopted to find the optimal solution, which noticeably boosts the model accuracy. The experimental results show that the error of the system is about 0.2 mm, which is caused by the error of the AACMM, the sensor error and the calibration error. By measuring a complicated part, the proposed system is proved to be flexible and facilitate, with the ability to measure a part expediently from any necessary direction. Furthermore, the proposed calibration method can also be used for robot hand-eye relationship calibration.

show abstract

“…SLP projects a sinusoidal striped fringe onto the surface to be measured, then the fringe is deformed by the surface and captured by a camera. Finally, the depth map can be calculated using the triangulation principle 4 , 5 . The phase-shifting profilometry (PSP) has the highest accuracy of the existing SLP methods.…”

Section: Introductionmentioning

confidence: 99%

Single-shot structured light projection profilometry with SwinConvUNet

Wang

Jiaqing

et al. 2022

Opt. Eng.

View full text Add to dashboard Cite

Structured light profilometry (SLP) is now widely utilized in noncontact threedimensional (3D) reconstruction due to its convenience in dynamic measurements. Compared with classic fringe projection profilometries, multiple deep neural networks are proposed to demodulate or unwrap the fringe phase, and these networks utilize convolution layers to extract local features while omitting global characteristics. In this paper, we propose SwinConvUNet, a deep neural network for single-shot SLP that can extract local and global features simultaneously. In the network structure design, convolution layers are applied in shallow layers to extract local features, whereas transformer layers extract global features in deep layers, and an improved loss function by combining gradient-based structural similarity is employed to improve reconstruction details. The experimental results demonstrate that SwinConvUNet is more effective than the U-net model at decreasing learnable parameters while maintaining 3D reconstruction accuracy.

show abstract

Three-dimensional shape measurement technique for large-scale objects based on line structured light combined with industrial robot

Cited by 24 publications

References 14 publications

Combined line laser 3D measurement method based on binocular vision

Combined line laser 3D measurement method based on binocular vision

Flexible Scanning Method by Integrating Laser Line Sensors with Articulated Arm Coordinate Measuring Machines

Single-shot structured light projection profilometry with SwinConvUNet

Contact Info

Product

Resources

About