Development and Verification of a Novel Robot-Integrated Fringe Projection 3D Scanning System for Large-Scale Metrology

Du, Hui; Chen, Xiaobo; Xi, Juntong; Yu, Cheng-Yi; Zhao, Bao

doi:10.3390/s17122886

Cited by 33 publications

(14 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Non-contact 3D shape reconstruction using the structured-light techniques is commonly used in a broad range of applications including machine vision, reverse engineering, quality assurance, 3D printing, entertainment, etc. [ 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 ]. The technique typically retrieves the depth or height information with an algorithm based on geometric triangulation, where the structured light helps facilitate the required image matching or decoding process.…”

Section: Introductionmentioning

confidence: 99%

Single-Shot 3D Shape Reconstruction Using Structured Light and Deep Convolutional Neural Networks

Nguyen

Wang

2020

Sensors

View full text Add to dashboard Cite

Single-shot 3D imaging and shape reconstruction has seen a surge of interest due to the ever-increasing evolution in sensing technologies. In this paper, a robust single-shot 3D shape reconstruction technique integrating the structured light technique with the deep convolutional neural networks (CNNs) is proposed. The input of the technique is a single fringe-pattern image, and the output is the corresponding depth map for 3D shape reconstruction. The essential training and validation datasets with high-quality 3D ground-truth labels are prepared by using a multi-frequency fringe projection profilometry technique. Unlike the conventional 3D shape reconstruction methods which involve complex algorithms and intensive computation to determine phase distributions or pixel disparities as well as depth map, the proposed approach uses an end-to-end network architecture to directly carry out the transformation of a 2D image to its corresponding 3D depth map without extra processing. In the approach, three CNN-based models are adopted for comparison. Furthermore, an accurate structured-light-based 3D imaging dataset used in this paper is made publicly available. Experiments have been conducted to demonstrate the validity and robustness of the proposed technique. It is capable of satisfying various 3D shape reconstruction demands in scientific research and engineering applications.

show abstract

Section: Introductionmentioning

confidence: 99%

Single-Shot 3D Shape Reconstruction Using Structured Light and Deep Convolutional Neural Networks

Nguyen

Wang

2020

Sensors

View full text Add to dashboard Cite

show abstract

“…Inheriting excellent dexterity of serial robot and advantages of high accuracy and well stability of 3D camera, measurement system integrating these two devices is considered as a promising alternative for large-scale automatic measurement and inspection in advanced manufacturing, such as shape construction of car part (Du et al , 2017). The 3D camera is often laser scanner (Rahayem, 2009) or structured-light-based camera (Xu et al , 2017), because of their high accuracy.…”

Section: Introductionmentioning

confidence: 99%

Simultaneous identification of joint stiffness, kinematic and hand-eye parameters of measurement system integrated with serial robot and 3D camera

Zhuang

Cao

et al. 2021

View full text Add to dashboard Cite

Purpose This paper aims to propose a measurement principle and a calibration method of measurement system integrated with serial robot and 3D camera to identify its parameters conveniently and achieve high measurement accuracy. Design/methodology/approach A stiffness and kinematic measurement principle of the integrated system is proposed, which considers the influence of robot weight and load weight on measurement accuracy. Then an error model is derived based on the principle that the coordinate of sphere center is invariant, which can simultaneously identify the parameters of joint stiffness, kinematic and hand-eye relationship. Further, considering the errors of the parameters to be calibrated and the measurement error of 3D camera, a method to generate calibration observation data is proposed to validate both calibration accuracy and parameter identification accuracy of calibration method. Findings Comparative simulations and experiments of conventional kinematic calibration method and the stiffness and kinematic calibration method proposed in this paper are conducted. The results of the simulations show that the proposed method is more accurate, and the identified values of angle parameters in modified Denavit and Hartenberg model are closer to their real values. Compared with the conventional calibration method in experiments, the proposed method decreases the maximum and mean errors by 19.9% and 13.4%, respectively. Originality/value A new measurement principle and a novel calibration method are proposed. The proposed method can simultaneously identify joint stiffness, kinematic and hand-eye parameters and obtain not only higher measurement accuracy but also higher parameter identification accuracy, which is suitable for on-site calibration.

show abstract

“…To further expand the measurement range for measuring large-size objects and guarantee the overall measurement accuracy, more external measurement devices are being integrated into 3D shape measurement systems [ 23 , 24 , 25 , 26 ], such as indoor GPS (iGPS) systems, total stations, and laser trackers. Du, F. et al [ 23 ] developed a large-scale 3D measurement system that combines iGPS, a robot, and a portable scanner.…”

Section: Introductionmentioning

confidence: 99%

“…However, it was too expensive to be widely adopted. Du, H. et al [ 26 ] proposed a robot-integrated 3D scanning system, which combines a 3D scanner, a laser tracker, and a robot. The scanner is carried by the robot heading to the planned measurement position during operation.…”

Section: Introductionmentioning

confidence: 99%

A Combined Measurement Method for Large-Size Aerospace Components

Zhou

Liu

et al. 2020

Sensors

View full text Add to dashboard Cite

Automated and high-accuracy three-dimensional (3D) shape measurement is required in quality control of large-size components for the aerospace industry. To eliminate the contradiction between global measurement and local precision measurement control in 3D digitalization for the key local features of the large-size components, a combined measurement method is proposed, including a 3D scanner, a laser tracker, and an industrial robot used as an orienting device, to achieve high-accuracy measurement. As for improving the overall measurement accuracy, an accurate calibration method based on coordinate optimization of common points (COCP) and coordinate optimization of global control points (COGP) is proposed to determine the coordinate systems. Firstly, a coordinate optimization method of common points (COCP) is recommended. Then, a coordinate optimization method of global control points (COGP) based on the angular constraint is proposed for minimizing the measurement errors and improving the measurement accuracy of the position and orientation of the 3D scanner. Finally, a combined measurement system is established, and validation experiments are carried out in laboratory within a distance of 4 m. The calibration experiment results demonstrate that the max and mean errors of the coordinate transformation have been reduced from 0.037 and 0.022 mm to 0.021 and 0.0122 mm. Additionally, the measurement experiment results also show that the combined measurement system features high accuracy.

show abstract

Development and Verification of a Novel Robot-Integrated Fringe Projection 3D Scanning System for Large-Scale Metrology

Cited by 33 publications

References 28 publications

Single-Shot 3D Shape Reconstruction Using Structured Light and Deep Convolutional Neural Networks

Single-Shot 3D Shape Reconstruction Using Structured Light and Deep Convolutional Neural Networks

Simultaneous identification of joint stiffness, kinematic and hand-eye parameters of measurement system integrated with serial robot and 3D camera

A Combined Measurement Method for Large-Size Aerospace Components

Contact Info

Product

Resources

About