Optical MEMS devices for compact 3D surface imaging cameras

Yang, Shiwen; Seo, Yeong‐Hyeon; Kim, Jae‐Beom; Kim, H; Jeong, Ki‐Hun

doi:10.1186/s40486-019-0087-4

Cited by 17 publications

(8 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The fourth revolution of science and technology provides a new driving force for the development of high-temperature metal component 3D size and morphology measurements. The accuracy and speed of measurement systems will continue to be improved, and miniaturized measurement systems, such as the low-depth camera systems of mobile phones [ 105 , 106 , 107 , 108 , 109 , 110 ], will continue to be produced. The following is an analysis of and outlook on the future development trends of the measurement of high-temperature metal components with stereo vision:…”

Section: Future Development Trendsmentioning

confidence: 99%

Three-Dimensional Morphology and Size Measurement of High-Temperature Metal Components Based on Machine Vision Technology: A Review

Wen

Wang

Zhang

et al. 2021

Sensors

View full text Add to dashboard Cite

The three-dimensional (3D) size and morphology of high-temperature metal components need to be measured in real time during manufacturing processes, such as forging and rolling. Since the surface temperature of a metal component is very high during the forming and manufacturing process, manually measuring the size of a metal component at a close distance is difficult; hence, a non-contact measurement technology is required to complete the measurement. Recently, machine vision technology has been developed, which is a non-contact measurement technology that only needs to capture multiple images of a measured object to obtain the 3D size and morphology information, and this technology can be used in some extreme conditions. Machine vision technology has been widely used in industrial, agricultural, military and other fields, especially fields involving various high-temperature metal components. This paper provides a comprehensive review of the application of machine vision technology in measuring the 3D size and morphology of high-temperature metal components. Furthermore, according to the principle and method of measuring equipment structures, this review highlights two aspects in detail: laser scanning measurement and multi-view stereo vision technology. Special attention is paid to each method through comparisons and analyses to provide essential technical references for subsequent researchers.

show abstract

Section: Future Development Trendsmentioning

confidence: 99%

Three-Dimensional Morphology and Size Measurement of High-Temperature Metal Components Based on Machine Vision Technology: A Review

Wen

Wang

Zhang

et al. 2021

Sensors

View full text Add to dashboard Cite

show abstract

“…Known sensor technologies for robotic 3D sensing can be roughly sorted into stereoscopic vision, structured light and time-of-flight (ToF) [3]. From these, structured light is the most accurate for surface interaction [4].…”

Section: Introductionmentioning

confidence: 99%

SL Sensor: An Open-Source, ROS-Based, Real-Time Structured Light Sensor for High Accuracy Construction Robotic Applications

Lam¹,

Blum²,

Siegwart³

et al. 2022

Preprint

View full text Add to dashboard Cite

High accuracy 3D surface information is required for many construction robotics tasks such as automated cement polishing or robotic plaster spraying. However, consumer-grade depth cameras currently found in the market are not accurate enough for these tasks where millimeter (mm)-level accuracy is required. We present SL Sensor, a structured light sensing solution capable of producing high fidelity point clouds at 5Hz by leveraging on phase shifting profilometry (PSP) codification techniques. We compared SL Sensor to two commercial depth cameras -the Azure Kinect and RealSense L515. Experiments showed that the SL Sensor surpasses the two devices in both precision and accuracy. Furthermore, to demonstrate SL Sensor's ability to be a structured light sensing research platform for robotic applications, we developed a motion compensation strategy that allows the SL Sensor to operate during linear motion when traditional PSP methods only work when the sensor is static. Field experiments show that the SL Sensor is able produce highly detailed reconstructions of spray plastered surfaces. The software and a sample hardware build of the SL Sensor are made open-source with the objective to make structured light sensing more accessible to the construction robotics community. All documentation and code is available at https://github.com/ethz-asl/sl_sensor/.

show abstract

“…3D augmentation requires depth maps to be acquired. Existing techniques for acquiring depth information include structured light camera, laser scanning, time-of-flight (TOF) camera, and stereo camera methods [24]. In the structured light camera method, the depth information of an object is acquired by projecting structured light with various shapes, such as points or planes, onto an object and analyzing the structural light change information from the captured image [25].…”

Section: Introductionmentioning

confidence: 99%

Deep Learning and Detection Technique with Least Image-Capturing for Multiple Pill Dispensing Inspection

et al. 2022

View full text Add to dashboard Cite

In this study, we propose a method to effectively increase the performance of small-object detection using limited training data. We aimed at detecting multiple objects in an image using training data in which each image contains only a single object. Medical pills of various shapes and colors were used as the learning and detection targets. We propose a labeling automation process to easily create label files for learning and a three-dimensional (3D) augmentation technique that applies stereo vision and 3D photo inpainting (3DPI) to avoid overfitting caused by limited data. We also apply confidence-based nonmaximum suppression and voting to improve detection performance. The proposed 3D augmentation, 2D rotation, nonmaximum suppression, and voting algorithms were applied in experiments conducted with 20 and 40 types of pills. The precision, recall, individual accuracy, and combination accuracy of the experiment with 20 types of pills were 0.998, 1.000, 0.998, and 0.991, respectively, and those for the experiment with 40 types of pills were 0.986, 0.999, 0.985, and 0.940, respectively.

show abstract

Optical MEMS devices for compact 3D surface imaging cameras

Cited by 17 publications

References 39 publications

Three-Dimensional Morphology and Size Measurement of High-Temperature Metal Components Based on Machine Vision Technology: A Review

Three-Dimensional Morphology and Size Measurement of High-Temperature Metal Components Based on Machine Vision Technology: A Review

SL Sensor: An Open-Source, ROS-Based, Real-Time Structured Light Sensor for High Accuracy Construction Robotic Applications

Deep Learning and Detection Technique with Least Image-Capturing for Multiple Pill Dispensing Inspection

Contact Info

Product

Resources

About