Autonomous 3D geometry reconstruction through robot-manipulated optical sensors

Abstract

Many industrial sectors face increasing production demands and the need to reduce costs, without compromising the quality. The use of robotics and automation has grown significantly in recent years, but versatile robotic manipulators are still not commonly used in small factories. Beside of the investments required to enable efficient and profitable use of robot technology, the efforts needed to program robots are only economically viable in case of large lot sizes. Generating robot programs for specific manufacturing tasks still relies on programming trajectory waypoints by hand. The use of virtual simulation software and the availability of the specimen digital models can facilitate robot programming. Nevertheless, in many cases, the virtual models are not available or there are excessive differences between virtual and real setups, leading to inaccurate robot programs and time-consuming manual corrections. Previous works have demonstrated the use of robot-manipulated optical sensors to map the geometry of samples. However, the use of simple user-defined robot paths, which are not optimized for a specific part geometry, typically causes some areas of the samples to not be mapped with the required level of accuracy or to not be sampled at all by the optical sensor. This work presents an autonomous framework to enable adaptive surface mapping, without any previous knowledge of the part geometry being transferred to the system. The novelty of this work lies in enabling the capability of mapping a part surface at the required level of sampling density, whilst minimizing the number of necessary view poses. Its development has also led to an efficient method of point cloud down-sampling and merging. The article gives an overview of the related work in the field, a detailed description of the proposed framework and a proof of its functionality through both simulated and experimental evidences.

Depth Image Completion through Iterative Low-Pass Filtering

“…In this section, we showcase completion depth images obtained from a Kinect for Xbox 360 (Kinect 1.0) and a Kinect 2.0. Kinect 1.0 employs IR structured light to acquire depth images [11].…”

“…These devices incorporate advanced optical technologies such as backside-illuminated CMOS [8] and current-assisted photonic demodulators [9], representing a significant leap in light sensitivity, gate-level signal processing, and overall performance. However, despite these technological strides, challenges persist, particularly in dealing with reflective targets, absorbing surfaces, and distant objects [10,11].…”

Intelligent In situ Printing of Multimaterial Bioinks for First‐Aid Wound Care Guided by Eye‐In‐Hand Robot Technology

“…[ 3b ] By orienting the camera toward the targeted object or defect, surface information, including color images and stereoscopic depth imagery, is acquired using a 3D recognition mechanism based on the principle of binocular disparity. [ 14 ] This assembled system allows for dynamic collection of multiple diverse views of the targeted objects by rotating its arms in 6‐DOF. This results in few spatial scanning restrictions for object positions.…”

Advancements in robotic-enabled sensing: A European perspective

“…The trend towards smart factories, equipped with interconnected robotic systems capable of self-diagnosis and autonomous operation has become increasingly prevalent. European research has been integral to these developments, with a notable example being the contribution to the field of adaptive robotics, where systems self-optimise to dynamically changing conditions 1 , 21 . In retrospect, the European contribution to robotic NDT and sensing has been characterised by consistent innovation, cross-disciplinary integration, and strategic collaboration.…”