A 3-Stage Machine Learning-Based Novel Object Grasping Methodology

Abstract

The automatic grasping of objects previously unseen by a robotic system is a difficult task-of which there is currently no robust solution. The research presented in this article improves upon previous works that employ depth data and learning techniques to generate and select from a pool of hypothesised grasps by focusing on the pruning and selection process. In this work, a vision-based, sampling methodology that generates candidate grasps through a convolutional neural network is proposed. Each candidate grasp is assessed using scores derived from the candidate itself and other related input modalities-such as the centre of gravity of the object. The final selection is determined by a learning algorithm. To overcome human bias, objective measures of grasp performance are established that comprehensively measure the error introduced by the grasp trial itself. The proposed metrics are empirically demonstrated to quantify grasp quality, offer useful criteria for network training and provide better descriptive power than traditional measures of grasp outcome. Experimentation showed that the proposed methodology can generate a meaningful, final grasp within 1.3 seconds. Trials quantitatively demonstrate a small-object-in-isolation performance of 99%. For unknown objects, this equates to a 10% improvement relative to other similar methodologies. Testing also showed that grasp performance was improved by 5% when implementing the proposed metrics-compared to the baseline.

Prediction of Robot Grasp Robustness using Artificial Intelligence Algorithms

“…Baressi Šegota et al (2020) [3] demonstrate the use of an evolutionary algorithm to optimize the path of a 6-DOF industrial robotic manipulator, to lower the torsion exhibited on the joints during the transversal of the trajectory. Van Vuuren et al (2020) [6] demonstrate a machine learning method for grasp selection, by applying a three-step process consisting of a convolutional neural network for sampling, grasp evaluation, and a final learning algorithm for grasp selection. The proposed solution is shown to be capable of generating a viable grasp, on previously unseen objects in 1.3 seconds.…”

A lightweight grasping pose estimation method for retail warehousing

“…The end-to-end method [4][5][6] extracts image feature information by constructing a neural network and directly obtains the grasping position information, which has good performance. Cheng et al [7] proposed a Randomly Cropped Ensemble Neural Network (RCE-NN), which solved the detection of similar overlapping objects but could only detect objects with similar features.…”