Monitoring of manipulation activities for a service robot using supervised learning

Abstract

To be a good helper, grasping and manipulation are the most important abilities of a service robot. It should be able to adapt its manipulation actions to new tasks and environments. During the execution, it is important to rate the success of actions, so that the robot can plan and execute further actions to correct and recover from the failed actions.The successful execution of manipulation actions depends on various factors during the whole execution, such as the position of the robotic hand and forces exerted by the robot. The goal of the manipulation action monitoring is to estimate the sucess state from the huge amount of data collected during the execution. The main challenge to solve this problem is to identify the success or failure state from the the high dimensional data collection.We propose a method to classify ongoing activities using a set of support vector machines (SVM). After a supervised training process with manually labeled successful or failure results, our system can correctly estimate the resulting state of a manipulation activity. We present experiments on our bimanual manipulation demonstrator and evaluate the results.