Gesture recognition is very important for Human-Robot Interfaces. In this paper, we present a novel depth based method for gesture recognition to improve the interaction of a service robot autonomous shopping cart, mostly used by reduced mobility people. In the proposed solution, the identification of the user is already implemented by the software present on the robot where a bounding box focusing on the user is extracted. Based on the analysis of the depth histogram, the distance from the user to the robot is calculated and the user is segmented using from the background. Then, a region growing algorithm is applied to delete all other objects in the image. We apply again a threshold technique to the original image, to obtain all the objects in front of the user. Intercepting the threshold based segmentation result with the region growing resulting image, we obtain candidate objects to be arms of the user. By applying a labelling algorithm to obtain each object individually, a Principal Component Analysis is computed to each one to obtain its center and orientation. Using that information, we intercept the silhouette of the arm with a line obtaining the upper point of the interception which indicates the hand position. A Kalman filter is then applied to track the hand and based on state machines to describe gestures (Start, Stop, Pause) we perform gesture recognition. We tested the proposed approach in a real case scenario with different users and we obtained an accuracy around 89,7%. 1 Introduction Nowadays, with robots entering in our daily lives, it is becoming important to provide the users a simple and intuitive way to interact with them. Human-Robot interactions has already proved to be a major field in robotics with an
Robotics is a growing industry with applications in numerous markets, including retail, transportation, manufacturing, and even as personal assistants. Consumers have evolved to expect more from the buying experience, and retailers are looking at technology to keep consumers engaged. In today's highly competitive business climate, being able to attract, serve, and satisfy more customers is a key to success. It is our belief that smart robots will play a significant role in physical retail in the future. One successful example is wGO, 1 a robotic shopping assistant developed by Follow Inspiration. The wGO is an autonomous and self-driven shopping cart, designed to follow people with reduced mobility (the elderly, people in wheelchair, pregnant women, those with temporary reduced mobility, etc.) in commercial environments. With the Retail Robot, the user can control the shopping cart without the need to push it. This brings numerous advantages and a higher level of comfort since the user does not need to worry about carrying the groceries or pushing the shopping cart. The wGO operates under a vision-guided approach based on user-following with no need for any external device. Its integrated architecture of control, navigation, perception, planning, and awareness is designed to enable the robot to successfully perform personal assistance, while the user is shopping.
Keywords: robotics, vision, retail, reduced mobility1 The robot is currently patent pending.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.