Human Activity Recognition for Domestic Robots

Abstract

Abstract. Capabilities of domestic service robots could be further improved, if the robot is equipped with an ability to recognize activities performed by humans in its sensory range. For example in a simple scenario a floor cleaning robot can vacuum the kitchen floor after recognizing human activity "cooking in the kitchen". Most of the complex human activities can be sub divided into simple activities which can later used for recognize complex activities. Activities like "take meditation" can be sub divided into simple activities like "opening pill container" and "drinking water". However, even recognizing simple activities are highly challenging due to the similarities between some inter activities and dissimilarities of intra activities which are performed by different people, body poses and orientations. Even a simple human activity like "drinking water" can be performed while the subject is in different body poses like sitting, standing or walking. Therefore building machine learning techniques to recognize human activities with such complexities is non trivial. To address this issue, we propose a human activity recognition technique that uses 3D skeleton features produced by a depth camera. The algorithm incorporates importance weights for skeleton 3D joints according to the activity being performed. This allows the algorithm to ignore the confusing or irrelevant features while relying on informative features. Later these joints were ensembled together to train Dynamic Bayesian Networks (DBN), which is then used to infer human activities based on likelihoods. The proposed activity recognition technique is tested on a publicly available dataset and UTS experiments with overall accuracies of 85% and 90%.

Affordance-map: Mapping human context in 3D scenes using cost-sensitive SVM and virtual human models

“…In our approach, we calculated 3D Distance Transform by using the occupied voxels of 3D point clouds, OC. The distance transform map DT (x) of the occupancy grid map OC can be generated using an unsigned distance function (2), that represents Euclidean distance from each location x of the environment to the nearest occupied voxel in OC(x).…”

“…In robotics, learning human context often involves tracking humans to learn their motion patterns [1], human activity detection [2], [3] and modeling relationships between humans and their surroundings [4]. Almost all of these techniques require robots to detect and track humans for a considerable amount of time before it is being used to model human context.…”

Automatic detection of human interactions from RGB-D data for social activity classification

“…It is a probability based ensemble which combines a set of classifiers through their temporal entropy. The approach presented in [9] uses HMMs implemented as a Dynamic Bayesian Network with Gaussian Mixture Models (GMM) to handle the multimodality of the data over time. A Long Short Term Memory (LSTM) based approach [10] was presented to perform classification.…”

HMM-based Activity Recognition with a Ceiling RGB-D Camera

“…Even in (Coppola et al, 2015) the authors introduced a simple way to apply qualitative trajectory calculus to model 3D movements of the tracked human body using HMMs. HMMs combined with Gaussian Mixture Models (GMM) to model the combination of continuous joint positions over time for activity recognition was introduced in (Piyathilaka and Kodagoda, 2015).…”