Arm gesture recognition and humanoid imitation using functional principal component analysis

Abstract

A method is proposed for gesture recognition and humanoid imitation based on Functional Principal Component Analysis (FPCA). FPCA is a statistical technique of functional data analysis that has never been applied before for humanoid imitation. In functional data analysis data (e.g. gestures) are functions that can be considered as observations of a random variable on a functional space. FPCA is an extension of multivariate PCA that provides functional principal components which describe the modes of variation in the data. In the proposed approach FPCA is used for both unsupervised clustering of training data and gesture recognition.In this work we focus on arm gesture recognition. Human hand paths in Cartesian space are reconstructed from inertial sensors. Recognized gestures are reproduced by a small humanoid robot. The FPCA algorithm has also been compared to a state of the art algorithm for gesture classification based on Dynamic Time Warping (DTW). Results indicate that, in this domain, the FPCA algorithm achieves a comparable recognition rate while it outperforms DTW in terms of efficiency in execution time.

A Task Learning Mechanism for the Telerobots

“…33 DTW algorithm was widely used in speech recognition to deal with the problem of similarity for two di®erent temporal sequences. 34,35 By introducing the boundary, monotonicity and step size conditions, the similarity can be represented as follows:…”

Characterisation of gestural units in light of human-avatar interaction

“…In Lim et al [32] each movement primitive is represented and stored as a set of joint trajectory basis functions that are then extracted via a PCA of human motion capture data. In [2], gestures computed from inertial sensors are defined by hand paths as a discrete time sequence in the Cartesian space; these are converted to training functional data by basis function expansions using B-splines (curve fitting), and then Functional Principal Component Analysis (FPCA) is performed on all the training data to determine a finite set of functional principal components (FPCs) that explain the modes of variation in the data.…”

“…[24] tested a user centric gesture segmentation algorithm and developed observer profiles based on how individual users segment motion sequences, encoding gesture boundaries as a binary vector of hierarchically connected body segment activities. Boundary detection methods are attractive because they provide a generic segmentation of the video, which is not dependent on the gestures classes; some precautions 2 …”

Highly accurate and efficient cluster validation index engine using global separation and local dispersion architecture for adaptive image clustering systems

“…Clustering technology, as one of the most important key techniques used to analyze data by dividing it into a set of groups, 2,3) has already been widely applied to many intelligent applications, including image clustering, robotic vision, text mining and spike sorting. [4][5][6][7] Many unsupervised clustering algorithms such as hierarchical clustering, K-means and self-organizing maps have been developed to realize the data categorization. [8][9][10] As the most widely used clustering algorithm in hardware implementation, K-means has advantages in its computational efficiency and clustering performance.…”