3D Human Action Recognition with Skeleton Orientation Vectors and Stacked Residual Bi-LSTM

Wan, Xiaoxia; Xing, Tengfei; Gong, Shengrong; Liu, Chunping

doi:10.1109/acpr.2017.98

Cited by 3 publications

(1 citation statement)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…e skeleton model of the human body can be quickly and accurately estimated from the depth data, so the method of human posture estimation based on RGB-D data is widely used. Wan et al [22] extracted the orientation vectors from several groups of skeleton joints and used a stacked residual bidirectional long-short term memory (LSTM) network to build modal. Liu et al [23] proposed a new action recognition LSTM network based on skeleton data, that is, global context aware attention LSTM network.…”

Section: Skeleton Data-basedmentioning

confidence: 99%

Using a Multilearner to Fuse Multimodal Features for Human Action Recognition

Tang

Wang

et al. 2020

Mathematical Problems in Engineering

View full text Add to dashboard Cite

The representation and selection of action features directly affect the recognition effect of human action recognition methods. Single feature is often affected by human appearance, environment, camera settings, and other factors. Aiming at the problem that the existing multimodal feature fusion methods cannot effectively measure the contribution of different features, this paper proposed a human action recognition method based on RGB-D image features, which makes full use of the multimodal information provided by RGB-D sensors to extract effective human action features. In this paper, three kinds of human action features with different modal information are proposed: RGB-HOG feature based on RGB image information, which has good geometric scale invariance; D-STIP feature based on depth image, which maintains the dynamic characteristics of human motion and has local invariance; and S-JRPF feature-based skeleton information, which has good ability to describe motion space structure. At the same time, multiple K-nearest neighbor classifiers with better generalization ability are used to integrate decision-making classification. The experimental results show that the algorithm achieves ideal recognition results on the public G3D and CAD60 datasets.

show abstract

Section: Skeleton Data-basedmentioning

confidence: 99%