Deep Learning Techniques for Spatiotemporal Weighted Pose Taekwondo Features and Their Application in Tactical Analysis

Abstract

Taekwondo behavior recognition has become a popular study issue in the past few decades due to its vast range of applications in the visual realm. The research of Taekwondo behavior recognition based on skeleton sequences has received increasing attention in recent years due to the widespread use of depth sensors and the development of real-time skeleton estimate methods based on depth images. In order to characterize the behavioral sequences, the majority of research work currently in existence extracts the spatial domain information of various skeleton joints within frames and the temporal domain information of the skeleton joints between frames. However, this research work ignores the fact that different joints and postures play different roles in determining the behavioral categories. Consequently, this paper presents a spatio-temporal weighted gesture Taekwondo features-based approach for Taekwondo recognition that employs a bilinear classifier to iteratively compute the weights of the static gestures and joint points relative to the action category in order to identify the joint points and gestures with high information content; concurrently, this paper introduces dynamic temporal regularization and Fourier time pyramid algorithms for temporal modeling in order to provide a better temporal analysis of the behavioural features, and ultimately employs support vector machines to complete the behavioural classification. According to experimental results on several datasets, this strategy outperforms certain other methods in terms of recognition accuracy and is highly competitive.