3D Human Pose Estimation in Vietnamese Traditional Martial Art Videos

Nguyen, Thuy-Anh; Le, Hung Van; Duong, Long; Pham, Cong Thanh; Dung, Le

doi:10.25073/jaec.201933.252

Cited by 4 publications

(2 citation statements)

References 29 publications

(55 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Figure 1 presents several applications based on human posture estimation. There have been studies using human posture to build applications in sports [ 59 , 92 ] and preserving and developing traditional martial arts [ 93 , 94 ]. Moreover, there is Zhang et al [ 95 ], who published a dataset of human postures in martial arts, dancing, and sports.…”

Section: Pose-based Applicationmentioning

confidence: 99%

Unified End-to-End YOLOv5-HR-TCM Framework for Automatic 2D/3D Human Pose Estimation for Real-Time Applications

Nguyen¹,

Nguyen²,

Scherer

et al. 2022

Sensors

Self Cite

View full text Add to dashboard Cite

Three-dimensional human pose estimation is widely applied in sports, robotics, and healthcare. In the past five years, the number of CNN-based studies for 3D human pose estimation has been numerous and has yielded impressive results. However, studies often focus only on improving the accuracy of the estimation results. In this paper, we propose a fast, unified end-to-end model for estimating 3D human pose, called YOLOv5-HR-TCM (YOLOv5-HRet-Temporal Convolution Model). Our proposed model is based on the 2D to 3D lifting approach for 3D human pose estimation while taking care of each step in the estimation process, such as person detection, 2D human pose estimation, and 3D human pose estimation. The proposed model is a combination of best practices at each stage. Our proposed model is evaluated on the Human 3.6M dataset and compared with other methods at each step. The method achieves high accuracy, not sacrificing processing speed. The estimated time of the whole process is 3.146 FPS on a low-end computer. In particular, we propose a sports scoring application based on the deviation angle between the estimated 3D human posture and the standard (reference) origin. The average deviation angle evaluated on the Human 3.6M dataset (Protocol #1–Pro #1) is 8.2 degrees.

show abstract

Section: Pose-based Applicationmentioning

confidence: 99%

Unified End-to-End YOLOv5-HR-TCM Framework for Automatic 2D/3D Human Pose Estimation for Real-Time Applications

Nguyen¹,

Nguyen²,

Scherer

et al. 2022

Sensors

Self Cite

View full text Add to dashboard Cite

show abstract

“…Many authors have converted this problem into a typical constrained optimization problem to minimize the main error in mapping an unknown 3D pose to a 2D pose at an unknown observation angle. This optimization problem is subject to the corresponding application constraints and sometimes requires the assumption that the 3D pose has a better optimization state in the lower dimensional subspace, but this optimization-based approach can be sensitive to initialization and local minima and often require expensive constraint solvers [20]. With the rapid development of deep learning, we are more pleased to find that many algorithmic effects change qualitatively when the amount of data reaches a certain level.…”

Section: Human Skeleton Detection Based On the 3d Diffusionmentioning

confidence: 99%

Three-Dimensional Diffusion Model in Sports Dance Video Human Skeleton Detection and Extraction

2021

Advances in Mathematical Physics

View full text Add to dashboard Cite

The research in this paper mainly includes as follows: for the principle of action recognition based on the 3D diffusion model convolutional neural network, the whole detection process is carried out from fine to coarse using a bottom-up approach; for the human skeleton detection accuracy, a multibranch multistage cascaded CNN structure is proposed, and this network structure enables the model to learn the relationship between the joints of the human body from the original image and effectively predict the occluded parts, allowing simultaneous prediction of skeleton point positions and skeleton point association information on the one hand, and refinement of the detection results in an iterative manner on the other. For the combination problem of discrete skeleton points, it is proposed to take the limb parts formed between skeleton points as information carriers, construct the skeleton point association information model using vector field, and consider it as a feature, to obtain the relationship between different skeleton points by using the detection method. It is pointed out that the reorganization problem of discrete skeleton points in multiperson scenes is an NP-Hard problem, which can be simplified by decomposing it into a set of subproblems of bipartite graph matching, thus proposing a matching algorithm for discrete skeleton points and optimizing it for the skeleton dislocation and algorithm problems of human occlusion. Compared with traditional two-dimensional images, audio, video, and other multimedia data, the 3D diffusion model data describe the 3D geometric morphological information of the target scene and are not affected by lighting changes, rotation, and scale transformation of the target and thus can describe the realistic scene more comprehensively and realistically. With the continuous updating of diffusion model acquisition equipment, the rapid development of 3D reconstruction technology, and the continuous enhancement of computing power, the research on the application of 3D diffusion model in the detection and extraction of a human skeleton in sports dance videos has become a hot direction in the field of computer vision and computer graphics. Among them, the feature detection description and model alignment of 3D nonrigid models are a fundamental problem with very important research value and significance and challenging at the same time, which has received wide attention from the academic community.

show abstract

A new intelligence fuzzy-based hybrid metaheuristic algorithm for analyzing the application of tea waste in concrete as natural fiber

Cao

Zandi

Rahimi

et al. 2021

Computers and Electronics in Agriculture

View full text Add to dashboard Cite

3D Human Pose Estimation in Vietnamese Traditional Martial Art Videos

Cited by 4 publications

References 29 publications

Unified End-to-End YOLOv5-HR-TCM Framework for Automatic 2D/3D Human Pose Estimation for Real-Time Applications

Unified End-to-End YOLOv5-HR-TCM Framework for Automatic 2D/3D Human Pose Estimation for Real-Time Applications

Three-Dimensional Diffusion Model in Sports Dance Video Human Skeleton Detection and Extraction

A new intelligence fuzzy-based hybrid metaheuristic algorithm for analyzing the application of tea waste in concrete as natural fiber

Contact Info

Product

Resources

About