A Machine Intelligence Approach to Virtual Ballet Training

Muneesawang, Paisarn; Khan, Naimul; Kyan, Matthew; Elder, R. Bruce; Dong, Nan; Sun, Guang; Li, Haiyan; Zhong, Ling; Guan, Ling

doi:10.1109/mmul.2015.73

Cited by 27 publications

(23 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…• Improvement of an intuitive grading and feedback system for human activities. The algorithm for grading and feedback is based off [11,12].…”

Section: Contributionmentioning

confidence: 99%

Real time system for human action evaluation

Tan¹

2021

Preprint

View full text Add to dashboard Cite

This thesis presents a real-time human activity analysis system, where a user’s activity can be quantitatively evaluated with respect to a ground truth recording. Multiple Kinects are used to solve the problem of self-occlusion while performing an activity. The Kinects are placed in locations with different perspectives to extract the optimal joint positions of a user using Singular Value Decomposition (SVD) and Sequential Quadratic Programming (SQP). The extracted joint positions are then fed through our Incremental Dynamic Time Warping (IDTW) algorithm so that an incomplete sequence of an user can be optimally compared against the complete sequence from an expert (ground truth). Furthermore, the user’s performance is communicated through a novel visual feedback system, where colors on the skeleton present the user’s level of performance. Experimental results demonstrate the impact of our system, where through elaborate user testing we show that our IDTW algorithm combined with visual feedback improves the user’s performance quantitatively.

show abstract

“…• Improvement of an intuitive grading and feedback system for human activities. The algorithm for grading and feedback is based off [11,12].…”

Section: Contributionmentioning

confidence: 99%

Real time system for human action evaluation

Tan¹

2021

Preprint

View full text Add to dashboard Cite

show abstract

“…The method is based on motion acquisition via Kinect and on the application of appropriate quaternionic signal-processing techniques for temporally synchronizing, spatially aligning, and comparing signals characterizing the dance performance. Muneesawang et al (2015) used Dynamic Time Warping (DTW) to provide a dance student with visual feedback on her performance in real time. In this system, a dancer's gestures are first captured with Kinect, recognized, and isolated.…”

Section: Related Workmentioning

confidence: 99%

Analysis of Movement Quality in Full-Body Physical Activities

Niewiadomski

Kolykhalova

Piana

et al. 2019

ACM Trans. Interact. Intell. Syst.

View full text Add to dashboard Cite

Full-body human movement is characterized by fine-grain expressive qualities that humans are easily capable of exhibiting and recognizing in others' movement. In sports (e.g., martial arts) and performing arts (e.g., dance), the same sequence of movements can be performed in a wide range of ways characterized by different qualities, often in terms of subtle (spatial and temporal) perturbations of the movement. Even a non-expert observer can distinguish between a top-level and average performance by a dancer or martial artist. The difference is not in the performed movements-the same in both cases-but in the "quality" of their performance.In this article, we present a computational framework aimed at an automated approximate measure of movement quality in full-body physical activities. Starting from motion capture data, the framework computes low-level (e.g., a limb velocity) and high-level (e.g., synchronization between different limbs) movement features. Then, this vector of features is integrated to compute a value aimed at providing a quantitative assessment of movement quality approximating the evaluation that an external expert observer would give of the same sequence of movements. Next, a system representing a concrete implementation of the framework is proposed. Karate is adopted as a testbed. We selected two different katas (i.e., detailed choreographies of movements in karate) characterized by different overall attitudes and expressions (aggressiveness, meditation), and we asked seven athletes, having various levels of experience and age, to perform them. Motion capture data were collected from the performances and were analyzed with the system. The results of the automated analysis were compared with the scores given by 14 karate experts who rated the same performances. Results show that the movementquality scores computed by the system and the ratings given by the human observers are highly correlated (Pearson's correlations r = 0.84, p = 0.001 and r = 0.75, p = 0.005).

show abstract

“…Trajkova and Ferati 13 evaluated the usability of the Super Mirror for ballet education. Sun et al 14 and Muneesawang et al 15 proposed a ballet dance education system in a cave automatic virtual environment (CAVE). Similar to the Super Mirror, the proposed method also provides instructional feedback based on an interface for visualization of instructions and feedback in a CAVE.…”

Section: Related Workmentioning

confidence: 99%

A feasibility study of ballet education using measurement and analysis on partial features of still scenes

Park

Hong

Park

et al. 2016

International Journal of Distributed Sensor Networks

View full text Add to dashboard Cite

There have been a number of dance and ballet education systems using different multimedia devices. One of the wellknown multimedia devices is Kinect which uses multiple built-in sensors. We focus on Kinect-based dance and ballet education systems. Existing systems that use Kinect cannot properly recognize the turnout movement. We propose the use of a lower body joint point estimation algorithm and a closest foot points estimation algorithm that can efficiently perform image localization for recognition of basic ballet movements. In addition, in order to evaluate correct ballet movements, we propose a method that extracts partial features from still scenes and performs measurements for knee and foot positions. The proposed method is the first ballet education system that properly measures movements of a ballet dancer.

show abstract

A Machine Intelligence Approach to Virtual Ballet Training

Cited by 27 publications

References 15 publications

Real time system for human action evaluation

Real time system for human action evaluation

Analysis of Movement Quality in Full-Body Physical Activities

A feasibility study of ballet education using measurement and analysis on partial features of still scenes

Contact Info

Product

Resources

About