A multi-modal dance corpus for research into interaction between humans in virtual environments

Multimodal classification of dance movements using body joint trajectories and step sounds

“…at three different time instants of a choreography performed by one dancer from the 3DLife dance database [5]. (The joints in red color are the ones we use in our system.…”

“…To evaluate our system, a subset of the 3DLife dance database [5] is used. This database is composed of multimodal recordings of Salsa choreographies performed by several dancers.In addition to these recordings complementary files including synchronization delays for each media, and dance step annotations related to each music choreography are attached.…”

“…Our system relies on a novel multimodal representation exploiting trajectories of dancers' 3D body joint positions (estimated from depthmap sequences) and an original segmentation technique segmenting those trajectories into sub-trajectories. The sub-trajectories are defined on instants where dancers' footstep impacts happen on the floor (detected from signals of piezoelectric sensors installed on the floor [5]). Then the classification of dance gestures is achieved by hidden Markov models (HMM) classifier using principal component analysis (PCA) to represent efficiently those subtrajectories [3].…”

Human skeleton matching for e-learning of dance using a probabilistic neural network

“…Waldherr et al developed an application of human robot interaction by employing camera based human movement tracking approach in order to control the movement of a robotic arm [3]. Essid et al presented a new idea of multi modal dance collection based approach that facilitates the interaction between human beings in virtually framed environment [4]. As a response to the Huawei 3DLife challenge, Alexiadis et al proposed a Kinect based approach for creating an online dance evaluating software, which measures the worth of a performance with respect to a standard one and generates feedback for further improvement [1].…”

TPT-Dance&Actions : un corpus multimodal d’activités humaines

“…A notre connaissance, il n'existe qu'une seule base de données multimodales de danse, il s'agit du corpus 3DLife Dance dataset (Essid, Lin et al, 2012) se focalisant sur l'analyse de scènes de salsa. Nous avons participé à sa construction et nous l'avons utilisée pour évaluer certains de nos algorithmes.…”