Autonomous Humanoid Robot Dance Generation System based on real-time music input

Abstract

There have been many attempts made by companies and researchers to make people feel more familiar with robots. As one example, Dance performance of Entertainment Robot could conceivably provide an event that would be seen easily in a public place. In most cases, however, programmers' and researchers' workload, if they were to attempt to program dance motions for a robot and synchronize them, would be too heavy. In addition, pre-programmed dance motion and synchronization information are useful only for one certain music and are useless for any other music input. To solve these problems, we have introduced a new system that can make a robot dance automatically with real-time music input. The system consists of two main parts: the first is a real-time beat extraction system for music; the second one is a system of dance motion for a humanoid robot. In the first part, music input is analyzed using FFT and peak-to-peak time duration in the low frequency area is computed. In the second part, the process of making and synchronizing the dance motion of the humanoid robot is described. Finally, we perform experiments to check the validity of the proposed system. Also, limitations and further work are described.

Tracing from Sound to Movement with Mixture Density Recurrent Neural Networks

“…There are several aspects to consider when selecting appropriate audio features to represent the music examples to which the dancers were improvising. Several previous works Seo et al, 2013) have largely focused on the rhythmical, beatmatching aspects when generating dance.…”

Dual flexible 7 DoF arm robot learns like a child to dance using Q-learning

“…Because a dancing robot can be an important part in such events, there have been many related studies for dancing robots. There are several different approaches that may be used in the generation of dance movements in humanoid robots [2] [3] [4]. Worldwide, robotics and artificial intelligence researchers are making attempts to make robots dance to the sound of music tracks [5], and make them participate in collaborative musical performances with humans [6].…”

Robot Actors and Authoring Tools for Live Performance System

“…In order to generate realistic dance motion for the robot, a continuous motion of dance was captured, investigated, and categorized into simple gestures [4]. Another study proposed a robot dance generation system based on the beat and feature extracted from music source [3].…”