Interactive Multimedia Interface and Multimodal Analysis for Technology-Enhanced Learning and Performance Preservation

Abstract

This paper presents one of the interactive multimedia tools resulted from a research and development project in the context of technology-enhanced learning for music, and the usage of the multimodal interface for performing arts preservation. Firstly, the paper briefly introduces the i-Maestro project (see www.i-maestro.org). With particular focuses on the interactive multimedia interface for 3D motion visualization, the paper discusses the applications and usages of this gestural interface for technology-enhanced learning for string instruments. The interface utilizes online and offline multimodal data analysis and provide interactive feedback using 3D graphics and sonification. It provides additional level of details and data for stylistic and performance analysis. Next, the paper presents an ongoing research project which is working on digital preservation of interactive music performance using this interface.