A comparison of molecular approaches for generating sparse and structured multiresolution representations of audio and music signals

Abstract

The authors investigate the characteristics and performance of joint (single-step) and sequential (two-step) approaches to creating sparse and structured multiresolution representations of audio and music signals derived using sparse overcomplete methods. A joint approach, such as molecular matching pursuit, attempts to find structures in a signal as part of the decomposition process, while a sequential approach, such as agglomerative clustering, attempts to find structures in the completed decomposition of a signal. Each of these approaches have different benefits and drawbacks. For a joint approach, it is computationally convenient that the decomposition and structuring are done simultaneously, but usually only simple structural relations are possible. For a sequential approach, one is working in a parameter space of much smaller dimension than the original signal, but the computation is higher since the decomposition and the structure building are two separate processes. Results from these approaches using real audio and music signals will be compared and contrasted, and will contribute to our goal of creating an enhanced interface between the content of audio and music signals, e.g., onsets, notes, voices, and their multiresolution sparse atomic decompositions.

Analysis, Visualization, and Transformation of Audio Signals Using Dictionary-based Methods†

“…We have designed an algorithm that builds molecular representations from atomic ones [Sturm et al, 2008c, Sturm et al, 2008d, Sturm, 2009. Each molecule is a group of atoms that act together to represent a high-level feature.…”