Model-based sonification based on the impulse pattern formulation

Abstract

The most common strategy for interactive sonification is parameter mapping sonification, where sensed or defined data is pre-processed and then used to control one or more variables in a signal processing chain. A well-known but rarely used alternative is model-based sonification, where data is fed into a physical or conceptual model that generates or modifies sound. In this paper, we suggest the Impulse Pattern Formulation (IPF) as a model-based sonification strategy. The IPF can model natural systems and interactions, like the sound production of musical instruments, the reverberation in rooms, and human synchronization to a rhythm. Hence, the IPF has the potential to be easy to interpret and intuitive to interact with. Experiment results show that the IPF is able to produce an intuitively interpretable, natural zero, i.e., a coordinate origin. Coordinate origins are necessary to sonify both polarities of a dimension as well as absolute magnitudes.

Introduction to the special issue on design and perception of interactive sonification

“…Simon Linke, Rolf Bader & Robert Mores [7] introduce the Impulse Pattern Formulation (IPF) [8] as a Model-Based Sonification approach. Even though the IPF has only very few parameters, the recursive function can describe various interactive systems, like physical, neural, and social systems.…”