A Domain-Specific Metamodel for Multimedia Processing Systems

Abstract

In this paper, we introduce 4MPS, a Metamodel for Multimedia Processing Systems. The goal of 4MPS is to offer a generic system metamodel that can be instantiated to describe any multimedia processing design. The metamodel combines the advantages of the object-oriented paradigm and metamodeling techniques with system engineering principles and graphical models of computation.4MPS is based on the classification of multimedia processing objects into two main categories: Processing objects that operate on data and controls, and Data objects that passively hold media content. Processing objects encapsulate a method or algorithm. They also include support for synchronous data processing and asynchronous event-driven Controls as well as a configuration mechanism and an explicit life cycle state model. Data input to and output from Processing objects is done through Ports. Data objects offer a homogeneous interface to media data, and support for metaobject-like facilities such as reflection and serialization.The metamodel can be expressed in the language of graphical models of computation such as the Dataflow Networks and presents a comprehensive conceptual framework for media signal processing applications. 4MPS has its practical validation in several existing environments, including the author's CLAM framework.

A framework for efficient and rapid development of cross-platform audio applications

“…Although initially derived for the audio and music domains, it presents a comprehensive conceptual framework for media signal processing applications. In this section, we provide a brief outline of the metamodel, see [5] for a more detailed description.…”

“…It has been formalized through a metamodel and a pattern language so the lessons learned can be used beyond CLAM. 5 Note that most of these features can be individually traced in many other environments. It is the inclusion of all of them what makes CLAM unique.…”

The multimodal music stand

“…synz shares many design ideologies of existing signal-processing frameworks such as platform-independence, ease-of-use, and flexibility. In addition, synz stresses computational efficiency together with modularity and generic programming to make it a solid foundation for higher-level dataflow models, such as 4MS [22], and plug-in architectures.…”

Experiencing Audio and Music in a Fully Immersive Environment

“…This goal required flexibility in the systems configuration and interfaces manipulation. Its most current version [7] was designed using the "Metamodel for Multimedia Processing Systems" (also known as 4mps) proposed by Xavier Amatriain [1]. This metamodel provides a solid ground for a flexible, dynamic and extensible library.…”

“…It is assumed that the speakers are equidistant from the listener, and that panning only allows moving the source position along the arc between speakers (i.e., source distance must be simulated independently). The first step is to determine which three speakers define the smallest triangle that includes p (the desired position), and what the contribution of energy from each of these will be to simulate a source at position p. Given a desired source position, one can apply an arbitrary weighting function to derive the factors for the output channels given the position of the vector for the loudspeaker triplet L (see equation 1).…”