Qualitative Evaluation of Media Device Orchestration for Immersive Spatial Audio Reproduction

Personalization in Object-based Audio for Accessibility: A Review of Advancements for Hearing Impaired Listeners

“…More recent work on the S3A project has used OBA to integrate ad hoc arrays of personal and mobile devices into immersive audio reproduction. Media Device Orchestration (MDO) [118] utilizes additional metadata and allows individual objects, or object categories, to be sent to connected mobile devices. MDO enables mobile devices to augment a sound scene to improve immersion and also has potential for specific objects, e.g., narration, to be sent to a specific individual's device.…”

“…However, the increase of video on demand consumption and headphone listening may provide the necessary impetus for change. A number of object-based technologies in development have the potential to offer this type of personalization through binaural rendering [111,105,115] or sending alternate mixes to secondary devices [118,123]. The use of binaural rendering has the additional advantage of providing useful location cues to listeners who may also have some sight loss [130].…”

A System Architecture for Semantically Informed Rendering of Object-Based Audio

“…This is due to the quality, limited number, and restricted positioning of loudspeakers, as well as the optimal listening experience being limited to a narrow "sweet spot." As an alternative, the use of an ad hoc array of portable devices to deliver or augment a media experience-termed media device orchestration (MDO)-has recently been proposed [12]. MDO utilizes sound-producing devices that are likely to be present in domestic environments (such as mobile phones, laptops, tablets, etc.)…”

“…Francombe et al [12] described an implementation using metadata adaptation and the VISR framework to allow rendering to an MDO system. In addition to the core object metadata, the framework allowed advanced metadata describing aspects such as target loudspeaker quality and object category (e.g., narrator, ambience, etc.)…”

“…• Definition of a metadata representation, extending the schema proposed in [3]; • Introduction of a processing framework for metadata adaptations, generalizing the software introduced in [9] to foster the composition of structured, complex adaptation schemes; • Integration of perceptual metering into the system architecture; • Description of an exemplary extensible open-source implementation to illustrate the concepts of the system architecture, but also to enable experimentation and research into the SIR approach; • Discussion of the system architecture's capabilities through a series of application examples drawn from our previous work [10][11][12][13].…”