Creating object-based experiences in the real world

Evans, Michael J.; Ferne, Tristan; Watson, Zillah; Melchior, Frank; Brooks, Matthew L.; Stenton, Phil; Forrester, Ian

doi:10.1049/ibc.2016.0034

Cited by 10 publications

(9 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Sixteen projects meeting this criteria were identified. Two additional projects were initially identified and later excluded as they did not specifically describe audio personalization [59,60]. The majority of projects addressed speech to noise ratio (15 projects).…”

Section: Methodology Of the Systematic Reviewmentioning

confidence: 99%

“…A project carried out by the BBC, called Story Explorer, developed tools to create additional online content for media. The content allowed users to explore information relevant to a program such as to story-lines, key events, and characters [60]. This approach, coupled with tools for synchronized second screen content [131], offers technology to deliver supporting information.…”

Section: Redundancymentioning

confidence: 99%

See 1 more Smart Citation

Personalization in Object-based Audio for Accessibility: A Review of Advancements for Hearing Impaired Listeners

Ward¹,

Shirley²

2019

J. Audio Eng. Soc.

View full text Add to dashboard Cite

Hearing loss is widespread and significantly impacts an individual's ability to engage with broadcast media. Access can be improved through new object-based audio personalization methods. Utilizing the literature on hearing loss and intelligibility this paper develops three dimensions that are evidenced to improve intelligibility: spatial separation, speech to noise ratio, and redundancy. These can be personalized, individually or concurrently, using object-based audio. A systematic review of all work in object-based audio personalization is then undertaken. These dimensions are utilized to evaluate each project's approach to personalization, identifying successful approaches, commercial challenges, and the next steps required to ensure continuing improvements to broadcast audio for hard of hearing individuals.

show abstract

Section: Methodology Of the Systematic Reviewmentioning

confidence: 99%

Section: Redundancymentioning

confidence: 99%

Personalization in Object-based Audio for Accessibility: A Review of Advancements for Hearing Impaired Listeners

Ward¹,

Shirley²

2019

J. Audio Eng. Soc.

View full text Add to dashboard Cite

show abstract

“…Today we see personal data being used from the very beginning of user jouneys on digital media platforms : media content discovery platforms [57] like popular media recommenders on Netflix. Modern media research leverages audience personal data for personalisation of the very content itself [22,30]. Here, personal data has given rise to entirely new genres of media like interactive media [31,70,71] wherein the media content allows for direct user interaction and customisation through user data [12,31,48,70,71].…”

Section: The Turn To Personal Data In Media Experiencesmentioning

confidence: 99%

Human Data Interaction in Data-Driven Media Experiences : An Exploration of Data Sensitive Responses to the Socio-Technical Challenges of Personal Data Leverage

Sailaja

Jones

McAuley

2021

ACM International Conference on Interactive Media Experiences

View full text Add to dashboard Cite

While explication of socio-technical challenges posed by personal data leverage in media research has been of interest recently, effective responses that alleviate them are yet to be studied. This paper reports the use of a Cross Media Profiler prototype supported by a Personal Data Store, that combines personal data from different media services for more holistic media recommendations. This prototype is used to probe and explore the integration of Human Data Interaction principles in media experiences, as a response to these challenges. Our focus groups reveal that users prefer the media service when supported by the PDS while highlighting improvements around transparency and control. The work leads to two outcomes : design recommendations for future media experiences to embody increased sensitivity to the implications of personal data leverage and a critique of the HDI agenda through the lens of data driven media, which scopes out potential for future IMX intervention. CCS CONCEPTS• Human-centered computing → Human computer interaction (HCI).

show abstract

“…For instance, a hearing-impaired listener might adjust the balance between dialog and background sounds to improve speech intelligibility [3], or a football fan might choose to hear the match as if they are seated with their own team's fans in the stadium [4]. Furthermore, the objectbased representation can allow the content itself to respond to user input based on semantic metadata [5], for instance to dynamically create a documentary of a certain length while retaining the key narrative [6].…”

Section: Introductionmentioning

confidence: 99%

“…URL: http://www.steinberg.net/en/products/nuendo range/nuendo/start.html (checked 10/2016)5 URL: https://cycling74.com/products/max/ (checked 12/2016)…”

mentioning

confidence: 99%

An Audio-Visual System for Object-Based Audio: From Recording to Listening

Coleman

Franck

Francombe

et al. 2018

IEEE Trans. Multimedia

View full text Add to dashboard Cite

Object-based audio is an emerging representation for audio content, where content is represented in a reproductionformat-agnostic way and thus produced once for consumption on many different kinds of devices. This affords new opportunities for immersive, personalized, and interactive listening experiences. This article introduces an end-to-end object-based spatial audio pipeline, from sound recording to listening. A high-level system architecture is proposed, which includes novel audiovisual interfaces to support object-based capture and listenertracked rendering, and incorporates a proposed component for objectification, i.e., recording content directly into an object-based form. Text-based and extensible metadata enable communication between the system components. An open architecture for object rendering is also proposed. The system's capabilities are evaluated in two parts. First, listener-tracked reproduction of metadata automatically estimated from two moving talkers is evaluated using an objective binaural localization model. Second, object-based scene capture with audio extracted using blind source separation (to remix between two talkers) and beamforming (to remix a recording of a jazz group), is evaluated with perceptually-motivated objective and subjective experiments. These experiments demonstrate that the novel components of the system add capabilities beyond the state of the art. Finally, we discuss challenges and future perspectives for object-based audio workflows.

show abstract

Creating object-based experiences in the real world

Cited by 10 publications

References 0 publications

Personalization in Object-based Audio for Accessibility: A Review of Advancements for Hearing Impaired Listeners

Personalization in Object-based Audio for Accessibility: A Review of Advancements for Hearing Impaired Listeners

Human Data Interaction in Data-Driven Media Experiences : An Exploration of Data Sensitive Responses to the Socio-Technical Challenges of Personal Data Leverage

An Audio-Visual System for Object-Based Audio: From Recording to Listening

Contact Info

Product

Resources

About