The media industry is currently being pulled in the often-opposing\ud
directions of increased realism (high resolution, stereoscopic,\ud
large screen) and personalization (selection and control of\ud
content, availability on many devices). We investigate the\ud
feasibility of an end-to-end format-agnostic approach to support\ud
both these trends. In this paper, different aspects of a format-\ud
agnostic capture, production, delivery and rendering system are\ud
discussed. At the capture stage, the concept of layered scene\ud
representation is introduced, including panoramic video and 3D\ud
audio capture. At the analysis stage, a virtual director component\ud
is discussed that allows for automatic execution of\ud
cinematographic principles, using feature tracking and saliency\ud
detection. At the delivery stage, resolution-independent\ud
audiovisual transport mechanisms for both managed and\ud
unmanaged networks are treated. In the rendering stage, a\ud
rendering process that includes the manipulation of audiovisual\ud
content to match the connected display and loudspeaker properties\ud
is introduced. Different parts of the complete system are revisited\ud
demonstrating the requirements and the potential of this advanced\ud
concept.Peer ReviewedPostprint (published version
An end-to-end AV broadcast system providing an immersive, interactive experience for live events is the development aim for the EU FP7 funded project, FascinatE. The project has developed real time audio object event detection and localisation, scene modelling and processing methods for multimedia data including 3D audio, which will allow users to navigate the event by creating their own unique user-defined scene. As part of the first implementation of the system a test shoot was carried out capturing a live Premier League football game and methods have been developed to detect, analyse, extract and localise salient audio events from a range of sensors and represent them within an audio scene in order to allow free navigation within the scene.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.