Multichannel Audio Coding for Multimedia Services in Intelligent Environments

Abstract

Abstract. Audio is an integral component of multimedia services in intelligent environments. Use of multiple channels in audio capturing and rendering offers the advantage of recreating arbitrary acoustic environments, immersing the listener into the acoustic scene. On the other hand, multichannel audio contains a large degree of information which is highly demanding to transmit, especially for real-time applications. For this reason, a variety of compression methods have been developed for multichannel audio content. In this chapter, we initially describe the currently popular methods for multichannel audio compression. Low-bitrate encoding methods for multichannel audio have also been recently starting to attract interest, mostly towards extending MP3 audio coding to multichannel audio recordings, and these methods are also examined here. For synthesizing a truly immersive intelligent audio environment, interactivity between the user(s) and the audio environment is essential. Towards this goal, we present recently proposed multichannel-audio-specific models, namely the source/filter and the sinusoidal models, which allow for flexible manipulation and high-quality low-bitrate encoding, tailored for applications such as remote mixing and distributed immersive performances.

Immersive Environment: An Emerging Future of Telecommunications

“…The idea is to use a sensor network to capture the targeted environment data (such as a sound environment) in real time and transfer it to a remote user using low-bandwidth channels such as the current Internet infrastructure or wireless channels. 7 This would give the use an immersive presence in the targeted environment. Figure 2 illustrates a scenario such If successfully integrated, WSNs could have a major impact on society.…”

“…Because immersive specialized sound and user-controlled interactivity depend on enhanced audio content, the ability to efficiently capture, process, transmit, and render multiple recordings containing numerous sound sources is of crucial importance 7. …”