Methods and Tools for Wavelet-Based Scalable Multiview Video Coding

Abstract

A wavelet-based multiview video coding scheme is presented in this paper. It uses a 4-D wavelet transform, which is composed of a 1-D temporal wavelet transform, namely motion compensated temporal filtering, a 1-D view-directional wavelet transform, namely disparity compensated view filtering and a 2-D spatial wavelet transform. Since the presented framework can make use of the inherent scalability properties of the wavelet transforms involved, it allows full scalability of the coded bitstream in the temporal, view, spatial, and quality dimensions. Coding performance close to the H.264/advanced video coding based standard multiview video codec is shown. Enhancements of the view transform, in order to better account for brightness and color variations across views are introduced. Additionally, the use of a signal adaptive anisotropic wavelet packet (WP) transform as a generalization of WP transforms for the spatial decomposition is proposed. Both enhancements lead to a decrease of bit rate of up to 11% compared with the baseline version of the codec.

3-D mesh compensated wavelet lifting for 3-D+t medical CT data

“…On the other hand, this leads to a subsampling of the motion information in z-direction. 1 The CT volume data set was kindly provided by Siemens Healthcare. Fig.…”

“…By incorporating a compensation method directly into the wavelet transform, the transform can be adapted to the signal. A compensated wavelet transform in temporal direction is known as Motion Compensated Temporal Filtering (MCTF) [1]. Blur and ghosting artifacts caused by displacement in the signal can be reduced and thus the visual quality of the lowpass band is increased.…”

“…Simulation results are presented in Section 4. Instead of the original volume f2t−1, a predictor is subtracted from f2t, denoted by the warping operator W2t−1→2t [1]. The compensation is called MC in Fig.…”

Content-Based Scalable Multi-View Video Coding Using 4D Wavelet

“…For example, in immersive teleconference, there is an interaction between consumers. Participants at different geographical sites meet virtually and see each other in either free viewpoint or 3DTV style [5][6][7][8][9][10]. The immersive teleconference provides a more natural way of communications [11][12].…”

Homogeneous and Heterogeneous MPSoC Architectures with Network‐On‐Chip Connectivity for Low‐Power and Real‐Time Multimedia Signal Processing

“…Telecommunications, consumer, and infotainment applications are characterized by a growing interest in the realtime and low-power implementation of DSP techniques, for images, videos, and audio, to improve system performances in terms of coding efficiency, visualization quality, and audio reproduction fidelity. At the state-of-the-art, several algorithms have been proposed [1][2][3][4][5][6][7][8][9][10][11][12][13] which represent mature solutions for video and audio coding, noise and artifact suppression, high-dynamic-range signal management, interpolation, video motion estimation, and low-distortion digital audio amplification. The implementation of such algorithms in real-time and with low-power consumption is a challenging open issue.…”