Improved side information generation with iterative decoding and frame interpolation for Distributed Video Coding

Abstract

Distributed Video Coding (DVC) is a new paradigm in video coding, which is receiving a lot of interests nowadays. Side Information (SI) generation is a key function in the DVC decoder, and plays a key-role in determining the performance of the codec. This paper proposes an improved side information generation scheme, which exploits both spatial and temporal correlations in the sequences. Partially decoded Wyner-Ziv (WZ) frames, based on initial SI by Motion Compensation Temporal Interpolation (MCTI), are exploited to improve the performance of the whole SI generation. In addition, an enhanced temporal frame interpolation is proposed, including motion vector refinement and smoothing, optimal compensation mode selection, and a new matching criterion for motion estimation. Simulation results show that the proposed scheme can achieve up to 2.3 dB improvement in Rate Distortion (RD) performance for video with high motion, when compared to state-of-the-art DVC.

Distributed Video Coding: Trends and Perspectives

“…The turbo decoder selects for each block which SI stream to use, based on the error probability. Finally, exploiting both spatial and temporal correlations in the sequence, a partially decoded WZ frame is exploited to improve the performance of the whole SI generation in [28]. In addition, an enhanced motion compensated temporal frame interpolation is proposed.…”

Iterative Multiview Side Information for Enhanced Reconstruction in Distributed Video Coding

“…We initially introduced iterative SI for the monoview scenario in [25], where the final SI depends not only on the key frames but also on the WZ bits as well. This final SI is used to refine the reconstruction of the decoded WZ frame.…”

A low-complexity frame/block motion activity classification algorithm for Wyner-Ziv video coding

“…The performance of a Wyner-Ziv video coding system is significantly determined by the quality of side information(SI), while the quality of SI significantly depends on the coding efficiency of the key frames [2,4]. So, we are interested in the methods of coding key frames in order to improve the rate distortion performance.…”

“…It is transform coded and represented by bitplanes. Parity bits generated from the corresponding bitplanes at the encoder are used to correct the errors in each bitplane, also in the descending order of bit significance until the total rate budget for this frame is achieved [4]. At the same time, the side information blocks of the previous frame are used to classify the motion activity of the current key frame and the macroblocks in it.…”