Interframe wavelet coding—motion picture representation for universal scalability

Abstract

Scalability at the bitstream level is an important feature for encoded video that is to be transmitted and stored with a variety of target rates or to be replayed on devices with different capabilities and resolutions. This is attractive for digital cinema applications, where the same encoded source representation could seamlessly be used for purposes of archival and various distribution channels. Conventional high-performance video compression schemes are based on the method of motion-compensated prediction, using a recursive loop in the prediction process. Due to this recursion and the inherent drift in cases of deviation between encoder and decoder states, scalability is difficult to realize and typically effects a penalty in compression performance for prediction-based coders. The method of interframe wavelet coding overcomes this limitation by replacing the prediction along the time axis by a wavelet filter, which can nevertheless be operated in combination with motion compensation. Recent advances in motion-compensated temporal filtering (MCTF) have proven that combination with arbitrary motion compensation methods is possible. Compression performance is achieved that is comparable with state of the art single-layer coders targeting only for one rate. The paper provides an explanation of MCTF methods and the resulting 3D wavelet representation, and shows results obtained in the context of encoding digital cinema (DC) materials. r

Game-Theoretic Paradigm for Resource Management in Spectrum Agile Wireless Networks

“…The selected sequences (see Table 1) are CIF at 30Hz. We use the recentlydeveloped Motion Compensated Temporal Filtering based scalable video coding [10]. We use a Group Of Pictures (GOP) structure with 16 frames in each GOP, and temporal decomposition with 4 temporal levels.…”

Blind motion-compensated video watermarking

“…Kundur et al [4] depend on anchor points to embed a correlated watermark in similar host video components, Doërr et al use frame registration to align the video's background component before watermarking. Pankajakshan et al [6] embed the watermark in the low-pass approximation obtained by a motion-compensated temporal wavelet transform (MC-TWT) [11]. Figure 1 shows the temporal low-pass frame with and without MC of the first 16 Foreman sequence frames.…”

“…The MC-TWT offers the advantage of an efficient, fine-grained motion model based on block-based ME to track both foreground as well as background video components and is compatible with potential future video coding standards [6,11,12].…”

“…Here, we follow the notation of [6] and restrict ourselves to the Haar wavelet and a motion model, M , with integer pixel accuracy. Extensions to the 5/3 wavelet for bidirectional filtering and sub-pixel accuracy motion can be found in [11].…”

New Forming Scheme of Reference of LL Band for In-Band Video Coding with Spatial Scalability

“…One is inter-frame wavelet coder [1], and the other is in-band wavelet coder [2] [3]. Inter-frame wavelet coders perform wavelet transform along temporal axis to generate temporal high pass and low pass frames in time domain.…”