Transforms for the motion compensation residual

Kamisli, Fatih; Lim, Jae S.

doi:10.1109/icassp.2009.4959702

Cited by 26 publications

(22 citation statements)

References 12 publications

(21 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The parameter θ represents the angle of rotation of the axes from the horizontal and vertical directions in relation to the model from As described in [3], applying this generalized Markov-1 model to images and MC residuals produces several key results. Blocks in both images and MC residuals show strong correlation in one direction.…”

Section: Characteristics Of MC Residualsmentioning

confidence: 99%

Analysis of one-dimensional transforms in coding motion compensation prediction residuals for video applications

Zhang

Lim

2012

2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Self Cite

View full text Add to dashboard Cite

In video coding, motion compensation prediction provides significant increases in overall compression efficiency. The prediction residuals are typically treated as images and compressed by applying two-dimensional transforms such as the two-dimensional discrete cosine transform (2D-DCT). Previous work has found that the use of directionadaptive one-dimensional discrete cosine transforms (1D-DCTs) in coding motion compensation residuals can provide significant additional bitrate savings. However, this requires optimization over all of the available transforms to minimize the overall bitrate, which can be expensive in terms of time and computation.In this thesis, we examine the use of only the horizontal and vertical 1D-DCTs in addition to the 2D-DCT for coding motion compensation residuals. By reducing the number of available transforms, the amount of required computation decreases significantly, with a potential cost in performance. We perform experiments using a modified H.264/AVC codec to compare the performance of using different sets of available transforms. The results indicate that for typical applications of video coding, most of the performance benefit from using directional 1D-DCTs can be retained by keeping only the horizontal and vertical 1D-DCTs.

show abstract

Section: Characteristics Of MC Residualsmentioning

confidence: 99%

Analysis of one-dimensional transforms in coding motion compensation prediction residuals for video applications

Zhang

Lim

2012

2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Self Cite

View full text Add to dashboard Cite

show abstract

“…These residuals tend to be more sparse than blocks found in the original image or video frame. In [6] it was observed that the correlation of data along the direction of features in a motioncompensated prediction residual is much higher than the correlation in other directions. The authors therefore only applied a first set of directional 1-D transforms on the residuals.…”

Section: Introductionmentioning

confidence: 98%

“…To improve coding performance on blocks with oblique features, several directional transforms have been developed [4][5][6][7][8]. In [4], a separable Directional 2-D DCT (DDCT) was used to transform image blocks.…”

Section: Introductionmentioning

confidence: 99%

Direction-adaptive transforms for coding prediction residuals

Cohen

Klomp

Vetro

et al. 2010

2010 IEEE International Conference on Image Processing

View full text Add to dashboard Cite

In this paper, we present 2-D direction-adaptive transforms for coding prediction residuals of video. These Direction-Adaptive Residual Transforms (DART) are shown to be more effective than the traditional 2-D DCT when coding residual blocks that contain directional features. After presenting the directional transform structures and improvements to their efficiency, we outline how they are used to code both Inter and Intra prediction residuals. For Intra coding, we also demonstrate the relation between the prediction mode and the optimal DART orientation. Experimental results exhibit up to 7% and 9.3% improvements in compression efficiency in JM 16.0 and JM-KTA 2.6r1 respectively, as compared to using only the conventional H.264/AVC transform. IEEE International Conference on Image Processing 2010 (ICIP 2010)This work may not be copied or reproduced in whole or in part for any commercial purpose. Permission to copy in whole or in part without payment of fee is granted for nonprofit educational and research purposes provided that all such whole or partial copies include the following: a notice that such copying is by permission of Mitsubishi Electric Research Laboratories, Inc.; an acknowledgment of the authors and individual contributions to the work; and all applicable portions of the copyright notice. Copying, reproduction, or republishing for any other purpose shall require a license with payment of fee to Mitsubishi Electric Research Laboratories, Inc. All rights reserved. ABSTRACTIn this paper, we present 2-D direction-adaptive transforms for coding prediction residuals of video. These Direction-Adaptive Residual Transforms (DART) are shown to be more effective than the traditional 2-D DCT when coding residual blocks that contain directional features. After presenting the directional transform structures and improvements to their efficiency, we outline how they are used to code both Inter and Intra prediction residuals. For Intra coding, we also demonstrate the relation between the prediction mode and the optimal DART orientation. Experimental results exhibit up to 7% and 9.3% improvements in compression efficiency in JM 16.0 and JM-KTA 2.6r1 respectively, as compared to using only the conventional H.264/AVC transform.

show abstract

“…A 2-D auto-covariance function formed from equation (1) using separable construction is given by equation (2).…”

Section: A Auto-covariance Modelsmentioning

confidence: 99%

“…Another example is the 2-D Discrete Wavelet Transform (2-D DWT), which is used to compress images in the JPEG2000 standard and high-pass prediction residual frames in inter-frame wavelet coding [1]. However, prediction residuals have different spatial characteristics from image intensities [2], [3], [4], [5]. It is of interest therefore to study if transforms better than those used for image intensities can be developed for prediction residuals.…”

Section: Introductionmentioning

confidence: 99%

1-D Transforms for the Motion Compensation Residual

Kamisli

Lim

2011

IEEE Trans. on Image Process.

Self Cite

View full text Add to dashboard Cite

Abstract-Transforms used in image coding are also commonly used to compress prediction residuals in video coding. Prediction residuals have different spatial characteristics from images, and it is useful to develop transforms that are adapted to prediction residuals. In this paper, we explore the differences between the characteristics of images and motion compensated prediction residuals by analyzing their local anisotropic characteristics and develop transforms adapted to the local anisotropic characteristics of these residuals. The analysis indicates that many regions of motion compensated prediction residuals have 1-D anisotropic characteristics and we propose to use 1-D directional transforms for these regions. We present experimental results with one example set of such transforms within the H.264/AVC codec and the results indicate that the proposed transforms can improve the compression efficiency of motion compensated prediction residuals over conventional transforms.

show abstract

Transforms for the motion compensation residual

Cited by 26 publications

References 12 publications

Analysis of one-dimensional transforms in coding motion compensation prediction residuals for video applications

Analysis of one-dimensional transforms in coding motion compensation prediction residuals for video applications

Direction-adaptive transforms for coding prediction residuals

1-D Transforms for the Motion Compensation Residual

Contact Info

Product

Resources

About