Fine-grain scalable video coding using 3D wavelets and active meshes

Abstract

This article introduces a novel approach for scalable video coding based on an analysis-synthesis scheme. Active meshes are used to represent motion model, this permits to exploit temporal redundancy along motion trajectories in a video sequence using temporal wavelet transform. The use of 3D wavelets in the coding strategy provides natural scalability functionalities to the video coder. Furthermore, the analysis-synthesis scheme allows to decouple motion and texture and to code these informations separately. Motion can then be lossy coded, bitrates gain can be reported to texture coding. Because motion is lossy coded, a new quality criterion measured in the texture domain is then proposed. Finally, the proposed analysis-synthesis video coding scheme overcomes some of the limitations of existing video coding schemes using 3D wavelets, limitations due for the most part to the use of block-based motion model. Our video coding scheme performs as well as fully optimized H26Lv8, while providing a scalable bitstream.

Motion tubes for the representation of image sequences

“…In [1], motion field continuities are handled by the use of triangular motionadaptive meshes. However, meshes are not able to efficiently represent the motion field discontinuities, nor able to handle texture occlusions and disocclusions.…”