Multi-video compression in texture space using 4D SPIHT

Abstract

Abstracl-We present a model-based approach to encode multiple synchronized \ideo streams which show a dynamic scene from different viewpoints. By utilizing 3D scene geometry, we compensate for motion and disparity by transforming all video images to object textures prior to compression.A 4D SPIHT wavelet compression algorithm exploits inter frame coherence in both temporal and spatial di mension. Unused texels increase the compression, and a shape mask can be omitted at the cost of higher decoder complexity. The proposed coding scheme is intended for use in conjunction with Free-Viewpoint Video and 3D· TV applications.

Data Reduction Techniques for Simulation, Visualization and Data Analysis

“…Among them EBCOT is the coder that was adopted by the JPEG200 standard. Though originally proposed to code 2D images, most of these coders are extended to higher dimensions, including 3D versions of ZeroTree [CP96], SPIHT [KP97], SPECK [TPM03], SBHP [LP06] and EBCOT [XXLZ01], and 4D versions of ZeroTree [ZJM*02], SBHP [LP07] and SPIHT [ZLMS04, LBMN05]. Wavelet coefficient coding is a big topic itself, and this survey includes only some representative and well‐studied techniques.…”

Multitemporal Hyperspectral Image Compression

“…One conceptually straightforward approach would be to treat the temporal direction as yet another dimensionality to the data and deploy a suitable 4-D compression algorithm, e.g., [11]. Such a 4-D coder would generally be an extension of an existing 3-D algorithm to the next higher dimensionality, including a 4-D transform to effectuate decorrelation spatially, spectrally, as well as temporally.…”

“…Instead, we assume that an encoder can store and use only one prior hyperspectral volume (the reference image) to aid in the coding of the current image (the test image). With only two images in the temporal direction, a full 4-D coder like in [11] is inapplicable since there are not enough data in the temporal direction to support a 4-D transform; consequently, we consider modifications to the 3-D coding of hyperspectral volumes to exploit the availability of the reference image.…”

High-Quality Reconstruction from Multiview Video Streams

“…An extension to the MPEG framework for encoding multiview video and geometry content has been proposed in [31]. Methods for efficient encoding of model-based free-viewpoint videos are described in [32] and [33] and will be addressed briefly in the following.…”

“…The second compaction scheme is based on 4-D-SPIHT [33], and we have a closer look at its individual processing steps in the following.…”