Layer Selection in Progressive Transmission of Motion-Compensated JPEG2000 Video

Abstract

MCJ2K (Motion-Compensated JPEG2000) is a video codec based on MCTF (Motion-Compensated Temporal Filtering) and J2K (JPEG2000). MCTF analyzes a sequence of images, generating a collection of temporal sub-bands, which are compressed with J2K. The R/D (Rate-Distortion) performance in MCJ2K is better than the MJ2K (Motion JPEG2000) extension, especially if there is a high level of temporal redundancy. MCJ2K codestreams can be served by standard JPIP (J2K Interactive Protocol) servers, thanks to the use of only J2K standard file formats. In bandwidth-constrained scenarios, an important issue in MCJ2K is determining the amount of data of each temporal sub-band that must be transmitted to maximize the quality of the reconstructions at the client side. To solve this problem, we have proposed two rate-allocation algorithms which provide reconstructions that are progressive in quality. The first, OSLA (Optimized Sub-band Layers Allocation), determines the best progression of quality layers, but is computationally expensive. The second, ESLA (Estimated-Slope sub-band Layers Allocation), is sub-optimal in most cases, but much faster and more convenient for real-time streaming scenarios. An experimental comparison shows that even when a straightforward motion compensation scheme is used, the R/D performance of MCJ2K competitive is compared not only to MJ2K, but also with respect to other standard scalable video codecs.

Digital Signal, Image and Video Processing for Emerging Multimedia Technology

“…For video processing, Yan, T. et al proposed a novel ρ domain rate control algorithm for multiview high efficiency video coding (MV-HEVC) [17]. In addition, Maturana-Espinosa, J.C. et al proposed two rate-allocation algorithms which provided reconstructions that were progressive in quality [18]. They used Optimized Sub-band Layers Allocation (OSLA) and Estimated-Slope sub-band Layers Allocation (ESLA).…”