Standard-Compliant HEVC Screen Content Coding for Raw Light Field Image Coding

Tsang, Sik-Ho; Chan, Yui-Lam

doi:10.1109/icspcs47537.2019.9008587

Cited by 5 publications

(3 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Spatial correlation is usually exploited using suitable wellknown intra-coding tools. In [16], the High-Efficiency Video Coding standard -Screen Content Coding (HEVC-SCC) extension [17], [18] is adopted to code the light field data organized as a single, large 2D matrix of MIs. The HEVC-SCC intra block copy mode proved useful for light field coding as MIs tend to include repetitive patterns.…”

Section: Volume 4 2016mentioning

confidence: 99%

Supporting Wider Baseline Light Fields in JPEG Pleno With a Novel Slanted 4D-DCT Coding Mode

et al. 2023

View full text Add to dashboard Cite

Light fields are one of the emerging 3D representation formats with an effective potential to offer very realistic and immersive visual experiences. This capability comes at the cost of a very large amount of acquired data which practical use requires efficient coding solutions. This need was already addressed by the JPEG Pleno Light Field Coding standard for static light fields, which has specified two coding modes, named 4D-Transform and 4D-Prediction. While the first offers better compression performance for smaller baseline light fields, the second excels for larger baseline light fields. This paper intends to propose a novel light field coding mode, the Slanted 4D-Transform coding mode, which extends the 4D-Transform coding mode based on the conventional 4D-DCT, to offer better compression performance than both the available JPEG Pleno coding modes, independently of the baseline. The key idea is to apply first to each 4D block in the light field an adaptive, hierarchical geometric transformation, which makes the data in the block more energy-compaction friendly for the following 4D-DCT. The rate-distortion performance results show that the proposed Slanted 4D-Transform codec is able to outperform both the already standardized JPEG Pleno coding modes, showing BD-Rates gains of 31.03% and 28.30% for the 4D-Transform and 4D-Prediction modes, respectively, thus implying that a single coding mode can efficiently code all types of light fields.INDEX TERMS JPEG Pleno standard, Light field coding, 4D transform mode, 4D-DCT, Slant transform.

show abstract

Section: Volume 4 2016mentioning

confidence: 99%

Supporting Wider Baseline Light Fields in JPEG Pleno With a Novel Slanted 4D-DCT Coding Mode

et al. 2023

View full text Add to dashboard Cite

show abstract

“…Some of the already presented modifications of HEVC SCC were focused on increasing its efficiency for some applications, e.g., encoding of raw light-field video [28] and implementing multiview video coding equivalent to HEVC Multiview Coding (MV-HEVC) [9,29,30]. To the authors' best knowledge, this paper presents the first modification of a video compression technique (i.e., HEVC SCC) that makes it more adapted to the characteristics of video produced by another compression standard (MIV).…”

Section: Related Workmentioning

confidence: 99%

Advanced HEVC Screen Content Coding for MPEG Immersive Video

2022

View full text Add to dashboard Cite

This paper presents the modified HEVC Screen Content Coding (SCC) that was adapted to be more efficient as an internal video coding of the MPEG Immersive Video (MIV) codec. The basic, unmodified SCC is already known to be useful in such an application. However, in this paper, we propose three additional improvements to SCC to increase the efficiency of immersive video coding. First, we analyze using the quarter-pel accuracy in the intra block copy technique to provide a more effective search of the best candidate block to be copied in the encoding process. The second proposal is the use of tiles to allow inter-view prediction inside MIV atlases. The last proposed improvement is the addition of the MIV bitstream parser in the HEVC encoder that enables selecting the most efficient coding configuration depending on the type of currently encoded data. The experimental results show that the proposal increases the compression efficiency for natural content sequences by almost 7% and simultaneously decreases the computational time of encoding by more than 15%, making the proposal very valuable for further research on immersive video coding.

show abstract

“…Such image compositions present spatial correlation that may be exploited using suitable wellknown intra coding tools; while the redundancy inside the MIs or PIs is naturally exploited by the image codec, the use of appropriate intra prediction tools may also allow exploiting, although not completely, some of the redundancy across MIs or PIs. The LF coding solution in [14] uses the High Efficiency Video Coding standard -Screen Content Coding (HEVC-SCC) extension [15]- [17] to code the LF data organized as a single, large 2D matrix. The Intra Block Copy mode, used in the screen content coding pipeline, proved to be useful for LF coding as, e.g.…”

Section: A Most Relevant Light Field Coding Solutionsmentioning

confidence: 99%

The JPEG Pleno Light Field Coding Standard 4D-Transform Mode: How to Design an Efficient 4D-Native Codec

et al. 2020

View full text Add to dashboard Cite

The increasing demand for highly realistic and immersive visual experiences has led to the emergence of richer 3D visual representation models such as light fields, point clouds and meshes. Light fields may be modelled as a 2D array of 2D views, corresponding to a large amount of data, which demands for highly efficient coding solutions. Although static light fields are inherently 4D structures, the coding solutions in the literature mostly employ traditional 2D coding tools associated with techniques such as depth-based image rendering to generate a residual, again to be coded using available 2D coding tools. To address the market needs, JPEG has launched the so-called JPEG Pleno standard, which Part 2 is dedicated to light field coding. The JPEG Pleno Light Field Coding standard includes two coding modes, one based on the 4D-DCT, so-called 4D-Transform mode, and another based on depth-based synthesis, so-called 4D-Prediction. The 4D-Transform coding mode standardizes for the first time a 4D-native light field coding solution where the full light field redundancy across the four dimensions is comprehensively exploited, somehow extending to 4D the 2D coding framework adopted decades ago by the popular JPEG Baseline standard. In this context, this paper describes and analyzes in detail the conceptual and algorithmic design process which has led to the creation of the JPEG Pleno Light Field Coding standard 4D-Transform coding mode. This has happened through a sequence of steps involving technical innovation design and integration where increasingly sophisticated coding tools have been combined and improved to maximize the final rate distortion (RD) performance. INDEX TERMS JPEG Pleno standard, Light field coding, 4D-Transform mode, 4D-DCT.

show abstract

Standard-Compliant HEVC Screen Content Coding for Raw Light Field Image Coding

Cited by 5 publications

References 19 publications

Supporting Wider Baseline Light Fields in JPEG Pleno With a Novel Slanted 4D-DCT Coding Mode

Supporting Wider Baseline Light Fields in JPEG Pleno With a Novel Slanted 4D-DCT Coding Mode

Advanced HEVC Screen Content Coding for MPEG Immersive Video

The JPEG Pleno Light Field Coding Standard 4D-Transform Mode: How to Design an Efficient 4D-Native Codec

Contact Info

Product

Resources

About