View synthesis optimization based on texture smoothness for 3D-HEVC

Dou, Huan; Chan, Yui-Lam; Jia, Kebin; Siu, Wan-Chi

doi:10.1109/icassp.2015.7178209

Cited by 12 publications

(3 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this situation, the reconstructed depth map quality cannot guarantee the synthesised view quality from the traditional RDO. Therefore, the VSO scheme [17–20] was designed in 3D‐HEVC to look for the optimal mode in depth map coding. Different from RDO, the VSO scheme considers both the synthesised view and depth map quality.…”

Section: Depth Map Coding Techniquesmentioning

confidence: 99%

Overview of current development in depth map coding of 3D video and its future

Chan

Chen

et al. 2020

IET signal process.

View full text Add to dashboard Cite

3D videos have attracted attention from academia and industry after great success in the film industry. Multiview video plus depth (MVD) is the most popular 3D video format to provide vivid 3D feeling and has been adopted as an international 3D video coding standard, namely 3D extension of high efficiency video coding (HEVC). MVD includes a limited number of textures and depth maps to synthesise virtual views. In MVD, depth samples describe the distance between a camera and an actual object as a grey-level image. The characteristics of depth maps are quite different from texture images. Consequently, new coding tools are designed for depth maps in 3D-HEVC to improve the coding efficiency at the expense of high-computational complexity, which faces great challenges in coding systems. Depth map coding is also an important technique in immersive media to support three degrees of freedom 3DoF+/6DoF applications such as virtual reality/augmented reality. The study starts with an overview of what has been done over the last decade in 3D-HEVC, especially depth map coding, regarding theories, methodologies, current research and state-of-the-art fast approaches. Following this, a comprehensive comparison of the reviewed techniques is presented, and an outlook on its future trends is provided.

show abstract

Section: Depth Map Coding Techniquesmentioning

confidence: 99%

Overview of current development in depth map coding of 3D video and its future

Chan

Chen

et al. 2020

IET signal process.

View full text Add to dashboard Cite

show abstract

“…The introduction of depth maps into the 3D video system avoids the transmission of all texture views redundantly and the required views for display can be rendered by DIBR [4]- [5] in 3D-HEVC as compared with the conventional multi-vi- ew video format specified in the early 3D-video system [6]- [9]. Besides the coding tools inheriting from HEVC, depth map coding also adopts a number of new techniques, including SDC [10], DMM [11] and view synthesized distortion [12].…”

Section: Introductionmentioning

confidence: 99%

Early determination of intra mode and segment-wise DC coding for depth map based on hierarchical coding structure in 3D-HEVC

Zhang

Tsang

Chan

et al. 2015

2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA)

Self Cite

View full text Add to dashboard Cite

This paper proposes a fast algorithm to reduce the high computational complexity of depth map coding in 3D-HEVC, which obstructs 3D video from the practical applications. Due to the special feature of depth maps, depth modelling modes (DMMs) were developed to keep sharp edges for depth map. Consequently, the 3D-HEVC encoder can improve the coding performance of synthesized views significantly. However, this is at the significant cost of increased complexity. Since 3D-HEVC reuses the well-known hierarchical coding structure, the mode information of the parent coding units (CU) can be reused to predict the most probable modes for their CUs. Besides, a method is also proposed for early determination of segment-wise DC coding (SDC) decision based on the hierarchical coding structure. Simulation results show that the proposed algorithm achieves a reduction of 33% encoding time while maintaining the quality of synthesized views in term of bit-rate values.

show abstract

“…Joint Collaborative Team on Video Coding (JCT-VC) introduced a new generation of coding standards for 3D video such as High Efficiency Video Coding (HEVC) [18], 3D-HEVC [19], MV-HEVC [20], etc. New tools have been introduced such as depth modeling mode (DMM) [21], segment-based depth coding (SDC) [22], and view synthesis optimization (VSO) [21], [23], [24] to explicitly handle depth video coding with consideration of preserving sharp edges. DMM intra mode of depth maps in 3D-HEVC offers flexibility in representing the sharp edges by following a non-rectangle partition approach based on wedgelet [25] or contour [26] based segmentation.…”

Section: Introductionmentioning

confidence: 99%

A Flexible Lossy Depth Video Coding Scheme Based on Low-rank Tensor Modelling and HEVC Intra Prediction for Free Viewpoint Video

Sharma¹,

Kumar²

2021

Preprint

View full text Add to dashboard Cite

The compression quality losses of depth sequences determine quality of view synthesis in free-viewpoint video. The depth map intra prediction in 3D extensions of the HEVC applies intra modes with auxiliary depth modeling modes (DMMs) to better preserve depth edges and handle motion discontinuities. Although such modes enable high efficiency compression, but at the cost of very high encoding complexity. Skipping conventional intra coding modes and DMMs in depth coding limits practical applicability of the HEVC for 3D display applications. In this paper, we introduce a novel low-complexity scheme for depth video compression based on low-rank tensor decomposition and HEVC intra coding. The proposed scheme leverages spatial and temporal redundancy by compactly representing the depth sequence as a high-order tensor. Tensor factorization into a set of factor matrices following CANDECOMP/PARAFAC (CP) decomposition via alternating least squares give a low-rank approximation of the scene geometry. Further, compression of factor matrices with HEVC intra prediction support arbitrary target accuracy by flexible adjustment of bitrate, varying tensor decomposition ranks and quantization parameters. The results demonstrate proposed approach achieves significant rate gains by efficiently compressing depth planes in low-rank approximated representation. The proposed algorithm is applied to encode depth maps of benchmark "Ballet" and "Breakdancing" sequences. The decoded depth sequences are used for view synthesis in a multi-view video system, maintaining appropriate rendering quality.

show abstract

View synthesis optimization based on texture smoothness for 3D-HEVC

Cited by 12 publications

References 12 publications

Overview of current development in depth map coding of 3D video and its future

Overview of current development in depth map coding of 3D video and its future

Early determination of intra mode and segment-wise DC coding for depth map based on hierarchical coding structure in 3D-HEVC

A Flexible Lossy Depth Video Coding Scheme Based on Low-rank Tensor Modelling and HEVC Intra Prediction for Free Viewpoint Video

Contact Info

Product

Resources

About