Overview of efficient high-quality state-of-the-art depth enhancement methods by thorough design space exploration

Vosters, Luc; Varekamp, C.; Haan, G. de

doi:10.1007/s11554-015-0537-z

Cited by 7 publications

(9 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In practice, one often faces further relevant problems such as the so-called 'flying pixels' at depth boundaries [72], flickering in video frames, occlusions due to disparity between the two cameras, and other sources of missing or outlying data, e.g., specular surfaces. Depth enhancement including completion of missing data [82] is addressed in numerous studies [134]. Below, we discuss two of these sources of errors that can result in loss or distortion of depth data.…”

Section: Discussionmentioning

confidence: 99%

“…Further important application areas are 3D reconstruction of objects and environments [17,27,6,31,67,63], computer graphics [122,103,65] and 3DTV [120,118,133,134,78]. (See study [116] for a recent survey of depth sensing for 3D television.)…”

Section: Time-of-flight Camerasmentioning

confidence: 99%

“…They also present an analysis of computational complexity and runtime for GPU implementations of the methods. In a further study [134], the authors discuss 3DTV requirements for a high-quality depth map and propose a subsampling method based on the algorithms [87] and [33]. The study [134] also provides a benchmark and qualitative analysis of temporal post-processing methods in depth upsampling for 3DTV.…”

Section: Video-based Depth Upsamplingmentioning

confidence: 99%

See 2 more Smart Citations

Image-guided ToF depth upsampling: a survey

Eichhardt

Chetverikov

Jankó

2017

Machine Vision and Applications

View full text Add to dashboard Cite

Recently, there has been remarkable growth of interest in the development and applications of Time-of-Flight (ToF) depth cameras. However, despite the permanent improvement of their characteristics, the practical applicability of ToF cameras is still limited by low resolution and quality of depth measurements. This has motivated many researchers to combine ToF cameras with other sensors in order to enhance and upsample depth images. In this paper, we review the approaches that couple ToF depth images with high-resolution optical images. Other classes of upsampling methods are also briefly discussed. Finally, we provide an overview of performance evaluation tests presented in the related studies.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Time-of-flight Camerasmentioning

confidence: 99%

Section: Video-based Depth Upsamplingmentioning

confidence: 99%

See 1 more Smart Citation

Image-guided ToF depth upsampling: a survey

Eichhardt

Chetverikov

Jankó

2017

Machine Vision and Applications

View full text Add to dashboard Cite

show abstract

“…The view synthesis process demands a precise edge information since border distortions should introduce blocking artifacts, mosquito noise, and edge blurring. 8 JCT-3V included new intraframe prediction tools to deal with the distinct characteristics between texture and depth maps. These tools include depth modeling modes (DMMs), 9 which are composed of DMM-1 and DMM-4, depth intraskip (DIS), 10 and segment-wise direct component coding (SDC).…”

Section: Introductionmentioning

confidence: 99%

Exploration of depth modeling mode one lossless wedgelets storage strategies for 3D-high efficiency video coding

2018

View full text Add to dashboard Cite

The 3D-high efficiency video coding has introduced tools to obtain higher efficiency in 3-D video coding, and most of them are related to the depth maps coding. Among these tools, the depth modeling mode-1 (DMM-1) focuses on better encoding edges regions of depth maps. The large memory required for storing all wedgelet patterns is one of the bottlenecks in the DMM-1 hardware design of both encoder and decoder since many patterns must be stored. Three algorithms to reduce the DMM-1 memory requirements and a hardware design targeting the most efficient among these algorithms are presented. Experimental results demonstrate that the proposed solutions surpass related works reducing up to 78.8% of the wedgelet memory, without degrading the encoding efficiency. Synthesis results demonstrate that the proposed algorithm reduces almost 75% of the power dissipation when compared to the standard approach.

show abstract

“…Figure 2 shows that depth maps contain characteristics that contrast with texture frames; i.e., they contain large areas of constant values (background or body of objects) and sharp edges (border of objects) [13], while texture frames have smooth transitions between its pixels. Therefore, using only traditional 2D video coding techniques in depth maps compression introduces blocking artifacts, mosquito noise and edge blurring [14] if a high compression is desired.…”

Section: Introductionmentioning

confidence: 99%

Real-time scalable hardware architecture for 3D-HEVC bipartition modes

Sanchez

Marcon

Agostini

2016

J Real-Time Image Proc

View full text Add to dashboard Cite

This article presents a real-time scalable hardware architecture for the bipartition modes of 3D highefficiency video coding (3D-HEVC) standard, which includes the depth modeling modes 1 (DMM-1) and 4 (DMM-4). A simplification of the DMM-1 algorithm was done, removing the refinement step. This simplification causes a small BD-rate increase (0.09 %) with the advantage of better using our hardware resources, reducing the necessary memory required for storing all DMM-1 wedgelet patterns by 30 %. The scalable architecture can be configured to support all the different block sizes supported by the 3D-HEVC and also to reach different throughputs, according to the application requirements. Then, the proposed solution can be efficiently used for several encoding scenarios and many different applications. Synthesis results considering a test case show that the designed architecture is capable of processing HD 1080p videos in real time, but with other configurations, higher resolutions are also possible to be processed.

show abstract

Overview of efficient high-quality state-of-the-art depth enhancement methods by thorough design space exploration

Cited by 7 publications

References 39 publications

Image-guided ToF depth upsampling: a survey

Image-guided ToF depth upsampling: a survey

Exploration of depth modeling mode one lossless wedgelets storage strategies for 3D-high efficiency video coding

Real-time scalable hardware architecture for 3D-HEVC bipartition modes

Contact Info

Product

Resources

About