Model-Based Video Coding Using Colour and Depth Cameras

Sandberg, David; Forssén, Per-Erik; Ogniewski, Jens

doi:10.1109/dicta.2011.33

Cited by 9 publications

(1 citation statement)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Reconstructing a precise 3D model plays an important role here; that is why they have tested their algorithm on very simple scenes and even selected features and corresponding points manually. In [12], depth sensors are employed to capture a more precise 3D model. However, these sensors are not available in many 2D video coding scenarios.…”

Section: Introductionmentioning

confidence: 99%

3D Geometry-Based Global Motion Compensation For VVC

Golestani

Sauer²,

Rohlfmg³

et al. 2021

2021 IEEE International Conference on Image Processing (ICIP)

View full text Add to dashboard Cite

Since most 2D videos are initially captured in 3D environments, developing 3D motion models for video coding is beneficial. This paper introduces a method for extracting 3D geometry data from 2D videos and synthesizing 3D-based virtual Reference Pictures (RPs). These novel RPs are offered to the Versatile Video Coding (VVC) encoder for use in motion compensation. The proposed method generates 3D geometry data in the form of 3D meshes at the encoder and transmits it to the decoder as an overhead bitstream. However, this overhead could eat up the whole coding gain or even make it worse than the anchor VVC. This paper solves this problem by employing 3D mesh processing techniques, e.g., mesh denoising, mesh decimation, and mesh compression. Simulation results show that the proposed method outperforms VVC up to ~3.8%.

show abstract

Section: Introductionmentioning

confidence: 99%

3D Geometry-Based Global Motion Compensation For VVC

Golestani

Sauer²,

Rohlfmg³

et al. 2021

2021 IEEE International Conference on Image Processing (ICIP)

View full text Add to dashboard Cite

show abstract

What Is the Best Depth-Map Compression for Depth Image Based Rendering?

Ogniewski

Forssén

2017

Computer Analysis of Images and Patterns

Self Cite

View full text Add to dashboard Cite

Many of the latest smart phones and tablets come with integrated depth sensors, that make depth-maps freely available, thus enabling new forms of applications like rendering from different view points. However, efficient compression exploiting the characteristics of depth-maps as well as the requirements of these new applications is still an open issue. In this paper, we evaluate different depth-map compression algorithms, with a focus on tree-based methods and view projection as application. The contributions of this paper are the following: 1. extensions of existing geometric compression trees, 2. a comparison of a number of different trees, 3. a comparison of them to a state-of-the-art video coder, 4. an evaluation using ground-truth data that considers both depth-maps and predicted frames with arbitrary camera translation and rotation. Despite our best efforts, and contrary to earlier results, current video depth-map compression outperforms tree-based methods in most cases. The reason for this is likely that previous evaluations focused on low-quality, low-resolution depth maps, while high-resolution depth (as needed in the DIBR setting) has been ignored up until now. We also demonstrate that PSNR on depth-maps is not always a good measure of their utility.

show abstract

Emerging Imaging Technologies: Trends and Challenges

Domański

Grajek

Conti

et al. 2018

3D Visual Content Creation, Coding and Delivery

View full text Add to dashboard Cite

This chapter addresses image and video technologies related to 3D immersive multimedia delivery systems with special emphasis on the most promising digital formats. Besides recent research results and technical challenges associated with multiview image and image, video and lightfield acquisition and processing, the chapter also presents relevant results from international standardization activities in the scope of ISO, IEC and ITU. Standard solutions to encode multiview image and video content and ongoing research is addressed, along with novel solutions to enable further developments in the emerging technologies dealing with capture and coding for lightfield content and Free Viewpoint Television.

show abstract

Model-Based Video Coding Using Colour and Depth Cameras

Cited by 9 publications

References 17 publications

3D Geometry-Based Global Motion Compensation For VVC

3D Geometry-Based Global Motion Compensation For VVC

What Is the Best Depth-Map Compression for Depth Image Based Rendering?

Emerging Imaging Technologies: Trends and Challenges

Contact Info

Product

Resources

About