Enabling Introduction of Stereoscopic (3D) Video: Formats and Compression Standards

Bruls, W.H.A.; Varekamp, C.; Gunnewiek, R.K.; Barenbrug, B.; Bourge, Arnaud

doi:10.1109/icip.2007.4378898

Cited by 13 publications

(13 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Many applications now use the traditional stereo format (images for the left and right view) in which depth is implicitly encoded, and therefore hard to adjust. By making depth explicit in the form of parallax (or depth) maps (as standardized in MPEG, as described in [3]), adjusting depth becomes possible [4]. So does catering for an arbitrary number of views, which is often required for glasses-free displays.…”

Section: Introductionmentioning

confidence: 98%

Declipse 2: multi-layer image and depth with transparency made practical

Barenbrug

2009

SPIE Proceedings

Self Cite

View full text Add to dashboard Cite

To be able to accommodate different viewing conditions (e.g. different display sizes, display types, viewing distance), a 3D format is required where the depth effect can be adjusted. Within MPEG, the image-and-depth format has been standardized. This format is bandwidth efficient, highly flexible and therefore well suited to introduce 3D content into for example the home environment. Extensions to this format have been proposed to enable occlusion handling, by introducing more image-and-depth layers, containing image data located behind the foreground objects, to enable looking around such foreground objects. In the presence of such a multi-layer representation, a next extension is to add transparency information to the layers, allowing for alpha matting (offering significant gains in rendering quality) and inclusion of semi-transparent objects in the scene. Due to the multi-layer nature, it is then still possible to tune the amount of depth. In this paper, we report on our design choices to arrive at the Declipse 2 format, by going through the whole video chain, from content creation, to looking at the effects of video compression and finally real-time 3D rendering and display of such multi-layer content with transparency information, showing the feasibility of the approach under practical conditions.

show abstract

Section: Introductionmentioning

confidence: 98%

Declipse 2: multi-layer image and depth with transparency made practical

Barenbrug

2009

SPIE Proceedings

Self Cite

View full text Add to dashboard Cite

show abstract

“…Strategies for "hole-filing" (like e.g. Layered Depth Images (LDI) [3]) have to be introduced to improve the stereoscopic experience [4]. Another solution consists in coding several adjacent views (Multi-View Coding, MVC).…”

Section: Introductionmentioning

confidence: 99%

Inter-view coding for stereoscopic Digital Cinema

Boisson

Lopez

2008

2008 15th IEEE International Conference on Image Processing

View full text Add to dashboard Cite

An inter-view coding scheme is proposed for stereoscopic video applications such as 3D Digital Cinema. It tackles inter-view redundancy with efficient inter-view disparity-compensated filtering. In the temporal dimension, intra-coding with JPEG2000 is used to meet Digital Cinema specific requirements in terms of latency and random access. Inter-view disparity, as well as uncovered areas, are efficiently addressed within the inter-view Haar transform, and the resulting overhead information only amounts to a few percents of the bitstream. The proposed stereoscopic coding scheme delivers both left and right views with a high level of quality and yields to significant improvement in terms of bitrate saving and image quality in comparison with simulcast.

show abstract

“…Blend the result with the value from the previous frame using Equation 5. After all pixels in one onion-peel layer are visited, the algorithm recomputes the border and repeats the above process, until all pixels are visited or until a maximum number of layers has been processed.…”

Section: Set a Confidence Level For This Pixel The Confidence Is Basmentioning

confidence: 99%

“…The preferred display independent input format for home 3D displays is the image-plus-depth format, [3][4][5] which has been standardised in MPEG-C part 3. Being independent of specific display properties, such as number of views, view mapping on pixel grid, etc., this interface format allows optimal multiview visualisation of content from many different sources, while maintaining interoperability between display types.…”

Section: Introductionmentioning

confidence: 99%

Coherent spatial and temporal occlusion generation

et al. 2009

Self Cite

View full text Add to dashboard Cite

A vastly growing number of productions from the entertainment industry are aiming at 3D movie theatres. These productions use a two-view format, primarily intended for eye-wear assisted viewing in a well defined environment. To get this 3D content into the home environment, where a large variety of 3D viewing conditions exists (e.g different display sizes, display types, viewing distance), we need a flexible 3D format that can adjust the depth effect. Such a format is the image plus depth format in which a video frame is enriched with depth information of all pixels in the video. This format can be extended with an additional layer for occluded video and associated depth, that contains what is behind objects in the video. To produce 3D content in this extended format, one has to deduce what is behind objects. There are various axes along which this occluded data can be obtained. This paper presents a method to automatically detect and fill the occluded areas exploiting the temporal axis. To get visually pleasing results, it is of utmost importance to make the inpainting globally consistent. To do so, we start by analyzing data along the temporal axis and compute a confidence for each pixel. Then pixels from the future and the past that are not visible in the current frame are weighted and accumulated based on computed confidences. These results are then fed to a generic multi-source framework that computes the occlusion layer based on the available confidences and occlusion data.

show abstract

Enabling Introduction of Stereoscopic (3D) Video: Formats and Compression Standards

Cited by 13 publications

References 4 publications

Declipse 2: multi-layer image and depth with transparency made practical

Declipse 2: multi-layer image and depth with transparency made practical

Inter-view coding for stereoscopic Digital Cinema

Coherent spatial and temporal occlusion generation

Contact Info

Product

Resources

About