Real-time embedded system for stereo video processing for multiview displays

Berretty, Robert-Paul; Riemens, A. K.; Machado, P. F.

doi:10.1117/12.702474

Cited by 7 publications

(8 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…4 showed how to compute depth from an uncalibrated stereo signal. Like Braspenning and Op de Beeck, the used techniques were derived from scan rate conversion systems.…”

Section: Related Workmentioning

confidence: 99%

“…4 As can be seen in Figure 2, we execute the disparity estimation to identify the disparities and occlusion maps in both cameras. …”

Section: Depth Estimation For the Reference Cameramentioning

confidence: 99%

“…In a previous paper, we presented a method for robustly computing the disparity map from a stereo pair. 4 Here we briefly state its main components. The following steps can be distinguished.…”

Section: Depth Estimation For the Reference Cameramentioning

confidence: 99%

See 2 more Smart Citations

Robust image, depth, and occlusion generation from uncalibrated stereo

Barenbrug

Berretty

Gunnewiek

2008

Stereoscopic Displays and Applications XIX

View full text Add to dashboard Cite

Philips is developing a product line of multi-view auto-stereoscopic 3D displays. 1 For interfacing, the image-plus-depth format is used. 2, 3 Being independent of specific display properties, such as number of views, view mapping on pixel grid, etc., this interface format allows optimal multi-view visualisation of content from many different sources, while maintaining interoperability between display types. A vastly growing number of productions from the entertainment industry are aiming at 3D movie theatres. These productions use a two view format, primarily intended for eye-wear assisted viewing. It has been shown 4 how to convert these sequences into the image-plus-depth format. This results in a single layer depth profile, lacking information about areas that are occluded and can be revealed by the stereoscopic parallax. Recently, it has been shown how to compute for intermediate views for a stereo pair. 4, 5 Unfortunately, these approaches are not compatible to the image-plus-depth format, which might hamper the applicability for broadcast 3D television. 3

show abstract

“…4 showed how to compute depth from an uncalibrated stereo signal. Like Braspenning and Op de Beeck, the used techniques were derived from scan rate conversion systems.…”

Section: Related Workmentioning

confidence: 99%

“…4 As can be seen in Figure 2, we execute the disparity estimation to identify the disparities and occlusion maps in both cameras. …”

Section: Depth Estimation For the Reference Cameramentioning

confidence: 99%

See 1 more Smart Citation

Robust image, depth, and occlusion generation from uncalibrated stereo

Barenbrug

Berretty

Gunnewiek

2008

Stereoscopic Displays and Applications XIX

View full text Add to dashboard Cite

show abstract

“…Berrety et.al [3] implemented a real-time embedded depth generation system for the autostereoscopic 3D display that gets inputs with an image-plus-depth interface. Their system generated a depth map that has 720x480 pixels with 30fps.…”

Section: Previous Workmentioning

confidence: 99%

Autostereoscopic 3D video generation from stereoscopic videos using FPGA and GPU

Shin

Kim

et al. 2012

2012 International Conference on 3D Imaging (IC3D)

View full text Add to dashboard Cite

We introduce a semi-real time autostereoscopic 3D video generation system using FPGA hardware and GPU processor. Proposed system consists of two major blocks. The first block is a disparity estimation block that is implemented on FPGA. In this block, we extract a disparity map of each frame from inputted stereoscopic video through the video capture board by DP (dynamic programming)based stereo matching. And post-processing is optionally done in order to improve the quality of the estimated disparity map. Estimated disparity map is transferred to the GPU through USB 3.0 and PCI-express interfaces. Original stereoscopic video is also transferred to the GPU. With these data, disparity-based view interpolation is performed in order to generate virtual multi-view videos. Each pixel of generated multi-view video is re-arranged on the autostereoscopic 3D display panel in order to provide 3D depth perception.The prototype of the proposed system generates 9-view qHD(960x540) video with about 20fps.

show abstract

“…Automatic generation of depth maps from video is a complex process. We observe that often depth maps are not aligned with objects in the image due to the use of heuristics based algorithms [2]. Moreover, these depth maps are generated at a lower resolution than the image to reduce computations, or just due to the nature of an algorithm [2] [3].…”

Section: Introductionmentioning

confidence: 98%

Real-time implementation of depth map post-processing for 3D-TV on a programmable DSP (TriMedia)

Gangwal

Coezijn

Berretty

2009

2009 Digest of Technical Papers International Conference on Consumer Electronics

View full text Add to dashboard Cite

Automatically generated depth maps from video are usually not aligned with the objects in the original image and produced at lower resolutions. We propose to apply a jointbilateral filter to smoothen the depth map within the objects and upsample it to the original image resolution while keeping object edges in the depth map aligned with the original image. We performed algorithmic and DSP specific optimizations to achieve the real-time implementation on an embedded DSP processor, TM3270, while preserving high quality results. Upsampling 90x72@50Hz depth maps to 720x576@50Hz, requires 69% to 86% of the TM3270 cycle budget.

show abstract

Real-time embedded system for stereo video processing for multiview displays

Cited by 7 publications

References 9 publications

Robust image, depth, and occlusion generation from uncalibrated stereo

Robust image, depth, and occlusion generation from uncalibrated stereo

Autostereoscopic 3D video generation from stereoscopic videos using FPGA and GPU

Real-time implementation of depth map post-processing for 3D-TV on a programmable DSP (TriMedia)

Contact Info

Product

Resources

About