Display adaptive 3D content remapping

Masiá, Belén; Wetzstein, Gordon; Aliaga, Carlos; Raskar, Ramesh; Gutiérrez, Diego

doi:10.1016/j.cag.2013.06.004

Cited by 42 publications

(21 citation statements)

References 30 publications

(2 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…New glasses-free 3D displays such as parallax-barrier or lightfield displays support only a relatively shallow depth range [Masia et al 2013]. As a result, the visual quality quickly degrades for objects that are further away from the screen plane.…”

Section: Discussionmentioning

confidence: 99%

“…Didyk et al [2011] proposed a perceptual model for disparity that mimics the disparity processing done by the HVS and applies this for disparity manipulations. In the context of automultiscopic displays, the problem of extreme depth compression was addressed [Didyk et al 2012;Masia et al 2013;Chapiro et al 2014]. These techniques aim at fitting disparities into a very shallow range taking care that the crucial disparity details are preserved.…”

Section: Disparity Manipulationmentioning

confidence: 99%

See 1 more Smart Citation

GazeStereo3D

Kellnhofer¹,

Didyk

Hefeeda³

et al. 2016

ACM Trans. Graph.

View full text Add to dashboard Cite

Figure 1: Beyond common disparity mapping (a) our approach adapts to attended regions such as the Armadillo (b) or Bunny (d) and modifies disparity in that region to enhance depth and reduce discomfort from the accommodation-vergence conflict (c,e). To that end we build non-linear remapping curves and use our novel perceptual model to ensure a seamless transition between them (f). AbstractProducing a high quality stereoscopic impression on current displays is a challenging task. The content has to be carefully prepared in order to maintain visual comfort, which typically affects the quality of depth reproduction. In this work, we show that this problem can be significantly alleviated when the eye fixation regions can be roughly estimated. We propose a new method for stereoscopic depth adjustment that utilizes eye tracking or other gaze prediction information. The key idea that distinguishes our approach from the previous work is to apply gradual depth adjustments at the eye fixation stage, so that they remain unnoticeable. To this end, we measure the limits imposed on the speed of disparity changes in various depth adjustment scenarios, and formulate a new model that can guide such seamless stereoscopic content processing. Based on this model, we propose a real-time controller that applies local manipulations to stereoscopic content to find the optimum between depth reproduction and visual comfort. We show that the controller is mostly immune to the limitations of low-cost eye tracking solutions. We also demonstrate benefits of our model in off-line applications, such as stereoscopic movie production, where skillful directors can reliably guide and predict viewers' attention or where attended image regions are identified during eye tracking sessions. We validate both our model and the controller in a series of user experiments. They show significant improvements in depth perception without sacrificing the visual quality when our techniques are applied.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Disparity Manipulationmentioning

confidence: 99%

GazeStereo3D

Kellnhofer¹,

Didyk

Hefeeda³

et al. 2016

ACM Trans. Graph.

View full text Add to dashboard Cite

show abstract

“…Several techniques have been developed to correctly reconstruct light fields from recorded data [Isaksen et al 2000;Stewart et al 2003] and avoid both spatial and inter-view aliasing on automultiscopic displays [Zwicker et al 2006;Konrad and Agniel 2006;Didyk et al 2013]. To further adjust content to a particular device, a few techniques for multi-view content depth manipulation have been proposed [Zwicker et al 2006;Didyk et al 2012;Masia et al 2013]. They focus on depth manipulations to achieve the best trade-off between the blur introduced by inter-view antialiasing and presented depth.…”

Section: Light Field Processing and Manipulationmentioning

confidence: 99%

Improving visual quality of view transitions in automultiscopic displays

Didyk²,

Durand³

et al. 2014

ACM Trans. Graph.

View full text Add to dashboard Cite

Automultiscopic screens present different images depending on the viewing direction. This enables glasses-free 3D and provides motion parallax effect. However, due to the limited angular resolution of such displays, they suffer from hot-spotting, i. e., image quality is highly affected by the viewing position. In this paper, we analyze light fields produced by lenticular and parallax-barrier displays, and show that, unlike in real world, the light fields produced by such screens have a repetitive structure. This induces visual artifacts in the form of view discontinuities, depth reversals, and excessive disparities when viewing position is not optimal. Although the problem has been always considered as inherent to the technology, we demonstrate that light fields reproduced on automultiscopic displays have enough degrees of freedom to improve the visual quality. We propose a new technique that modifies light fields using global and local shears followed by stitching to improve their continuity when displayed on a screen. We show that this enhances visual quality significantly, which is demonstrated in a series of user experiments with an automultiscopic display as well as lenticular prints.

show abstract

“…A key problem of these methods encounter is as follows: it will exposure rear object originally in the change of disparity, thus forming the image empty, and empty redraw is still a challenging task. Another image synthesis method uses image deformation [24][25][26][27]. It avoids the production of image cavities, but it will image distortion.…”

Section: Relevant Workingmentioning

confidence: 99%

Non-uniform Depth Compression Control Algorithm for 3D Real Time Video Detection

Zhen-wu¹,

Liu²,

Wang³

2014

TOAUTOCJ

View full text Add to dashboard Cite

For real-time stereo vision system, this paper analyzes the parallax generation mechanism of the virtual camera imaging; it presents projection transform of binocular images in single camera space. At the same time it changes the control depth perception by introducing camera wheelbase into bending deformation of the object, which can ensure the continuity of non-uniform compression ratio. The method is simple and flexible. The experimental results show that the depth mapping method will not visually produce distortion,which can effectively improve the quality of image. This method is a 3D graphics development for virtual reality and real-time game rendering, and it can be applied to 3D computer animation. When rendering stereo image, it can use this method to control the depth, which can reduce the amount of complicated work in post-production.

show abstract

Display adaptive 3D content remapping

Cited by 42 publications

References 30 publications

GazeStereo3D

GazeStereo3D

Improving visual quality of view transitions in automultiscopic displays

Non-uniform Depth Compression Control Algorithm for 3D Real Time Video Detection

Contact Info

Product

Resources

About