The effects of fast disparity adjustment in gaze-controlled stereoscopic applications

Bernhard, Matthias K.; Dell'mour, Camillo; Hecher, Michael; Stavrakis, Efstathios; Wimmer, Michael

doi:10.1145/2578153.2578169

Cited by 22 publications

(22 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…To this end, we compared the depth impression and the temporal stability of our gaze-contingent disparity retargeting (Sec. 8.1) to three potential alternatives: first, a traditional static mapping which does not adapt to the gaze location in any way; second, an immediate shift of depth which brings the depth in the gaze location to the screen without temporal considerations (similar to [Bernhard et al 2014]); and finally, the method of Hanhart and Ebrahimi [2014] as discussed in Sec. 3.2.…”

Section: Discussionmentioning

confidence: 99%

“…Fisker et al [2013] investigate the gaze-driven disparity adjustment towards the screen plane in an informal experiment and report promising results in terms of visual comfort and perceived depth. Bernhard et al [2014] perform a full-scale experiment where an abrupt disparity adjustment to the screen plane is compared to the static disparity case in terms of the vergence time. In this case, shorter timings are desirable for reducing the viewing fatigue.…”

Section: Gaze-driven Disparity Manipulationmentioning

confidence: 99%

See 1 more Smart Citation

GazeStereo3D

Kellnhofer¹,

Didyk

Hefeeda³

et al. 2016

ACM Trans. Graph.

View full text Add to dashboard Cite

Figure 1: Beyond common disparity mapping (a) our approach adapts to attended regions such as the Armadillo (b) or Bunny (d) and modifies disparity in that region to enhance depth and reduce discomfort from the accommodation-vergence conflict (c,e). To that end we build non-linear remapping curves and use our novel perceptual model to ensure a seamless transition between them (f). AbstractProducing a high quality stereoscopic impression on current displays is a challenging task. The content has to be carefully prepared in order to maintain visual comfort, which typically affects the quality of depth reproduction. In this work, we show that this problem can be significantly alleviated when the eye fixation regions can be roughly estimated. We propose a new method for stereoscopic depth adjustment that utilizes eye tracking or other gaze prediction information. The key idea that distinguishes our approach from the previous work is to apply gradual depth adjustments at the eye fixation stage, so that they remain unnoticeable. To this end, we measure the limits imposed on the speed of disparity changes in various depth adjustment scenarios, and formulate a new model that can guide such seamless stereoscopic content processing. Based on this model, we propose a real-time controller that applies local manipulations to stereoscopic content to find the optimum between depth reproduction and visual comfort. We show that the controller is mostly immune to the limitations of low-cost eye tracking solutions. We also demonstrate benefits of our model in off-line applications, such as stereoscopic movie production, where skillful directors can reliably guide and predict viewers' attention or where attended image regions are identified during eye tracking sessions. We validate both our model and the controller in a series of user experiments. They show significant improvements in depth perception without sacrificing the visual quality when our techniques are applied.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Gaze-driven Disparity Manipulationmentioning

confidence: 99%

GazeStereo3D

Kellnhofer¹,

Didyk

Hefeeda³

et al. 2016

ACM Trans. Graph.

View full text Add to dashboard Cite

show abstract

“…However, the DOF correction will limit stereofusion to regions of the scene with admissible disparities and could tamper this potential issue. A good strategy to deal with this problem would be to smooth the speed at which the vergence alignment and DOF correction are applied [25]. This aspect of the corrective algorithm needs to be studied in detail with subjective trials, which is an interesting venue for future research.…”

Section: Discussionmentioning

confidence: 99%

“…al in [24] as visual discomfort palliative. The effect of affecting the image disparity as a mean to emulate vergence and control the screen parallax over the ROI has been presented in [25] by Bernhard et al who studied the time lapses necessary to produce stereofusion.…”

Section: Background Of the Ideamentioning

confidence: 99%

Improvements in the Visualization of Stereoscopic 3D Imagery

Gurrieri

2015

3D Res

View full text Add to dashboard Cite

A pleasant visualization of stereoscopic imagery must take into account factors that may produce eye strain and fatigue. Fortunately, our binocular vision system has embedded mechanisms to perceive depth for extended periods of time without producing eye fatigue; however, stereoscopic imagery may still induce visual discomfort in certain displaying scenarios. An important source of eye fatigue originates in the conflict between vergence eye movement and focusing mechanisms. Today's eye-tracking technology makes possible to know the viewers' gaze direction; hence, 3D imagery can be dynamically corrected based on this information. In this paper, I introduce a method to improve the visualization of stereoscopic imagery on planar displays based on emulating vergence and accommodation mechanisms of binocular human vision. Unlike other methods to improve visual comfort that introduce depth distortions in the stereoscopic visual media this technique aims to produce a gentler and more natural binocular viewing experience without distorting the original depth of the scene.

show abstract

“…He suggested to solve the problem of transitions by cross-fading the horizontal image translation to zero at the cut. Bernhard et al [2014] showed how binocular fusion times can be reduced by means of active manipulation of the convergence plane. The object of interest is brought back to the zero-disparity plane once the change in gaze has been detected, but before the vergence adaptation is complete.…”

Section: S3d Content Processingmentioning

confidence: 99%

Modeling and optimizing eye vergence response to stereoscopic cuts

Templin¹,

Didyk²,

Hefeeda³

et al. 2014

ACM Trans. Graph.

View full text Add to dashboard Cite

zbFigure 1: Unexpected changes of disparity in stereoscopic 3D imagery, such as those introduced by cuts in S3D films, are challenging for the audience. Using an eye-tracker, we recorded eye vergence responses of 16 subjects to step-like changes in disparity (left). Then, a model of adaptation time was derived, and parameters for the average observer estimated. Having such a predictor enables, for example, optimization of film editing operations to best match the human depth adaptation abilities (right). The colors of the lines connecting points of interest before and after the cut visualize the corresponding vergence adaptation times. AbstractSudden temporal depth changes, such as cuts that are introduced by video edits, can significantly degrade the quality of stereoscopic content. Since usually not encountered in the real world, they are very challenging for the audience. This is because the eye vergence has to constantly adapt to new disparities in spite of conflicting accommodation requirements. Such rapid disparity changes may lead to confusion, reduced understanding of the scene, and overall attractiveness of the content. In most cases the problem cannot be solved by simply matching the depth around the transition, as this would require flattening the scene completely. To better understand this limitation of the human visual system, we conducted a series of eye-tracking experiments. The data obtained allowed us to derive and evaluate a model describing adaptation of vergence to disparity changes on a stereoscopic display. Besides computing user-specific models, we also estimated parameters of an average observer model. This enables a range of strategies for minimizing the adaptation time in the audience.

show abstract

The effects of fast disparity adjustment in gaze-controlled stereoscopic applications

Cited by 22 publications

References 36 publications

GazeStereo3D

GazeStereo3D

Improvements in the Visualization of Stereoscopic 3D Imagery

Modeling and optimizing eye vergence response to stereoscopic cuts

Contact Info

Product

Resources

About