Depth perception with gaze-contingent depth of field

Mauderer, Michael; Conte, Simone; Nacenta, Miguel A.; Vishwanath, Dhanraj

doi:10.1145/2556288.2557089

Cited by 58 publications

(37 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Several types of benchtop gazecontingent display systems-systems that update the displayed content based on where the user fixates in a scene-have been proposed in the literature, including systems that adjust binocular disparity, depth of field rendering, and focus distance (11,19,31,32). Gaze-contingent depth of field displays can simulate the changes in depth of field blur that occur when the eyes accommodate near and far, but they do not actually stimulate accommodation and thus, have not been found to improve perception and comfort (19,32).…”

Section: Resultsmentioning

confidence: 99%

Optimizing virtual reality for all users through gaze-contingent and adaptive focus displays

Padmanaban

Konrad

Stramer

et al. 2017

Proc. Natl. Acad. Sci. U.S.A.

163

View full text Add to dashboard Cite

From the desktop to the laptop to the mobile device, personal computing platforms evolve over time. Moving forward, wearable computing is widely expected to be integral to consumer electronics and beyond. The primary interface between a wearable computer and a user is often a near-eye display. However, current generation near-eye displays suffer from multiple limitations: they are unable to provide fully natural visual cues and comfortable viewing experiences for all users. At their core, many of the issues with near-eye displays are caused by limitations in conventional optics. Current displays cannot reproduce the changes in focus that accompany natural vision, and they cannot support users with uncorrected refractive errors. With two prototype neareye displays, we show how these issues can be overcome using display modes that adapt to the user via computational optics. By using focus-tunable lenses, mechanically actuated displays, and mobile gaze-tracking technology, these displays can be tailored to correct common refractive errors and provide natural focus cues by dynamically updating the system based on where a user looks in a virtual scene. Indeed, the opportunities afforded by recent advances in computational optics open up the possibility of creating a computing platform in which some users may experience better quality vision in the virtual world than in the real one.virtual reality | augmented reality | 3D vision | vision correction | computational optics E merging virtual reality (VR) and augmented reality (AR) systems have applications that span entertainment, education, communication, training, behavioral therapy, and basic vision research. In these systems, a user primarily interacts with the virtual environment through a near-eye display. Since the invention of the stereoscope almost 180 years ago (1), significant developments have been made in display electronics and computer graphics (2), but the optical design of stereoscopic near-eye displays remains almost unchanged from the Victorian age. In front of each eye, a small physical display is placed behind a magnifying lens, creating a virtual image at some fixed distance from the viewer (Fig. 1A). Small differences in the images displayed to the two eyes can create a vivid perception of depth, called stereopsis.However, this simple optical design lacks a critical aspect of 3D vision in the natural environment: changes in stereoscopic depth are also associated with changes in focus. When viewing a near-eye display, users' eyes change their vergence angle to fixate objects at a range of stereoscopic depths, but to focus on the virtual image, the crystalline lenses of the eyes must accommodate to a single fixed distance ( Fig. 2A). For users with normal vision, this asymmetry creates an unnatural condition known as the vergence-accommodation conflict (3, 4). Symptoms associated with this conflict include double vision (diplopia), compromised visual clarity, visual discomfort, and fatigue (3, 5). Moreover, a lack of accurate focus also removes a cu...

show abstract

Section: Resultsmentioning

confidence: 99%

Optimizing virtual reality for all users through gaze-contingent and adaptive focus displays

Padmanaban

Konrad

Stramer

et al. 2017

Proc. Natl. Acad. Sci. U.S.A.

163

View full text Add to dashboard Cite

show abstract

“…In particular, some users expressed fatigue and discomfort caused by the DoF effects. Mauderer et al [28] found that gaze-contingent DoF effects increase realism and help estimate the depth of virtual objects. Vinnikov and Allison [29] found that although DoF effects improve depth perception in monocular systems, users felt discomfort when these were applied to stereoscopic systems.…”

Section: Impact Of Dof Renderingmentioning

confidence: 99%

EyeAR: Refocusable Augmented Reality Content through Eye Measurements

Rompapas

Rovira

Plopski

et al. 2017

MTI

View full text Add to dashboard Cite

Augmented Reality (AR) superimposes computer graphics (CG) onto a user's view of the real world. A key quality problem in this field is to achieve coherence between reality and CG when the user's eyes refocus or change pupil size. We designed and evaluated a display that improves coherence by measuring the user's eye state and continuously adapting CG accordingly. Our tabletop prototype emulates an Optical See-Through Head-Mounted Display, a common AR display device. In our evaluation, participants observed three pillars at different depths. We then challenged them to identify a virtual pillar among the three while freely refocusing their eyes. Results show that our design significantly improved realism. Compared to Light Field Displays, our design aims to simplify display-optics while providing similar quality. We could only partially achieve this goal. We discuss the lessons we learned and how we plan to overcome the remaining challenges. The experimental protocol from our evaluation is useful for display developers as it can be used to measure the coherence of a display.

show abstract

“…Most common existing displays only portray linear perspective, with a few offering binocular disparity and motion perspective. A few other cues such as simulating accommodation via blur are being investigated but are still in early stages of development [Mauderer et al 2014].…”

Section: Depth Cues and Perceptionmentioning

confidence: 99%

The Effects of Changing Projection Geometry on Perception of 3D Objects on and Around Tabletops

Nacenta

Hancock

Gutwin

et al. 2016

ACM Trans. Comput.-Hum. Interact.

Self Cite

View full text Add to dashboard Cite

________________________________________________________________________Displaying 3D objects on horizontal displays can cause problems in the way that the virtual scene is presented on the 2D surface; inappropriate choices in how 3D is represented can lead to distorted images and incorrect object interpretations. We present four experiments that test 3D perception. We varied projection geometry in three ways: type of projection (perspective/parallel), separation between the observer's point of view and the projection's center (discrepancy), and presence of motion parallax (with/without parallax). Projection geometry had strong effects different for each task. Reducing discrepancy is desirable for orientation judgments, but not for object recognition or internal angle judgments. Using a fixed center of projection above the table reduces error and improves accuracy in most tasks. The results have far-reaching implications for the design of 3D views on tables, in particular for multi-user applications where projections that appear correct for one person will not be perceived correctly by another.

show abstract

Depth perception with gaze-contingent depth of field

Cited by 58 publications

References 36 publications

Optimizing virtual reality for all users through gaze-contingent and adaptive focus displays

Optimizing virtual reality for all users through gaze-contingent and adaptive focus displays

EyeAR: Refocusable Augmented Reality Content through Eye Measurements

The Effects of Changing Projection Geometry on Perception of 3D Objects on and Around Tabletops

Contact Info

Product

Resources

About