Foveated 3D graphics

Guenter, Brian; Finch, Mark; Drucker, Steven M.; Tan, Desney; Snyder, John

doi:10.1145/2366145.2366183

Cited by 323 publications

(223 citation statements)

References 33 publications

(38 reference statements)

Supporting

Mentioning

216

Contrasting

Unclassified

Order By: Relevance

“…Vlachos [17] presented a stencil mesh to cull hidden areas after warping in advance. Foveated rendering [18] is a gaze-contingent multi-resolution rendering technique. By using eye trackers, this technique lowers image quality in the periphery (outside the fovea) to increase rendering performance.…”

Section: Vr Acceleration Techniquesmentioning

confidence: 99%

Z2 traversal order: An interleaving approach for VR stereo rendering on tile-based GPUs

Nah

Lim

et al. 2017

Comp. Visual Media

View full text Add to dashboard Cite

With increasing demands of virtual reality (VR) applications, efficient VR rendering techniques are becoming essential. Because VR stereo rendering has increased computational costs to separately render views for the left and right eyes, to reduce the rendering cost in VR applications, we present a novel traversal order for tile-based mobile GPU architectures: Z 2 traversal order. In tile-based mobile GPU architectures, a tile traversal order that maximizes spatial locality can increase GPU cache efficiency. For VR applications, our approach improves upon the traditional Z order curve. We render corresponding screen tiles in left and right views in turn, or simultaneously, and as a result, we can exploit spatial adjacency of the two tiles. To evaluate our approach, we conducted a trace-driven hardware simulation using Mesa and a hardware simulator. Our experimental results show that Z 2 traversal order can reduce external memory bandwidth requirements and increase rendering performance.

show abstract

Section: Vr Acceleration Techniquesmentioning

confidence: 99%

Z2 traversal order: An interleaving approach for VR stereo rendering on tile-based GPUs

Nah

Lim

et al. 2017

Comp. Visual Media

View full text Add to dashboard Cite

show abstract

“…Guenter et al [10] introduced a foveated rendering approach, generating and blending together three images of different quality in real-time depending on the inputs from a desktop eye tracker. Instead of using the eye gaze for rendering optimizations, we introduce a foveated compression method to lower the required data rate for in-home streaming.…”

Section: Related Workmentioning

confidence: 99%

The Next Generation of In-home Streaming: Light Fields, 5K, 10 GbE, and Foveated Compression

Pohl¹,

Jungmann²,

Taudul³

et al. 2017

Proceedings of the 2017 Federated Conference on Computer Science and Information Systems

View full text Add to dashboard Cite

Abstract-Interacting with real-time rendered 3D content from powerful machines on smaller devices is becoming ubiquitous through commercial products that enable in-home streaming within the same local network. However, support for high resolution, low latency in-home streaming at high image quality is still a challenging problem. To enable this, we enhance an existing open source framework for in-home streaming. We add highly optimized DXT1 (DirectX Texture Compression) support for thin desktop and notebook clients. For rendered light fields, we improve the encoding algorithms for higher image quality. Within a 10 Gigabit Ethernet (10 GbE) network, we achieve streaming up to 5K resolution at 55 frames per second. Through new low-level algorithmic improvements, we increase the compression speed of ETC1 (Ericsson Texture Compression) by a factor of 5. We are the first to bring ETC2 compression to real-time speed, which increases the streamed image quality. Last, we reduce the required data rate by more than a factor of 2 through foveated compression with real-time eye tracking.Index Terms-in-home streaming, ETC1, ETC2, DXT1, light fields.

show abstract

“…McConkie and Loschky [2002] have shown that a switch from a significant blur to a sharp image can be detected by the observer even 5 ms after the end of a saccade. However, the tolerable delay can grow to up to 60 ms [Loschky and Wolverton 2007] for more subtle blur changes as in multi-resolution techniques [Guenter et al 2012;Geisler and Perry 1998]. …”

Section: Saccadic Suppressionmentioning

confidence: 99%

“…In foveated rendering [Guenter et al 2012], the efficiency of image generation can be improved by maintaining high image resolution only around the gaze location. The authors reported that seamless rendering can be achieved with a latency below 40 ms.…”

Section: Other Gaze-driven Applicationsmentioning

confidence: 99%

“…Gaze-contingent displays use eye tracking technology to monitor the fixation location and to conform the quality of depiction to the variable photoreceptor density. This way a more efficient control of the level of detail in geometric models [Murphy and Duchowski 2001], the image resolution in foveated rendering [Guenter et al 2012], the state of luminance adaptation in tone mapping [Jacobs et al 2015], the amount of blur in depth-of-field effects [Duchowski et al 2014a], and the level of video compression [Geisler and Perry 1998] can be achieved, to name just a few key applications. When the fixation is shifted to another location the image content must be adjusted accordingly, and saccadic suppression [McConkie and Loschky 2002;Loschky and Wolverton 2007], i.e., cutting off conscious registration of the blurred retinal signal due to fast saccadic eye motion (up to 1000 deg/s), is employed to hide the visibility of such adjustments.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

GazeStereo3D

Kellnhofer¹,

Didyk

Hefeeda³

et al. 2016

ACM Trans. Graph.

View full text Add to dashboard Cite

Figure 1: Beyond common disparity mapping (a) our approach adapts to attended regions such as the Armadillo (b) or Bunny (d) and modifies disparity in that region to enhance depth and reduce discomfort from the accommodation-vergence conflict (c,e). To that end we build non-linear remapping curves and use our novel perceptual model to ensure a seamless transition between them (f). AbstractProducing a high quality stereoscopic impression on current displays is a challenging task. The content has to be carefully prepared in order to maintain visual comfort, which typically affects the quality of depth reproduction. In this work, we show that this problem can be significantly alleviated when the eye fixation regions can be roughly estimated. We propose a new method for stereoscopic depth adjustment that utilizes eye tracking or other gaze prediction information. The key idea that distinguishes our approach from the previous work is to apply gradual depth adjustments at the eye fixation stage, so that they remain unnoticeable. To this end, we measure the limits imposed on the speed of disparity changes in various depth adjustment scenarios, and formulate a new model that can guide such seamless stereoscopic content processing. Based on this model, we propose a real-time controller that applies local manipulations to stereoscopic content to find the optimum between depth reproduction and visual comfort. We show that the controller is mostly immune to the limitations of low-cost eye tracking solutions. We also demonstrate benefits of our model in off-line applications, such as stereoscopic movie production, where skillful directors can reliably guide and predict viewers' attention or where attended image regions are identified during eye tracking sessions. We validate both our model and the controller in a series of user experiments. They show significant improvements in depth perception without sacrificing the visual quality when our techniques are applied.

show abstract

Foveated 3D graphics

Cited by 323 publications

References 33 publications

Z2 traversal order: An interleaving approach for VR stereo rendering on tile-based GPUs

Z2 traversal order: An interleaving approach for VR stereo rendering on tile-based GPUs

The Next Generation of In-home Streaming: Light Fields, 5K, 10 GbE, and Foveated Compression

GazeStereo3D

Contact Info

Product

Resources

About