Precomputed radiance transfer for dynamic scenes with diffuse interreflection

Iwasaki, Kei; Dobashi, Yoshinori; Tamura, Naoki; Johan, Henry; Yoshimoto, Fujiichi; Nishita, Tomoyuki

doi:10.1145/1179849.1180065

Cited by 18 publications

(19 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…During the execution, the indirect lighting can be evaluated by applying the pre-computed coefficients to the SH basis function, which can be done pretty fast, if the order of the basis function stays low. Iwasaki [8] and Wang [9] showed that this approach also works for dynamic rigid body motion and deformable bodies, but the pre-computations on the scene were not avoided and thus PRT cannot be applied instantly to a scene captured from an RGB-D sensor.…”

Section: Related Workmentioning

confidence: 99%

Instant indirect illumination for dynamic mixed reality scenes

Lensing

Broll

2012

2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

View full text Add to dashboard Cite

For seamless integration of virtual content into real scenes, realizing mutual global lighting effects between both worlds belongs to the most important and challenging goals. Therefore, plenty of global illumination approaches exist, which mostly share the same restriction: the real scene is approximated by a static model, which was built in advance and thus has to remain static. In our paper, we propose an image-space global illumination approach, based on reflective shadow maps, combined with the use of an RGB-D camera, to simulate first bounce diffuse indirect illumination without any pre-computations. Our approach supports indirect illumination in both directions (real to virtual and vice versa) and runs in real-time. Furthermore, it does not require advanced shader properties, since we developed an implementation making efficient usage of the Z-Buffer algorithm for calculating indirect illumination. INTRODUCTIONDue to the fast development of modern graphic cards, real-time global illumination (GI) became a vast area of research. Indirect illumination effects, which were previously seen in offline rendering only, become more and more applicable to real-time applications. Since many real-time GI approaches require additional calculations on the scene in advance, they typically restrict dynamic changes to rigid body motion or approximate indirect illumination for low frequency behavior only. Both approaches are not suitable for mixed reality applications, where the captured real scene typically introduces all kinds of dynamic movements to be instantly considered. This is somehow annoying for mixed reality applications, as due to the blending of virtual and real content, global illumination effects become more important to provide seamless integration of virtual content (see Figure 1). Nevertheless, global illumination approaches exist, which are real-time capable and also account for high frequency indirect light behavior. Dachsbacher's Reflective Shadow Maps (RSM) [1] represent such an approach. As it is robust, it provides a foundation for several recent GI algorithms [2][3]. The performance of indirect lighting with RSM can be much improved if the lighting calculation is restricted to the visible part of the scene only [4], which can be achieved by screen-space deferred lighting. This restriction to screen-space calculations allows for new opportunities in the area of mixed reality. Employing a RGB-D camera allows us to obtain a coarse spatial representation of the visible scene which then may be used for GI calculations. For the refinement of the coarse spatial representation we propose guided image filtering [5] where the RGB-Image serves as guidance image to improve the depth image. During our research we observed that indirect illumination with RSM provides acceptable results to mixed reality applications, if the number of virtual point lights (VPL) introducing indirect light based on the RSM, is very high (4-8k). For such high VPL counts the fillrate becomes the bottleneck of an implementation. Thus, o...

show abstract

Section: Related Workmentioning

confidence: 99%

Instant indirect illumination for dynamic mixed reality scenes

Lensing

Broll

2012

2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

View full text Add to dashboard Cite

show abstract

“…Precomputed and low-frequency radiance transfer Many techniques for real-time GI precompute the light transport including all visibility information which entails restrictions such as static [Sloan et al 2002] or semi-static scenes [Iwasaki et al 2007]. Hašan et al [2007] approximate GI by many point lights and present a scalable GPU-technique for high-quality images targeting rendering times of few seconds.…”

Section: Previous Workmentioning

confidence: 99%

Cascaded light propagation volumes for real-time indirect illumination

Kaplanyan¹,

Dachsbacher

2010

Proceedings of the 2010 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games

117

101

View full text Add to dashboard Cite

Figure 1: Real-time rendering (58fps on a NVIDIA GTX285 at 1280 × 720 resolution) of the "Crytek Sponza" scene (262k triangles, available at http://www.crytek.com/downloads/technology/) using our method for indirect illumination with 3 cascades of light propagation volumes (LPVs, with 50, 25 and 12.5 meters grid spacing; the scene extend is about 37 × 15 × 22m 3 ). Lights, camera, and geometry can be fully dynamic. The time required for the computation of the indirect illumination is about 10 milliseconds only. Right: We add participating media (single-scattering) effects rendering at 34 fps by ray marching through the LPV. The overhead for ray marching is about 18ms. AbstractThis paper introduces a new scalable technique for approximating indirect illumination in fully dynamic scenes for real-time applications, such as video games. We use lattices and spherical harmonics to represent the spatial and angular distribution of light in the scene. Our technique does not require any precomputation and handles large scenes with nested lattices. It is primarily targeted at rendering single-bounce indirect illumination with occlusion, but can be extended to handle multiple bounces and participating media. We demonstrate that our method produces plausible results even when running on current game console hardware with a budget of only a few milliseconds for performing all computation steps for indirect lighting. We evaluate our technique and show it in combination with a variety of popular real-time rendering techniques.

show abstract

“…Instant radiosity techniques [Keller 1997] dynamically inject virtual point lights (VPL) to simulate diffuse bounced light [Dachsbacher and Stamminger 2005;Dachsbacher and Stamminger 2006;Ritschel et al 2008]. Examples of other approaches are screen-space radiosity ], multi-resolution height field sampling [Nowrouzezahrai and Snyder 2009], precomputed rigid reflectance fields [Iwasaki et al 2007], and real-time ray-tracing [Parker et al 1999]. Unfortunately, these techniques do not scale to large scenes, do not exploit coherence in light transport operators, or do not have performance characteristics suitable for the strict rendering budgets of modern game engines.…”

Section: Related Workmentioning

confidence: 99%

Modular Radiance Transfer

et al. 2011

View full text Add to dashboard Cite

Figure 1: Indirect light computed in reduced subspaces for a cave with 19 blocks and 4 lights. We derive low-dimensional transport operators, on simple proxy shapes, that are warped and combined at run-time, at > 475 FPS on high-end GPUs and > 45 FPS on mobile platforms, and can model indirect light at surfaces (with detailed normal variation) and within volumes of large-scale scene geometry. AbstractMany rendering algorithms willingly sacrifice accuracy, favoring plausible shading with high-performance. Modular Radiance Transfer (MRT) models coarse-scale, distant indirect lighting effects in scene geometry that scales from high-end GPUs to low-end mobile platforms. MRT eliminates scene-dependent precomputation by storing compact transport on simple shapes, akin to bounce cards used in film production. These shapes' modular transport can be instanced, warped and connected on-the-fly to yield approximate light transport in large scenes. We introduce a prior on incident lighting distributions and perform all computations in low-dimensional subspaces. An implicit lighting environment induced from the low-rank approximations is in turn used to model secondary effects, such as volumetric transport variation, higher-order irradiance, and transport through lightfields. MRT is a new approach to precomputed lighting that uses a novel low-dimensional subspace simulation of light transport to uniquely balance the need for high-performance and portable solutions, low memory usage, and fast authoring iteration.

show abstract

Precomputed radiance transfer for dynamic scenes with diffuse interreflection

Cited by 18 publications

References 3 publications

Instant indirect illumination for dynamic mixed reality scenes

Instant indirect illumination for dynamic mixed reality scenes

Cascaded light propagation volumes for real-time indirect illumination

Modular Radiance Transfer

Contact Info

Product

Resources

About