Polarization-Based Illumination Detection for Coherent Augmented Reality Scene Rendering in Dynamic Environments

Abstract

A virtual object that is integrated into the real world in a perceptually coherent manner using the physical illumination information in the current environment is still under development. Several researchers investigated the problem producing a high-quality result; however, pre-computation and offline availability of resources were the essential assumption upon which the system relied. In this paper, we propose a novel and robust approach to identifying the incident light in the scene using the polarization properties of the light wave and using this information to produce a visually coherent augmented reality within a dynamic environment. This approach is part of a complete system which has three simultaneous components that run in real-time: (i) the detection of the incident light angle, (ii) the estimation of the reflected light, and (iii) the creation of the shading properties which are required to provide any virtual object with the detected lighting, reflected shadows, and adequate materials. Finally, the system performance is analyzed where our approach has reduced the overall computational cost.

An Empirical Evaluation of the Performance of Real-Time Illumination Approaches: Realistic Scenes in Augmented Reality

“…The current method studies the light based on color brightness which is the most common method, however the physics-based lighting method is the focus for investigation in our future work. Simulating the reflected light provides evidence from multiple evaluations that the global cube map is not an accurate method and reduces the overall performance, therefore, the local sampling can be explored further for a more realistic approach [26]. Also, a complete GPU implementation would provide a better performance cost in general.…”