Reflectance Estimation From Urban Terrestrial Images: Validation of a Symbolic Ray-Tracing Method on Synthetic Data

Abstract

ABSTRACT:Terrestrial geolocalized images are nowadays widely used on the Internet, mainly in urban areas, through immersion services such as Google Street View. On the long run, we seek to enhance the visualization of these images; for that purpose, radiometric corrections must be performed to free them from illumination conditions at the time of acquisition. Given the simultaneously acquired 3D geometric model of the scene with LIDAR or vision techniques, we face an inverse problem where the illumination and the geometry of the scene are known and the reflectance of the scene is to be estimated. Our main contribution is the introduction of a symbolic ray-tracing rendering to generate parametric images, for quick evaluation and comparison with the acquired images. The proposed approach is then based on an iterative estimation of the reflectance parameters of the materials, using a single rendering pre-processing. We validate the method on synthetic data with linear BRDF models and discuss the limitations of the proposed approach with more general non-linear BRDF models.

Description de la campagne aéroportée UMBRA : étude de l'impact anthropique sur les écosystèmes urbains et naturels avec des images THR multispectrales et hyperspectrales

“…Cela permet d'estimer l'éclairement direct solaire au niveau du sol, information qui n'est pas accessible directement dans les images pointant vers le soleil, du fait de la surexposition des pixels dans le halo solaire. Ces données permettent l'étude de l'illumination de la scène à partir des images (Coubard et al, 2012), et l'estimation de la réflectance des matériaux des façades, pour des applications de corrections des images et de réalité augmentée (par exemple le ré-éclairement de la scène) (Coubard et al, 2011).…”

Reconstruction of Sky Illumination Domes From Ground-Based Panoramas

“…The purpose of the sky radiance reconstruction is to use physicallybased methods for extracting information form the pixels of the images. The estimation of the reflectance of the materials of the scene is an important step for these methods, and is usually performed by minimizing the difference between acquired images and simulated images with unknown reflectances (Coubard et al, 2011). So the influence of the environment map on the simulated light is very important to know.…”