High-resolution lighting of 3D reliefs using a network of projectors and cameras

Abstract

Vibrant lighting of relief maps via high-resolution dynamic projected imagery can be a powerful tool for simulation, augmented reality, and visualization, enabling several scientific, educational and entertainment applications. This is usually achieved via multiple projectors lighting the relief map, which are then sensed by multiple cameras for geometric and color calibration. However, cumbersome semi-automatic calibration techniques have limited the applicability of such systems.In this paper we present the first fully-automatic lighting system that registers high-resolution images on arbitrarily-shaped relief maps using a network of projectors and cameras. The devices are uncalibrated and casually aligned with the only constraint that every surface point of the relief is seen by at least two of the cameras. Our method achieves precise geometric registration followed by seamless edge blending. Quick recalibration allows changes in the position and number of the devices, as well as the surface geometry. Thus, our work can enable easy deployment of spatially augmented reality environments in various scales playing a fundamental role in increasing their popularity in several applications like geospatial analysis, architectural lighting, cultural heritage restoration, theatrical lighting and visualization. It can also be applied to any immersive VR environments on non-planar surfaces like domes or cylinders.

View-dependent Projection Mapping Enhanced by Real Background

“…(a.17) Then, the next equation is obtained from Equations (a. 16) and (a.17 Then, the following is obtained from Equations (a.12), (a. Then, the following is obtained from Equations (a.5) and (a.…”

“…A homography matrix is often used to relate the planar surface with the image planes of the projector and the camera. A self-calibration does not use a specialized apparatus [14][15] [16][17] [18]. Typically, structured light patterns are projected onto a non-planar surface whose geometry is unknown.…”

Recent Advances in Projection Mapping Algorithms, Hardware and Applications

“…This is hard to achieve in real-world situations, since in most projectors the principal point is usually not located close to the center of the image plane but shifted on the y-axis due to the lens shift optics. Sajadi and colleagues present a system which enables the calibration of multiple cameras and projectors, assuming that the cameras all share the same focal length and contain no distortion parameters, which might not lead to a sufficiently-accurate calibration depending on the used lenses [STRM15].…”

Pmomo

“…While there have been many researches on Projection Mapping on static sculptures [1] [20] [30] [31], Dynamic Projection Mapping that can keep tracking of a moving target and aligning the projection at interactive level is still a challenge. To achieve high-quality results, the accuracy and the robustness of the system must achieve high requirements as to make light bundles be projected exactly onto the target object in real-time.…”