Autocalibrating Tiled Projectors on Piecewise Smooth Vertically Extruded Surfaces

Abstract

Abstract-In this paper, we present a novel technique to calibrate multiple casually aligned projectors on fiducial-free piecewise smooth vertically extruded surfaces using a single camera. Such surfaces include cylindrical displays and CAVEs, common in immersive virtual reality systems. We impose two priors to the display surface. We assume the surface is a piecewise smooth vertically extruded surface for which the aspect ratio of the rectangle formed by the four corners of the surface is known and the boundary is visible and segmentable. Using these priors, we can estimate the display's 3D geometry and camera extrinsic parameters using a nonlinear optimization technique from a single image without any explicit display to camera correspondences. Using the estimated camera and display properties, the intrinsic and extrinsic parameters of each projector are recovered using a single projected pattern seen by the camera. This in turn is used to register the images on the display from any arbitrary viewpoint making it appropriate for virtual reality systems. The fast convergence and robustness of this method is achieved via a novel dimension reduction technique for camera parameter estimation and a novel deterministic technique for projector property estimation. This simplicity, efficiency, and robustness of our method enable several coveted features for nonplanar projection-based displays. First, it allows fast recalibration in the face of projector, display or camera movements and even change in display shape. Second, this opens up, for the first time, the possibility of allowing multiple projectors to overlap on the corners of the CAVE-a popular immersive VR display system. Finally, this opens up the possibility of easily deploying multiprojector displays on aesthetic novel shapes for edutainment and digital signage applications.

Efficient Depth-aware Image Deformation Adaptation for Curved Screen Displays

“…Chang et al [7] introduced a two-step projection model, wherein a viewing hemisphere is mapped to the image plane. Finally, mapping planar images to curved surfaces has been addressed in [25] and [23]. Speci cally, Sajadi et al [25] estimate the camera parameters and projector properties for cylindrical displays.…”

“…Finally, mapping planar images to curved surfaces has been addressed in [25] and [23]. Speci cally, Sajadi et al [25] estimate the camera parameters and projector properties for cylindrical displays. In order to achieve seamless display on a curved screen using overlapping projectors, Raskar et al [23] address geometric calibration and alignment issues.…”

“…Request permissions from permissions@acm.org. purpose in mind [21,25]. Following this trend, mainstream manufacturers are currently investing in the production of curved displays, both in the TV and in the smartphone sector.…”

Non‐planar projection performance evaluation and projector pose optimization

“…With the advancement of digital media technology, however, traditional planar projection technology can no longer satisfy the modern projection application requirement with a high sense of immersion and multiple forms of representation. Therefore, non‐planar projection technologies based on the cylinder, dome, and even free‐surface screens have emerged …”

High-resolution lighting of 3D reliefs using a network of projectors and cameras

“…It can also be used for large non-planar display surfaces like domes or cylinders in immersive visualization environments. Instead of using custom solutions for each kind of surface [24,25,26,27,28], our general solution can be used to deploy multiple uncalibrated devices registering images seamlessly across all such display shapes.…”