Simulation of mid-air images using combination of physically based rendering and image processing

Abstract

Although it is beneficial to use an optical simulator to design a mid-air imaging system, the use of a simulator requires optical knowledge, and it cannot be handled by non-specialists. To create a design assistance system that can be used by non-specialists, we demonstrate three methods: a method for extracting mid-air images and images of stray light from computer graphics rendered images, a method for calculating the visible range of mid-air images, and an evaluation of design parameters. First, a mid-air image and an image of stray light are extracted by considering the differences of images rendered using different numbers of bounces at each camera position, after which the visible range of the mid-air image is calculated. In addition, other parameters, such as the distance between a micro-mirror array plate (MMAP) and the extracted mid-air image, are adjusted in detail and evaluated by considering the visible range of the obtained mid-air image. Moreover, to demonstrate the effectiveness of the proposed method, the design of the previous research was improved to eliminate images of stray light, and we reduced the size of the existing system. Unlike other conventional approaches, using the visible range of the extracted mid-air images and without the need for a visual check, our proposed method enables the extraction of mid-air images and unwanted light, and the evaluation of optical systems. This technique can be applied to improve the design of optical systems and in the examination of the related applications.

Shadowless Projection Mapping using Retrotransmissive Optics

“…The stray light causes a ghost image. Previous works solved the ghost image problem by applying another optical device such as a polarizer and a view-control film [12,17,29,71,75]. However, since these solutions are tailored for displaying mid-air images, they cannot be directly applied to our PM system.…”