Moveable interactive projected displays using projector based tracking

Abstract

Video projectors have typically been used to display images on surfaces whose geometric relationship to the projector remains constant, wuch as walls or pre-calibrated surfaces. In this paper, we present a technique for projecting content onto moveable surfaces that adapts to the motion and location of the surface to simulate an active display. This is accomplished using a projector based location tracking technique. We use light sensors embedded into the moveable surface and project low-perceptibility Gray-coded patterns to first discover the sensor locations, and then imcrementally track them at interactive rates. We describe how to reduce the perceptibility of tracking patterns, achieve interactive tracking rates, use motion modeling to improve tracaking performance, and respond to sensor occlusions. A group of tracked sensors can define quadrangles for simulating moveable displays while single sensors can be used as control inputs. By unifying the tracking and display technology into a single mechanism, we can substantially reduce the cost and complexity of implementing applications that combine motion tracking and projected imagery. ACM Symposium on User Interface Software & Technology (UIST)This work may not be copied or reproduced in whole or in part for any commercial purpose. Permission to copy in whole or in part without payment of fee is granted for nonprofit educational and research purposes provided that all such whole or partial copies include the following: a notice that such copying is by permission of Mitsubishi Electric Research Laboratories, Inc.; an acknowledgment of the authors and individual contributions to the work; and all applicable portions of the copyright notice. Copying, reproduction, or republishing for any other purpose shall require a license with payment of fee to Mitsubishi Electric Research Laboratories, Inc. All rights reserved. Video projectors have typically been used to display images on surfaces whose geometric relationship to the projector remains constant, such as walls or pre-calibrated surfaces.In this paper, we present a technique for projecting content onto moveable surfaces that adapts to the motion and location of the surface to simulate an active display. This is accomplished using a projector based location tracking techinque. We use light sensors embedded into the moveable surface and project low-perceptibility Graycoded patterns to first discover the sensor locations, and then incrementally track them at interactive rates. We describe how to reduce the perceptibility of tracking patterns, achieve interactive tracking rates, use motion modeling to improve tracking performance, and respond to sensor occlusions. A group of tracked sensors can define quadrangles for simulating moveable displays while single sensors can be used as control inputs. By unifying the tracking and display technology into a single mechanism, we can substantially reduce the cost and complexity of implementing applications that combine motion tracking and projected imagery.

A Shadow Cursor for Calibrating Screen Coordinates of Tabletop Displays and Its Evaluation

“…A sequence of binary patterns appears on a computer screen in order then the temporal pattern captured by a handheld camera at a specified spot on the screen uniquely represents its own spot. Those binary patterns are hopefully invisible to users, so that this way requires other techniques such as infrared ones [2].…”

A MEMS-based interactive laser scanning display with a collocated laser range finder

“…P. Khandnor et al used a video camera to capture the location of the electronic pointing gear for visual input [1]. J. C. Lee et al used a mobile panel equipped with light-emitting devices that could be used as a marker to locate the position and the attitude of the hand-held panel [2].…”

Smart display: A mobile self-adaptive projector-camera system

“…In the work [2], a specially designed surface is used. By embedding light sensors into the surface, the surface is capable of detecting the signal sending from the projector.…”