An image transforming scheme for mobile projection mapping applications

Abstract

This paper introduces a technique that can easily transform images used for mobile projection mapping. In order to project various images to fit the plane of an irregular shaped object, the bilinear patch and the biquadratic Bezier patch were used, and a patch-merging method that combines multiple patches was developed. A merged patch is obtained by combining the mesh coordinates of the individual patches. Once an image to be projected is determined, then the image can be easily placed on the merged patch using an Android function. Afterwards, the image can be transformed into various shapes by adjusting the positions of the control points of the merged patch on the screen of a smartphone or a tablet PC. As the number of control points increases as patches are merged, a much more diverse image can be created. An Android App dedicated to projection mapping was created so that users can easily implement image transformations with mobile devices. It was shown that various shapes of images can be easily created through the App and finally, a shirt image was designed to demonstrate its usefulness.