Tour into the picture with water surface reflection and object movements

Abstract

Given a still picture, tour into the picture (TIP) generates a walk-through animation of a 3D scene constructed from the picture. In this paper, we generalize TIP to deal with water surface reflection while allowing foreground objects to move. We formulate a non-linear optimization problem to find the 3D scene parameters with respect to the camera position, to automatically construct a reasonable 3D scene model, provided with a set of points and their corresponding points on the water surface. To synthesize a stream of reflected images on the water surface in accordance with the camera movement, we propose a novel image-based approach, which makes the best of the limited information available in the input picture. Furthermore, we incorporate water surface movement data acquired from water simulation on top of stochastic motion textures for objects such as trees and plants, to create a dynamic scene.

Matting and Compositing for Fresnel Reflection on Wavy Surfaces

“…Editing photographs with Fresnel reflection is quite interesting, especially when an image includes reflections on wavy surfaces. Indeed, pleasing images and animations with reflections on wavy surfaces can be created from a single photograph, although this involves considerable manual labor [CGZ*05, PHCS06]. Matting plays the key role in semi‐automating this creation process; the reflected image is first separated into a reflection component, transmission component, and alpha matte, and then new objects can be composited by using this information.…”