Interactive Depth-Aware Effects for Stereo Image Editing

Abstract

This paper introduces methods for adding userguided depth-aware effects with minimal user interaction to images captured with a consumer-grade stereo camera. In particular, we present methods for highlighted depth-offield [14], haze, depth-of-field, and image relighting. Unlike many prior methods for adding such effects, we do not assume prior scene models or require extensive user guidance to create such models, nor do we require multiple images of the scene under different conditions. We also do not require specialized camera rigs or other equipment such as light-field camera arrays, active lighting, etc. Instead, we use only an easily portable and affordable consumer-grade stereo camera. The depth is calculated from a stereo image pair using an extended version of PatchMatch Stereo [5] designed to compute not only image disparities but also normals for visible surfaces. We also introduce a pipeline for rendering multiple effects in the order they would occur physically. Each can be added, removed, or adjusted in the pipeline without having to reapply subsequent effects. Individually or in combination, these effects can be used to enhance the sense of depth or structure in images and provide increased artistic control. These effects can be applied to the stereo pair together in a fashion that preserves stereo consistency, or they can be applied to a single image only, thus leveraging the advantages of stereo acquisition even when producing a single photograph.