A practical approach for depth estimation and image restoration using defocus cue

Abstract

Reconstruction of depth from 2D images is an important research issue in computer vision. Depth from defocus (DFD) technique uses space varying blurring of an image as a cue in reconstructing the 3D structure of a scene. In this paper we explore the regularization based approach for simultaneous estimation of depth and image restoration from defocused observations. We are given two defocused observations of a scene that are captured with different camera parameters. Our method consists of two steps. First we obtain the initial estimates for the depth as well as for the focused image. In the second step we refine the solution by using a fast optimization technique. Here we use the classic depth recovery method due to Subbarao for obtaining the initial depth map and Weiner filter approach for initial image restoration. Since the problem we are solving is ill-posed and does not yield unique solution, it is necessary to regularize the solution by imposing additional constraint to restrict the solution space. The regularization is performed by imposing smoothness constraint only. However, for preserving the depth and image intensity discontinuities, they are identified prior to the minimization process from initial estimates of the depth map and the restored image. The final solution is obtained by using computationally efficient gradient descent algorithm, thus avoiding the need for computationally taxing algorithms. The depth as well as intensity edge details of the final solution correspond to those obtained using the initial estimates. The experimental results indicate that the quality of the restored image is good even under severe space-varying blur conditions.

A novel method for 2D-to-3D video conversion based on boundary information

“…Vanishing line detection [10][11][12][13] Depth from model Color theory [14,15,23,34] Depth from defocus Use blur information to get depth value [16][17][18][19] Depth from visual saliency Estimation in region of interest [20][21][22] 5. Four kinds of scanning modes to fix the depth map; 6.…”

“…In [14] they approximated 3D structures of natural scenes to generate stereo images, using warm or cool color theories to generate depth data with simple models. Some utilized the defocus method to extract depth information, as in [16][17][18][19]. In [17] they employed blur information based on the number of high-value coefficients by wavelet transform.…”