Multi-epipolar plane image based 3D reconstruction using robust surface fitting

Abstract

In this paper, we present a novel method for 3D reconstruction from epipolar plane (EP) representation of images and surface fitting for multiview or lightfield images. The proposed method detects parallelograms in EP images using mean shift segmentation. The slopes of the parallel lines along the left and right boundaries of the parallelograms are computed with Hough transform to estimate depth. In addition we also introduce a new concept of estimating depth from multiple EP images(diagonal EP images), making the resultant depth map denser. Multi-view depth maps are then combined and surface fitting is done to obtain the final depth map. Our method uses simple techniques to construct a quality depth map without being computationally demanding.