A Depth Extraction Method Based on Motion and Geometry for 2D to 3D Conversion

Abstract

With the development of 3DTV, the conversion of existing 2D videos to 3D videos becomes an important component of 3D content production. One of the key steps in 2D to 3D conversion is how to generate a dense depth map. In this paper, we propose a novel depth extraction method based on motion and geometric information for 2D to 3D conversion, which consists of two major depth extraction modules, the depth from motion and depth from geometrical perspective. The H.264 motion estimation result is utilized and cooperates with moving object detection to diminish block effect and generates a motion-based depth map. On the other hand, a geometry-based depth map is generated by edge detection andHough transform. Finally, the motion-based depth map and the geometry-based depth map are integrated into one depth map by a depth fusion algorithm.

A novel method for 2D-to-3D video conversion based on boundary information

“…Vanishing line detection [10][11][12][13] Depth from model Color theory [14,15,23,34] Depth from defocus Use blur information to get depth value [16][17][18][19] Depth from visual saliency Estimation in region of interest [20][21][22] 5. Four kinds of scanning modes to fix the depth map; 6.…”

“…In [20] they set up a method based on visual saliency to extract the regions of interest from a color image. Additional methods have applied a combination of several depth cues to determine the depth information, such as in [3,5,6]. Jung et al [23] proposed a depth-map estimation algorithm under the assumption that the depth of image will increase from bottom region to upper region.…”

“…In [1] they utilized motion estimation [4] to present a conversion which requires only a few user instructions on key frames and propagates the depth maps to non-key frames. Huang et al used H.264 codec to encode the motion vectors and combined two kinds of depth cues: motion information and the geometric perspective [5]. Raza [6] presented a method for a dynamic scene.…”

“…Conversely, a single-frame method is derived based on only oneview information with its depth information. Depth from the perspective geometry has been used in [10][11][12][13]. These methods mostly took vanishing line detection to identify the depth information.…”

Plenoptic Layer-Based Modeling for Image Based Rendering

“…An extension to the general segmentation method is over-segmentation [35,42] or the use of high level object segmentation [43][44][45] often based on human intervention [15]. Another approach to improving robustness is using structures within images [46] to help validate depth assignments by other methods.…”