In this paper we propose a novel framework for efficiently extracting foreground objects in so called shortbaseline image sequences. We apply the obtained segmentation to improve subsequent 3D reconstruction results. Essentially, our framework combines a graph cut based optimization algorithm with an intuitive user interface. At first a meanshift segmentation algorithm partitions each image of the sequence into a certain number of regions. Additionally we provide an intelligent graphical user interface for easy specification of foreground as well as background regions across all images of the sequence. Within the graph cut optimization algorithm we define new energy terms to increase the robustness and to keep the segmentation of the foreground object coherent across all images of the sequence. Finally, a refined graph cut segmentation and several adjustment operations allow an accurate and effective foreground extraction. The obtained results are demonstrated on several real world data sets.
This paper proposes a fast 3D reconstruction approach for efficiently generating watertight 3D models from multiple short baseline views. Our method is based on the combination of a GPU-based plane-sweep approach, to compute individual dense depth maps and a subsequent robust volumetric depth map integration technique. Basically, the dense depth map values are transformed to a volumetric grid, which are further embedded in a graph structure. The edge weights of the graph are derived from the dense depth map values and if available, from sparse 3D information. The final optimized surface is obtained as a min-cut/maxflow solution of the weighted graph. We demonstrate the robustness and accuracy of our proposed approach on several real world data sets.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.