A depth-image-based rendering (DIBR) method with spatial and temporal texture synthesis is presented in this article. Theoretically, the DIBR algorithm can be used to generate arbitrary virtual views of the same scene in a three-dimensional television system. But the disoccluded area, which is occluded in the original views and becomes visible in the virtual views, makes it very difficult to obtain high image quality in the extrapolated views. The proposed view synthesis method combines the temporally stationary scene information extracted from the input video and spatial texture in the current frame to fill the disoccluded areas in the virtual views. Firstly, the current texture image and a stationary scene image, which is extracted from the input video, are warped to the same virtual perspective position by the DIBR method. Then, the two virtual images are merged together to reduce the hole regions and maintain the temporal consistency of these areas. Finally, an oriented exemplar-based inpainting method is utilized to eliminate the remaining holes. Experimental results are shown to demonstrate the performance and advantage of the proposed method compared with other view synthesis methods.
In this paper, an efficient depth image based view rendering method for high quality multiview virtual images synthesis is proposed, which utilizes two color images with their associated depth maps. The proposed method consists of four main steps. The first step is virtual camera parameters design by using shift-sensor camera model to avoid the keystone distortion. Secondly, the mixed color pixels around the boundary of image objects is detected and skipped in the following rendering step, which can eliminate the "ghost" artifacts. Then the two input color images are rendered to multiple virtual view positions on the basis of depth-image-based rendering (DIBR) and merged into one image. Finally, an oriented exemplar-based inpainting algorithm is proposed to fill the disoccluded areas. Experiment results are shown to demonstrate the superior performance of the proposed method compared to other traditional DIBR methods.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.