Multiview virtual image synthesis for auto-stereoscopic display based on two views

Abstract

In this paper, an efficient depth image based view rendering method for high quality multiview virtual images synthesis is proposed, which utilizes two color images with their associated depth maps. The proposed method consists of four main steps. The first step is virtual camera parameters design by using shift-sensor camera model to avoid the keystone distortion. Secondly, the mixed color pixels around the boundary of image objects is detected and skipped in the following rendering step, which can eliminate the "ghost" artifacts. Then the two input color images are rendered to multiple virtual view positions on the basis of depth-image-based rendering (DIBR) and merged into one image. Finally, an oriented exemplar-based inpainting algorithm is proposed to fill the disoccluded areas. Experiment results are shown to demonstrate the superior performance of the proposed method compared to other traditional DIBR methods.