View Generation with 3D Warping Using Depth Information for FTV

Abstract

Free viewpoint images can be generated from multi-view images using Ray-Space method. Ray-Space data requires ray interpolation so as to satisfy the Plenoptic Function. Ray interpolation is realized by estimating view-dependent depth. Depth estimation is usually costly process, thus it is desirable that this process is skipped from rendering process to achieve real-time rendering. This paper proposes a method to render a novel view image using multi-view images and depth maps which are computed in advance. Virtual viewpoint image is generated by 3D warping, which causes some problems that have not occurred in the method with view dependent depth estimation. We handled these problems by projecting depth map to virtual image plane first and perform post-filtering on the projected depth map. We succeeded in obtaining high quality arbitrary viewpoint images from relatively small number of cameras.

Performance-efficient architecture for free-viewpoint 3DTV receiver

“…Our research on 3D rendering further extends the current research on DIBR [4,5]. A novel aspect is that not only reference camera views, but also the rendered views should be accompanied by depth information.…”

Multi–Scale Synthesized View Assessment Based on Morphological Pyramids

“…For each sequence four virtual views are generated on the positions corresponding to those positions obtained by the real cameras using seven depth image based rendering algorithms, named A1-A7 [21][22][23][24][25]. One key frame from each synthesized sequence is randomly chosen for the DIBR images database [1].…”

“…The algorithm A2 is based on A1 except that the borders are not cropped but in-painted. The algorithm A3 [22] use in-painting method to fill in the missing parts in the virtual image which introduces blur in the disoccluded area. This algorithm was adopted as the reference software for MPEG standardization experiments in 3D Video group.…”

Real-Time Virtual-View Image Synthesis Algorithm Using Kinect Camera

“…향상된 깊이 영상과 키넥트 카메라에서 획득된 색 상 영상에 3D 워핑 기법을 적용하여 가상 시점을 생 성한다 [12] . 먼저 기준 영상 화소들의 실제 좌표를 산출 하고 다시 원하는 가상 시점으로 재투영한다.…”