Multiple ray cluster rendering for interactive integral imaging system

Abstract

In this paper, we present an efficient Computer Generated Integral Imaging (CGII) method, called multiple ray cluster rendering (MRCR). Based on the MRCR, an interactive integral imaging system is realized, which provides accurate 3D image satisfying the changeable observers' positions in real time. The MRCR method can generate all the elemental image pixels within only one rendering pass by ray reorganization of multiple ray clusters and 3D content duplication. It is compatible with various graphic contents including mesh, point cloud, and medical data. Moreover, multi-sampling method is embedded in MRCR method for acquiring anti-aliased 3D image result. To our best knowledge, the MRCR method outperforms the existing CGII methods in both the speed performance and the display quality. Experimental results show that the proposed CGII method can achieve real-time computational speed for large-scale 3D data with about 50,000 points.

Real time light field reconstruction for sub-pixel based integral imaging display

“…In the figure, red color represents higher MTF value, while blue color represents lower MTF value. The MTF of [Jiao et al 2013] is shown in the left image of Figure 13, while our result is shown in the right image of Figure 13. The result can demonstrate that the sub-pixel based light field reconstruction method can achieve higher spatial-resolution than pixel based light field reconstruction method [Jiao et al 2013].…”

“…For comparison, under the same condition that the horizontal angular resolution is 8, both the height and width between adjacent light field ray is as 8 times of the pixel's size, so the spatial resolution under regular pixel based light field reconstruction only achieves (1000/8)x(1000/8)=125x125. [Jiao et al 2013] Here, the angular resolution can be represented by the number of view-dependent reconstructed light field views. Figure 4: Illustration of specific design for micro lens array.…”

“…The reason for this two-line representation is to pack the MSOV in one texture for further re-arrangement calculation on fragment shader. The reconstructed light field views are re-arranged [Jiao et al 2013] at sub-pixel level to form the final integral image. In order to accelerate the re-arrangement process, the remapping coordinate for sub-pixels has been pre-calculated as the index texture.…”

“…Previous light field rendering acceleration work [Yang et al 2005] proposed parallel group rendering (PGR) method which can reduce * e-mail:shaohui.jiao@intel.com the number of scene rendering passes to the number of displayed pixels in one elemental image, while recent work [Jiao et al 2013] proposed the multiple ray cluster rendering (MRCR) method which exploits the geometry duplication on GPU, thus, only single rendering pass of light field rendering is realized. Besides, interaction is provided with adaption to the observersąŕ positions for achieving enlarged view zone.…”

Efficient sub-pixel based light field reconstruction on integral imaging display

“…The experimental result demonstrates the high speed performance of our method. In the aspect of reconstructed spatial resolution, [Jiao et al 2013] achieves only 125x125 while the proposed method can obtain 250x250 at the same integral image size.…”