In this paper, we propose an occlusion removal method using sub-image block matching for improved recognition of partially occluded 3D objects in computational integral imaging (CII). When 3D plane images are reconstructed in CII, occlusion degrades the resolution of reconstructed images. To overcome this problem, we apply the sub-image transform to elemental image array (EIA) and these sub-images are employed using block matching method for depth estimation. Based on the estimated depth information, we remove the unknown occlusion. After completing the occlusion removal for all sub-images, we obtain the modified EIA without occlusion information through the inverse sub-image transform. Finally, the 3D plane images are reconstructed by using a computational integral imaging reconstruction method with the modified EIA. The proposed method can provide a substantial gain in terms of the visual quality of 3D reconstructed images. To show the usefulness of the proposed method we carry out some experiments and the results are presented.
Computational integral imaging method can digitally provide a series of plane images of three-dimensional (3D) objects. However, the resolution of 3D reconstructed images is dramatically degraded as the distance from the lenslet array increases. In this paper, to overcome this problem, we propose a novel computational integral imaging reconstruction (CIIR) method based on smart pixel mapping (SPM). Since SPM is a computational process in which elemental images recorded at long distances are convertible to ones recorded near lenslet array, this can give us the improved resolution of plane images for 3D objects located at a long distance range from a lenslet array. For the effective use of the SPM-based CIIR method, we design a novel two-stage CIIR method by the combined use of the conventional CIIR and the SPM-based one. The conventional CIIR method is applied over a short distance range, while the SPM-based CIIR is used over a long distance range. We carry out some experiments to verify the performance of the two-stage CIIR system. From the experimental results, the proposed system can provide a substantial gain over a long distance range in terms of the resolution of reconstructed plane images.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.