Enhanced 3D Point Cloud from a Light Field Image

Abstract

The importance of three-dimensional (3D) point cloud technologies in the field of agriculture environmental research has increased in recent years. Obtaining dense and accurate 3D reconstructions of plants and urban areas provide useful information for remote sensing. In this paper, we propose a novel strategy for the enhancement of 3D point clouds from a single 4D light field (LF) image. Using a light field camera in this way creates an easy way for obtaining 3D point clouds from one snapshot and enabling diversity in monitoring and modelling applications for remote sensing. Considering an LF image and associated depth map as an input, we first apply histogram equalization and histogram stretching to enhance the separation between depth planes. We then apply multi-modal edge detection by using feature matching and fuzzy logic from the central sub-aperture LF image and the depth map. These two steps of depth map enhancement are significant parts of our novelty for this work. After combing the two previous steps and transforming the point–plane correspondence, we can obtain the 3D point cloud. We tested our method with synthetic and real world image databases. To verify the accuracy of our method, we compared our results with two different state-of-the-art algorithms. The results showed that our method can reliably mitigate noise and had the highest level of detail compared to other existing methods.

COVID-19 classification by CCSHNet with deep fusion using transfer learning and discriminant correlation analysis

“…Second, the histogram stretching (HS) [ 27 , 28 ] was utilized to increase the contrast of all images. Take the i th image as an example, its minimum and maximum grayscale values and were calculated as: here ( w, h, c ) means the index of width, height, and channel directions along image , respectively.…”

Virtual Reality Improves Clinical Assessment of the Optic Nerve

“…Earlier studies on similar 3D data visualization tasks have also observed superior benefits of kinetic depth over stereoscopic cues (e.g., Sollenberger and Milgram, 1993;Ware and Mitchell, 2005). It is possible that volumetric surface reconstruction from 3D point cloud data could provide more reliable geometric perceptive cues to infer 3D shape of objects depicted in single rendered images (e.g., Farhood et al, 2020). The results we obtained in our optic nerve reconstruction and visualization study suggest that the perceptual benefit of perspective cues provided by viewing slanted surfaces improves estimates of C/D ratio more than stereopsis alone.…”

Nonlinear Optimization of Light Field Point Cloud

“…An approach of Farhood et al [ 23 ] shows how the depth map, obtained by the light field camera, can be improved for getting the high-quality point cloud. The depth map is modified by histogram manipulations, aimed for better separation of depth layers, and then further enhanced by adding information about the objects’ edges.…”