3D reconstruction of a region of interest using structured light and stereo panoramic images

Abstract

Construction of 3D environments from photorealistic images is important for many industries, including virtual reality, games and tourism among others. Extensive work has been undertaken using multiple stereo vision systems and fusion processing to create full 3D virtual environments. To improve the efficiency and accuracy, a stereo panoramic imaging system is used. A 3D environment can be created by using two panoramic images from a one-shot camera system. However a whole 3D scene is not always required, so a system which reconstructs 3D data only in a region of interest has been developed. A new structured light projection system for region of interest reconstruction is presented and tested. Based on the experimental tests, conclusions have been derived for highlighting the advantages of the approach.

3D multi-directional sensor with pyramid mirror and structured light

“…To improve the spatial resolution, a rotating line laser is used to scan the environment [18]. A Gaussian noise pattern is also projected for region of interest (ROI) reconstruction using stereo multi-directional vision [19]. A similar system has also been proposed, wherein the position and orientation of the synthetic pattern emitter with respect to the camera is flexible and arbitrary for use in a wearable personal assistance system [20].…”

A Panoramic 3D Reconstruction System Based on the Projection of Patterns

“…The 3D reconstruction systems that incorporate lenses and mirrors into acquired images with an omnidirectional field of view are called catadioptric systems. A common approach for 3D reconstruction is the use of structured light projection with a 360-degree laser line combined with omnidirectional stereo cameras that take images with multiple views [11, 12]. The disadvantage of these approaches is that we can only recover 3D information in the area of the laser incidence, limiting the reconstruction area.…”

Development of a New Stereo‐Panorama System Based on off‐The‐Shelf Stereo Cameras

“…Such models can be used in different applications and disciplines including control and robotics (Cobzas and Zhang, ), map completion (Micusik and Kosecka, ), map visualisation (Shimamura et al., ), generation of intelligent decision support systems (Lin et al., ) and navigation (Chen, ). There exist a number of problems, such as moving vehicles and occlusions, which may affect the construction of such models (Gledhill et al., ).…”

“…As a source for image‐based techniques, a stereo panorama is a multi‐viewpoint panoramic image (Huang et al., ) which is formed by overlaying two single panoramas, one for the left eye and one for the right eye; as a consequence, stereoviewing is possible (Gledhill, ). They are rich in visual information and allow for simple identification of objects (Gledhill et al., ). Fig.…”