Development of a New Stereo‐Panorama System Based on off‐The‐Shelf Stereo Cameras

Abstract

There exist a number of techniques which are used to produce stereo panoramas, each of which has its own advantages and disadvantages. In this paper, a new stereo-panorama generating system is presented which uses off-theshelf stereo cameras. In addition to stereoviewing, the system offers the possibility of making geometric measurements. The benefits of such a system are: (a) overcoming the effects of moving objects in the images; (b) increased automation of matching and stitching; (c) simple geometric information extraction; and (d) equal resolution over the whole stereo panorama. The structure of the system is described, including system implementation, calibration, stereo-panorama generation, georeferencing, co-registration of multiple panoramas and 3D measurements. In addition, an experiment to evaluate the capability of the system in modelling 3D environments is reported. Evaluation results show that the system can produce a suitable 3D panoramic environment for the simultaneous 3D visualisation and measurement of objects, especially in urban areas.

3D Face Tracking Using Stereo Cameras: A Review

“…In regard to the uniqueness constraint, it is difficult to apply to the occluded and transparent regions. There is the need of defining the occlusion region so that the image region where there is no disparity should be easily identifiable [37]. The existing algorithms handle differently the regions that have been occluded.…”

“…In order to have results that yield positive performances, there is need to consider using adaptive windows, whereby there are smaller and bigger windows. Smaller windows will be used in cases of near discontinuity, while larger windows will be used in cases of away discontinuities [37].…”

“…In the process, algorithms are derived that will be used for the virtual distance. Amini et al [37] and Lopez-Quintero et al [39] sought to realise the multimodal immersion of the human operator through the means of auditory, visual, tactile, and kinesthetic display and sensing capabilities. However, they realised that there are some drawbacks in their theory of stereo vision telepresence [37].…”

“…Amini et al [37] and Lopez-Quintero et al [39] sought to realise the multimodal immersion of the human operator through the means of auditory, visual, tactile, and kinesthetic display and sensing capabilities. However, they realised that there are some drawbacks in their theory of stereo vision telepresence [37]. The drawbacks hindered the feasible implementation of a stereo vision system, hence the ideal properties, such as having communication with no time delay, or having curved camera chips, as well as displays which gave a distortion-less, extended field of view were unattainable.…”

Modelling and automated calibration of a general multi‐projective camera

“… 3D structure‐and‐motion estimation, for example, dense reconstruction (Furukawa and Ponce, ; Furukawa et al., ), sparse bundle adjustment and Internet‐based reconstruction (Snavely et al., ), space structure estimation (Se et al., ), incremental structure from motion (Wu, ), stereo panoramas (Amini et al., ) and dual fluoroscopy imaging system calibration used for bone reconstruction (Lichti et al., ). Navigation systems, for example, indoor localisation (Svoboda et al., ), stereo tracking for dental surgery (Wang et al., ), car trajectory estimation (Paracchini et al., ), underwater navigation (Pfingsthorn et al., ) and spacecraft precise docking (Tweddle, ). Combinatory applications with other sensors, for example, outdoor SLAM (Schleicher et al., ). …”