Using Relative Orientation Constraints to Produce Virtual Images From Oblique Frames

Abstract

ABSTRACT:Image acquisition systems based on multi-head arrangement of digital cameras are attractive alternatives enabling larger imaging area when compared to a single frame camera. The calibration of this kind of systems can be performed using bundle adjustment with relative orientation stability constraints. The paper will address the details of the steps of the proposed approach for system calibration, image rectification, registration and fusion. Experiments with terrestrial and aerial images acquired with two Fuji FinePix S3Pro cameras were performed. The experiments focused on the assessment of the results of self calibrating bundle adjustment with and without relative orientation constraints and the effects in the registration and fusion when generating virtual images The experiments have shown that the images can be accurately rectified and registered with the proposed approach, achieving residuals smaller than 1 pixel.

Photogrammetric Bundle Adjustment With Self-Calibration of the PrimeSense 3D Camera Technology: Microsoft Kinect

“…Success of ROP constraints has also been demonstrated for systems with three cameras [30] and more [31]. In the least-squares adjustment, this constraint can be realized by adding equations/observations [32], [33] or be integrated directly into the collinearity equations [29], [34]. It was further explained in [34] and [35] that expressing this in the functional model rather than as a constraint equation can reduce the computational load and allow the rotations, translations, and their corresponding standard deviations to be estimated directly.…”

Advancement of close range photogrammetry with a portable panoramic image mapping system (PPIMS)

“…For instance, Tommaselli et al. (, ) reported the problem of calibrating an oblique multi‐camera system for airborne photogrammetry, whilst Rehak and Skaloud () introduced a system calibration procedure to determine the spatial offsets between the camera perspective centre and the GNSS antenna reference point for a fixed‐wing micro aerial vehicle. Mounting calibration can be done either as an in‐flight calibration or in the laboratory.…”

Generating Virtual Images from Oblique Frames

“…The approach used in this paper to generate larger images from dual head oblique cameras follows four main steps as previously presented in [15,16]: (1) dual head system calibration with RO constraints; (2) image rectification; (3) image registration with translations and scale check and; (4) fusion and brightness adjustment to generate a large image. The calibration step has now been changed to consider Base Components Stability Constraints (BCSC), instead the Base Length Stability Constraint.…”

“…The approach presented in this paper is another option, and it is based on the parameters estimated in a bundle adjustment with relative orientation constraints [15,16]. This approach has some similarities to existing techniques, but with some differences that will be discussed in Section 2.2.…”