Robust extraction of image correspondences exploiting the image scene geometry and approximate camera orientation

Abstract

ABSTRACT:Image-based modeling techniques are an important tool for producing 3D models in a practical and cost effective manner. Accurate image-based models can be created as long as one can retrieve precise image calibration and orientation information which is nowadays performed automatically in computer vision and photogrammetry. The first step for orientation is to have sufficient correspondences across the captured images. Keypoint descriptors like SIFT or SURF are a successful approach for finding these correspondences. The extraction of precise image correspondences is crucial for the subsequent image orientation and image matching steps. Indeed there are still many challenges especially with wide-baseline image configuration. After the extraction of a sufficient and reliable set of image correspondences, a bundle adjustment is used to retrieve the image orientation parameters. In this paper, a brief description of our previous work on automatic camera network design is initially reported. This semi-automatic procedure results in wide-baseline high resolution images covering an object of interest, and including approximations of image orientations, a rough 3D object geometry and a matching matrix indicating for each image its matching mates. The main part of this paper will describe the subsequent image matching where the pre-knowledge on the image orientations and the pre-created rough 3D model of the study object is exploited. Ultimately the matching information retrieved during that step will be used for a precise bundle block adjustment. Since we defined the initial image orientation in the design of the network, we can compute the matching matrix prior to image matching of high resolution images. For each image involved in several pairs that is defined in the matching matrix, we detect the corners or keypoints and then transform them into the matching images by using the designed orientation and initial 3D model. Moreover, a window is defined for each corner and its initial correspondence in the matching images. A SIFT or SURF matching is implemented between every matching window to find the homologous points. This is followed by Least Square Matching LSM to refine the correspondences for a sub-pixel localization and to avoid inaccurate matches. Image matching is followed by a bundle adjustment to orient the images automatically to finally have a sparse 3D model. We used the commercial software Photomodeler Scanner 2010 for implementing the bundle adjustment since it reports a number of accuracy indices which are necessary for the evaluation purposes. The experimental test of comparing the automated image matching of four pre-designed streopairs shows that our approach can provide a high accuracy and effective orientation when compared to the results of commercial and open source software which does not exploit the pre-knowledge about the scene.

Accuracy and Block Deformation Analysis in Automatic Uav and Terrestrial Photogrammetry – Lesson Learnt –

“…how undetectable and unmodelled systematic errors affects the accuracy of final results. Camera network with high redundancy and intersection angles close to 90 degrees are more reliable if compared to image sequences as usually seen in SfM procedures (Alsadik et al, 2013). In this paper some qualitative and quantitative analyses using different UAV and terrestrial camera network configurations are reported in the case of the digital documentation of a complex archaeological structure -the roman theatre in Ventimiglia, Italy.…”

Range and Image Based Modelling: A Way for Frescoed Vault Texturing Optimization

“…Using this computer vision technique the geometric structure of the 3D scene and the pose of the camera at each image can be quickly recovered from a series of overlapping, offset images. (Alsadik et al, 2013;Guidi et al, 2010;Guidi & Remondino 2012;Koska & Kremen, 2013;Lerma et al, 2010;Rodriquez 2012;Wenzel et al, 2013). This new approach to softcopy photogrammetry generates very dense 3D colour point clouds quite similar in size to the one produced from laser scanning surveys.…”

Frescoed Vaults: Accuracy Controlled Simplified Methodology for Planar Development of Three-Dimensional Textured Models

“…The new approach to softcopy photogrammetry realized by Structure from Motion (SfM) and MVS (Multi-View Stereo) algorithms generates very dense 3D color point clouds quite similar in size to those produced from laser scanning surveys [18][19][20][21][22][23]. However, even if software evolution in this field is very fast and performance is good in terms of processing time, and the amount of manageable data and obtainable precisions are gradually improving, these procedures may not always be considered reliable.…”