Fully Automatic Registration of Image Sets on Approximate Geometry

Corsini, Massimiliano; Dellepiane, Matteo; Ganovelli, Fabio; Gherardi, Riccardo; Fusiello, Andrea; Scopigno, Roberto

doi:10.1007/s11263-012-0552-5

Cited by 71 publications

(76 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Otherwise, our algorithm rejects the photograph as not registered. The verified poses in the largest connected component constitute the final output of our algorithm and can be further refined by bootstrapping existing dense registration approaches (e.g., Corsini et al 2012). …”

Section: Pose Verificationmentioning

confidence: 99%

See 1 more Smart Citation

Automatic Registration of Images to Untextured Geometry Using Average Shading Gradients

Plötz

Roth

2017

Int J Comput Vis

View full text Add to dashboard Cite

Many existing approaches for image-to-geometry registration assume that either a textured 3D model or a good initial guess of the 3D pose is available to bootstrap the registration process. In this paper we consider the registration of photographs to 3D models even when no texture information is available. This is very challenging as we cannot rely on texture gradients, and even shading gradients are hard to estimate since the lighting conditions are unknown. To that end, we propose average shading gradients, a rendering technique that estimates the average gradient magnitude over all lighting directions under Lambertian shading. We use this gradient representation as the building block of a registration pipeline based on matching sparse features. To cope with inevitable false matches due to the missing texture information and to increase robustness, the pose of the 3D model is estimated in two stages. Coarse pose hypotheses are first obtained from a single correct match each, subsequently refined using SIFT flow, and finally verified. We apply our algorithm to registering images of real-world objects to untextured 3D meshes of limited accuracy. Moreover, we show that registration can be performed even for paintings despite lacking photo-realism.

show abstract

Section: Pose Verificationmentioning

confidence: 99%

“…However, it is not unusual that scanning campaigns are required to take place at night; Fig. 1 Our algorithm finds the pose of an untextured 3D model of a potentially textured object from a single photograph thus we need to work with the raw geometry information only (Corsini et al 2012).…”

Section: Introductionmentioning

confidence: 99%

Automatic Registration of Images to Untextured Geometry Using Average Shading Gradients

Plötz

Roth

2017

Int J Comput Vis

View full text Add to dashboard Cite

show abstract

“…However it remains an important gap in high-resolution/accuracy registration of 2D/3D data in a multispectral context where some recent works achieved promising results but still using constraining hardware/software requirement (Simon et al, 2010, Chane et al, 2013. Regarding the registration of multimodal images within a photogrammetric process some related works explore possible combination of SIFT features and Mutual Information (MI) also popularly used in medical imaging fusion (Corsini et al, 2013, Shen et al, 2014. Finally, most of multispectral photogrammetric approaches are related to aerial or airborne surveys rather than close-range ones (Gehrke and Greiwe, 2013).…”

Section: A Short Review Of Image-based Multimodality For Ch Studiesmentioning

confidence: 99%

Multispectral Photogrammetric Data Acquisition and Processing Forwall Paintings Studies

Pamart¹,

Guillon²,

Faraci³

et al. 2017

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

ABSTRACT:In the field of wall paintings studies different imaging techniques are commonly used for the documentation and the decision making in term of conservation and restoration. There is nowadays some challenging issues to merge scientific imaging techniques in a multimodal context (i.e. multi-sensors, multi-dimensions, multi-spectral and multi-temporal approaches). For decades those CH objects has been widely documented with Technical Photography (TP) which gives precious information to understand or retrieve the painting layouts and history. More recently there is an increasing demand of the use of digital photogrammetry in order to provide, as one of the possible output, an orthophotomosaic which brings a possibility for metrical quantification of conservators/restorators observations and actions planning. This paper presents some ongoing experimentations of the LabCom MAP-CICRP relying on the assumption that those techniques can be merged through a common pipeline to share their own benefits and create a more complete documentation.

show abstract

“…While the latter can be obtained with automatic procedures, the former may need user intervention. In the case of the Sarcophagus, a quite large number of images was acquired (306) and mapped using the procedure proposed in Corsini et al (2013). The method makes use of Structure from Motion (SfM) to estimate the relative position of the cameras of the photographic set and a sparse reconstruction of the scene.…”

Section: Processing the Colour Datamentioning

confidence: 99%

3d Digitization of an Heritage Masterpiece - A Critical Analysis on Quality Assessment

Menna¹,

Nocerino²,

Remondino³

et al. 2016

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

Self Cite

View full text Add to dashboard Cite

ABSTRACT:Despite being perceived as interchangeable when properly applied, close-range photogrammetry and range imaging have both their pros and limitations that can be overcome using suitable procedures. Even if the two techniques have been frequently cross-compared, critical analysis discussing all sub-phases of a complex digitization project are quite rare. Comparisons taking into account the digitization of a cultural masterpiece, such as the Etruscan Sarcophagus of the Spouses (Figure 1) discussed in this paper, are even less common. The final 3D model of the Sarcophagus shows impressive spatial and texture resolution, in the order of tenths of millimetre for both digitization techniques, making it a large 3D digital model even though the physical size of the artwork is quite limited. The paper presents the survey of the Sarcophagus, a late 6th century BC Etruscan anthropoid Sarcophagus. Photogrammetry and laser scanning were used for its 3D digitization in two different times only few days apart from each other. The very short time available for the digitization was a crucial constraint for the surveying operations (due to constraints imposed us by the museum curators). Despite very high-resolution and detailed 3D models have been produced, a metric comparison between the two models shows intrinsic limitations of each technique that should be overcome through suitable onsite metric verification procedures as well as a proper processing workflow.

show abstract

Fully Automatic Registration of Image Sets on Approximate Geometry

Cited by 71 publications

References 36 publications

Automatic Registration of Images to Untextured Geometry Using Average Shading Gradients

Automatic Registration of Images to Untextured Geometry Using Average Shading Gradients

Multispectral Photogrammetric Data Acquisition and Processing Forwall Paintings Studies

3d Digitization of an Heritage Masterpiece - A Critical Analysis on Quality Assessment

Contact Info

Product

Resources

About