A Robust and Versatile Pipeline for Automatic Photogrammetric-Based Registration of Multimodal Cultural Heritage Documentation

Pamart, Anthony; Morlet, F.; Luca, Livio de; Véron, Philippe

doi:10.3390/rs12122051

Cited by 8 publications

(6 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For instance, in advocating for consistent data management, we opted for a singular digitization approach. Image-based modeling was selected, not only for its long-established use in our team's research (as detailed in works by De Pamart et al, 2020), but also due to its recognized benefits, which we will discuss further below. Moreover, as previously noted, our strategy required customization to accommodate the diverse nature of the corpus.…”

Section: Figure 1 Overall Strategy Diagrammentioning

confidence: 99%

Strategies and Experiments for Massive 3d Digitalization of the Remains After the Notre Dame De Paris’ Fire

Comte,

Pamart,

Réby

et al. 2024

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

Abstract. After the catastrophic fire at Notre Dame de Paris, a significant challenge was presented by the numerous lead-contaminated remnants. To address this, a detailed digitization strategy was devised and executed, tailored to the unique needs of this extensive and diverse corpus. This strategy involved the development and customization of both hardware and software tools, ensuring their effectiveness throughout the digitization process – from initial data acquisition to data dissemination.Central to our approach was the alignment of our methods with the distinct characteristics of each artifact, facilitating their effective preservation and future utility. Our strategy's adaptability was key, allowing us to incorporate advanced deep learning techniques into various aspects of our workflow. Notably, this included the implementation of the Segment Anything Model for automatic image segmentation, enhancing our image-based modeling capabilities. We also ventured into pioneering methods like 3D Gaussian Splatting and the exploration of radiance field methods for visualization.Moreover, the project has been mindful of data responsibility, aiming to make all digital data openly accessible beyond 2025. We have placed a strong emphasis on harmonizing and managing data, minimizing redundancies, and ensuring efficient storage, all while maintaining transparency about the limitations and errors in our methodologies. This holistic approach to digitization, balancing technological innovation with responsible data management, aims to preserve and make accessible the digital heritage of Notre Dame de Paris for future generations.

show abstract

Section: Figure 1 Overall Strategy Diagrammentioning

confidence: 99%

Strategies and Experiments for Massive 3d Digitalization of the Remains After the Notre Dame De Paris’ Fire

Comte,

Pamart,

Réby

et al. 2024

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

show abstract

“…Pipeline design is influenced by objectives including levels of output quality, velocity, reproducibility, flexibility, robustness, and automation (c.f. [372,373]). This contradicts with the huge variety of cultural heritage qualities [82,374].…”

Section: Data Processingmentioning

confidence: 99%

“…This contradicts with the huge variety of cultural heritage qualities [82,374]. Despite recent achievements, e.g., with regards to data fusion (e.g., [372]), most pipelines are still highly purpose built and require manual processing to reach satisfying model quality.…”

Section: Data Processingmentioning

confidence: 99%

Digital 3D Technologies for Humanities Research and Education: An Overview

Münster¹

2022

Applied Sciences

View full text Add to dashboard Cite

Digital 3D modelling and visualization technologies have been widely applied to support research in the humanities since the 1980s. Since technological backgrounds, project opportunities, and methodological considerations for application are widely discussed in the literature, one of the next tasks is to validate these techniques within a wider scientific community and establish them in the culture of academic disciplines. This article resulted from a postdoctoral thesis and is intended to provide a comprehensive overview on the use of digital 3D technologies in the humanities with regards to (1) scenarios, user communities, and epistemic challenges; (2) technologies, UX design, and workflows; and (3) framework conditions as legislation, infrastructures, and teaching programs. Although the results are of relevance for 3D modelling in all humanities disciplines, the focus of our studies is on modelling of past architectural and cultural landscape objects via interpretative 3D reconstruction methods.

show abstract

“…The data processing was performed by Totally Automated Coregistration and Orientations (TACO) which is a MicMac based library automating incremental registration for multi-source 3D reconstruction. This Python-based package was developed within the SUMUM research project and previously presented (Pamart et Al., 2020). The code source of the beta release is available following this link ; https://page.hn/5oot7b.…”

Section: Photogrammetric Based Processing For Spatial Registration An...mentioning

confidence: 99%

A Semantically Enriched Multimodal Imaging Approach Dedicated to Conservation and Restoration Studies

Pamart¹,

Roussel²,

Hubert³

et al. 2022

Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci.

View full text Add to dashboard Cite

Abstract. For the past decades, Cultural Heritage (CH) is commonly documented by digital-based imaging and analytical techniques. This documentation is used as a support by heritage scientists to study and help the preservation of CH objects. Multiple techniques or modalities are usually required and applied to complete the documentation and the possible diagnostic from it. In this paper we explored multimodal imaging strategies to survey, analyse and share semantically enriched digital replicas. Three challenging case-studies from the SUMUM research project aims to illustrate efficient multi-source approaches in multi-scalar, multi-temporal and multi-spectral contexts. From multimodal data acquisitions, a photogrammetric-based registration method (TACO) has been developed in order to exploit a 2D/3D semantic annotation process implemented into a CH oriented collaborative web platform (AIOLI). In the exemples showed, the structure and the content of the annotations work is based from condition reports provided by conservation and restoration experts. To this end, all the documentation gathered on CH objects are either directly merged by image based registration while complementary analysis can be spatially anchored to annotations as linked resources. The dissemination part is explored by built-in AIOLI’s collaborative features or external Potree-based viewer, to enhance the accessibility of the final 3D annotated scenes for further expertises or wide-public events and purposes.

show abstract

A Robust and Versatile Pipeline for Automatic Photogrammetric-Based Registration of Multimodal Cultural Heritage Documentation

Cited by 8 publications

References 36 publications

Strategies and Experiments for Massive 3d Digitalization of the Remains After the Notre Dame De Paris’ Fire

Strategies and Experiments for Massive 3d Digitalization of the Remains After the Notre Dame De Paris’ Fire

Digital 3D Technologies for Humanities Research and Education: An Overview

A Semantically Enriched Multimodal Imaging Approach Dedicated to Conservation and Restoration Studies

Contact Info

Product

Resources

About