A Semantically Enriched Multimodal Imaging Approach Dedicated to Conservation and Restoration Studies

Abstract

Abstract. For the past decades, Cultural Heritage (CH) is commonly documented by digital-based imaging and analytical techniques. This documentation is used as a support by heritage scientists to study and help the preservation of CH objects. Multiple techniques or modalities are usually required and applied to complete the documentation and the possible diagnostic from it. In this paper we explored multimodal imaging strategies to survey, analyse and share semantically enriched digital replicas. Three challenging case-studies from the SUMUM research project aims to illustrate efficient multi-source approaches in multi-scalar, multi-temporal and multi-spectral contexts. From multimodal data acquisitions, a photogrammetric-based registration method (TACO) has been developed in order to exploit a 2D/3D semantic annotation process implemented into a CH oriented collaborative web platform (AIOLI). In the exemples showed, the structure and the content of the annotations work is based from condition reports provided by conservation and restoration experts. To this end, all the documentation gathered on CH objects are either directly merged by image based registration while complementary analysis can be spatially anchored to annotations as linked resources. The dissemination part is explored by built-in AIOLI’s collaborative features or external Potree-based viewer, to enhance the accessibility of the final 3D annotated scenes for further expertises or wide-public events and purposes.

A Web-Based Platform for 3D Visualization of Multimodal Imaging Data in Cultural Heritage Asset Documentation

“…The concept stems from the need to attribute imaging data from different sensors to realistic digitized building elements, accessible in an open, interactive online environment. Although similar approaches based on 3D photogrammetric or scanned models have been reported [17], the presented workflow and product simplify the multimodal imaging integration method and add to the realism of the presented 3D data.…”

A Review of Semantic Annotation in the Context of the Linked Open Data Cloud

“…Semantic annotation is considered a very significant contemporary technology that is used in text mining to give the selected text clarity and understanding rather than an ambiguous form [3]. Semantic annotation can be defined as a comment that is added to the text, image, or diagram to enrich the target information, which can be formed as a text description, underlines, highlights, images, links, and so on [4].…”