Data modeling and evaluation of deep semantic annotation for cultural heritage images

Abstract

PurposeTo meet the emerging demand for fine-grained annotation and semantic enrichment of cultural heritage images, this paper proposes a new approach that can transcend the boundary of information organization theory and Panofsky's iconography theory.Design/methodology/approachAfter a systematic review of semantic data models for organizing cultural heritage images and a comparative analysis of the concept and characteristics of deep semantic annotation (DSA) and indexing, an integrated DSA framework for cultural heritage images as well as its principles and process was designed. Two experiments were conducted on two mural images from the Mogao Caves to evaluate the DSA framework's validity based on four criteria: depth, breadth, granularity and relation.FindingsResults showed the proposed DSA framework included not only image metadata but also represented the storyline contained in the images by integrating domain terminology, ontology, thesaurus, taxonomy and natural language description into a multilevel structure.Originality/valueDSA can reveal the aboutness, ofness and isness information contained within images, which can thus meet the demand for semantic enrichment and retrieval of cultural heritage images at a fine-grained level. This method can also help contribute to building a novel infrastructure for the increasing scholarship of digital humanities.

Imagens do patrimônio cultural como objetos digitais na perspectiva da polirrepresentação: análise do Europeana Image Classification Pilot

“…Ao considerar a rica semântica das imagens de patrimônio cultural e a dependência pragmática, isto é, contextual, de sua interpretação, fica evidente que quanto mais complexa em conteúdo e abstrata é uma dada imagem de patrimônio cultural, maior variedade de elementos associados serão necessários para compreender seu significado (Wang et al, 2021). Assim sendo, retoma-se a base teórica de que a informação é construída e interpretada com base em elementos DOI: http://dx.doi.org/10.22201/iibi.24488321xe.2024.100.58866 contextuais provenientes tanto da percepção dos atores cognitivos, em outros termos, do seu 'modelo de mundo' -estruturas cognitivas ou de conhecimento determinadas pelo indivíduo e suas experiências socioculturais-quanto das manifestações cognitivas do objeto de informação, geradas por um ator cognitivo com um modelo de mundo próprio em um determinado contexto e identificadas em outro.…”

Intelligent Restoration Technology of Mural Digital Image Based on Machine Learning Algorithm

“…Some murals are used to describe early fairy tales [2]. Among them, the murals of the Saint Monk's nunnery are rich and diverse, mainly including Buddha statues, Bodhisattva statues, major historical events, and custom paintings [3]. The murals of the Holy Monk's nunnery mainly reflect the description of characters and events and the texture of folk decoration.…”

Exploring the topic evolution of Dunhuang murals through image classification

“…Cultural heritage, the product of society and history, provides vivid materials for current scientific research, and is of great significance for tracing the development of human civilisation and cultural exchange. Therefore, UNESCO, Europeana and other cultural organisations have launched cultural heritage digitalisation projects [1]. In the field of digital humanities, taking advantage of modern information technologies to promote the storage and utilisation of digital resources, and to strengthen the protection of cultural heritage is the theme of development.…”