Ontological access to images of fine art

Abstract

Information retrieval in a knowledge rich domain poses challenges that are different from other domains. The domain of fine arts and cultural heritage is an exemplar of such a domain. The many facets of, and complex interrelations between, works of fine art are not easily addressed by conventional keyword-based approaches or even by structured cataloguing systems. Information retrieval challenges in this domain include: the conversion of existing legacy data into knowledge representations that emulate the semantics of the domain's relationships; and easy access to a robust knowledge representation for users unfamiliar with query languages. Our research addresses aspects of both challenges as they are connected and may benefit from being addressed in conjunction. Based on a study on user preferences in art image search and a review of existing structured resources for cataloguing art and heritage information, we have developed two prototypes: Ontology Populator and Artfinder . The first prototype, Ontology Populator , is used to automatically enrich data akin to legacy data kept by heritage institutions and transform it into a knowledge base. The second prototype is a graphical query builder, Artfinder , which interacts with the knowledge base. The Artfinder interface, is constructed dynamically from the structure of the underlying knowledge. A task-based evaluation of Artfinder was carried out with 10 expert and 10 layperson evaluators. Participants reviewed the interface favourably and the evaluation also revealed potential for improvement. Artfinder and its “query logic,” perhaps is a semantically richer mode of accessing knowledge repositories, allowing for logically more complex queries than are currently supported outside the realm of dedicated query languages. We believe that domain experts and perhaps informed laypersons will benefit from this retrieval approach.

Usability of data-oriented user interfaces for cultural heritage: A systematic mapping study

“…There are nine studies where the intended users are researchers. In this group, we may find applications to provide a richer mode of accessing knowledge like through ontology-based information retrieval [70], the exploration of complex databases [28,71] or specialised search [26,62]. Others are focused on allowing in-depth analysis of CH artefacts like coins located on digital maps [61] or the surface of historical violins [67].…”

“…The majority of the articles (21%) propose certain semantic organisation of the CH information to help people find what they are looking for. In many of these works [7,58,63,70], ontologies and other structures are used to standardise the information to highlight historical and cultural associations [26,55,58] and to generate recommendations [7,50,52]. The aggregation of digital archives with its geospatial information is also proposed [56,59].…”

Proceedings of the Third Workshop on Semantic Web and Information Extraction

“…The development of our system is inspired by an earlier system of temporal expression resolution for German language date expressions, an auxiliary part of a research project concerned with information retrieval on digital repositories of works of art, (Isemann and Ahmad, 2014). The approach was an iterative development cycle of successively resolving ever more complex date and time descriptors and mapping them to unambiguous time spans in ISO 8601 format.…”