Towards Ontology-Driven Discourse: From Semantic Graphs to Multimedia Presentations

Abstract

Abstract. Traditionally, research in applying Semantic Web technology to multimedia information systems has focused on using annotations and ontologies to improve the retrieval process. This paper concentrates on improving the presentation of the retrieval results. First, our approach uses ontological domain knowledge to select and organize the content relevant to the topic the user is interested in. Domain ontologies are valuable in the presentation generation process, because effective presentations are those that succeed in conveying the relevant domain semantics to the user. Explicit discourse and narrative knowledge allows selection of appropriate presentation genres and creation of narrative structures, which are used for conveying these domain relations. In addition, knowledge of graphic design and media characteristics is essential to transform abstract presentation structures into real multimedia presentations. Design knowledge determines how the semantics and presentation structure are expressed in the multimedia presentation. In traditional Web environments, this type of design knowledge remains implicit, hidden in style sheets and other document transformation code. Our second use of Semantic Web technology is to model design knowledge explicitly, and to enable it to drive the transformations needed to turn annotated media items into structured presentations.

A comparative survey of Personalised Information Retrieval and Adaptive Hypermedia techniques

“…Description logic is used to solve the "concept-covering problem", which corresponds to the knowledge need of the current user. Similarly, in Geurts, et al (2003) ontologies are used in order to provide a "structured progression" through retrieved results. The concept of narrative units is proposed, which are used to construct the complete result presentation in a structured order.…”

ISRST: An Interest Based Storytelling Model Using Rhetorical Relations

“…Semantically organized events using primarily RST have been used in applications that present multimedia content [5,11,13], but most of them use only a very limited set of relations. Since rhetorically structured content was mainly used for organizational purposes, these applications do not deal with the narrative implications that rhetorical relations have in storytelling-like presentations.…”

“…Even though some models do not deal with interactivity at all [1,23,11,19], most models deal with several kinds of intrusive interaction that goes from parameter specification [5,10], and menu selection and interruptions [29,27,13,7] to full user action multimedia processing [21,28,6,18,15].…”

Creating Meaningful Multimedia Presentations

“…Here the underlying semantics is used to aid the user in selecting the video fragments and the query structure for ordering them for presentation. DISC [7] uses an annotated multimedia repository and a domain ontology to create multimedia presentations on demand. A semantic graph is created which consists of a domain ontology of classes, instances and relations between them together with the media material related to the instances.…”

“…A number of systems, such as DISC [7], demonstrate that an intermediate format is required. We call this intermediate format a structured progression [12].…”