Interval-based conceptual models for time-dependent multimedia data

Abstract

Abstract-Multimedia data often have time dependencies that must be satisfied at presentation time. To support a general-purpose multimedia information system, these timing relationships must be managed to provide utility to both the data presentation system and the multimedia author.In this paper we propose new conceptual models for capturing these timing relationships and managing them as part of a database. Specifically, we introduce and define n-ary and reverse temporal relations along with their temporal constraints. These new relations are a generalization of our earlier temporal models and establish the basis for conceptual database structures and temporal access control algorithms to facilitate forward, reverse, and partial-interval evaluation during multimedia object playout. The proposed relations are defined to ensure a property of monotonically increasing playout deadlines to facilitate both real-time deadline-driven playout scheduling or optimistic interval-based process playout.Furthermore, we show a translation of the conceptual models to a structure suitable for a relational database.

Video Content Description Using Fuzzy Spatio-temporal Relations

“…Furthermore, in these approaches the temporal nature of video is neglected. A few systems have addressed the issue of object-based video retrieval (Deng & Manjunath, 1998;Courtney, 1997) and spatial modeling of video data that involve temporal information (Bimbo et al, 1995;Little & Ghafoor, 1993;Dagtas & Ghafoor, 1999;Vazirgiannis et al, 1998). The semantic modeling of video content is a difficult problem.…”

A survey on content-based retrieval for multimedia databases

“…The relation consists of spatial/temporal relations and intervals or coordinates associated with the relations representing spatial and/or temporal correlation. Several studies have given representations of spatial and/or temporal relations, as seen in [11], [13], [30], [24], [38], [39]. The frameworks of these studies which concern the synchronization of objects have been influenced by the work in [1].…”

“…Meanwhile, [1] discussed interval-based temporal relations; before, equal, meets, overlaps, during, starts, and finishes. Little and Ghafoor [30] extended basic binary temporal relations discussed in [1] to n-ary temporal relations, and discussed reverse relations of them. Hopner [24] also follows Allen's definition of basic temporal relations.…”

Modeling Multimedia Synchronization Using a Time Petri Net Based Approach

“…Another group of approaches consider the PN tool for multimedia synchronization. For example: -Object Composition Petri Net Model (OCPN) (Little and Ghafoor, 1993). However, the OCPN approach does not inherently support modelling of interaction.…”

“…Usually, they are binary relationships but can be easily extended to n-ary ones (Little & Ghafoor, 1993). Sequential relationships combine intervals which share the same timeline (mutual exclusion), occurring one after the other with (before) or without delay (meet) between them.…”