Object-based multimedia content description schemes and applications for MPEG-7

Abstract

In this paper, we describe description schemes (DSs) for image, video, multimedia, home media, and archive content proposed to the MPEG-7 standard. MPEG-7 aims to create a multimedia content description standard in order to facilitate various multimedia searching and filtering applications. During the design process, special care was taken to provide simple but powerful structures that represent generic multimedia data. We use the eXtensible Markup Language (XML) to illustrate and exemplify the proposed DSs because of its interoperability and flexibility advantages. The main components of the image, video, and multimedia description schemes are object, feature classification, object hierarchy, entity-relation graph, code downloading, multi-abstraction levels, and modality transcoding. The home media description instantiates the former DSs proposing the 6-W semantic features for objects, and 1-P physical and 6-W semantic object hierarchies. The archive description scheme aims to describe collections of multimedia documents, whereas the former DSs only aim at individual multimedia documents. In the archive description scheme, the content of an archive is represented using multiple hierarchies of clusters, which may be related by entity-relation graphs. The hierarchy is a specific case of entity-relation graph using a containment relation. We explicitly include the hierarchy structure in our DSs because it is a natural way of defining composite objects, a more efficient structure for retrieval, and the representation structure used in MPEG-4. We demonstrate the feasibility and the efficiency of our description schemes by presenting applications that already use the proposed structures or will greatly benefit from their use. These applications are the Visual Apprentice, the AMOS-Search system, a multimedia broadcast news browser, a storytelling system, and an image meta search engine, MetaSEEk.

Context-aware support in structured documents for interactive-TV

“…Most of the earlier approaches on describing multimedia content (including Benitez et al [22], Dublin Core Metadata Initiative [23] and Lagoze and Hunter [24]) have been covered by the MPEG group in the form of the MPEG-7 international open ISO standard [3]. This standard, a toolbox of generic description structures with associated semantics, is meant to be instantiated by any multimedia document that requires the use of metadata.…”

ClassView : Hierarchical Video Shot Classification, Indexing, and Accessing

“…The semantics-sensitive video classifier is expected not only to be efficient for bridging the semantic gap but also to provide an effective video database indexing scheme, thus the tree structure of the semantic video classifier should be related to the concept hierarchy of video contents. Unfortunately, the video database model problem has not been addressed efficiently for supporting video access over the large-scale database [1], [2].…”

“…nologies need to be developed for indexing, browsing, filtering, searching, and updating the vast amount of information available in video databases [1], [2]. The recent development of content-based video retrieval systems has advanced our capabilities for searching videos via color, layout, texture, motion, and shape features [3]- [11].…”

An access control model for video database systems

“…MPEG-7 aims at developing a multimedia content description standard in order to facilitate multimedia searching and filtering application Beritez et al 2000]. In the context of MPEG-7, a description of an audiovisual (AV) document includes descriptors (termed Ds), which specify the syntax and semantics of a representation entity for a feature of the AV data, and description schemes (termed DSs) which specify the structures and semantics of a set of Ds and DSs.…”

“…In order to support video content description in MPEG-7, many approaches have been proposed in the past Beritez et al 2000]. However, all these approaches focus on describing a single video sequence.…”