A Proposal for a Video Modeling for Composing Multimedia Document

Abstract

Abstract. This paper contributes to the modeling of audiovisual information with a particular focus on the description needs for the composition of video elements (character, shot, scene, etc.) with other media information (text, sound, image, etc) inside multimedia document. This model has been experimented through an authoring and presentation tool called VideoMadeus. The resultants are illustrated with several examples of document where spatio-temporal synchronization of video is required.

Structured Media for Authoring Multimedia Documents

“…The availability of standards will allow the exchange of data from media-oriented applications to document authoring and presentation applications. Our work contributes to the modeling [5] and the development of authoring applications that fulfill both media content description needs and multimedia composition.…”

“…We have proposed in [5] a video content modeling for composing multimedia documents. It is based on the hierarchical structure of that media in terms of sequence, scene, shot, transition and object elements as proposed in existing approaches for video indexing [8].…”

“…For instance, in the document displayed in Figure 2, the video object "Little girl phones" of a video segment displayed in the figure 1 has been synchronized with a text media (see the timeline document view). Authors can also apply operations and interactions on elements of the video such as tracking, hyperlink, and erasure [5]. Thus, more complex multimedia documents can be specified while maintaining the declarative approach of XML that allows the use of high-level authoring interfaces like our video content editing.…”

A Multimedia Model Based on Structured Media and Sub-Elements for Complex Multimedia Authoring and Presentation

“…Its aim is to bring more sophisticated composition of different information resources to authoring and presentation multimedia documents. We have proposed in [16] a video content model for composing multimedia documents, in which we have used the descriptors from different standards. For instance, we use the Dublin core's element set for bibliographical information (e.g., title, creator, rights) and we have refined the Ds and DSs from MPEG-7 for structural information (e.g., scene, shot, event).…”

“…The particular context of multimedia document authoring and presentation systems requires specific content description needs of video media. We have been working on this subject for two years and have proposed a video model that is consistent with our multimedia document model [16]. At the top level, the video model comprises different description schemes (DSs) proposed from MPEG-7, it consists of six description schemes in the following:…”