Many authoring tools let authors create scenarios, but very few let them create an active multimedia scenario that will not only play itself back, but will change course dynamically, depending on user interactions. Our temporal model provides a new way to represent asynchronous and synchronous temporal events, allowing authors to create scenarios that offer viewers seamless, transparent options.hen we think of documents, we usually think of books. Authoring a book requires writ-W ing a linear storyline that describes events that happen in time. Creating a multimedia presentation is considerably more complex. Unlike a book, which is unimedia and linear, multimedia presentations often contain media that must occur simultaneously or in some related way, and the author must specify all these relations. For instance, a book, which consists of words strung together, is most often read from front to back. Multimedia presentations contain many other media types, such as audio and video, that can be rendered in parallel. Further, the presentation may be interactive and subtly different at each runtime. We need new document models and methods of representing temporal relations in multimedia documents.One of the main issues in temporal models of scenarios is the model's degree of flexibility in expressing different temporal relationships. In this article, we are mainly concerned with the temporal behavior of scenarios, not the other attributes of the document such as its layout, quality, and playback speed. We studied how to represent and model multimedia scenarios (fully specified temporal entities involving multiple media) that "play themselves back"-that is, multiple media are rendered automatically before the users' eyes-while letting the user interact with the running presentation, "driving" it in a custom direction. We provide a new representation for asynchronous and synchronous temporal events that lets authors create scenarios offering viewers non-halting, transparent options. A temporal model for active multimediaPerhaps the most prevalent temporal model is the timeline,' which aligns all events (see "Definitions" sidebar) on a single axis representing time. Since the events all appear in the order in which they should be presented, exactly one of the basic point relations-"before" (<), "after" (>), or "simultaneous to" (=)-holds between any pair of events on a single timeline (Figure 1). The timeline model, though simple and graphical, lacks the flexibility to represent relations that are determined interactively, such as at runtime. For example, assume a graphic (say a mathematical graph) is to be rendered on the screen only until a user action (say a mouse selection) dictates that the next one should be rendered. The start time of the graphic is known at the time of authoring. However, the end time of the graphic depends on the user action and cannot be known until presentation time. Hence a traditional timeline, which requires a total specification of all temporal relations between media objects, cannot repres...
A multimedia application involves information that may be in a form of video, images, audio, text and graphics, need to be stored, retrieved and manipulated in large databases. In this paper, we propose an object-oriented database schema that supports multimedia documents and their temporal, spatial and logical structures. We present a document example and show how the schema can adress all the structures described. We also present a multimedia query specification language that can be used to describe a multimedia content portion to be retrieved from the database. The language provides means by which the user can specify the information on the media as well as the temoral and spatial relationships among these media.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.