The stratification system a design environment for random access video

Smith, Thomas G.; Davenport, Glorianna

doi:10.1007/3-540-57183-3_22

Cited by 72 publications

(37 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…For example, the Strata system [Smith and Davenport, 1992] employs keywords that are relevant over a frame span of a video (implicit segments). Keyword association can be partially overlapping and this produces a layered annotation of the video, with each layer representing some association among the segments.…”

Section: Formal Annotation Of Unitsmentioning

confidence: 99%

Semantic annotation of narrative media objects

Lombardo

Damiano

2011

Multimed Tools Appl

View full text Add to dashboard Cite

This paper addresses the annotation of the narrative features of media objects. Based on a relevant narratological and computational background, we introduce an ontology-based model called Drammar, an annotation schema for the narrative features of media objects based on Drammar and a software tool, Cinematic, for annotating these objects and validating the annotation. Annotated media objects can also be automatically edited into sequences, with the twofold goal of testing the validity of the annotation -through the reconstruction of the baseline sequence -and exploring the possibility of alternative sequences.The software tool encodes both the narrative model and the annotation itself in ontological format, and relies on external ontologies for representing world knowledge and limit the arbitrariness of the annotation.The paper opens the way to the design of a general annotation schema for narrative multimedia with the long-term goal of building large corpora of annotated video material and of bridging the gap between the low-level signal analysis and the high-level semantic representation of the narrative content of the media objects.Finally, the paper illustrates a few projects elaborated with the Drammar annotation and the Cinematic tool, with purposes of artistic research and cross-media analysis, that provide an empirical validation of the annotation process.

show abstract

Section: Formal Annotation Of Unitsmentioning

confidence: 99%

Semantic annotation of narrative media objects

Lombardo

Damiano

2011

Multimed Tools Appl

View full text Add to dashboard Cite

show abstract

“…Specification of such frames is hard because it is often independent of shot or scene boundaries. Different units of metadata may address different frame ranges, requiring a stratified approach [22,28]. Even within a specific frame, identifying the target object is often not trivial.…”

Section: Multimedia-specific Metadata Problemsmentioning

confidence: 99%

That obscure object of desire: multimedia metadata on the Web, part 2

Nack¹,

Ossenbruggen

Hardman

2005

IEEE Multimedia

View full text Add to dashboard Cite

C e n t r u m v o o r W i s k u n d e e n I n f o r m a t i c a INformation SystemsThat Obscure Object of Desire: Multimedia Metadata on the Web (Part I) Jacco van Ossenbruggen, Frank Nack, Lynda Hardman ABSTRACT This article discusses the state of the art in metadata for audio-visual media in large semantic networks, such as the Semantic Web. Our discussion is predominantly motivated by the two most widely known approaches towards machine-processable and semantic-based content description, namely the Semantic Web activity of the W3C and ISO's efforts in the direction of complex media content modeling, in particular the Multimedia Content Description Interface (MPEG-7). We explain that the conceptual ideas and technologies discussed in both approaches are essential for the next step in multimedia development. Unfortunately, there are still many practical obstacles that block their widespread use for providing multimedia metadata on the Web. Based on a scenario to explain our vision of a media-aware Semantic Web, we derive in Part I a number of problems regarding the semantic content description of media units. We then discuss the multimedia production chain, in particular emphasizing the role of progressive metadata production. As a result we distill a set of media-based metadata production requirements and show how current media production environments fail to address these. We then introduce those parts of the W3C and ISO standardization works that are relevant to our discussion. In Part II of this article, we analyze their abilities to define structures for describing media semantics, discuss syntactic and semantic problems, ontological problems for media semantics, and the problems of applying the theoretical concepts to real world problems. Part II concludes with implications of the findings for future action with respect to the actions the community should take. REPORT INS-E0308 DECEMBER 3, 2003 INS ACM Computing Classification AbstractThis article discusses the state of the art in metadata for audio-visual media in large semantic networks, such as the Semantic Web. Our discussion is predominantly motivated by the two most widely known approaches towards machine-processable and semantic-based content description, namely the Semantic Web activity of the W3C and ISO's efforts in the direction of complex media content modeling, in particular the Multimedia Content Description Interface (MPEG-7).We explain that the conceptual ideas and technologies discussed in both approaches are essential for the next step in multimedia development. Unfortunately, there are still many practical obstacles that block their widespread use for providing multimedia metadata on the Web.Based on a scenario to explain our vision of a mediaaware Semantic Web, we derive in part I a number of problems regarding the semantic content description of media units. We then discuss the multimedia production chain, in particular emphasizing the role of progressive metadata production. As a result we distill a set of media-based metadata produ...

show abstract

“…To facilitate the dynamic use of audio-visual material, A4SM's general attempt at content description applies the strata oriented approach [1] in combination with the setting concept [37]. The usefulness of combining these two approaches results in gaining the temporality of the multi-layered approach without the disadvantage of using keywords, as keywords have been replaced by a structured content representation, which comprise not only textual descriptions but also descriptions of image decomposition based on feature extraction.…”

Section: General Representational Concepts In A4smmentioning

confidence: 99%

“…At the same time the notion of the 'digital' as the capability to combine atomic information fragments became apparent. The idea of 'semantic and semiotic productivity' allowing an endless montage of signs inspired a great deal of research in computer environments that embody mechanisms to interpret, manipulate or generate visual media [4,36,1,34,41,52,46,11,51,29,9,24]. Similar developments were acquired for audible information [5,18,39,47,40,6,45].…”

Section: Introductionmentioning

confidence: 99%

Designing annotation before it's needed

Nack

Putz²

2001

Proceedings of the Ninth ACM International Conference on Multimedia

View full text Add to dashboard Cite

This paper considers the automated and semi-automated annotation of audiovisual media in a new type of production framework, A4SM (Authoring System for Syntactic, Semantic and Semiotic Modelling). We present the architecture of the framework and outline the underlying XML-Schema based content description structures of A4SM. We then describe tools for a news and demonstrate how video material can be annotated in real time and how this information can not only be used for retrieval but also can be used during the different phases of the production process itself. Finally, we discuss the pros and cons of our approach of evolving semantic networks as the basis for audio-visual content description.

show abstract

The stratification system a design environment for random access video

Cited by 72 publications

References 1 publication

Semantic annotation of narrative media objects

Semantic annotation of narrative media objects

That obscure object of desire: multimedia metadata on the Web, part 2

Designing annotation before it's needed

Contact Info

Product

Resources

About