This paper presents a new approach for classifying individual video frames as being a 'cartoon' or a 'photographic image'. The task arose from experiments performed at the TREC-2002 video retrieval benchmark: 'cartoons' are returned unexpectedly at high ranks even if the query gave only 'photographic' image examples. Distinguishing between the two genres has proved difficult because of their large intra-class variation. In addition to image descriptors used in prior cartoon-classification work, we introduce novel descriptors like ones based on the pattern spectrum of parabolic size distributions derived from parabolic granulometries and the complexity of the image signal approximated by its compression ratio. We evaluate the effectiveness of the proposed feature set for classification (using Support Vector Machines) on a large set of keyframes from the TREC-2002 video track collection and a set of web images. The paper reports the identification error rates against the number of images used as training set. The system is compared with one that classifies Web images as photographs or graphics and its superior performance is evident.
Abstract-We describe the application of a probabilistic multimedia model to video retrieval. From video shots, we compute Gaussian-mixture models that capture correlations in time and space, such as the appearance and disappearance of objects. These models improve the precision of "query by example/s" results in the TRECVID 2003 collection when compared to models that only make use of static visual information. Furthermore, integrated with information from automatic speech recognition (ASR) transcripts, they outperform ASR only results.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.