trackThem: Exploring a Large-Scale News Video Archive by Tracking Human Relations

Ide, Ichiro; Kinoshita, Tomoyoshi; Mo, Hiroshi; Katayama, Norio; Satoh, Shin’ichi

doi:10.1007/11562382_42

Cited by 9 publications

(4 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…As part of the Carnegie Mellon University's Informedia project, Christel et al proposed a news video browsing interface that visualizes news stories based on the combinations of the 3Ws focusing especially on the "Where" attribute [24], [25]. We focused on the cooccurrence of the "Who" attribute, and proposed a news video browsing interface by exploring the social network in news contents [26].…”

Section: Work On the Visualization Of News Structurementioning

confidence: 99%

Efficient Tracking of News Topics Based on Chronological Semantic Structures in a Large-Scale News Video Archive

Ide

Kinoshita²,

Takahashi

et al. 2012

IEICE Trans. Inf. & Syst.

Self Cite

View full text Add to dashboard Cite

Section: Work On the Visualization Of News Structurementioning

confidence: 99%

Efficient Tracking of News Topics Based on Chronological Semantic Structures in a Large-Scale News Video Archive

Ide

Kinoshita²,

Takahashi

et al. 2012

IEICE Trans. Inf. & Syst.

Self Cite

View full text Add to dashboard Cite

“…Providing summarization and visualization of large-scale news videos is an important task, which aims at saving time for general audiences in searching and reading news of interest. One solution for this task is to let the audience track up and down the topic thread structure originating from a specified story [6,10]. However, in a large-scale broadcast video database, there are tens or hundreds of news stories depicting the same topic.…”

Section: Topic Summarizationmentioning

confidence: 99%

Large-scale news topic tracking and key-scene ranking with video near-duplicate constraints

Ide

Satoh

2009

Proceedings of the First ACM Workshop on Large-Scale Multimedia Retrieval and Mining

Self Cite

View full text Add to dashboard Cite

To make full use of the overwhelming volume of news videos available today, it is necessary to track the development of news stories from different channels, mine their dependencies, and organize them in a semantic way. We propose a novel news topic tracking and re-ranking system. The main contributions include: (1) a novel scheme of mining topicrelated stories through tracking and re-ranking on the basis of near duplicates built on top of text, (2) a proposed simple but effective query-expansion algorithm for improving the representativeness of a search query, (3) a large-scale broadcast video database containing more than 34,000 news stories constructed for experimentation, and (4) a novel keyscene ranking scheme for analyzing both text similarity and video near-duplicate constraints.

show abstract

“…Ozkan and Duygulu proposed a method for extracting facial images from news videos with the name of a person [2]. Ide et al proposed a method for extracting human relationships from news videos [3]. In this paper, we focus on the extraction of speech shots such as interviews, press conferences, and public speakings, from news videos.…”

Section: Introductionmentioning

confidence: 99%

Speech Shot Extraction From Broadcast News Videos

Kumagai

Doman

Takahashi

et al. 2012

Int. J. Semantic Computing

Self Cite

View full text Add to dashboard Cite

We propose a method for discriminating between a speech shot and a narrated shot to extract genuine speech shots from a broadcast news video. Speech shots in news videos contain a wealth of multimedia information of the speaker, and could thus be considered valuable as archived material. In order to extract speech shots from news videos, there is an approach that uses the position and size of a face region. However, it is difficult to extract them with only such an approach, since news videos contain non-speech shots where the speaker is not the subject that appears in the screen, namely, narrated shots. To solve this problem, we propose a method to discriminate between a speech shot and a narrated shot in two stages. The first stage of the proposed method directly evaluates the inconsistency between a subject and a speaker based on the co-occurrence between lip motion and voice. The second stage of the proposed method evaluates based on the intra- and inter-shot features that focus on the tendency of speech shots. With the combination of both stages, the proposed method accurately discriminates between a speech shot and a narrated shot. In the experiments, the overall accuracy of speech shots extraction by the proposed method was 0.871. Therefore, we confirmed the effectiveness of the proposed method.

show abstract

trackThem: Exploring a Large-Scale News Video Archive by Tracking Human Relations

Cited by 9 publications

References 6 publications

Efficient Tracking of News Topics Based on Chronological Semantic Structures in a Large-Scale News Video Archive

Efficient Tracking of News Topics Based on Chronological Semantic Structures in a Large-Scale News Video Archive

Large-scale news topic tracking and key-scene ranking with video near-duplicate constraints

Speech Shot Extraction From Broadcast News Videos

Contact Info

Product

Resources

About