Movie Analysis with Emphasis to Dialogue and Action Scene Detection

Benetos, Emmanouil; Siatras, Spyridon; Kotropoulos, Constantine; Nikolaidis, Nikos; Pitas, Ioannis

doi:10.1007/978-0-387-76316-3_7

Cited by 2 publications

(1 citation statement)

References 35 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Furthermore, combined audio-visual processing is more close to human perception. Audio-based dialogue detection can be used auxiliary to video-based dialogue detection and is proven to boost dialogue detection efficiency [3], [9], [10]. Related topics to dialogue detection are face detection and tracking, speaker tracking and speaker turn detection [12].…”

Section: Introductionmentioning

confidence: 99%

Audio-Assisted Movie Dialogue Detection

Kotti

Ververidis

Evangelopoulos

et al. 2008

IEEE Trans. Circuits Syst. Video Technol.

View full text Add to dashboard Cite

Abstract-An audio-assisted system is investigated that detects if a movie scene is a dialogue or not. The system is based on actor indicator functions. That is, functions which define if an actor speaks at a certain time instant. In particular, the crosscorrelation and the magnitude of the corresponding the crosspower spectral density of a pair of indicator functions are input to various classifiers, such as voted perceptrons, radial basis function networks, random trees, and support vector machines for dialogue/non-dialogue detection. To boost classifier efficiency AdaBoost is also exploited. The aforementioned classifiers are trained using ground truth indicator functions determined by human annotators for 41 dialogue and another 20 non-dialogue audio instances. For testing, actual indicator functions are derived by applying audio activity detection and actor clustering to audio recordings. 23 instances are randomly chosen among the aforementioned 41 dialogue instances, 17 of which correspond to dialogue scenes and 6 to non-dialogue ones. Accuracy ranging between 0.739 and 0.826 is reported.

show abstract