Speaker Segmentation of Interviews Using Integrated Video and Audio Change Detectors

Lagrange, Mathieu; Martins, Luís Gustavo; Teixeira, Luís; Tzanetakis, George

doi:10.1109/cbmi.2007.385415

Cited by 1 publication

(1 citation statement)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…An example of a multimodal application implemented in MarsyasX is a speaker segmentation system [4]. The algorithm and the corresponding network can be broadly separated in three parts: the audio speaker segmentation algorithm, the visual motion estimation and centroid calculation, and finally a multimodal speaker segmentation module that combines the visual and audio results.…”

Section: Multimodal Speaker Identificationmentioning

confidence: 99%

MarsyasX

Teixeira

Martins

Lagrange

et al. 2008

Proceedings of the 16th ACM International Conference on Multimedia

Self Cite

View full text Add to dashboard Cite

The design and implementation of multimedia signal processing systems is challenging especially when efficiency and real-time performance is desired. In many modern applications, software systems must be able to handle multiple flows of various types of multimedia data such as audio and video. Researchers frequently have to rely on a combination of different software tools for each modality to assemble proof-of-concept systems that are inefficient, brittle and hard to maintain. Marsyas is a software framework originally developed to address these issues in the domain of audio processing. In this paper we describe MarsyasX, a new open-source cross-modal analysis framework that aims at a broader score of applications. It follows a dataflow architecture where complex networks of processing objects can be assembled to form systems that can handle multiple and different types of multimedia flows with expressiveness and efficiency.

show abstract

Section: Multimodal Speaker Identificationmentioning

confidence: 99%