A new method of speaker localization using the filtered correlation

Sayoud, Halim; Ouamour, Siham; Khennouf, Salah

doi:10.1109/icindma.2010.5538372

Cited by 3 publications

(1 citation statement)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It is assumed that only one speaker is active at a given instant of time and speakers are assumed to be stationary. To detect active speaker using audio part, location of speakers [8] is used as key factor. TDOA is used to find the relative delay between all pairs of microphones.…”

Section: Speaker Detection Using Audio Visual Sensor Arraymentioning

confidence: 99%

Active Speaker Detection using audio-visual sensor array

Kheradiya¹,

Reddy²,

Hegde³

2014

2014 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT)

View full text Add to dashboard Cite

Active Speaker Detection(ASD) in a noisy environment is a challenging problem. Audio modality does not help significantly when the level of noise is high, so usage of bimodal information like vision and speech together for ASD in a meeting room scenario is explored in this work. The method proposed in this work uses an audio-visual sensor array placed in circular geometry. Time difference of arrival(TDOA) is used to find the pivot mic corresponding to the active speaker, Directional of arrival(DOA) using audio modality is used to localise speaker and TDOA features are used in bimodal decision level fusion. In video modality active speaker is localised by lip activity detection method, followed by stereo triangulation. A pivot camera is also detected and used to extract correlation based video features. Multimodal active speaker detection is performed by the weighted fusion of audio and video modality decisions. A decision level fusion is used herein for improved ASD performance.Extensive experiments are performed on the M-MONC database and video recorded using lab testbed. The Multimodal approach proposed in this work for ASD indicates better performance than the existing clustering based method in terms of detection rate.

show abstract

Section: Speaker Detection Using Audio Visual Sensor Arraymentioning

confidence: 99%