Incremental On-Line Clustering of Speakers' Short Segments

Abstract

This paper deals with clustering of speakers' short segments, in a scenario where additional segments continue to arrive and should be constantly clustered together with previous segments that were already clustered. In realistic applications, it is not possible to cluster all segments every time a new segment arrives. Hence, incremental clustering is applied in an on-line mode. New segments can either belong to existing speakers, therefore, have to be assigned to one of the existing clusters, or they could belong to new speakers and thus new clusters should be formed. In this work we show that if there are enough segments per speaker in the off-line initial clustering process, it constitutes a good starting point for the incremental on-line clustering. In this case, incremental online clustering can be successfully applied based on the previously proposed mean-shift clustering algorithm with PLDA score as a similarity measure and with k-nearest neighbors (kNN) neighborhood selection.

Probabilistic Back-ends for Online Speaker Recognition and Clustering

“…Another example is online speaker diarization or clustering [4][5][6][7][8][9]. In this case, short speech segments from an audio stream have to be classified with low latency (e.g.…”

Toeplitz Inverse Covariance Based Robust Speaker Clustering for Naturalistic Audio Streams

“…in a multispeaker audio stream [1]. Some of the practical applications of diarization technology include information retrieval [2], broadcast news, meeting conversations, telephone calls, VoIP, digital audio logging [3] and interaction analysis in Peer-Led Team Learning (PLTL) groups [4,5,6,7]. Diarization is a challenging task for naturalistic audio streams as they contain short conversational turns, overlapped speech, noise and reverberation [8,9].…”

“…NIST Rich Transcription (RT) evaluations involved broadcast news data and meeting recordings for diarization study [1]. Summed-channel telephone speech from NIST SRE evaluations have been used in diarization studies [4].…”