Clustering of imbalanced high-dimensional media data

Abstract

Media content in large repositories usually exhibits multiple groups of strongly varying sizes. Media of potential interest often form notably smaller groups. Such media groups differ so much from the remaining data that it may be worthy to look at them in more detail. In contrast, media with popular content appear in larger groups. Identifying groups of varying sizes is addressed by clustering of imbalanced data. Clustering highly imbalanced media groups is additionally challenged by the high dimensionality of the underlying features. In this paper, we present the imbalanced clustering (IClust) algorithm designed to reveal group structures in high-dimensional media data. IClust employs an existing clustering method in order to find an initial set of a large number of potentially highly pure clusters which are then successively merged. The main advantage of IClust is that the number of clusters does not have to be pre-specified and that no specific assumptions about the cluster or data characteristics need to be made. Experiments on real-world media data demonstrate that in comparElectronic supplementary material The online version of this article (https://doi.org/10.1007/s11634-017-0292-z) contains supplementary material, which is available to authorized users. B Šárka Brodinová

AnyThreat: An Opportunistic Knowledge Discovery Approach to Insider Threat Detection

“…There is a considerable body of literature that has successfully applied k-means clustering for class decomposition and/or class imbalance data [3,10,25,26,39]. In the class decomposition component, We select k-means clustering [23] to decompose the class into k clusters (subclasses).…”

Classification of Existing Health Model of India at the End of the Twelfth Plan using Enhanced Decision Tree Algorithm

“…As an effective tool, data mining can deal with such issues by mining available health-related complex data sets. In data mining, various problems have been solved to extract potential knowledge from unorganised data, using various measures, like information-theoretic measures (Chen et al, 1996), local generalised quadratic distance metrics (Karim & Frank, 2017) and means like clustering of imbalanced high-dimensional media data (Sarka et al, 2018;Antonella & Mariangela, 2017;Panagiotis & Christos, 2016). Classification, which is one of the main objectives of data mining, is an effective tool to analyse the training set and study a classified model (Gondek & Hofmann, 2007;Zhang et al, 2006).…”