Large scale K-means clustering using GPUs

Abstract

The k-means algorithm is widely used for clustering, compressing, and summarizing vector data. We present a fast and memory-efficient GPU-based algorithm for exact k-means, Asynchronous Selective Batched K-means (ASB K-means). Unlike most GPU-based k-means algorithms that require loading the whole dataset onto the GPU for clustering, the amount of GPU memory required to run our algorithm can be chosen to be much smaller than the size of the whole dataset. Thus, our algorithm can cluster datasets whose size exceeds the available GPU memory. The algorithm works in a batched fashion and applies the triangle inequality in each k-means iteration to omit a data point if its membership assignment, i.e., the cluster it belongs to, remains unchanged, thus significantly reducing the number of data points that need to be transferred between the CPU’s RAM and the GPU’s global memory and enabling the algorithm to very efficiently process large datasets. Our algorithm can be substantially faster than a GPU-based implementation of standard k-means even in situations when application of the standard algorithm is feasible because the whole dataset fits into GPU memory. Experiments show that ASB K-means can run up to 15x times faster than a standard GPU-based implementation of k-means, and it also outperforms the GPU-based k-means implementation in NVIDIA’s open-source RAPIDS machine learning library on all the datasets used in our experiments.

A Study of Arrhythmia Risk Level Discrimination Based on K-Means Algorithm and Analytic Hierarchy Method

“…In addition, K-means clustering method is widely used in large-scale data processing. Mi et al proposed a large-scale K-means clustering method based on GPUs in "Large scale K-means clustering using GPUs" [5], which provides an efficient computational means for the analysis of arrhythmia data. And M. AI et al in "K-means clustering algorithms: a comprehensive review, variants analysis, and advances in the era of big data" [6] provided a comprehensive evaluation and analysis of K-Means clustering algorithms that provides researchers with a more comprehensive selection of methods.…”

Multidimensional Data Analysis for Enhancing In-Depth Knowledge on the Characteristics of Science and Technology Parks

“…Cluster Analysis: K-means [12][13][14] was used, a well-known non-parametric technique for cluster analysis that has numerous fields of application such as healthcare, coronavirus, and urban hotspots, e.g., [15][16][17]. In k-means, each instance is assigned to its nearest centroid, which represents an average of the instances in the cluster.…”