Maxmin distance sort heuristic-based initial centroid method of partitional clustering for big data mining

Pandey, Kamlesh Kumar; Shukla, Diwakar

doi:10.1007/s10044-021-01045-0

Cited by 10 publications

(8 citation statements)

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Statistical analysis 73,[99][100][101][102] determines statistically significant differences between the proposed algorithm and the state-of-the-art algorithms. there is no significant difference, whereas the alternative hypothesis H1 states that there is a significant difference among clustering algorithms.…”

Section: Discussionmentioning

confidence: 99%

“…Statistical analysis 73,99–102 determines statistically significant differences between the proposed algorithm and the state‐of‐the‐art algorithms. Friedman and post hoc tests have been used in this study to determine the significance of the algorithm difference.…”

Section: Discussionmentioning

confidence: 99%

“…Based on the above literature and comparative analysis. 40,65,66,[71][72][73][74] Table 1 evaluates the initial centroid approaches for big data clustering using distance computation, algorithm scalability, result consistency, convergence consistency and computational efficiency characteristics.…”

Section: Related Workmentioning

confidence: 99%

“…The variety characteristic controls the data classes and cluster structure, while the velocity characteristic represents the time complexity, computation efficiency and scalability of the clustering method. Based on the above literature and comparative analysis 40,65,66,71–74 . Table 1 evaluates the initial centroid approaches for big data clustering using distance computation, algorithm scalability, result consistency, convergence consistency and computational efficiency characteristics.…”

Section: Related Workmentioning

confidence: 99%

See 3 more Smart Citations

Min‐max kurtosis stratum mean: An improved K‐means cluster initialization approach for microarray gene clustering on multidimensional big data

Pandey

Shukla

2022

Concurrency and Computation

Self Cite

View full text Add to dashboard Cite

SUMMARY Microarray gene clustering is a big data application that employs the K‐means (KM) clustering algorithm to identify hidden patterns, evolutionary relationships, unknown functions and gene trends for disease diagnosis, tissue detection and biological analysis. The selection of initial centroids is a major issue in the KM algorithm because it influences the effectiveness, efficiency and local optima of the cluster. The existing initial centroid initialization algorithm is computationally expensive and degrades cluster quality due to the large dimensionality and interconnectedness of microarray gene data. To deal with this issue, this study proposed the min‐max kurtosis stratum mean (MKSM) algorithm for big data clustering in a single machine environment. The MKSM algorithm uses kurtosis for dimension selection, mean distance for gene relationship identification, and stratification for heterogeneous centroid extraction. The results of the presented algorithm are compared to the state‐of‐the‐art initialization strategy on twelve microarray gene datasets utilizing internal, external and statistical assessment criteria. The experimental results demonstrate that the MKSMKM algorithm reduces iterations, distance computation, data comparison and local optima, and improves cluster performance, effectiveness and efficiency with stable convergence.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

See 2 more Smart Citations

Min‐max kurtosis stratum mean: An improved K‐means cluster initialization approach for microarray gene clustering on multidimensional big data

Pandey

Shukla

2022

Concurrency and Computation

Self Cite

View full text Add to dashboard Cite

show abstract

“…The first two steps are known as the assignment phase and the last two steps are known as the update phase (Jain, 2010). The KM clustering faces four fundamental limitations due to the random distribution of initial centroids Kingravi, 2012, 2015;Celebi et al, 2013;Pandey and Shukla, 2022b). The first is the knowledge of K in advance, the second is the detection of compact hyper-spherical well-separated clusters, the third is the utilization of the Euclidean distance and the fourth is local minima.…”

Section: Introductionmentioning

confidence: 99%

NDPD: an improved initial centroid method of partitional clustering for big data mining

Pandey

Shukla

2022

JAMR

Self Cite

View full text Add to dashboard Cite

PurposeThe K-means (KM) clustering algorithm is extremely responsive to the selection of initial centroids since the initial centroid of clusters determines computational effectiveness, efficiency and local optima issues. Numerous initialization strategies are to overcome these problems through the random and deterministic selection of initial centroids. The random initialization strategy suffers from local optimization issues with the worst clustering performance, while the deterministic initialization strategy achieves high computational cost. Big data clustering aims to reduce computation costs and improve cluster efficiency. The objective of this study is to achieve a better initial centroid for big data clustering on business management data without using random and deterministic initialization that avoids local optima and improves clustering efficiency with effectiveness in terms of cluster quality, computation cost, data comparisons and iterations on a single machine.Design/methodology/approachThis study presents the Normal Distribution Probability Density (NDPD) algorithm for big data clustering on a single machine to solve business management-related clustering issues. The NDPDKM algorithm resolves the KM clustering problem by probability density of each data point. The NDPDKM algorithm first identifies the most probable density data points by using the mean and standard deviation of the datasets through normal probability density. Thereafter, the NDPDKM determines K initial centroid by using sorting and linear systematic sampling heuristics.FindingsThe performance of the proposed algorithm is compared with KM, KM++, Var-Part, Murat-KM, Mean-KM and Sort-KM algorithms through Davies Bouldin score, Silhouette coefficient, SD Validity, S_Dbw Validity, Number of Iterations and CPU time validation indices on eight real business datasets. The experimental evaluation demonstrates that the NDPDKM algorithm reduces iterations, local optima, computing costs, and improves cluster performance, effectiveness, efficiency with stable convergence as compared to other algorithms. The NDPDKM algorithm minimizes the average computing time up to 34.83%, 90.28%, 71.83%, 92.67%, 69.53% and 76.03%, and reduces the average iterations up to 40.32%, 44.06%, 32.02%, 62.78%, 19.07% and 36.74% with reference to KM, KM++, Var-Part, Murat-KM, Mean-KM and Sort-KM algorithms.Originality/valueThe KM algorithm is the most widely used partitional clustering approach in data mining techniques that extract hidden knowledge, patterns and trends for decision-making strategies in business data. Business analytics is one of the applications of big data clustering where KM clustering is useful for the various subcategories of business analytics such as customer segmentation analysis, employee salary and performance analysis, document searching, delivery optimization, discount and offer analysis, chaplain management, manufacturing analysis, productivity analysis, specialized employee and investor searching and other decision-making strategies in business.

show abstract

Clustering Mining Method Analysis of Human Resources Big Data Driven by Swarm Intelligence Algorithm

Zhang¹

2023

Lecture Notes on Data Engineering and Communications Technologies

View full text Add to dashboard Cite

Maxmin distance sort heuristic-based initial centroid method of partitional clustering for big data mining

Cited by 10 publications

References 41 publications

Min‐max kurtosis stratum mean: An improved K‐means cluster initialization approach for microarray gene clustering on multidimensional big data

Min‐max kurtosis stratum mean: An improved K‐means cluster initialization approach for microarray gene clustering on multidimensional big data

NDPD: an improved initial centroid method of partitional clustering for big data mining

Clustering Mining Method Analysis of Human Resources Big Data Driven by Swarm Intelligence Algorithm

Contact Info

Product

Resources

About