Stratified linear systematic sampling based clustering approach for detection of financial risk group by mining of big data

Pandey, Kamlesh Kumar; Shukla, Diwakar

doi:10.1007/s13198-021-01424-0

Cited by 11 publications

(4 citation statements)

References 76 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Statistical analysis 73,[99][100][101][102] determines statistically significant differences between the proposed algorithm and the state-of-the-art algorithms. there is no significant difference, whereas the alternative hypothesis H1 states that there is a significant difference among clustering algorithms.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Min‐max kurtosis stratum mean: An improved K‐means cluster initialization approach for microarray gene clustering on multidimensional big data

Pandey

Shukla

2022

Concurrency and Computation

Self Cite

View full text Add to dashboard Cite

SUMMARY Microarray gene clustering is a big data application that employs the K‐means (KM) clustering algorithm to identify hidden patterns, evolutionary relationships, unknown functions and gene trends for disease diagnosis, tissue detection and biological analysis. The selection of initial centroids is a major issue in the KM algorithm because it influences the effectiveness, efficiency and local optima of the cluster. The existing initial centroid initialization algorithm is computationally expensive and degrades cluster quality due to the large dimensionality and interconnectedness of microarray gene data. To deal with this issue, this study proposed the min‐max kurtosis stratum mean (MKSM) algorithm for big data clustering in a single machine environment. The MKSM algorithm uses kurtosis for dimension selection, mean distance for gene relationship identification, and stratification for heterogeneous centroid extraction. The results of the presented algorithm are compared to the state‐of‐the‐art initialization strategy on twelve microarray gene datasets utilizing internal, external and statistical assessment criteria. The experimental results demonstrate that the MKSMKM algorithm reduces iterations, distance computation, data comparison and local optima, and improves cluster performance, effectiveness and efficiency with stable convergence.

show abstract

Section: Discussionmentioning

confidence: 99%

“…Statistical analysis 73,99–102 determines statistically significant differences between the proposed algorithm and the state‐of‐the‐art algorithms. Friedman and post hoc tests have been used in this study to determine the significance of the algorithm difference.…”

Section: Discussionmentioning

confidence: 99%

Min‐max kurtosis stratum mean: An improved K‐means cluster initialization approach for microarray gene clustering on multidimensional big data

Pandey

Shukla

2022

Concurrency and Computation

Self Cite

View full text Add to dashboard Cite

show abstract

“…Systematic sampling is one of the sampling approach that extracts data from a dataset at a regular intervals. The literature (Kao et al, 2011;Aune-Lundberg and Strand, 2014;Mostafa and Ahmad, 2018;Pandey and Shukla, 2021) shows that systematic sampling has more operationally convenient, precise, easier and efficient estimators than randomization.…”

Section: Initial Centroid Methodsmentioning

confidence: 99%

NDPD: an improved initial centroid method of partitional clustering for big data mining

Pandey

Shukla

2022

JAMR

Self Cite

View full text Add to dashboard Cite

PurposeThe K-means (KM) clustering algorithm is extremely responsive to the selection of initial centroids since the initial centroid of clusters determines computational effectiveness, efficiency and local optima issues. Numerous initialization strategies are to overcome these problems through the random and deterministic selection of initial centroids. The random initialization strategy suffers from local optimization issues with the worst clustering performance, while the deterministic initialization strategy achieves high computational cost. Big data clustering aims to reduce computation costs and improve cluster efficiency. The objective of this study is to achieve a better initial centroid for big data clustering on business management data without using random and deterministic initialization that avoids local optima and improves clustering efficiency with effectiveness in terms of cluster quality, computation cost, data comparisons and iterations on a single machine.Design/methodology/approachThis study presents the Normal Distribution Probability Density (NDPD) algorithm for big data clustering on a single machine to solve business management-related clustering issues. The NDPDKM algorithm resolves the KM clustering problem by probability density of each data point. The NDPDKM algorithm first identifies the most probable density data points by using the mean and standard deviation of the datasets through normal probability density. Thereafter, the NDPDKM determines K initial centroid by using sorting and linear systematic sampling heuristics.FindingsThe performance of the proposed algorithm is compared with KM, KM++, Var-Part, Murat-KM, Mean-KM and Sort-KM algorithms through Davies Bouldin score, Silhouette coefficient, SD Validity, S_Dbw Validity, Number of Iterations and CPU time validation indices on eight real business datasets. The experimental evaluation demonstrates that the NDPDKM algorithm reduces iterations, local optima, computing costs, and improves cluster performance, effectiveness, efficiency with stable convergence as compared to other algorithms. The NDPDKM algorithm minimizes the average computing time up to 34.83%, 90.28%, 71.83%, 92.67%, 69.53% and 76.03%, and reduces the average iterations up to 40.32%, 44.06%, 32.02%, 62.78%, 19.07% and 36.74% with reference to KM, KM++, Var-Part, Murat-KM, Mean-KM and Sort-KM algorithms.Originality/valueThe KM algorithm is the most widely used partitional clustering approach in data mining techniques that extract hidden knowledge, patterns and trends for decision-making strategies in business data. Business analytics is one of the applications of big data clustering where KM clustering is useful for the various subcategories of business analytics such as customer segmentation analysis, employee salary and performance analysis, document searching, delivery optimization, discount and offer analysis, chaplain management, manufacturing analysis, productivity analysis, specialized employee and investor searching and other decision-making strategies in business.

show abstract

“…In fact, the transmission of fnancial risk is a multidimensional network structure, and spatial analysis can ft this situation well. It not only transfers the crisis from the "country of origin" to the "infected country" but also links its connection and impact with the individual countries in crisis [15][16][17]. Te specifc fnancial risk transmission model is shown in Figure 4.…”

Section: Time-varyingmentioning

confidence: 99%

Evaluation of Spatial Spillover Effect of Multidimensional Hybrid Financial Risk Contagion Based on the DAI Spatial Econometric Model

Dong

2023

Advances in Multimedia

View full text Add to dashboard Cite

The process of global integration has accelerated, and the international financial market has become increasingly closely linked. The financial risks that come with them are becoming more complex and difficult to guard against. Multimedia modeling in Health Cloud biometric authentication and data management systems can be applied to the analysis of financial markets. Most of the current financial risk analysis models are based on a single time, and the models are relatively simple and cannot adapt to the current complex multidimensional mixed financial risk environment. Therefore, this paper aimed to analyze the spatial spillover effect of financial risk contagion based on the directed asymmetric (DAI) spatial econometric model. This paper proposed to transfer entropy information weight information and introduce the GARCH (generalized auto-regressive conditional heteroskedasticity) model to improve the traditional econometric model. By constructing a DAI measurement model, the spatial contagion of multidimensional mixed financial risks was analyzed, and on this basis, a generalized multidimensional economic space was established to analyze spatial spillover effects and analyze the specific path of spatial spillover effects. The model results in this paper showed that the degree of correlation between the stock and bond market varied greatly between countries. Among them, the change coefficient W s ⟶ b r s D of the event period was judged to have a large degree of negative change in the United Kingdom, Germany, and France in the European Union, which were −0.9885, −0.9876, and −0.9748, respectively. This showed that the model in this paper had a good and reliable ability to cope with the current multidimensional mixed complex financial risk environment and could be used as a reference for financial risk-related research. At the same time, it also proved that multimedia modeling in health cloud biometric authentication and data management system could provide a role in financial risk contagion analysis.

show abstract

Stratified linear systematic sampling based clustering approach for detection of financial risk group by mining of big data

Cited by 11 publications

References 76 publications

Min‐max kurtosis stratum mean: An improved K‐means cluster initialization approach for microarray gene clustering on multidimensional big data

Min‐max kurtosis stratum mean: An improved K‐means cluster initialization approach for microarray gene clustering on multidimensional big data

NDPD: an improved initial centroid method of partitional clustering for big data mining

Evaluation of Spatial Spillover Effect of Multidimensional Hybrid Financial Risk Contagion Based on the DAI Spatial Econometric Model

Contact Info

Product

Resources

About