A Novel Bearing Fault Diagnosis Method Using Spark-Based Parallel ACO-K-Means Clustering Algorithm

Abstract

K-Means clustering algorithm is a typical unsupervised learning method, and it has been widely used in the field of fault diagnosis. However, the traditional serial K-Means clustering algorithm is difficult to efficiently and accurately perform clustering analysis on the massive running-state monitoring data of rolling bearing. Therefore, a novel fault diagnosis method of rolling bearing using Spark-based parallel ant colony optimization (ACO)-K-Means clustering algorithm is proposed. Firstly, a Spark-based three-layer wavelet packet decomposition approach is developed to efficiently preprocess the running-state monitoring data to obtain eigenvectors, which are stored in Hadoop Distributed File System (HDFS) and served as the input of ACO-K-Means clustering algorithm. Secondly, ACO-K-Means clustering algorithm suitable for rolling bearing fault diagnosis is proposed to improve the diagnosis accuracy. ACO algorithm is adopted to obtain the global optimal initial clustering centers of K-Means from all eigenvectors, and the K-Means clustering algorithm based on weighted Euclidean distance is used to perform clustering analysis on all eigenvectors to obtain a rolling bearing fault diagnosis model. Thirdly, the efficient parallelization of ACO-K-Means clustering algorithm is implemented on a Spark platform, which can make full use of the computing resources of a cluster to efficiently process large-scale rolling bearing datasets in parallel. Extensive experiments are conducted to verify the effectiveness of the proposed fault diagnosis method. Experimental results show that the proposed method can not only achieve good fault diagnosis accuracy but also provide high model training efficiency and fault diagnosis efficiency in a big data environment.

Fault Detection of Wind Turbine Electric Pitch System Based on IGWO-ERF

“…Therefore, after the initial cleaning of the original data extracted by the SCADA system, the Z-score method is needed to scale the data proportionally, and the data of the same parameter is processed into the interval (−1, 1) with the mean u = 0 and the variance σ = 1. The Equation (19) is the mathematical expression of the Z-score, and the variance calculation is shown in Equation (20). During the optimization of the Extreme Random Forest parameters using the improved grey wolf optimization, the above two parameters (Table 1) are set into a twodimensional vector X(t + 1) (n_estimators, min_samples_leaf).…”

“…L.J. Wan [19] proposed a high-efficiency rolling bearing FD method based on Spark and improved random forest, which can increase the detection speed and obtain a higher accuracy. Ma, S.L.…”

A novel algorithm for complex transfer conditions in bearing fault diagnosis

“…proposed a fault feature extraction method utilizing time-varying envelope filtering, effectively extracting bearing cage fault signals that are often submerged in high levels of noise. Following feature extraction, the extracted features are utilized for fault classification using various methods such as support vector machines [16], Random Forest [17], and k-means [18].…”

Big Data Analytics Using Cloud Computing Based Frameworks for Power Management Systems: Status, Constraints, and Future Recommendations

“…Monitoring and information collection improve real-time analysis and intelligent diagnosis capabilities [ 19 , 39 ]. With the rapid development of cloud computing technology, various high-reliability and high-scalability, big data processing systems such as Hadoop, Spark, and Storm have emerged, providing favorable tools for the centralized processing of large-scale power equipment monitoring data [ 40 , 41 , 42 ]. Although these emerging computing models all offer a unified programming interface and shield more low-level details than traditional parallel computing programming models, how can they be introduced into the data processing of the power equipment monitoring center?…”