This paper presents a set of innovative algorithms and a system, named LogMaster, for mining correlations of events that have multiple attributions, i.e., node ID, application ID, event type, and event severity, in logs of large-scale cloud and HPC systems. Different from traditional transactional data, e.g., supermarket purchases, system logs have their unique characteristics, and hence we propose several innovative approaches to mining their correlations. We parse logs into an n-ary sequence where each event is identified by an informative nine-tuple. We propose a set of enhanced apriori-like algorithms for improving sequence mining efficiency; we propose an innovative abstraction-event correlation graphs (ECGs) to represent event correlations, and present an ECGs-based algorithm for fast predicting events. The experimental results on three logs of production cloud and HPC systems, varying from 433490 entries to 4747963 entries, show that our method can predict failures with a high precision and an acceptable recall rates.

The rotating machinery plays a vital role in industrial systems, in which unexpected mechanical faults during operation can lead to severe consequences. For fault prevention, many fault diagnostic methods based on vibration signals are available in the literature. However, the vibration signals are obtained by using different types of sensors, which can cause sensor installation issues and damage the rotating machinery. In addition, this kind of data acquisition through vibration signal induces a large amount of signal noise during machine operation, which will challenge the later fault diagnosis. A recent fault detection method based on infrared thermography (IRT) for rotating machinery avoids these issues. However, the corresponding literature is limited by the fact that the characteristics of the manual design cannot characterize the fault completely so that the diagnostic accuracy cannot exceed the diagnostic method based on the vibration signals. This paper introduces a popular image feature extraction method into the fault diagnosis of rotating machinery based on IRT for the first time. First, capturing the IRT images of the rotating machinery in different states, and then two popular feature extraction methods for IRT images, bag-of-visualword, and convolutional neural network, are tested in turn. Finally, the extracted features are classified to implement the automatic fault diagnosis. The developed method is applied to analyze the experimental IRT images collected from bearings, and the results demonstrate that the developed method is more effective than the traditional methods based on vibration signals.INDEX TERMS Fault diagnosis, infrared thermography, convolutional neural network, bag-of-visual-words, feature recognition.

No abstract

No abstract