Data-Driven Anomaly Detection Approach for Time-Series Streaming Data

Abstract

Recently, wireless sensor networks (WSNs) have been extensively deployed to monitor environments. Sensor nodes are susceptible to fault generation due to hardware and software failures in harsh environments. Anomaly detection for the time-series streaming data of sensor nodes is a challenging but critical fault diagnosis task, particularly in large-scale WSNs. The data-driven approach is becoming essential for the goal of improving the reliability and stability of WSNs. We propose a data-driven anomaly detection approach in this paper, named median filter (MF)-stacked long short-term memory-exponentially weighted moving average (LSTM-EWMA), for time-series status data, including the operating voltage and panel temperature recorded by a sensor node deployed in the field. These status data can be used to diagnose device anomalies. First, a median filter (MF) is introduced as a preprocessor to preprocess obvious anomalies in input data. Then, stacked long short-term memory (LSTM) is employed for prediction. Finally, the exponentially weighted moving average (EWMA) control chart is employed as a detector for recognizing anomalies. We evaluate the proposed approach for the panel temperature and operating voltage of time-series streaming data recorded by wireless node devices deployed in harsh field conditions for environmental monitoring. Extensive experiments were conducted on real time-series status data. The results demonstrate that compared to other approaches, the MF-stacked LSTM-EWMA approach can significantly improve the detection rate (DR) and false rate (FR). The average DR and FR values with the proposed approach are 95.46% and 4.42%, respectively. MF-stacked LSTM-EWMA anomaly detection also achieves a better F2 score than that achieved by other methods. The proposed approach provides valuable insights for anomaly detection in WSNs by detecting anomalies in the time-series status data recorded by wireless sensor nodes.

Artificial Immune System for Fault Detection and Classification of Semiconductor Equipment

“…Research using multiple algorithms was also presented such as a fault detection study through applying an ensemble algorithm after selecting key SVID data with random forest and k-means clustering, evaluating selected data with k-nearest neighbors (KNN) and naive bayes classifiers [28]. A fault detection study of high-density plasma-chemical vapor deposition equipment through the autoencoder-based model, the study using the imputation data and algorithms like KNN, support vector machine, and logistic regression, and the anomaly detection study using the time-series data were conducted [29][30][31]. Research using plasma monitoring sensor data as well as SVID data also progressed.…”

An Enterprise Time Series Forecasting System for Cloud Applications Using Transfer Learning

“…where r t is the random walk r t = r t−1 + u t (14) with r 0 = c and u t from iid(0, σ 2 u ). Under the null-hypothesis, y t is trend-stationary if σ 2 u = 0.…”

“…Time series anomaly/outlier detection has been investigated by numerous authors for many applications [ 11 , 12 , 13 , 14 , 53 , 54 , 55 , 56 , 57 , 58 ]. It is known as a very hard problem with many diverse ramifications.…”

“…Time series collection and analysis is of great importance for various reasons like anomaly detection, anomaly prediction, correlations and capacity planning [ 11 , 12 , 13 , 14 , 15 ]. The administrators of cloud environments require automated forecasts of the future metric-data values for the prediction of the future states of application or infrastructure components.…”

Integrated Diagnostic Framework for Process and Sensor Faults in Chemical Industry

“…The sensor fault interferes with the stability of the system and affects the judgment of the operator, which may lead to fault. Therefore, it is very important to diagnose process faults and sensor faults in modern industrial processes [ 7 , 8 , 9 ].…”