Anomaly Detection Based on Mining Six Local Data Features and BP Neural Network

Abstract

Key performance indicators (KPIs) are time series with the format of (timestamp, value). The accuracy of KPIs anomaly detection is far beyond our initial expectations sometimes. The reasons include the unbalanced distribution between the normal data and the anomalies as well as the existence of many different types of the KPIs data curves. In this paper, we propose a new anomaly detection model based on mining six local data features as the input of back-propagation (BP) neural network. By means of vectorization description on a normalized dataset innovatively, the local geometric characteristics of one time series curve could be well described in a precise mathematical way. Differing from some traditional statistics data characteristics describing the entire variation situation of one sequence, the six mined local data features give a subtle insight of local dynamics by describing the local monotonicity, the local convexity/concavity, the local inflection property and peaks distribution of one KPI time series. In order to demonstrate the validity of the proposed model, we applied our method on 14 classical KPIs time series datasets. Numerical results show that the new given scheme achieves an average F1-score over 90%. Comparison results show that the proposed model detects the anomaly more precisely.

An Anomaly Detection Algorithm for Microservice Architecture Based on Robust Principal Component Analysis

“….., X n }, n is the dimension of the KPI vector X. In order to make full use of the information in the indicator data, six features [38] of the normalized KPI data x = (x 1 , x 2 , ..., x n ) are mined as input data for the subsequent anomaly detection algorithm (SLI Algorithm). Different from [38], we consider both local and global features of the data in feature extraction.…”

Research on BP neural network model based on feature engineering

“…Some scholars call feature engineering attribute selection. It refers to selecting some features from the existing features to optimize the prediction of the system 6 . In order to improve the performance of machine learning, we design an optimization scheme.…”