Deep Ensemble Learning Model for Short-Term Load Forecasting within Active Learning Framework

Abstract

Short term load forecasting (STLF) is one of the basic techniques for economic operation of the power grid. Electrical load consumption can be affected by both internal and external factors so that it is hard to forecast accurately due to the random influencing factors such as weather. Besides complicated and numerous internal patterns, electrical load shows obvious yearly, seasonal, and weekly quasi-periodicity. Traditional regression-based models and shallow neural network models cannot accurately learn the complicated inner patterns of the electrical load. Long short-term memory (LSTM) model features a strong learning capacity to capture the time dependence of the time series and presents the state-of-the-art performance. However, as the time span increases, LSTM becomes much harder to train because it cannot completely avoid the vanishing gradient problem in recurrent neural networks. Then, LSTM models cannot capture the dependence over large time span which is of potency to enhance STLF. Moreover, electrical loads feature data imbalance where some load patterns in high/low temperature zones are more complicated but occur much less often than those in mild temperature zones, which severely degrades the LSTM-based STLF algorithms. To fully exploit the information beneath the high correlation of load segments over large time spans and combat the data imbalance, a deep ensemble learning model within active learning framework is proposed, which consists of a selector and a predictor. The selector actively selects several key load segments with the most similar pattern as the current one to train the predictor, and the predictor is an ensemble learning-based deep learning machine integrating LSTM and multi-layer preceptor (MLP). The LSTM is capable of capturing the short-term dependence of the electrical load, and the MLP integrates both the key history load segments and the outcome of LSTM for better forecasting. The proposed model was evaluated over an open dataset, and the results verify its advantage over the existing STLF models.

Performance comparison of single and ensemble CNN, LSTM and traditional ANN models for short‐term electricity load forecasting

“…In [31], the authors used two sequentially placed LSTMs for STELF. The input to the first LSTM network consisted of training data that were most similar to the current load samples.…”

Wear Fault Diagnosis of Aeroengines Based on Broad Learning System and Ensemble Learning

“…Ensemble learning is built by constructing multiple parallel estimators [36,37], combining the learning results of multiple classifiers in order to obtain better generalization ability and robustness than a single classifier. The principle of this method is to build multiple independent learners, and then, take the average of their predicted results.…”

Multi-Step Hourly Power Consumption Forecasting in a Healthcare Building with Recurrent Neural Networks and Empirical Mode Decomposition

“…Thus, it seems logical to assume that they can also provide accurate predictions in time series forecasting, as a great amount of data, with strong time dependency, is usually used to obtain future values. Therefore, they have been used to predict electric energy load [ 1 , 4 , 5 , 14 , 35 , 36 , 37 , 38 ], electricity prices [ 29 ] energy production in photovoltaic plants [ 39 ], consumption in residential areas [ 7 ] and buildings [ 8 , 9 ] or CO 2 emission allowance prices [ 40 ].…”