Multi-Sequence LSTM-RNN Deep Learning and Metaheuristics for Electric Load Forecasting

Abstract

Short term electric load forecasting plays a crucial role for utility companies, as it allows for the efficient operation and management of power grid networks, optimal balancing between production and demand, as well as reduced production costs. As the volume and variety of energy data provided by building automation systems, smart meters, and other sources are continuously increasing, long short-term memory (LSTM) deep learning models have become an attractive approach for energy load forecasting. These models are characterized by their capabilities of learning long-term dependencies in collected electric data, which lead to accurate prediction results that outperform several alternative statistical and machine learning approaches. Unfortunately, applying LSTM models may not produce acceptable forecasting results, not only because of the noisy electric data but also due to the naive selection of its hyperparameter values. Therefore, an optimal configuration of an LSTM model is necessary to describe the electric consumption patterns and discover the time-series dynamics in the energy domain. Finding such an optimal configuration is, on the one hand, a combinatorial problem where selection is done from a very large space of choices; on the other hand, it is a learning problem where the hyperparameters should reflect the energy consumption domain knowledge, such as the influential time lags, seasonality, periodicity, and other temporal attributes. To handle this problem, we use in this paper metaheuristic-search-based algorithms, known by their ability to alleviate search complexity as well as their capacity to learn from the domain where they are applied, to find optimal or near-optimal values for the set of tunable LSTM hyperparameters in the electrical energy consumption domain. We tailor both a genetic algorithm (GA) and particle swarm optimization (PSO) to learn hyperparameters for load forecasting in the context of energy consumption of big data. The statistical analysis of the obtained result shows that the multi-sequence deep learning model tuned by the metaheuristic search algorithms provides more accurate results than the benchmark machine learning models and the LSTM model whose inputs and hyperparameters were established through limited experience and a discounted number of experimentations.

Multimodal Emotion Recognition using Deep Learning

“…With the recent developments in Deep Learning (DL) architectures, deep learning has been applied [59] in multimodal emotion recognition. Deep learning techniques include deep belief net, deep Convolutional neural network, LSTM [60],support vector machine (SVM) [61],and their combination [27]. The suggested cLSTM-MMA alone is as successful in terms of precision as other fusion approaches but with a much more compact network structure.…”

Household Electricity Load Forecasting Based on Multitask Convolutional Neural Network with Profile Encoding

“…It is rather a hard problem for which an optimal solution cannot be found in a polynomial time. is hardness is accentuated by the complexity of electricity-consumption data patterns [44]. One effective strategy to acquire an optimal configuration in forecasting model depends on metaheuristics approaches [45][46][47][48][49][50][51][52][53][54][55][56] with excellent capability of finding near-optimal solutions in a very large space.…”

An attention‐based CNN‐LSTM‐BiLSTM model for short‐term electric load forecasting in integrated energy system

“…LSTM can effectively solve the problem of RNN in the training process, and it performs better in longer time series data. LSTM has been used for electric load forecasting in research 22‐24 . Bidirectional LSTM (BiLSTM) is the combination of forward LSTM and backward LSTM, which can fit the data from the forward and reverse directions of the sequence to achieve higher prediction accuracy.…”