Network Traffic Prediction Based on LSTM and Transfer Learning

Abstract

The increasing amount of traffic in recent years has led to increasingly complex network problems. To be able to improve overall network performance and increase network utilization, it is valuable to take measures to capture future trends in network traffic. In traditional machine learning, to guarantee the accuracy and high reliability of the models obtained through training, there are two basic assumptions: (1) the training samples used for learning and the new test samples satisfy the condition of independent identical distribution; and (2) there must be enough training samples to learn a good model. However, time-series data are not easily accessible in real life, and even after putting in a lot of time and effort to collect them, the data may be unavailable due to confidentiality. In this paper, a neural network model based on LSTM and transfer learning is proposed to address the problem of small sample size in network traffic prediction. Knowledge in the source domain is transferred to the target domain using transfer learning, and a prediction model with good performance is constructed with a small amount of target domain data. The results show that the performance of the transfer learning model improves by more than 40% over the direct training model when using the same samples for predicting 10,000 rows of data, resulting in better performance of the network traffic prediction task.INDEX TERMS LSTM, network traffic prediction, transfer learning.

Dynamic multiple-graph spatial-temporal synchronous aggregation framework for traffic prediction in intelligent transportation systems

“…GraphSAGE has also been used to model spatial dependency for inductive learning ( Liu et al, 2023 ; Liu, Ong & Chen, 2022 ). Temporal modules based on RNN and its LSTM, as well as GRU, have been introduced to learn temporal dependence ( Pan et al, 2022 ; Subramaniyan et al, 2023 ; Bao et al, 2022 ; Shu, Cai & Xiong, 2022 ; Wan et al, 2022 ). To improve computational efficiency, some studies employed CNN instead of RNN to model temporal correlation ( Ji, Yu & Lei, 2023 ; Zhang et al, 2022 ).…”

A novel Sybil attack detection scheme in mobile IoT based on collaborate edge computing

“…At present, the position prediction algorithm has been more mature, such as work [38][39][40][41][42]. Considering the accuracy of prediction and the complexity of the algorithm for edge nodes, we use the long short-term memory (LSTM) model to predict the position of u i based on the historical position of u i , and we call it point N p (x p , y p ) .…”

Towards a new intelligent traffic system based on deep learning and data integration

“…According to Figure 4, the output gate regulates how cell activations exit into the remainder of the network. The memory block afterwards received the forget gate [17]. Before adding it as input to the cell through the self-recurrent connection, the forget gate scales the internal state of the cell [18], [19].…”