Deep Reinforcement Learning for Edge Caching with Mobility Prediction in Vehicular Networks

Abstract

As vehicles are connected to the Internet, various services can be provided to users. However, if the requests of vehicle users are concentrated on the remote server, the transmission delay increases, and there is a high possibility that the delay constraint cannot be satisfied. To solve this problem, caching can be performed at a closer proximity to the user which in turn would reduce the latency by distributing requests. The road side unit (RSU) and vehicle can serve as caching nodes by providing storage space closer to users through a mobile edge computing (MEC) server and an on-board unit (OBU), respectively. In this paper, we propose a caching strategy for both RSUs and vehicles with the goal of maximizing the caching node throughput. The vehicles move at a greater speed; thus, if positions of the vehicles are predictable in advance, this helps to determine the location and type of content that has to be cached. By using the temporal and spatial characteristics of vehicles, we adopted a long short-term memory (LSTM) to predict the locations of the vehicles. To respond to time-varying content popularity, a deep deterministic policy gradient (DDPG) was used to determine the size of each piece of content to be stored in the caching nodes. Experiments in various environments have proven that the proposed algorithm performs better when compared to other caching methods in terms of the throughput of caching nodes, delay constraint satisfaction, and update cost.

Effect of vitamin energy drinks on relieving exercise-induced fatigue in muscle group by ultrasonic bioimaging data analysis

“…Long short-term memory (LSTM) [ 22 , 23 ] was utilized to identify muscle fatigue state. The number of layers of the LSTM model is set as input layer, hidden layer, and output layer through the query of relevant research literature, and the unit is 100.…”

Enhancing Heterogeneous Network Performance: Advanced Content Popularity Prediction and Efficient Caching

“…Furthermore, mobile edge computing (MEC) improves quality of experience (QoE) and quality of service (QoS) by storing content in network edge nodes, reducing the distance and time of data transmission. However, edge-caching strategies face numerous challenges when dealing with increasingly diverse content and varying user behaviors [12]. For instance, limited caching resources must be effectively utilized to store the most popular content while also considering how to rapidly respond to changes in user behavior.…”