“…Different machine learning algorithms have been proposed to solve the content placement and update problem at caches (and in some cases the delivery problem), such as Transfer learning [ 136 , 137 ], deep Q-learning [ 34 , 138 , 139 , 140 ], Actor-Critic [ 141 , 142 ], multi-agent multi-armed bandits (MMBAs) [ 143 , 144 ], 3D-CNN [ 145 ], LSTM networks [ 146 , 147 ], among other methods. Reinforcement learning algorithms are often preferred, as cache updates can be modelled as a Markov Decision Process [ 34 , 138 , 139 , 140 , 141 , 142 , 143 , 144 ], while deep learning supervised learning methods [ 145 , 146 , 147 ] are used to capture the trends in the evolution of the video requests. These trends are then used to optimize the content placement and the cache updates.…”