A Comparative Study of Deep Reinforcement Learning-based Transferable Energy Management Strategies for Hybrid Electric Vehicles

Abstract

The deep reinforcement learning-based energy management strategies (EMS) has become a promising solution for hybrid electric vehicles (HEVs). When driving cycles are changed, the network will be retrained, which is a timeconsuming and laborious task. A more efficient way of choosing EMS is to combine deep reinforcement learning (DRL) with transfer learning, which can transfer knowledge of one domain to the other new domain, making the network of the new domain reach convergence values quickly. Different exploration methods of RL, including adding action space noise and parameter space noise, are compared against each other in the transfer learning process in this work. Results indicate that the network added parameter space noise is more stable and faster convergent than the others. In conclusion, the best exploration method for transferable EMS is to add noise in the parameter space, while the combination of action space noise and parameter space noise generally performs poorly. Our code is available at https://github.com/BIT-XJY/ RL-based-Transferable-EMS.git.

A novel cloud-edge collaboration based short-term load forecasting method for smart grid

“…In the smart grid, although users often have similar electricity consumption habits, they also have their characteristics (Xu et al, 2022). Using user privacy data to train prefabricated models at edge nodes not only ensures the security of user privacy but also ensures the accuracy and efficiency of prediction results.…”