This paper presents a reinforcement learning (RL)-based energy management strategy for a hybrid electric tracked vehicle. A control-oriented model of the powertrain and vehicle dynamics is first established. According to the sample information of the experimental driving schedule, statistical characteristics at various velocities are determined by extracting the transition probability matrix of the power request. Two RL-based algorithms, namely Q-learning and Dyna algorithms, are applied to generate optimal control solutions. The two algorithms are simulated on the same driving schedule, and the simulation results are compared to clarify the merits and demerits of these algorithms. Although the Q-learning algorithm is faster (3 h) than the Dyna algorithm (7 h), its fuel consumption is 1.7% higher than that of the Dyna algorithm. Furthermore, the Dyna algorithm registers approximately the same fuel consumption as the dynamic programming-based global optimal solution. The computational cost of the Dyna algorithm is substantially lower than that of the stochastic dynamic programming.
The Toyota Prius equipped with a combustion engine and two electric machines is a power-split hybrid electric vehicle. This hybrid electric vehicle uses a power-split planetary gear system to combine the benefits of series and parallel hybrid vehicles. This paper develops a dynamic model and then we apply it for the optimal control development. Dynamic Programming (DP) is utilized to minimize a combination of fuel consumption and selected emission species over a given driving cycle. A trade-off study between fuel economy and emissions was performed compared to the simulation results performed in ADVISOR. It was found that significant emission reduction could be achieved at the cost of just a small increase in fuel consumption.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.