Distributed deep reinforcement learning for optimal voltage control of PEMFC

Abstract

Proton exchange membrane fuel cells (PEMFCs) are promising components in the renewable energy field due to their high energy efficiency and low pollution output. However, these cells are also characterized by considerable nonlinearity, which in turn adversely affects the PEMFC output voltage. Conventional control algorithms cannot guarantee sufficient output voltage control, as they lack the robust adaptive ability required for adapting to these fluctuations in PEMFCs. In this paper, an optimal output voltage controller based on distributed deep reinforcement learning, which controls the output voltage by regulating the fuel input of the PEMFC, is proposed. In addition, an ensemble intelligence exploration multi-delay deep deterministic policy gradient (EIM-DDPG) algorithm is proposed for this controller. An ensemble intelligence exploration policy plus a classification experience replay mechanism are included within the EIM-DDPG algorithm to improve the exploration ability of the algorithm and thus increase the robustness and adaptive capability of the controller. As a result, the model-free optimal output voltage controller offers high robustness and adaptability. The simulation results in this paper demonstrate that the proposed optimal controller can realize the effective control of PEMFC output voltage.This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.

Robust NN‐based backstepping control of non‐affine ferry ship fuel cell‐based DC MGs under stochastic disturbance inputs

“…Whereas the state‐space model (19)‐(21) contains uncertainty terms, in this paper a robust adaptive mechanism based on the radial basis function (RBF) neural network is utilized. The RBF neural network estimates the uncertainties and deterministic disturbance inputs and includes that information with the control law to assure the closed‐loop stability and enhance the tracking issue performance.…”

Optimal gain‐scheduling control of proton exchange membrane fuel cell: An LMI approach

“…This makes electrical power. Furthermore, oxygen reacts with the extra protons and produces water and heat, at the cathode side [5].…”

“…Fuel Cells generate low-cost DC electrical energy from chemical reactions through which hydrogen reacts with oxygen to produce water and heat, instead of carbon dioxide [4,5]. The fuel cells can be considered as promising power suppliers of recent transportation utilities, especially naval ships [6,7].…”

“…Depending on the type of their electrolyte, fuel cells are classified into different classes. A proton exchange membrane fuel cell (PEMFC) contains a polymer electrolyte membrane and is the primary choice of hybrid electric vehicles and distributed power generation systems, because of its high power density, solid and flexible electrolyte, low operating temperature (50 to 100 °C), fast triggering, and less number of moving parts in comparison to other classes of fuel cells [5].…”

Control Method for PEMFC Using Improved Deep Deterministic Policy Gradient Algorithm

“…In order to obtain accurate and fast response results, various advanced control strategies have been applied in the research of PEMFC output control strategies. (Zhang et al, 2019;Li and Yu, 2021b;Zhang et al, 2021).…”