Optimal Tracking Control for Uncertain Nonlinear Systems With Prescribed Performance via Critic-Only ADP

Abstract

2014 to 2018. His current research interests include distributed parameter systems, intelligent control, reinforcement learning, deep learning, and computational intelligence. Dr. Luo was a recipient of the Chinese Association of Automation Outstanding Ph.D Dissertation Award in 2015.

Optimal trajectory tracking control for a class of nonlinear nonaffine systems via generalized N‐step value gradient learning

“…Observing (27), the inequality (1 − 𝛾𝜆)V 𝜆 i (e k ) − e T k Qe k < 0 holds. Therefore, the candidate Lyapuonv function…”

“…Assume that conditions V 𝜆 0 (e k ) ≥ V 𝜆 1 (e k ) and V 0 0 (e k ) ≥ V 0 1 (e k ) hold. If the discount factor satisfies (27), then the control policy u i+j (e k ) is stabilizing, j ∈ N + .…”

“…As an important branch of control problems, optimal tracking are common and have received enormous attention 21‐23 . ADP methods have been extensively employed to solve the optimal tracking problems 24‐29 . By establishing an augmented system consisting of the original system and command generator, Hou et al 30 developed a $$$ {H}_{\infty } $$$ tracking controller to solve the tracking problem for discrete time nonlinear systems.…”

“…[21][22][23] ADP methods have been extensively employed to solve the optimal tracking problems. [24][25][26][27][28][29] By establishing an augmented system consisting of the original system and command generator, Hou et al 30 developed a H ∞ tracking controller to solve the tracking problem for discrete time nonlinear systems. Via the augmented system, Kiumarsi et al 31 tackled the tracking control problem for constrained affine systems by adopting the policy evaluation and the policy improvement.…”

Reinforcement Learning-Based Structural Control of Floating Wind Turbines

“…It is specifically designed and developed to tackle the control of complex nonlinear systems. Typical examples include coal gasification [32], energy management systems [33], hypersonic vehicle tracking [34], microgrid system [35] and optimal tracking [36]. However, to the authors' knowledge, its application in structural control of floating turbines has not yet been explored.…”