Learning-Based Adaptive Optimal Tracking Control of Strict-Feedback Nonlinear Systems

Abstract

This paper proposes a novel data-driven control approach to address the problem of adaptive optimal tracking for a class of nonlinear systems taking the strict-feedback form. Adaptive dynamic programming (ADP) and nonlinear output regulation theories are integrated for the first time to compute an adaptive near-optimal tracker without any a priori knowledge of the system dynamics. Fundamentally different from adaptive optimal stabilization problems, the solution to a Hamilton-Jacobi-Bellman (HJB) equation, not necessarily a positive definite function, cannot be approximated through the existing iterative methods. This paper proposes a novel policy iteration technique for solving positive semidefinite HJB equations with rigorous convergence analysis. A two-phase data-driven learning method is developed and implemented online by ADP. The efficacy of the proposed adaptive optimal tracking control methodology is demonstrated via a Van der Pol oscillator with time-varying exogenous signals.

Event‐triggered output consensus for heterogeneous multiagent systems with fixed and switching directed topologies

“…The matrices Π i and Γ i satisfy where S has no eigenvalues with negative real parts and ( S , H ) is observable. The above equations are also called regulator equations in output regulation theory …”

Extended Factitious Force Approach for Control of a Mobile Manipulator Moving on Unknown Terrain

“…In this paper a model of the mobile SSMP platform with 2R manipulator was investigated. However, in this article an adaptive algorithm [6] and robust algorithm are used to improve control quality in unknown terrain in terms of friction forces during the contact of platform wheels with the surface. The article presents results obtained during the simulations for mentioned two control algorithms -adaptive and robust dynamic control algorithm.…”

H∞ tracking control for linear discrete‐time systems via reinforcement learning

“…In recent decades, a large number of researches on the problem of H ∞ control have emerged . Meanwhile, the tracking control problem has been widely studied as it appears in many practical control applications . Combining tracking control with H ∞ control, it can attenuate the effects of disturbances on system and ensure the system trajectory tracks the reference signal.…”