In this paper, a new nonlinear controller for a quadrotor unmanned aerial vehicle (UAV) is proposed using neural networks (NNs) and output feedback. The assumption on the availability of UAV dynamics is not always practical, especially in an outdoor environment. Therefore, in this work, an NN is introduced to learn the complete dynamics of the UAV online, including uncertain nonlinear terms like aerodynamic friction and blade flapping. Although a quadrotor UAV is underactuated, a novel NN virtual control input scheme is proposed which allows all six degrees of freedom (DOF) of the UAV to be controlled using only four control inputs. Furthermore, an NN observer is introduced to estimate the translational and angular velocities of the UAV, and an output feedback control law is developed in which only the position and the attitude of the UAV are considered measurable. It is shown using Lyapunov theory that the position, orientation, and velocity tracking errors, the virtual control and observer estimation errors, and the NN weight estimation errors for each NN are all semiglobally uniformly ultimately bounded (SGUUB) in the presence of bounded disturbances and NN functional reconstruction errors while simultaneously relaxing the separation principle. The effectiveness of proposed output feedback control scheme is then demonstrated in the presence of unknown nonlinear dynamics and disturbances, and simulation results are included to demonstrate the theoretical conjecture.

In this paper, the Hamilton-Jacobi-Bellman equation is solved forward-in-time for the optimal control of a class of general affine nonlinear discrete-time systems without using value and policy iterations. The proposed approach, referred to as adaptive dynamic programming, uses two neural networks (NNs), to solve the infinite horizon optimal regulation control of affine nonlinear discrete-time systems in the presence of unknown internal dynamics and a known control coefficient matrix. One NN approximates the cost function and is referred to as the critic NN, while the second NN generates the control input and is referred to as the action NN. The cost function and policy are updated once at the sampling instant and thus the proposed approach can be referred to as time-based ADP. Novel update laws for tuning the unknown weights of the NNs online are derived. Lyapunov techniques are used to show that all signals are uniformly ultimately bounded and that the approximated control signal approaches the optimal control input with small bounded error over time. In the absence of disturbances, an optimal control is demonstrated. Simulation results are included to show the effectiveness of the approach. The end result is the systematic design of an optimal controller with guaranteed convergence that is suitable for hardware implementation.

In this paper, the optimal regulation and tracking control of affine nonlinear continuous-time systems with known dynamics is undertaken using a novel single online approximator (SOL)-based scheme. The SOLA-based adaptive approach is designed to learn the infinite horizon continuoustime Hamilton-Jacobi-Bellman (HJB) equation and its corresponding optimal control input. A novel parameter tuning algorithm is derived which not only ensures the optimal cost (HJB) function and control input are achieved, but also ensures the system states remain bounded during the online learning process. Lyapunov techniques show that all signals are uniformly ultimately bounded (UUB) and the approximated control signal approaches the optimal control input with small bounded error. In the absence of OLA reconstruction errors, asymptotic convergence to the optimal control is shown. Simulation results illustrate the effectiveness of the approach.

No abstract

In this paper, an asymptotically stable (AS) combined kinematic/torque control law is developed for leader-follower-based formation control using backstepping in order to accommodate the complete dynamics of the robots and the formation, and a neural network (NN) is introduced along with robust integral of the sign of the error feedback to approximate the dynamics of the follower as well as its leader using online weight tuning. It is shown using Lyapunov theory that the errors for the entire formation are AS and that the NN weights are bounded as opposed to uniformly ultimately bounded stability which is typical with most NN controllers. Additionally, the stability of the formation in the presence of obstacles is examined using Lyapunov methods, and by treating other robots in the formation as obstacles, collisions within the formation do not occur. The asymptotic stability of the follower robots as well as the entire formation during an obstacle avoidance maneuver is demonstrated using Lyapunov methods, and numerical results are provided to verify the theoretical conjectures.