This article proposes an adaptive dynamic programmingâbased adaptiveâgain sliding mode control (ADPâASMC) scheme for a fixedâwing unmanned aerial vehicle (UAV) with matched and unmatched disturbances. Starting from the dynamic of fixedâwing UAV, the controlâoriented model composed of attitude subsystem and airspeed subsystem is established. According to the different issues in two subsystems, two novel adaptiveâgain generalized superâtwisting (AGST) algorithms are developed to eliminate the effects of disturbances in two subsystems and make the system trajectories tend to the designed integral sliding manifolds in finite time. Then, based on the expected equivalent slidingâmode dynamics, the modified adaptive dynamic programming approach with actorâcritic structure is utilized to generate the nearly optimal control laws and achieve the nearly optimal performance of the slidingâmode dynamics. Furthermore, through the Lyapunov stability theorem, the tracking errors and the weight estimation errors of two neural networks are all uniformly ultimately bounded. Finally, comparative simulations demonstrate the superior performance of the proposed control scheme for the fixedâwing UAV.