Survey/review study
Adaptive Dynamic Programming for Networked Control Systems under Communication Constraints: A Survey of Trends and Techniques
Xueli Wang 1, Ying Sun 1,*, and Derui Ding 2
1 Department of Control Science and Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
2 School of Software and Electrical Engineering, Swinburne University of Technology, Melbourne 3122, Australia
* Correspondence: yingsun1991@163.com
Received: 22 September 2022
Accepted: 28 November 2022
Published: 22 December 2022
Abstract: The adaptive dynamic programming (ADP) technology has been widely used benefiting from its recursive structure in forward and the prospective conception of reinforcement learning. Furthermore, ADP-based control issues with communication constraints arouse ever-increasing research consideration in theoretical analysis and engineering applications due mainly to the wide participation of digital communications in industrial systems. The latest development of ADP-based optimal control with communication constraints is systematically surveyed in this paper. To this end, the development of ADP-based dominant methods is first investigated from their structures and implementation. Then, technical challenges and corresponding approaches are comprehensively and thoroughly discussed and the existing results are reviewed according to the constraint types. Furthermore, some applications of the ADP method in practical systems are summarized. Finally, future topics are lighted on ADP-based control issues.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.