Data-driven online unfalsified control by using analytic center

Saeki, Masami; Kondo, Katsuya; Wada, Nobutaka; Satoh, Shin’ichi

doi:10.1109/cdc.2014.7039696

Cited by 1 publication

(1 citation statement)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Recent projects for data-driven on-line controllers, data-driven for navigation system, pilot air-crafting and adaptive dweel-time switching using the methodology "Unfalsified Control" are discussed in (Saeki, Kondo, Wada, & Satoh, 2014;Yongqiang, Jiabin, Xiaochun, & Nan, 2015;Liming, Shan, & Dan, 2015;Sajjanshetty & Safonov, 2015), respectively.…”

Section: Sampled Data From Experiments Are Largely Described By Markomentioning

confidence: 99%

Tuning heuristics and convergence analysis of reinforcement learning algorithm for online data-based optimal control design

Silva

Neto

2020

RSD

View full text Add to dashboard Cite

A heuristic for tuning and convergence analysis of the reinforcement learning algorithm for control with output feedback with only input / output data generated by a model is presented. To promote convergence analysis, it is necessary to perform the parameter adjustment in the algorithms used for data generation, and iteratively solve the control problem. A heuristic is proposed to adjust the data generator parameters creating surfaces to assist in the convergence and robustness analysis process of the optimal online control methodology. The algorithm tested is the discrete linear quadratic regulator (DLQR) with output feedback, based on reinforcement learning algorithms through temporal difference learning in the policy iteration scheme to determine the optimal policy using input / output data only. In the policy iteration algorithm, recursive least squares (RLS) is used to estimate online parameters associated with output feedback DLQR. After applying the proposed tuning heuristics, the influence of the parameters could be clearly seen, and the convergence analysis facilitated.

show abstract

Section: Sampled Data From Experiments Are Largely Described By Markomentioning

confidence: 99%