Optimization of Tollmien-Schlichting waves control: comparison between a deep reinforcement learning and particle swarm optimization approach

Abstract

This work focuses on the suppression of Tollmien-Schlichting (TS) waves in a two-dimensional laminar boundary layer using optimized unsteady suction and blowing jets as an Active Flow Control (AFC) method. The suppression of TS waves via this AFC system is enabled through two artificial intelligence-based optimization methodologies: Single-Step Deep Reinforcement Learning (SDRL) and Particle Swarm Optimization (PSO). The primary aim of this research is to assess the performance of these methods in optimizing the AFC parameters with respect to convergence rate, computational efficiency, and ability to find an optimum control state. The findings demonstrate the success of both methods in finding appropriate control parameters resulting in TS wave attenuation by up to 40 dB in the maximum convective instability amplitude for the linear and nonlinear stages of development. The comparative study in this paper presents the effectiveness of the SDRL algorithm in optimizing the AFC system for TS waves' suppression and demonstrates that it can outperform PSO in terms of convergence rate and computational efficiency alongside a better performance in finding an improved optimum for linear control cases. However, the advantage of the SDRL-based controller over the PSO-based one diminishes in multi-frequency nonlinear control cases where the controller is located downstream and attempting to control highly amplified multi-modal TS waves.