Evaluation of Optimization Algorithms and Noise Robustness of Sparsity-Promoting Dynamic Mode Decomposition

Abstract

In the present study, we organize the existing sparsity-promoting dynamic mode decomposition (DMDsp) in terms of noise robustness, propose faster optimization algorithm for DMDsp, and evaluate its characteristics. Two kinds of DMDsp, namely system-based DMDsp (sDMDsp) and observationbased DMDsp (oDMDsp), combined with three kinds of optimization algorithm, namely the fast iterative shrinkage thresholding algorithm (FISTA), the alternating direction method of multipliers (ADMM), and a greedy algorithm, are investigated. For both sDMDsp and oDMDsp, FISTA yields the shortest processing time. The processing time for sDMDsp with FISTA is shorter than that for oDMDsp with FISTA. The original data reconstruction errors for sDMDsp and oDMDsp are similar among the three optimization algorithms. The noise robustness for sDMDsp and oDMDsp is evaluated. sDMDsp and oDMDsp have similar robustness to observation noise, except for a system with large system and observation noise, for which oDMDsp outperforms sDMDsp.INDEX TERMS Data analysis, Fluid dynamics, Modal analysis, Optimization method, System dynamics.

Objective Model Selection in Physics: Exploring the Finite Information Quantity Approach

“…3) Robustness to noise: Optimization techniques are often robust to noise in the objective function or parameter estimates. They can handle noisy or imperfect data and still converge to reasonable solutions, making them suitable for real-world applications where data quality may be less than ideal [45].…”

Efficient Sensor Node Selection for Observability Gramian Optimization

“…The optimization of sensor positions was intensively discussed in order to determine the most representative sensors and to reduce the resulting estimation error, such as when monitoring sensor networks [1][2][3][4], fluid flows around objects [5][6][7][8][9][10][11][12][13][14][15], plants and factories [16][17][18], infrastructures [19][20][21], circuits [22], and biological systems [23], estimating physical field [24][25][26][27], and localizing sources [28,29]. Recent advances in data science techniques have enabled us to extract reduced-order models from vastly large-scale measurements of complex phenomena [30][31][32][33][34][35][36][37][38][39]. Therefore, the optimized sensor measurement is gaining importance for the reconstruction of complex phenomena from sensor measurements based on the data-driven reduced-order models [40,41], as well as for model-free machine learning [42,43] and data assimilation …”