Recurrent neural networks for dynamical systems: Applications to ordinary differential equations, collective motion, and hydrological modeling

Abstract

Classical methods of solving spatiotemporal dynamical systems include statistical approaches such as autoregressive integrated moving average, which assume linear and stationary relationships between systems’ previous outputs. Development and implementation of linear methods are relatively simple, but they often do not capture non-linear relationships in the data. Thus, artificial neural networks (ANNs) are receiving attention from researchers in analyzing and forecasting dynamical systems. Recurrent neural networks (RNNs), derived from feed-forward ANNs, use internal memory to process variable-length sequences of inputs. This allows RNNs to be applicable for finding solutions for a vast variety of problems in spatiotemporal dynamical systems. Thus, in this paper, we utilize RNNs to treat some specific issues associated with dynamical systems. Specifically, we analyze the performance of RNNs applied to three tasks: reconstruction of correct Lorenz solutions for a system with a formulation error, reconstruction of corrupted collective motion trajectories, and forecasting of streamflow time series possessing spikes, representing three fields, namely, ordinary differential equations, collective motion, and hydrological modeling, respectively. We train and test RNNs uniquely in each task to demonstrate the broad applicability of RNNs in the reconstruction and forecasting the dynamics of dynamical systems.

Quantum Recurrent Neural Networks: Predicting the Dynamics of Oscillatory and Chaotic Systems

“…This capability allows for the modeling of complex systems with high degrees of freedom and nonlinearity, providing a flexible and potentially more accurate alternative to traditional methods. Consequently, the use of RNNs in solving ODEs, especially systems of ODEs, represents a significant shift towards data-driven approaches in the prediction of dynamical [19][20][21][22] and time series chaotic systems [23][24][25][26].…”

Artificial physics engine for real-time inverse dynamics of arm and hand movement

“…The main contribution of this work is the methodology for separately solving spatiotemporal dynamics corresponding to limb physics that can be combined with our previous solutions of musculoskeletal relationships (Sobinov et al 2020;Smirnov et al 2021). The ANNbased solutions of spatiotemporal characteristics in dynamical systems have been recently shown for the relatively simple Lorenz system (Park et al 2022). The representation of accurate arm dynamics with the ANN formulation is the focus of this study.…”

On the dynamics of a Riccati differential equation with perturbed delay A. M. A. EL-SAYED, S. M. SALMAN, A. A. F. ABDELFATTAH

“…Modeling and interpreting these phenomena may be greatly aided by studying dynamical systems. Synchronization and chaos control, secure communications, brain research, machine learning, electrical circuits, cryptography, and image encryption are just a few of the numerous fields that benefit from the study of dynamical systems [4][5][6][7][8][9].…”