Calibrating multi-dimensional complex ODE from noisy data via deep neural networks

Abstract

Ordinary differential equations (ODEs) are widely used to model complex dynamics that arises in biology, chemistry, engineering, finance, physics, etc. Calibration of a complicated ODE system using noisy data is generally very difficult. In this work, we propose a two-stage nonparametric approach to address this problem. We first extract the de-noised data and their higher order derivatives using boundary kernel method, and then feed them into a sparsely connected deep neural network with ReLU activation function. Our method is able to recover the ODE system without being subject to the curse of dimensionality and complicated ODE structure. When the ODE possesses a general modular structure, with each modular component involving only a few input variables, and the network architecture is properly chosen, our method is proven to be consistent. Theoretical properties are corroborated by an extensive simulation study that demonstrates the validity and effectiveness of the proposed method. Finally, we use our method to simultaneously characterize the growth rate of Covid-19 infection cases from 50 states of the USA.

Minimax optimal high-dimensional classification using deep neural networks

“…Hence, t u can be viewed as an intrinsic dimension of g u . Structure (6) has been adopted by [21,20,25,14,17] in multivariate regression using deep learning to address the "curse of dimensionality." Examples of ( 6) include generalized additive model [9,16], tensor product space ANOVA model [15], among others.…”

Variable Selection for Nonlinear Cox Regression Model via Deep Learning

“…Recently, deep learning has made great breakthroughs in a wide range of applications, such as natural language processing (Bahdanau et al (2014)), computer vision (He et al ( 2016)), dynamics system (Li et al (2021)), drug discovery and toxicology (Jiménez-Luna et al (2020)). Owing to the superior performance and good theoretical guarantees of deep learning, applying deep learning to survival data has also drawn much attention.…”

Deep Feature Screening: Feature Selection for Ultra High-Dimensional Data via Deep Neural Networks

“…Farrell et al (2021) studies the rates of convergence for deep feedforward neural nets in semiparametric inference. The successful applications include, but are not limited to, computer vision (He et al, 2016), natural language processing (Bahdanau et al, 2014), drug discovery and toxicology (Jiménez-Luna et al, 2020), and dynamics system (Li et al, 2021), functional data analysis (Wang et al, 2021).…”