In the context of science, the well-known adage "a picture is worth a thousand words" might well be "a model is worth a thousand datasets." Scientific models, such as Newtonian physics or biological gene regulatory networks, are human-driven simplifications of complex phenomena that serve as surrogates for the countless experiments that validated the models. Recently, machine learning has been able to overcome the inaccuracies of approximate modeling by directly learning the entire set of nonlinear interactions from data. However, without any predetermined structure from the scientific basis behind the problem, machine learning approaches are flexible but data-expensive, requiring large databases of homogeneous labeled training data. A central challenge is reconciling data that is at odds with simplified models without requiring "big data". In this work we develop a new methodology, universal differential equations (UDEs), which augments scientific models with machinelearnable structures for scientifically-based learning. We show howUDEs can be utilized to discover previously unknown governing equations, accurately extrapolate beyond the original data, and accelerate model simulation, all in a time and data-efficient manner. This advance is coupled with open-source software that allows for training UDEs which incorporate physical constraints, delayed interactions, implicitly-defined events, and intrinsic stochasticity in the model. Our examples show how a diverse set of computationallydifficult modeling issues across scientific disciplines, from automatically discovering biological mechanisms to accelerating climate simulations by 15,000x, can be handled by training UDEs.

In the context of science, the well-known adage “a picture is worth a thousand words” might well be “a model is worth a thousand datasets.” Scientific models, such as Newtonian physics or biological gene regulatory networks, are human-driven simplifications of complex phenomena that serve as surrogates for the countless experiments that validated the models. Recently, machine learning has been able to overcome the inaccuracies of approximate modeling by directly learning the entire set of nonlinear interactions from data. However, without any predetermined structure from the scientific basis behind the problem, machine learning approaches are flexible but data-expensive, requiring large databases of homogeneous labeled training data. A central challenge is reconciling data that is at odds with simplified models without requiring "big data". In this work demonstrate how a mathematical object, which we denote universal differential equations (UDEs), can be utilized as a theoretical underpinning to a diverse array of problems in scientific machine learning to yield efficient algorithms and generalized approaches. The UDE model augments scientific models with machine-learnable structures for scientifically-based learning. We show how UDEs can be utilized to discover previously unknown governing equations, accurately extrapolate beyond the original data, and accelerate model simulation, all in a time and data-efficient manner. This advance is coupled with open-source software that allows for training UDEs which incorporate physical constraints, delayed interactions, implicitly-defined events, and intrinsic stochasticity in the model. Our examples show how a diverse set of computationally-difficult modeling issues across scientific disciplines, from automatically discovering biological mechanisms to accelerating the training of physics-informed neural networks and large-eddy simulations, can all be transformed into UDE training problems that are efficiently solved by a single software methodology.

Deep-sea polymetallic nodule mining research activity has substantially increased in recent years, but the expected level of environmental impact is still being established. One environmental concern is the discharge of a sediment plume into the midwater column. We performed a dedicated field study using sediment from the Clarion Clipperton Fracture Zone. The plume was monitored and tracked using both established and novel instrumentation, including acoustic and turbulence measurements. Our field studies reveal that modeling can reliably predict the properties of a midwater plume in the vicinity of the discharge and that sediment aggregation effects are not significant. The plume model is used to drive a numerical simulation of a commercial-scale operation in the Clarion Clipperton Fracture Zone. Key takeaways are that the scale of impact of the plume is notably influenced by the values of environmentally acceptable threshold levels, the quantity of discharged sediment, and the turbulent diffusivity in the Clarion Clipperton Fracture Zone.

Recent advances in high-resolution imaging techniques and particle-based simulation methods have enabled the precise microscopic characterization of collective dynamics in various biological and engineered active matter systems. In parallel, data-driven algorithms for learning interpretable continuum models have shown promising potential for the recovery of underlying partial differential equations (PDEs) from continuum simulation data. By contrast, learning macroscopic hydrodynamic equations for active matter directly from experiments or particle simulations remains a major challenge. Here, we present a framework that leverages spectral basis representations and sparse regression algorithms to discover PDE models from microscopic simulation and experimental data, while incorporating the relevant physical symmetries. We illustrate the practical potential through applications to a chiral active particle model mimicking swimming cells and to recent microroller experiments. In both cases, our scheme learns hydrodynamic equations that reproduce quantitatively the self-organized collective dynamics observed in the simulations and experiments. The inference framework makes it possible to measure hydrodynamic parameters directly and simultaneously from video data.

No abstract

Recent advances in high-resolution imaging techniques and particle-based simulation methods have enabled the precise microscopic characterization of collective dynamics in various biological and engineered active matter systems. In parallel, data-driven algorithms for learning interpretable continuum models have shown promising potential for the recovery of underlying partial differential equations (PDEs) from continuum simulation data. By contrast, learning macroscopic hydrodynamic equations for active matter directly from experiments or particle simulations remains a major challenge, especially when continuum models are not known a priori or analytic coarse graining fails, as often is the case for nondilute and heterogeneous systems. Here, we present a framework that leverages spectral basis representations and sparse regression algorithms to discover PDE models from microscopic simulation and experimental data, while incorporating the relevant physical symmetries. We illustrate the practical potential through a range of applications, from a chiral active particle model mimicking nonidentical swimming cells to recent microroller experiments and schooling fish. In all these cases, our scheme learns hydrodynamic equations that reproduce the self-organized collective dynamics observed in the simulations and experiments. This inference framework makes it possible to measure a large number of hydrodynamic parameters in parallel and directly from video data.

No abstract

Motivated in part by the complex flow patterns observed in planetary atmospheres, we investigate generalized Navier-Stokes (GNS) equations that couple nonlinear advection with a generic linear instability. This analytically tractable minimal model for fluid flows driven by internal active stresses has recently been shown to permit exact solutions on a stationary 2D sphere. Here, we extend the analysis to linearly driven flows on rotating spheres, as relevant to quasi-2D atmospheres. We derive exact solutions of the GNS equations corresponding to time-independent zonal jets and superposed westwardpropagating Rossby waves. Direct numerical simulations with large rotation rates obtain statistically stationary states close to these exact solutions. The measured phase speeds of waves in the GNS simulations agree with analytical predictions for Rossby waves.