The Quest for Model Uncertainty Quantification: A Hybrid Ensemble and Variational Data Assimilation Framework

Abstract

This article presents a novel approach to couple a deterministic four‐dimensional variational (4DVAR) assimilation method with the particle filter (PF) ensemble data assimilation system, to produce a robust approach for dual‐state‐parameter estimation. In our proposed method, the Hybrid Ensemble and Variational Data Assimilation framework for Environmental systems (HEAVEN), we characterize the model structural uncertainty in addition to model parameter and input uncertainties. The sequential PF is formulated within the 4DVAR system to design a computationally efficient feedback mechanism throughout the assimilation period. In this framework, the 4DVAR optimization produces the maximum a posteriori estimate of state variables at the beginning of the assimilation window without the need to develop the adjoint of the forecast model. The 4DVAR solution is then perturbed by a newly defined prior error covariance matrix to generate an initial condition ensemble for the PF system to provide more accurate and reliable posterior distributions within the same assimilation window. The prior error covariance matrix is updated from one cycle to another over the main assimilation period to account for model structural uncertainty resulting in an improved estimation of posterior distribution. The premise of the presented approach is that it (1) accounts for all sources of uncertainties involved in hydrologic predictions, (2) uses a small ensemble size, and (3) precludes the particle degeneracy and sample impoverishment. The proposed method is applied on a nonlinear hydrologic model and the effectiveness, robustness, and reliability of the method is demonstrated for several river basins across the United States.

A Mutual Information‐Based Likelihood Function for Particle Filter Flood Extent Assimilation

“…Abbaszadeh et al. (2019) suggest using the 4D‐variational method for this initial state optimization, but for the case of hydraulic models developing the adjoint model is a major scientific challenge. Moreover, selecting among several well‐performing models is incredibly difficult using binary flood extents.…”

Leveraging machine learning for predicting flash flood damage in the Southeast US

“…The flash flood events that caused property damage were randomly divided into two parts: training (85% of dataset) and testing (15% dataset). The result of the developed model are evaluated using two performance measures: correlation coefficient (R) and bias, both of which have been commonly used to measure the accuracy and performance of the ML models (Gavahi et al 2019, Neri et al 2019, Shastry and Durand 2019, Abbaszadeh et al 2019a. Here, the regression (i.e.…”

Deep‐Learning‐Based Adjoint State Method: Methodology and Preliminary Application to Inverse Modeling

“…Although very promising results have been achieved, the procedure of model linearization can be complicated for strongly nonlinear dynamic system. There are also other studies showed that the gradient‐based inverse modeling can be implemented without calculating the adjoint and tangent linear model when they are integrated with ensemble‐based data assimilation approaches (Abbaszadeh et al., 2019; Hernández & Liang, 2018).…”