Hybrid forecasting: blending climate predictions with AI models

Abstract

Abstract. Hybrid hydroclimatic forecasting systems employ data-driven (statistical or machine learning) methods to harness and integrate a broad variety of predictions from dynamical, physics-based models – such as numerical weather prediction, climate, land, hydrology, and Earth system models – into a final prediction product. They are recognized as a promising way of enhancing the prediction skill of meteorological and hydroclimatic variables and events, including rainfall, temperature, streamflow, floods, droughts, tropical cyclones, or atmospheric rivers. Hybrid forecasting methods are now receiving growing attention due to advances in weather and climate prediction systems at subseasonal to decadal scales, a better appreciation of the strengths of AI, and expanding access to computational resources and methods. Such systems are attractive because they may avoid the need to run a computationally expensive offline land model, can minimize the effect of biases that exist within dynamical outputs, benefit from the strengths of machine learning, and can learn from large datasets, while combining different sources of predictability with varying time horizons. Here we review recent developments in hybrid hydroclimatic forecasting and outline key challenges and opportunities for further research. These include obtaining physically explainable results, assimilating human influences from novel data sources, integrating new ensemble techniques to improve predictive skill, creating seamless prediction schemes that merge short to long lead times, incorporating initial land surface and ocean/ice conditions, acknowledging spatial variability in landscape and atmospheric forcing, and increasing the operational uptake of hybrid prediction schemes.

Machine learning in financial forecasting: A U.S. review: Exploring the advancements, challenges, and implications of AI-driven predictions in financial markets

“…Additionally, the study highlights the computational demands of hybrid and AI-based models, suggesting that optimizing these models for computational efficiency could be a crucial step forward. Slater et al (2023) discuss the concept of hybrid forecasting, which blends climate predictions with AI models. The challenge here lies in the integration of diverse data sources and models to produce accurate forecasts.…”

Synthetic Forecast Ensembles for Evaluating Forecast Informed Reservoir Operations

“…Some advanced forecast models in operational use have even shorter hindcast periods (e.g., 1989—present for NCEP‐GEFS v12, Guan et al., 2019). While data‐driven streamflow forecasting can alleviate some of the computational burdens around hindcast development, they either are limited to using antecedent streamflow, basin conditions, and climatological weather sequences as inputs, thereby limiting skill for medium‐range forecasting (Troin et al., 2021), or they use remotely sensed or climate model forecast information as input and therefore cannot extend prior to the satellite era (Nevo et al., 2022; Slater et al., 2023).…”

Interpretable Structural Model Error Discovery From Sparse Assimilation Increments Using Spectral Bias‐Reduced Neural Networks: A Quasi‐Geostrophic Turbulence Test Case

“…Then, for out-ofsample states (that are from the same distribution as those of the training), the ANN predicts the systematic model tendency correction needed to nudge the state of NWP or climate model, thus improving the trajectory and potentially the simulated statistics. While ANNs are powerfully expressive, they have a number of major shortcomings: (a) they are difficult to interpret, (b) they do not generalize to out-of-distribution, (c) they are datahungry, and (d) their predictions fed into numerical models can cause instabilities and unphysical drifts (Bretherton et al, 2022;Clark et al, 2022;Farchi et al, 2023;Guan et al, 2022;Pahlavan et al, 2024;Slater et al, 2023;Subel et al, 2023). Challenges with interpretability hinder understanding the root cause(s) of the model errors and fixing them.…”