The ESCAPE project: Energy-efficient Scalable Algorithms for Weather Prediction at Exascale

Müller, Andreas; Deconinck, Willem; Kühnlein, Christian; Mengaldo, Gianmarco; Lange, Michael; Wedi, Nils; Bauer, Péter; Smolarkiewicz, Piotr K.; Diamantakis, Michail; Lock, Sarah‐Jane; Hamrud, Mats; Saarinen, Sami; Mozdzynski, George; Thiemert, Daniel; Glinton, Michael; Bénard, Pierre; Voitus, Fabrice; Colavolpe, Charles; Marguinaud, Philippe; Zheng, Yongjun; Bever, J. Van; Degrauwe, Daan; Smet, Geert; Termonia, Piet; Nielsen, Kristian Pagh; Sass, Bent Hansen; Poulsen, Jacob Weismann; Berg, Peter; Osuna, Carlos; Fuhrer, Oliver; Clément, Valentin; Baldauf, Michael; Gillard, Mike; Szmelter, Joanna; O'Brien, Enda; McKinstry, Alastair; Robinson, Oisín; Shukla, Parijat; Lysaght, Michael; Kulczewski, Michal; Ciznicki, Milosz; Piątek, Wojciech; Ciesielski, Sebastian; Błażewicz, Marek; Kurowski, Krzysztof; Procyk, Marcin; Spychala, Pawel; Bosak, Bartosz; Piotrowski, Zbigniew; Wyszogrodzki, Andrzej A.; Raffin, Erwan; Mazauric, Cyril; Guibert, David; Douriez, Louis; Vigouroux, Xavier; Gray, Alan; Messmer, Peter; Macfaden, Alexander J.; New, Nick

doi:10.5194/gmd-12-4425-2019

Cited by 25 publications

(16 citation statements)

References 34 publications

(42 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In performing the 1.4 km simulation, the focus was placed on the efficient use of CPUs on Summit. A GPU acceleration of the spectral transforms that has already shown great promise (Müller et al, 2019) was not yet available for the simulations presented here. With the use of GPUs in the future, we anticipate to further reduce the cost of transforms and therefore to increase the throughput of the 1.4 km simulations.…”

Section: Discussionmentioning

confidence: 99%

A Baseline for Global Weather and Climate Simulations at 1 km Resolution

Wedi

Polichtchouk

Dueben

et al. 2020

J Adv Model Earth Syst

Self Cite

View full text Add to dashboard Cite

In an attempt to advance the understanding of the Earth's weather and climate by representing deep convection explicitly, we present a global, four-month simulation (November 2018 to February 2019) with ECMWF's hydrostatic Integrated Forecasting System (IFS) at an average grid spacing of 1.4 km. The impact of explicitly simulating deep convection on the atmospheric circulation and its variability is assessed by comparing the 1.4 km simulation to the equivalent well-tested and calibrated global simulations at 9 km grid spacing with and without parametrized deep convection. The explicit simulation of deep convection at 1.4 km results in a realistic large-scale circulation, better representation of convective storm activity, and stronger convective gravity wave activity when compared to the 9 km simulation with parametrized deep convection. Comparison of the 1.4 km simulation to the 9 km simulation without parametrized deep convection shows that switching off deep convection parametrization at a too coarse resolution (i.e., 9 km) generates too strong convective gravity waves. Based on the limited statistics available, improvements to the Madden-Julian Oscillation or tropical precipitation are not observed at 1.4 km, suggesting that other Earth system model components and/or their interaction are important for an accurate representation of these processes and may well need adjusting at deep convection resolving resolutions. Overall, the good agreement of the 1.4 km simulation with the 9 km simulation with parametrized deep convection is remarkable, despite one of the most fundamental parametrizations being turned off at 1.4 km resolution and despite no adjustments being made to the remaining parametrizations. Plain Language Summary We present the world's first global simulation of an entire season of the Earth's atmosphere with 1.4 km average grid spacing and the top of the modeled atmosphere as high as 80 km. Albeit only a single realization due to its considerable computational cost, the resulting model output provides a reference and guidance for future simulations. For illustration we compare to simulations at 9 km grid spacing that represent the state of the art in numerical weather prediction and are still considerably finer when compared to models that are used for climate projections today. Thanks to its unprecedented detail, the simulation output will support future model development and satellite mission planning and may be seen as a prototype contribution to a future digital twin of our Earth.

show abstract

Section: Discussionmentioning

confidence: 99%

A Baseline for Global Weather and Climate Simulations at 1 km Resolution

Wedi

Polichtchouk

Dueben

et al. 2020

J Adv Model Earth Syst

Self Cite

View full text Add to dashboard Cite

show abstract

“…In Europe, at ECMWF energy efficiency and model sustainability efforts are focusing on reshaping model implementation into more manageable independent units called dwarfs, developed in the framework of the ESCAPE (Müller et al, 2019) and ESCAPE-2 1 projects. The dwarfs are eventually expected to cover around 60% of the forecast model code, so improved checkpointing procedures can be tested on existing dwarfs with a view to establishing a resilience framework applying to future ones.…”

Section: Discussionmentioning

confidence: 99%

Resilience and fault tolerance in high-performance computing for numerical weather and climate prediction

Benacchio

Bonaventura

Altenbernd

et al. 2021

The International Journal of High Performance Computing Applica

Self Cite

View full text Add to dashboard Cite

Progress in numerical weather and climate prediction accuracy greatly depends on the growth of the available computing power. As the number of cores in top computing facilities pushes into the millions, increased average frequency of hardware and software failures forces users to review their algorithms and systems in order to protect simulations from breakdown. This report surveys hardware, application-level and algorithm-level resilience approaches of particular relevance to time-critical numerical weather and climate prediction systems. A selection of applicable existing strategies is analysed, featuring interpolation-restart and compressed checkpointing for the numerical schemes, in-memory checkpointing, user-level failure mitigation and backup-based methods for the systems. Numerical examples showcase the performance of the techniques in addressing faults, with particular emphasis on iterative solvers for linear systems, a staple of atmospheric fluid flow solvers. The potential impact of these strategies is discussed in relation to current development of numerical weather prediction algorithms and systems towards the exascale. Trade-offs between performance, efficiency and effectiveness of resiliency strategies are analysed and some recommendations outlined for future developments.

show abstract

“…In the simulation of complex multi-scale flows arising in weather and climate (W&C), one of the biggest challenges is to satisfy strict service requirements in terms of time-to-solution and to satisfy budgetary constraints in terms of energy-to-solution, without compromising the accuracy and stability of the application [1]. One way to tackle this challenge is to use reduced-precision arithmetic in W&C models.…”

Section: Introductionmentioning

confidence: 99%

Machine-Learned Preconditioners for Linear Solvers in Geophysical Fluid Flows

Ackmann¹,

Dueben²,

Palmer³

et al. 2021

Preprint

View full text Add to dashboard Cite

Semi-implicit grid-point models for the atmosphere and the ocean require linear solvers that are working efficiently on modern supercomputers. The huge advantage of the semi-implicit time-stepping approach is that it enables large model time-steps. This however comes at the cost of having to solve a computationally demanding linear problem each model time-step to obtain an update to the model&#8217;s pressure/fluid-thickness field. In this study, we investigate whether machine learning approaches can be used to increase the efficiency of the linear solver.Our machine learning approach aims at replacing a key component of the linear solver&#8212;the preconditioner. In the preconditioner an approximate matrix inversion is performed whose quality largely defines the linear solver&#8217;s performance. Embedding the machine-learning method within the framework of a linear solver circumvents potential robustness issues that machine learning approaches are often criticized for, as the linear solver ensures that a sufficient, pre-set level of accuracy is reached. The approach does not require prior availability of a conventional preconditioner and is highly flexible regarding complexity and machine learning design choices.Several machine learning methods of different complexity from simple linear regression to deep feed-forward neural networks are used to learn the optimal preconditioner for a shallow-water model with semi-implicit time-stepping. The shallow-water model is specifically designed to be conceptually similar to more complex atmosphere models. The machine-learning preconditioner is competitive with a conventional preconditioner and provides good results even if it is used outside of the dynamical range of the training dataset.

show abstract

The ESCAPE project: Energy-efficient Scalable Algorithms for Weather Prediction at Exascale

Cited by 25 publications

References 34 publications

A Baseline for Global Weather and Climate Simulations at 1 km Resolution

A Baseline for Global Weather and Climate Simulations at 1 km Resolution

Resilience and fault tolerance in high-performance computing for numerical weather and climate prediction

Machine-Learned Preconditioners for Linear Solvers in Geophysical Fluid Flows

Contact Info

Product

Resources

About