This work documents the first version of the U.S. Department of Energy (DOE) new EnergyExascale Earth System Model (E3SMv1). We focus on the standard resolution of the fully coupled physical model designed to address DOE mission-relevant water cycle questions. Its components include atmosphere and land (110-km grid spacing), ocean and sea ice (60 km in the midlatitudes and 30 km at the equator and poles), and river transport (55 km) models. This base configuration will also serve as a foundation for additional configurations exploring higher horizontal resolution as well as augmented capabilities in the form of biogeochemistry and cryosphere configurations. The performance of E3SMv1 is evaluated by means of a standard set of Coupled Model Intercomparison Project Phase 6 (CMIP6) Diagnosis, Evaluation, and Characterization of Klima simulations consisting of a long preindustrial control, historical simulations (ensembles of fully coupled and prescribed SSTs) as well as idealized CO 2 forcing simulations. The model performs well overall with biases typical of other CMIP-class models, although the simulated Atlantic Meridional Overturning Circulation is weaker than many CMIP-class models. While the E3SMv1 historical ensemble captures the bulk of the observed warming between preindustrial (1850) and present day, the trajectory of the warming diverges from observations in the Key Points: • This work documents E3SMv1, the first version of the U.S. DOE Energy Exascale Earth System Model • The performance of E3SMv1 is documented with a set of standard CMIP6 DECK and historical simulations comprising nearly 3,000 years • E3SMv1 has a high equilibrium climate sensitivity (5.3 K) and strong aerosol-related effective radiative forcing (-1.65 W/m 2 ) Correspondence to: Chris Golaz, golaz1@llnl.gov Citation: Golaz, J.-C., Caldwell, P. M., Van Roekel, L. P., Petersen, M. R., Tang, Q., Wolfe, J. D., et al. (2019). The DOE E3SM coupled model version 1: Overview and evaluation at standard resolution. second half of the twentieth century with a period of delayed warming followed by an excessive warming trend. Using a two-layer energy balance model, we attribute this divergence to the model's strong aerosol-related effective radiative forcing (ERF ari+aci = −1.65 W/m 2 ) and high equilibrium climate sensitivity (ECS = 5.3 K). Plain Language Summary The U.S. Department of Energy funded the development of a new state-of-the-art Earth system model for research and applications relevant to its mission. The Energy Exascale Earth System Model version 1 (E3SMv1) consists of five interacting components for the global atmosphere, land surface, ocean, sea ice, and rivers. Three of these components (ocean, sea ice, and river) are new and have not been coupled into an Earth system model previously. The atmosphere and land surface components were created by extending existing components part of the Community Earth System Model, Version 1. E3SMv1's capabilities are demonstrated by performing a set of standardized simulation experiments described by...

This study provides an overview of the coupled high‐resolution Version 1 of the Energy Exascale Earth System Model (E3SMv1) and documents the characteristics of a 50‐year‐long high‐resolution control simulation with time‐invariant 1950 forcings following the HighResMIP protocol. In terms of global root‐mean‐squared error metrics, this high‐resolution simulation is generally superior to results from the low‐resolution configuration of E3SMv1 (due to resolution, tuning changes, and possibly initialization procedure) and compares favorably to models in the CMIP5 ensemble. Ocean and sea ice simulation is particularly improved, due to better resolution of bathymetry, the ability to capture more variability and extremes in winds and currents, and the ability to resolve mesoscale ocean eddies. The largest improvement in this regard is an ice‐free Labrador Sea, which is a major problem at low resolution. Interestingly, several features found to improve with resolution in previous studies are insensitive to resolution or even degrade in E3SMv1. Most notable in this regard are warm bias and associated stratocumulus deficiency in eastern subtropical oceans and lack of improvement in El Niño. Another major finding of this study is that resolution increase had negligible impact on climate sensitivity (measured by net feedback determined through uniform +4K prescribed sea surface temperature increase) and aerosol sensitivity. Cloud response to resolution increase consisted of very minor decrease at all levels. Large‐scale patterns of precipitation bias were also relatively unaffected by grid spacing.

The Energy Exascale Earth System Model Atmosphere Model version 1, the atmospheric component of the Department of Energy's Energy Exascale Earth System Model is described. The model began as a fork of the well‐known Community Atmosphere Model, but it has evolved in new ways, and coding, performance, resolution, physical processes (primarily cloud and aerosols formulations), testing and development procedures now differ significantly. Vertical resolution was increased (from 30 to 72 layers), and the model top extended to 60 km (~0.1 hPa). A simple ozone photochemistry predicts stratospheric ozone, and the model now supports increased and more realistic variability in the upper troposphere and stratosphere. An optional improved treatment of light‐absorbing particle deposition to snowpack and ice is available, and stronger connections with Earth system biogeochemistry can be used for some science problems. Satellite and ground‐based cloud and aerosol simulators were implemented to facilitate evaluation of clouds, aerosols, and aerosol‐cloud interactions. Higher horizontal and vertical resolution, increased complexity, and more predicted and transported variables have increased the model computational cost and changed the simulations considerably. These changes required development of alternate strategies for tuning and evaluation as it was not feasible to “brute force” tune the high‐resolution configurations, so short‐term hindcasts, perturbed parameter ensemble simulations, and regionally refined simulations provided guidance on tuning and parameterization sensitivity to higher resolution. A brief overview of the model and model climate is provided. Model fidelity has generally improved compared to its predecessors and the CMIP5 generation of climate models.

This work documents version two of the Department of Energy's Energy Exascale Earth SystemModel (E3SM). E3SMv2 is a significant evolution from its predecessor E3SMv1, resulting in a model that is nearly twice as fast and with a simulated climate that is improved in many metrics. We describe the physical climate model in its lower horizontal resolution configuration consisting of 110 km atmosphere, 165 km land, 0.5° river routing model, and an ocean and sea ice with mesh spacing varying between 60 km in the mid-latitudes and 30 km at the equator and poles. The model performance is evaluated with Coupled Model Intercomparison Project Phase 6 Diagnosis, Evaluation, and Characterization of Klima simulations augmented with historical simulations as well as simulations to evaluate impacts of different forcing agents. The simulated climate has many realistic features of the climate system, with notable improvements in clouds and precipitation compared to E3SMv1. E3SMv1 suffered from an excessively high equilibrium climate sensitivity (ECS) of 5.3 K. In E3SMv2, ECS is reduced to 4.0 K which is now within the plausible range based on a recent World Climate Research Program assessment. However, a number of important biases remain including a weak Atlantic Meridional Overturning Circulation, deficiencies in the characteristics and spectral distribution of tropical atmospheric variability, and a significant underestimation of the observed warming in the second half of the historical period. An analysis of single-forcing simulations indicates that correcting the historical temperature bias would require a substantial reduction in the magnitude of the aerosol-related forcing.

In this study, we analyze the realism with which tropical cyclones (TCs) are simulated in the fully coupled low‐ and high‐resolution Energy Exascale Earth System Model (E3SM) version 1, with a focus on the latter. Compared to the low‐resolution (grid spacing of ∼1°), the representation of TCs improves considerably in the high‐resolution configuration (grid spacing of ∼0.25°). Significant improvements are found in the global TC frequency, TC lifetime maximum intensities, and the relative distribution of TCs among the different basins. However, at both resolutions, spurious TC activity is found in some basins, notably in the subtropical regions. Contrasting the simulated large‐scale TC environment with observations reveals that the model environment is unrealistically conducive for TC development in those regions. Further analysis indicates that these biases are likely related to those in thermodynamic potential intensity, caused by systematic SST biases, and vertical wind shear in the coupled model. TC‐ocean interaction is also examined in the high‐resolution configuration of the model. The salient features of the ocean's response to TC‐induced mixing and the ocean's impact on TC intensification are well‐reproduced. Finally, an evaluation of the influence of El Niño Southern Oscillation (ENSO) on TCs in the high‐resolution configuration of the model reveals that the ENSO‐TC relationship in the model has the right sign and is significant for the North Atlantic and Northwest Pacific, albeit weaker than in observations. In summary, the high‐resolution configuration of the E3SM model simulates TC activity reasonably and hence could be a useful tool for TC‐related research.

No abstract

Abstract-Finite-difference, stencil-based discretization approaches are widely used in the solution of partial differential equations describing physical phenomena. Newton-Krylov iterative methods commonly used in stencil-based solutions generate matrices that exhibit diagonal sparsity patterns.To exploit these structures on modern GPUs, we extend the standard diagonal sparse matrix representation and define new matrix and vector data types in the PETSc parallel numerical toolkit. We create tunable CUDA implementations of the operations associated with these types after identifying a number of GPU-specific optimizations and tuning parameters for these operations. We discuss our implementation of GPU autotuning capabilities in the Orio framework and present performance results for several kernels, comparing them with vendor-tuned library implementations.

We present performance results and an analysis of a message passing interface (MPI)/OpenACC implementation of an electromagnetic solver based on a spectral-element discontinuous Galerkin discretization of the time-dependent Maxwell equations. The OpenACC implementation covers all solution routines, including a highly tuned element-by-element operator evaluation and a GPUDirect gather–scatter kernel to effect nearest neighbor flux exchanges. Modifications are designed to make effective use of vectorization, streaming, and data management. Performance results using up to 16,384 graphics processing units of the Cray XK7 supercomputer Titan show more than 2.5× speedup over central processing unit-only performance on the same number of nodes (262,144 MPI ranks) for problem sizes of up to 6.9 billion grid points. We discuss performance-enhancement strategies and the overall potential of GPU-based computing for this class of problems.