Optimizing the hybrid parallelization of BHAC

Cielo, Salvatore; Porth, Oliver; Iapichino, Luigi; Karmakar, Anupam; Olivares, Héctor; Xia, Chun

doi:10.1016/j.ascom.2021.100509

Cited by 5 publications

(3 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We here document how various IMEX strategies can be used in Newtonian settings for MPI-AMRVAC 3.0. The hybrid OpenMP-MPI parallelization strategy was optimized for BHAC in Cielo et al (2022), and we inherited much of this functionality within MPI-AMRVAC 3.0. Other, completely independent GR-MHD software efforts that derived from earlier MPI-AMRVAC variants include GR-AMRVAC by Meliani et al (2016), the Gmunu code introduced in Cheong et al (2021Cheong et al ( , 2022, or the NOVAs effort presented in Varniere et al (2022).…”

Section: Open-source Strategy With Mpi-amrvacmentioning

confidence: 99%

“…The code can use hybrid OpenMP-MPI parallelism, where the OpenMP pragmas ensure thread-based parallelism over the blocks available within a shared memory. The related BHAC code considerably improved on this hybrid parallelization aspect (Cielo et al 2022). For truly extreme resolution simulations, one needs further code restructuring (especially the internal boundary exchange involved with AMR meshes) toward task-based parallelism.…”

Section: Future Directionsmentioning

confidence: 99%

See 1 more Smart Citation

MPI-AMRVAC 3.0: Updates to an open-source simulation framework

Keppens¹,

Braileanu²,

Zhou³

et al. 2023

A&A

View full text Add to dashboard Cite

Context. Computational astrophysics nowadays routinely combines grid-adaptive capabilities with modern shockcapturing, high resolution spatio-temporal integration schemes in challenging multidimensional hydrodynamic and magnetohydrodynamic (MHD) simulations. A large, and still growing, body of community software exists, and we provide an update on recent developments within the open-source MPI-AMRVAC code. Aims. Complete with online documentation, the MPI-AMRVAC 3.0 release includes several recently added equation sets and offers many options to explore and quantify the influence of implementation details. While showcasing this flexibility on a variety of hydrodynamic and MHD tests, we document new modules of direct interest for state-of-the-art solar applications. Methods. Test cases address how higher-order reconstruction strategies impact long-term simulations of shear layers, with and without gas-dust coupling effects, how runaway radiative losses can transit to intricate multi-temperature, multiphase dynamics, and how different flavors of spatio-temporal schemes and/or magnetic monopole control produce overall consistent MHD results in combination with adaptive meshes. We demonstrate the use of super-time-stepping strategies for specific parabolic terms and give details on all the implemented implicit-explicit integrators. A new magneto-frictional module can be used to compute force-free magnetic field configurations or for data-driven timedependent evolutions, while the regularized-Biot-Savart-law approach can insert flux ropes in 3D domains. Synthetic observations of 3D MHD simulations can now be rendered on the fly, or in post-processing, in many spectral wavebands. Results. A particle module as well as a generic field line tracing module, fully compatible with the hierarchical meshes, can be used to do anything from sampling information at prescribed locations, to following the dynamics of charged particles and realizing fully two-way coupled simulations between MHD setups and field-aligned nonthermal processes. We provide reproducible, fully demonstrated tests of all code functionalities. Conclusions. While highlighting the latest additions and various technical aspects (e.g., reading in datacubes for initial or boundary conditions), our open-source strategy welcomes any further code usage, contribution, or spin-off development.

show abstract

Section: Open-source Strategy With Mpi-amrvacmentioning

confidence: 99%

Section: Future Directionsmentioning

confidence: 99%

MPI-AMRVAC 3.0: Updates to an open-source simulation framework

Keppens¹,

Braileanu²,

Zhou³

et al. 2023

A&A

View full text Add to dashboard Cite

show abstract

“…The code can use hybrid OpenMP-MPI parallelism, where the OpenMP pragma's ensure thread-based parallelism over the blocks available within a shared memory. The related BHAC code considerably improved on this latter hybrid parallelization aspect (Cielo et al 2022). For truly extreme resolution simulations, one needs further code restructuring (especially the internal boundary exchange involved with AMR meshes) towards task-based parallelism.…”

Section: Future Directionsmentioning

confidence: 99%

MPI-AMRVAC 3.0: updates to an open-source simulation framework

Keppens¹,

Braileanu²,

Zhou³

et al. 2023

Preprint

View full text Add to dashboard Cite

Context. Computational astrophysics nowadays routinely combines grid-adaptive capabilities with modern shockcapturing, high resolution spatio-temporal integration schemes on challenging multi-dimensional hydro-and magnetohydrodynamic (MHD) simulations. A large, and still growing, number of community software efforts exist, and we here provide an update on recent developments within the open-source MPI-AMRVAC code. Aims. Complete with online documentation, the MPI-AMRVAC 3.0 release includes several recently added equation sets, and offers many options to explore and quantify the influence of implementation details. While showcasing this flexibility on a variety of hydro and MHD tests, we document new modules of direct interest for state-of-the-art solar applications. Methods. Test cases address how higher order reconstruction strategies impact long term simulations of shear layers, with and without gas-dust coupling effects, how runaway radiative losses can transit to intricate multi-temperature, multi-phase dynamics, and how different flavors of spatio-temporal schemes and/or magnetic monopole control produce overall consistent MHD results in combination with adaptive meshes. We demonstrate the use of Super-Time-Stepping strategies for specific parabolic terms and give details on all the implemented Implicit-Explicit (IMEX) integrators. A new magnetofrictional module can be used for computing force-free magnetic field configurations or for data-driven timedependent evolutions, while the Regularized-Biot-Savart-Law approach can insert fluxropes in 3D domains. Synthetic observations of 3D MHD simulations can now be rendered on-the-fly, or in post-processing, in many spectral wavebands. Results. A particle module as well as a generic fieldline tracing module, fully compatible with the hierarchical meshes, can be used to do anything from sampling information at prescribed locations, to follow dynamics of charged particles, or realize fully two-way coupled simulations between MHD setups and field-aligned non-thermal processes. We provide reproducible, fully demonstrated tests of all code functionalities. Conclusions. While highlighting the latest additions and various technical aspects (e.g. reading in datacubes for initial or boundary conditions), our open-source strategy welcomes any further code usage, contribution, or spin-off development.

show abstract

CAFE-AMR: a computational MHD solar physics simulation tool that uses AMR

Ochoa-Armenta,

Guzmán

2023

Monthly Notices of the Royal Astronomical Society

View full text Add to dashboard Cite

The study of our Sun holds significant importance in Space Weather research, encompassing a diverse range of phenomena characterized by distinct temporal and spatial scales. To address these complexities, we developed CAFE-AMR, an implementation of an Adaptive Mesh Refinement (AMR) strategy coupled with a Magnetohydrodynamics (MHD) equation solver, aiming to tackle Solar Physics-related problems. CAFE-AMR employs standard fluid dynamics methods, including Finite Volume discretization, HLL and Roe class flux formulas, linear order reconstructors, second-order Runge-Kutta, and Corner Transport Upwind time stepping. In this paper, we present the core structure of CAFE-AMR, discuss and evaluate mesh refinement criteria strategies, and conduct various tests, including simulations of idealized Solar Wind models, relevant for Space Weather applications.

show abstract

Optimizing the hybrid parallelization of BHAC

Cited by 5 publications

References 22 publications

MPI-AMRVAC 3.0: Updates to an open-source simulation framework

MPI-AMRVAC 3.0: Updates to an open-source simulation framework

MPI-AMRVAC 3.0: updates to an open-source simulation framework

CAFE-AMR: a computational MHD solar physics simulation tool that uses AMR

Contact Info

Product

Resources

About